Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Ben_Jones comments on Taboo Your Words - Less Wrong

71 Post author: Eliezer_Yudkowsky 15 February 2008 10:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (128)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Ben_Jones 19 February 2008 02:13:45PM 2 points [-]


they tend to have high-quality definitions that are difficult to match in quality without lots of effort.

All well and good, and useful in their way. But still just a list of synonyms and definitions. You can describe 'tree' using other English words any which way you want, you're still only accounting for a miniscule fraction of the possible minds the universe could contain. You're still not really much closer to universal conveyance of the concept. Copy the OED out in a hundred languages; decent step in the right direction. To take the next big step though...well, that's the question, huh?

We cannot take PK's suggestion and use it to figure out FAI, because we have no idea what FAI really means.

Not quite accurate. I pretty much know what I want a Friendly AI to be - we probably all do. The problem is couching it in terms that said AI would grok, with no danger of a catastrophic misunderstanding (or getting told off by Eliezer).