Eliezer_Yudkowsky comments on No Universally Compelling Arguments - Less Wrong

33 Post author: Eliezer_Yudkowsky 26 June 2008 08:29AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 26 June 2008 10:18:53AM 8 points [-]

program an AI with a lot of knowledge about what humans think is right/wrong, and then letting the AI figure out who is correct and to what extent

Figure out which humans are what? How? An AI obeys the laws of physics; it is a lawful system just like you; everything in the AI happens for a reason, just like in your own brain. So if this judgment doesn't come from a ghost that you summoned into the machine... where does it come from? How does the AI know what is "correct"? What code executes while it's making that judgment and where did the code come from? Oh, and you should probably Taboo that there word "correct" while you're at it; if you can't, don't worry, it's coming up.