Nick_Tarleton comments on Best career models for doing research? - Less Wrong

27 Post author: Kaj_Sotala 07 December 2010 04:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (999)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 09 December 2010 05:47:30PM *  4 points [-]

"CEV" can (unfortunately) refer to either CEV the process of determining what humans would want if we knew more etc., or the volition of humanity output by running that process. It sounds to me like you're conflating these. The process is part of the seed AI and is needed before it goes FOOM, but the output naturally is neither, and there's no guarantee or demand that the process be capable of being executed by humans.

Comment author: David_Gerard 09 December 2010 06:00:08PM *  1 point [-]

OK. I still don't understand it, but I now feel my lack of understanding more clearly. Thank you!

(I suppose "what do people really want?" is a large philosophical question, not just undefined but subtle in its lack of definition.)