Vladimir_Nesov comments on David Chalmers' "The Singularity: A Philosophical Analysis" - Less Wrong

33 Post author: lukeprog 29 January 2011 02:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (202)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 29 January 2011 01:28:40PM *  1 point [-]

I'm somewhat skeptical of the idea that there isn't a universal morality (relative to some generalized Occamian prior-like-thing) that even a paperclip maximizer would converge to (if it was given the right decision theoretic (not necessarily moral per se) tools for philosophical reasoning, which is by no means guaranteed, so we should of course still be careful when designing AGIs).

There's goal system zero / God's utility function / Universal Instrumental Values.

Comment author: Vladimir_Nesov 29 January 2011 01:39:32PM *  -1 points [-]

Boo!

(To make a point as well-argued as the one it replies to.)

Edit: Now that the above comment was edited to include citations, my joke stopped being funny and got downvoted.