Cheyne comments on Clarification of AI Reflection Problem - Less Wrong

19 Post author: paulfchristiano 10 December 2011 10:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (8)

You are viewing a single comment's thread.

Comment author: Cheyne 11 December 2011 02:25:52PM 0 points [-]

[. . .] incorrect beliefs about the relationships between value and reality.

To anyone who would help, what are some examples of both correct and incorrect beliefs about the relationships between value and reality?

Comment author: paulfchristiano 11 December 2011 05:49:14PM 1 point [-]

A simple, maybe somewhat silly, example: I care about making as many happy humans as possible, but believe that I am in a simulation and everyone is a zombie, so spend all of my time trying to escape the simulation (thereby killing all humans).