LESSWRONG
LW

All of Cheyne's Comments + Replies

Clarification of AI Reflection Problem
Cheyne00

[. . .] incorrect beliefs about the relationships between value and reality.

To anyone who would help, what are some examples of both correct and incorrect beliefs about the relationships between value and reality?

Reply
1paulfchristiano
A simple, maybe somewhat silly, example: I care about making as many happy humans as possible, but believe that I am in a simulation and everyone is a zombie, so spend all of my time trying to escape the simulation (thereby killing all humans).