You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

snarles comments on CEV-tropes - Less Wrong Discussion

8 Post author: snarles 22 September 2014 06:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (15)

You are viewing a single comment's thread.

Comment author: snarles 25 September 2014 04:09:29PM 1 point [-]

Some new ideas which I have not seen previously.

  • Humans may wish for the creation of new sentient beings. But then a paradox arises, because the new beings should also be part of CEV. Then either CEV gives preference to humans existing before CEV was calculated, or CEV fails to converge as a consequence, or CEV finds a solution which can work for both humans and all potential newly created sentient beings.
  • CEV might work on humans, but then somebody creates a new artificial being with unnatural preferences specifically for the purpose of preventing CEV from converging