You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

ciphergoth comments on Naturalism versus unbounded (or unmaximisable) utility options - Less Wrong Discussion

34 Post author: Stuart_Armstrong 01 February 2013 05:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (72)

You are viewing a single comment's thread.

Comment author: ciphergoth 02 February 2013 03:47:00PM 4 points [-]

An agent who only recognises finitely many utility levels doesn't have this problem. However, there's an equivalent problem for such an agent where you ask them to name a number n, and then you send them to Hell with probability 1/n and Heaven otherwise.

Comment author: DanielVarga 02 February 2013 05:59:12PM *  1 point [-]

If it really has only finitely many utility levels, then for a sufficiently small epsilon and some even smaller delta, it will not care whether it ends up in Hell with probability epsilon or probability delta.

Comment author: ciphergoth 03 February 2013 08:13:48AM 4 points [-]

That's if they only recognise finitely many expected utility levels. However, such an agent is not VNM-rational.