ciphergoth comments on Naturalism versus unbounded (or unmaximisable) utility options - Less Wrong

34 Post author: Stuart_Armstrong 01 February 2013 05:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (72)

You are viewing a single comment's thread.

Comment author: ciphergoth 02 February 2013 03:47:00PM 4 points [-]

An agent who only recognises finitely many utility levels doesn't have this problem. However, there's an equivalent problem for such an agent where you ask them to name a number n, and then you send them to Hell with probability 1/n and Heaven otherwise.

Comment author: DanielVarga 02 February 2013 05:59:12PM *  1 point [-]

If it really has only finitely many utility levels, then for a sufficiently small epsilon and some even smaller delta, it will not care whether it ends up in Hell with probability epsilon or probability delta.

Comment author: ciphergoth 03 February 2013 08:13:48AM 4 points [-]

That's if they only recognise finitely many expected utility levels. However, such an agent is not VNM-rational.