wwa comments on Naturalism versus unbounded (or unmaximisable) utility options - Less Wrong

34 Post author: Stuart_Armstrong 01 February 2013 05:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (72)

You are viewing a single comment's thread.

Comment author: wwa 02 February 2013 12:17:09AM *  0 points [-]

What should you do?

Figure out that I'm not a perfectly rational agent and go on with the deal for as long as I feel like it.

Bail out when I subjectively can't stand any more of Hell or when I'm fed up with writing lots of numbers on an impossibly long roll of paper.

Of course, these aren't answers that help in developing a decision theory for an AI ...