You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Anti-Pascaline agent - Less Wrong Discussion

4 Post author: Stuart_Armstrong 12 March 2015 02:17PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (24)
Tags: probability utility wager pascal agent ai

Comments (24)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 09 May 2016 11:30:05AM 0 points [-]

alternatively for any ε you set, it will be profitable for the AI to create a new version of itself with the same utility function and ε'=ε/2 than give the new AI all the resources it has and commit suicide.

This doesn't seem true. A ε/2 AI will take risks, looking for higher utility, that the ε AI wouldn't.

Powered by Reddit Powered by Reddit