James_Miller comments on Pascal's Muggle: Infinitesimal Priors and Strong Evidence - Less Wrong

43 Post author: Eliezer_Yudkowsky 08 May 2013 12:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (404)

You are viewing a single comment's thread. Show more comments above.

Comment author: James_Miller 06 May 2013 01:03:23PM *  5 points [-]

Or even if the AI experienced an intelligence explosion the danger is that it would not believe it had really become so important because the prior odds of you being the most important thing that will probably ever exist is so low.

Edit: The AI could note that it uses a lot more computing power than any other sentient and so give itself an anothropic weight much greater than 1.

Comment author: Oligopsony 16 May 2013 03:17:53AM 1 point [-]

With respect to this being a "danger," don't Boltzmann brains have a decision-theoretic weight of zero?

Comment author: James_Miller 16 May 2013 05:02:33AM 1 point [-]

Why zero? If you came to believe there was a 99.99999% chance you are currently dreaming wouldn't it effect your choices?