MichaelVassar comments on Pascal's Muggle: Infinitesimal Priors and Strong Evidence - Less Wrong

43 Post author: Eliezer_Yudkowsky 08 May 2013 12:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (404)

You are viewing a single comment's thread.

Comment author: MichaelVassar 06 May 2013 10:02:39AM 4 points [-]

It seems to me like the whistler is saying that the probability of saving knuth people for $5 is exactly 1/knuth after updating for the Matrix Lord's claim, not before the claim, which seems surprising. Also, it's not clear that we need to make an FAI resistant to very very unlikely scenarios.

Comment author: Eliezer_Yudkowsky 06 May 2013 05:40:45PM 9 points [-]

I'm a lot more worried about making an FAI behave correctly if it encounters a scenario which we thought was very very unlikely.

Comment author: Luke_A_Somers 09 May 2013 10:16:02PM *  3 points [-]

Also, if the AI spreads widely and is around for a long time, it will eventually run into very unlikely scenarios. Not 1/3^^^3 unlikely, but pretty unlikely.