roystgnr comments on The Evil AI Overlord List - Less Wrong

27 Post author: Stuart_Armstrong 20 November 2012 05:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: roystgnr 20 November 2012 08:25:11PM 3 points [-]

One problem with (11) is that for the threat to be plausible, the AI has to assume:

a) Humans know so little that we have to resort to questionable "tests" like this of AI safety.

b) Humans know so much that we can afford for our AI safety tests to simulate interactions with an entire universe full of sentients.

The AI version of Pascal's Wager seems to be much like the human version, only even sillier.

Comment author: Decius 21 November 2012 08:08:52AM 2 points [-]

How large is the simulated universe? The AI only knows about the computing capacity that is simulated, and has no information about the nature of that which is simulating that world.