Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

timtyler comments on AI that doesn't want to get out - Less Wrong

-4 Post author: Tiiba 27 March 2011 04:16AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread.

Comment author: timtyler 28 March 2011 06:50:05PM 0 points [-]

One obvious problem will be people trying to break in. They have all the resources of the outside world to attempt that with.

Comment author: Tiiba 28 March 2011 07:27:34PM *  0 points [-]

Well, then they'll have themselves to blame when the AI converts their remains into nanomachines.

Not sure what you're saying.

Comment author: timtyler 28 March 2011 07:43:53PM 0 points [-]

You don't see why people would want to break into a compound containing the first machine intelligence?

Comment author: Tiiba 28 March 2011 09:02:04PM *  0 points [-]

Sure, but it's their funeral.

Another AI might succeed, but not humans. I think there would be at least a few weeks before another one appears, and that might be enough time to ask it how to make a true FAI.

Comment author: timtyler 28 March 2011 09:55:18PM *  0 points [-]

Well, not unmodified humans. You don't execute a 21st century jailbreak with spears and a loincloth. The outside world is not as resource-limited - and so it has some chance of gathering useful information from the attempt.

Comment author: Tiiba 28 March 2011 10:02:55PM 0 points [-]

And if they're modified? It's a superintelligent AI. You can't take it down with a shotgun, even if it's built into your arm.

Comment author: timtyler 28 March 2011 10:12:15PM 0 points [-]

No, no: tools. If someone has made a machine intelligence, the rest of the planet will probably have some pretty sophisticated equipment to hand.

The competiton for machines comes mostly from the previous generation of machines.