Comment on Q&A with Abram Demski on risks from AI

Tue, 17 Jan 2012 16:29:59 GMT

Assuming it took over a fraction of the Internet...

I object to the "assuming" part. It needs to acquire resources to acquire resources. If it can't take over the Internet with its initial resources then it won't be able to make use of further resources.

...that is bound to be very difficult, as you'd have to sever every computer it controls out the network.

You assume that everyone computer can run a seed AI and that the global infrastructure is very stable under attack.

...you could just have the AI split (or duplicate) itself, and let a gazillion sub-processes take care of the gazillion task is may want to perform.

I object to the "just" part.

Discuss