Kyre comments on Request for concrete AI takeover mechanisms - Less Wrong

18 Post author: KatjaGrace 28 April 2014 01:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (122)
Tags: existential_risk world_domination requests ai_risk

Comments (122)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kyre 28 April 2014 05:26:03AM 6 points [-]

I agree, I think there is a common part of the story that goes "once connected to the internet, the AI rapidly takes over a large number of computers, significantly amplifying its power". My credence that this could happen has gone way up over the last 10 years or so. Also my credence that an entity could infiltrate a very large number of machines without anyone noticing has also gone up.

Comment author: David_Gerard 29 April 2014 12:34:28PM 12 points [-]

Whenever you see the words "Internet of things", think "unfixable Heartbleed everywhere forever".

Comment author: CronoDAS 29 April 2014 12:28:35AM 3 points [-]

Also my credence that an entity could infiltrate a very large number of machines without anyone noticing has also gone up.

Hasn't something much like this already happened?

Comment author: Kaj_Sotala 06 May 2014 04:10:46PM *  0 points [-]

In conclusion, we argue that a compact worm that begins with a list including all likely vulnerable addresses, and that has initial knowledge of some vulnerable sites with high-bandwidth links, appears able to infect almost all vulnerable servers on the Internet in less than thirty seconds.

Staniford, Paxson & Weaver 2002

Comment author: XiXiDu 06 May 2014 05:36:00PM 0 points [-]

...we argue that a compact worm...appears able to infect almost all vulnerable servers on the Internet in less than thirty seconds.

What's important with respect to taking over the world is the amount and nature of control that can be gained by any given exploit.

Stuxnet was allegedly able to ruin one-fifth of Iran's nuclear centrifuges. Causing such damage is far from taking useful control of important infrastructure. It is not possible to e.g. remote control the Iranian nuclear program in order to build nukes and rockets, which are then remotely launched to take out the Iranian defense capabilities.

Powered by Reddit Powered by Reddit