dougclow comments on Request for concrete AI takeover mechanisms - Less Wrong

18 Post author: KatjaGrace 28 April 2014 01:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (122)

You are viewing a single comment's thread. Show more comments above.

Comment author: leplen 29 April 2014 09:55:51PM *  1 point [-]

Do you think that human beings will allow a single corporation to control a significant fraction of the world's resources? How will the company avoid anti-monopoly laws? Does a an AI CEO actually have control over a corporation, or does it only have the freedom to act within the defined social roles of what a "CEO" is allowed to do? I.e. it can negotiate a merger but can't hire a bunch of scientists and tell them to start mass producing nerve gas.

The U.S. government spends more money in a single year than the combined market capitalization of the 10 largest companies in the world.

In what sense does google "control a very large proportion of the world's computing resources"? Google maybe has the compute power equivalent to a handful of supercomputers, but even that isn't organized in a particularly useful way for an AI looking to do something dramatically different from performing millions of internet searches. For the vast majority of problems, I'd rather use ORNL's Titan than literally every computer google owns.

Comment author: dougclow 01 May 2014 10:44:39AM *  8 points [-]

An AI controlling a company like Google would be able to, say, buy up many of the world’s battle robot manufacturers, or invest a lot of money into human-focused bioengineering, despite those activities being almost entirely unrelated to their core business, and without giving any specific idea of why.

Indeed, on the evidence of the press coverage of Google's investments, it seems likely that many people would spend a lot of effort inventing plausible cover stories for the AI.

Comment author: Eugine_Nier 02 May 2014 01:24:39AM 2 points [-]

This raises interesting questions about who (or what) is really running Google.