MagnetoHydroDynamics comments on Imaginary Positions - Less Wrong

19 Post author: Eliezer_Yudkowsky 23 December 2008 05:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (49)

Sort By: Old

You are viewing a single comment's thread.

Comment author: timtyler 12 September 2010 10:28:03AM *  3 points [-]

In Turing's Cathedral, Dyson says:

For 30 years I have been wondering, what indication of its existence might we expect from a true AI? Certainly not any explicit revelation, which might spark a movement to pull the plug. Anomalous accumulation or creation of wealth might be a sign, or an unquenchable thirst for raw information, storage space, and processing cycles, or a concerted attempt to secure an uninterrupted, autonomous power supply. But the real sign, I suspect, would be a circle of cheerful, contented, intellectually and physically well-nourished people surrounding the AI.

Today, the inner circle at companies like Google and Facebook get more of the benefits than outsiders do - they get a share of the winnings.

People have reason to be sceptical when people say that their machine intelligence will be any different. You are just saying that, they will think - to get support from the masses during the construction process - when your project is at its most vulnerable.

In this model, they think you have a strong motivation to decieve them - so it is not much of a surprise when they fail to update based on what you say.