Nornagest comments on Intelligence explosion in organizations, or why I'm not worried about the singularity - Less Wrong

13 Post author: sbenthall 27 December 2012 04:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (187)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nornagest 27 December 2012 11:06:11AM *  1 point [-]

Smith considered a market as a benevolent super intelligence. In 1984, Orwell envisioned an organization as a mean super intelligence.

I'll give you Smith, but I don't think Orwell had intelligence as such in mind. One of the main things distinguishing 1984's Ingsoc from non-fictional 20th-century despotism, in fact, was that it didn't pretend to be an agent, that it didn't have goals like "conquer the world" or "safeguard the coming revolution": instead, it was more like a dumb attractor in ideology-space tending towards the undirected exercise of coercive state power for its own sake.

Comment author: buybuydandavis 27 December 2012 08:39:23PM 0 points [-]

It pretended to be an agent with goals like protecting the people from Eastasia and Eurasia.

Those pretenses were means to the end of the Coercive State Power Maximizer.

And I don't see how you distinguish Smith from Orwell in terms of intelligence or agency. If anything, I see more agency in Ingsoc than a market.