You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

SilentCal comments on Superintelligence 8: Cognitive superpowers - Less Wrong Discussion

7 Post author: KatjaGrace 04 November 2014 02:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (95)

You are viewing a single comment's thread. Show more comments above.

Comment author: SilentCal 06 November 2014 08:07:51PM 1 point [-]

I would imagine it as the ability to examine a reasonable amount of information on an individual (probably internet activity and possibly video surveillance) and determine what, if anything, you could tell them that would persuade them to do what you want them to. The AI box experiment is probably the canonical example. Exactly how much you could convince how many people to do is debatable; is that what you mean by saying you can't imagine this?

Comment author: Lumifer 06 November 2014 08:25:29PM 0 points [-]

I misunderstood you, then -- what you described I wouldn't call social manipulation. It's just figuring out the individual's pain and pleasure points and then applying the proper amount of pressure to them -- nothing social about that.

Whether I can imagine an AI having superpower-level psychological manipulation abilities (but NOT superintelligent at the same time), I'm not sure. On the one hand, you could probably call it a narrow AI, on the other hand it might be that the superpowered ability to manipulate humans does require enough AGI-nature so that the AI is essentially an AGI.