hankx7787 comments on Notes on the Psychology of Power - Less Wrong

34 Post author: gwern 27 July 2012 07:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread.

Comment author: hankx7787 29 July 2012 10:17:20AM *  7 points [-]

Luke/SI asked me to look into what the academic literature might have to say about people in positions of power.

Why?

Comment author: gwern 29 July 2012 02:15:22PM 11 points [-]

It seems relevant to what powerful uploads might do; or just future humans period - Hanson has pointed out that we should expect ever more extreme differences in wealth & power as time & economic growth go on.

Comment author: Kaj_Sotala 30 July 2012 05:50:10PM 7 points [-]

In addition to gwern's reply, it's also highly relevant for replying to arguments suggesting that game theory shows co-operation to be the most beneficial course of action, therefore we should expect AIs to want to co-operate with humans. The obvious flaw with that argument is that somebody might have more beneficial courses of action - such as exploitation - available to them, in which case we would expect AIs to ruthlessly exploit us if they were in the right position. It seems reasonable to presume that if you are in a position of power over someone, it easily becomes more beneficial to exploit them than to co-operate.

"Are humans more likely to exploit other humans when they have more power over them" is a testable prediction of this hypothesis: if exploitation is more beneficial than co-operation when you're powerful enough, then we would expect our brains to be evolved to take advantage of that.