John_Maxwell_IV comments on What does the world look like, the day before FAI efforts succeed? - Less Wrong

23 Post author: michaelcurzi 16 November 2012 08:56PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (63)

You are viewing a single comment's thread.

Comment author: John_Maxwell_IV 17 November 2012 09:25:27PM 3 points [-]

Intelligence amplification technology is widespread, preventing any differential adoption by the FAI team. However, FAI researchers are able to keep up with competing efforts to use that technology for AI research.

If the "FAI is important" position is correct, but requires intelligence to understand, would widespread IA cause more people to become interested in working on FAI?

Comment author: michaelcurzi 18 November 2012 12:17:54AM 3 points [-]

Yeah, I've heard that argument before. The idea is that intelligence not only makes you better at stuff, but also impacts how you make decisions about what to work on.

The alternate hypothesis is that intelligence-amplified people would just get better at being crazy. Perhaps one could start to tease apart the hypotheses by distinguishing 'intelligence' from 'reflectiveness' and 'altruism', and trying to establish how those quantities interact.

Comment author: John_Maxwell_IV 20 November 2012 04:40:18AM *  2 points [-]

Related point: High-IQ folks are more likely to cooperate in the prisoner's dilemna. (See Section 3 of this article.) Which suggests that they'd be more inclined to do altruistic stuff like make an AI that's friendly to everyone rather than an AI that serves their individual wishes.