Ford comments on Hack Away at the Edges - Less Wrong

48 Post author: lukeprog 01 December 2011 01:26PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (54)

You are viewing a single comment's thread. Show more comments above.

Comment author: Ford 12 December 2011 08:11:24PM 0 points [-]

Would the first AI want more AI's around? Wouldn't it compete more with AI's than with humans for resources? Or do you assume that humans, having made an AI smarter than an individual human, would work to network AI's into something even smarter?

Either way, the scaling issue is interesting. I would expect the gain from networking AI's to differ from the gain from networking humans, but I'm not sure which would work better. Differences among individual humans are a potential source of conflict, but can also make the whole greater than the sum of the parts. I wouldn't expect complementarity among a bunch of identical AI's. Generating useful differences would be an interesting problem.

Comment author: dlthomas 12 December 2011 08:28:27PM *  1 point [-]

If there is more to be gained by adding an additional AI then there is to be gained by scaling up the individual AI, then the best strategy for the AI is to create more AI's with the same utility function.

Edited to add: Unless, perhaps, the AI had an explicit dislike of creating others, in which case it would be a matter of which effect was stronger.