= 27d567bc2d48d9f40e9ccc20ea370b15)
Dolores1984 comments on Peter Thiel's AGI discussion in his startups class @ Stanford [link] - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (17)
Keep in mind, successful designs will expand in mindspace as they are easy to copy, modify, and improve upon. Think mold colonies growing rapidly from a small handful of spores. Also, remember bootstrapping. It's not just the AI's that can be build by a few thousand humans (plus all the disparate fields they draw on). It's all the AI's that can be built by those AI's, and on and on, ad infinitum.
You are essentially defining "successful designs" as such. And what we know about evolution is strong supporting evidence for this.
What makes you think the first generation of AI will have all of those qualities? What makes you think the first gen AIs will be useful for building more AIs?
The first biological replicators on earth would be considered non-viable clunky disasters by today's standards.
The only way we can have "Friendly AI" beyond the first generation is if such entities are part of a larger "ecosystem" and they face economic, group dynamics, and evolutionary pressures that motivate (and "motivate") them to be this way.
Perhaps the key to "Friendly AI" is going to be competitive augmentation of Human Intelligence.