Your statement sounds a bit overgeneralized - but you probably have a point.
Still, would you indulge me in some idle speculation? Maybe there could be a species of aliens that evolved to intelligence by developing special microbe-infested organs (which would be firewalled somehow from the rest of the alien themselves) and incentivizing the microbial colonies somehow to solve problems for the host.
Maybe we humans evolved to intelligence that way - after all, we do have a lot of bacteria in our guts. But then, all the evidence that we have pointing to brains as information-processing center would have to be wrong. Maybe brains are the firewall organ! Memes are sortof like microbes, and they're pretty well "firewalled" (genetic engineering is a meme-complex that might break out of the jail).
The notion of creating an ecology of entities, and incentivizing them to produce things that we value, might be a reasonable strategy, one that we humans have been using for some time.
I can't see how this comment relates to the previous one. It seems to start an entirely new conversation. Also, the metaphor with brains and microbes doesn't add understanding for me, I can only address the last paragraph, on its own.
The notion of creating an ecology of entities, and incentivizing them to produce things that we value, might be a reasonable strategy, one that we humans have been using for some time.
The crucial property of AIs making them a danger is (eventual) autonomy, not even rapid coming to power. Once the AI, or a society ("ec...
ITT we talk about whatever.