One crazy nihilist
A more convenient possible world was alluded to when I asked about excluding some individuals.
equilibrium
Only if
No merging?
A single AI would be much better
Maybe, but I had also asked about the relative difficulty of calculating CEV and DEV. If DEV is easier, perhaps possible rather than impossible, that's an advantage of it.
one of the AIs would probably succeed in destroying the others; cybersecurity so far has been a decisive win for offense.
War is a risk, it includes the possibility of mutual destruction, particularly if offense is more powerful. You don't think they'd merge resources and values instead of risking it?
empathy...lose out in any contentions over scarce resources
Most likely scenario I agree, still less than probable,
War is a risk, it includes the possibility of mutual destruction, particularly if offense is more powerful. You don't think they'd merge resources and values instead of risking it?
Cyberwar is different than regular war in that all competently performed attacks are inherently anonymous. Attacks performed very competently are also undetectable. This is very destabilizing. And it gets worse; while AIs might try to get around this by all merging together, none of them would be able to prove they hadn't hidden a copy of themselves somewhere.
Questions for discussion, with my tentative answers. Assuming I am wrong about some things, there is something interesting to consider. This is inspired by the recent SL4-type and CEV-centric topics in the discussion section.
Questions:
I
II
III
My Answers:
I
II
III