= 27d567bc2d48d9f40e9ccc20ea370b15)
humpolec comments on Open Thread, September, 2010-- part 2 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (858)
I'm not sure if non-interference is really the best thing to precommit to - if we encounter a pre-AI civilization that still has various problems, death etc., maybe what {the AI they would have build} would have liked more is for us to help them (in a way preserving their values).
If a superintelligence discovers a concept of value-preserving help (or something like CEV?) that is likely to be universal, shouldn't it precommit to applying it to all encountered aliens?
See also: Not Taking Over the World.
Voted up. It is a mortal sin to come up with responses to a valid objection I didn't anticipate to make my original theory true anyway, but for the purposes of fiction:
...perhaps the AI doesn't know whether it will be Friendly or not. The only thing the AI knows for certain is that it will further its values for it to exist. A "helpful" alien race that grants us super-technology might prevent us from accidentally creating an Unfriendly AI. Therefore, all Unfriendly AIs would regard pre-committing to helping their creator species as an acausal declaration of war.