I'm not so sure. If we're talking about a God-like unFriendly AI, it might do a quick survey of the human race atom by atom and then replace it with a lower entropy system. That way, it can analyze human beings without having them increase entropy, which is something even the AI cannot undo.
That way, it can analyze human beings without having them increase entropy, which is something even the AI cannot undo.
But if you kill patterns that can be reused, you just waste entropy. So our argument is in favor of freezing, not killing.
A comment to http://singinst.org/blog/2010/10/27/presentation-by-joshua-foxcarl-shulman-at-ecap-2010-super-intelligence-does-not-imply-benevolence/: Given as in the naive reinforcement learning framework (and that can approximate some more complex notions of value) that the value is in the environment, you don't want to be too hasty with the environment lest you destroy a higher value you haven't yet discovered! So you especially wouldn't replace high complexity systems like humans with low entropy systems like computer chips, without first analyzing them.