It depends when the singularity occurs. It is also indicative that there might be other problems. Let us say that an AI might be able to recreate some (famous) people from their work/habitation and memories in other people, along with a thorough understanding of human biology.
If an AI can it should preserve as much of the human environment as possible (no turning it into computronium), until it gains that ability. However it doesn't know whether a bit of the world will be useful for that purpose (hardened footprints in mud), until it has lots of computronium.
This problem just looks like the usual question of how much of our resources should be conserved and how much should be used. There is some optimal combination of physical conservation and virtual conservation that leaves enough memory and computronium for other things. We're always deciding between immediate economic growth and long term access to resources (fossil fuels, clean air, biodiversity, fish). In this case the resource is famous person memorabilia/ human environment. But this isn't a tricky conceptual issue, just a utility calculation, and the ...
This thread is for the discussion of Less Wrong topics that have not appeared in recent posts. Feel free to rid yourself of cached thoughts by doing so in Old Church Slavonic. If a discussion gets unwieldy, celebrate by turning it into a top-level post.
If you're new to Less Wrong, check out this welcome post.