You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Moloch: optimisation, "and" vs "or", information, and sacrificial ems - Less Wrong Discussion

20 Post author: Stuart_Armstrong 06 August 2014 03:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (58)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 18 August 2014 10:12:12AM 1 point [-]

I take your point.

But it occurs to me that ruthlessly efficient societies need to be highly coordinated societies, which may push in other directions; I wonder if there's something worth digging into there...

Comment author: satt 20 August 2014 01:18:54AM 1 point [-]

Another hopeful thought: we might escape being eaten for an unexpectedly long time because evolution is stupid. It might consistently program organic life to maximize for proxies of reproductive success like social status, long life, or ready access to food, rather than the ability to tile the universe with copies of itself.

This in no way implies humanity's safe forever; evolution would almost surely blunder into creating a copy-maximizing species eventually, by sheer random accident if nothing else. But humanity's window of safety might be millions or billions or trillions of years rather than millennia.