gwern comments on Thoughts on the Singularity Institute (SI) - Less Wrong

256 Post author: HoldenKarnofsky 11 May 2012 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1270)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 17 May 2012 06:35:28PM 2 points [-]

Nuclear war isn't the same situation, though. We can survive nuclear war at all sorts of levels of intensity, so the selection filter is not nearly the same as "the Sun going out", which is ~100% fatal. Bostrom's shadow paper might actually work for nuclear war, from the perspective of a revived civilization, but I'd have to reread it to see.

Comment author: rhollerith_dot_com 17 May 2012 08:16:18PM *  1 point [-]

The selection filter does not have to be total or near total for my point to stand, namely, Rule-of-Succession-like calculations can be useful even when one has enough information to think about the selection effects involved (provided that Rule-of-Succession-like calculations are ever useful).

And parenthetically selection effects on observations about whether nuclear exchanges happened in the past can be very strong. Consider for example a family who has lived in Washington, D.C., for the last 5 decades: Washington, D.C., is such an important target that it is unlikely the family would have survived the launch of most or all of the Soviet/Russian arsenal at the U.S. So, although I agree with you that the human race as a whole would probably have survived almost any plausible nuclear exchange, that does not do the family in D.C. much good. More precisely, it does not do much good for the family's ability to use historical data on whether or not nukes were launched at the U.S. in the past to refine their probability of launches in the future.

Comment author: thomblake 17 May 2012 08:22:23PM 1 point [-]

And parenthetically

An interesting bracket style. How am I supposed to know where the parenthetical ends?