Nisan comments on Less Wrong: Open Thread, September 2010 - Less Wrong

3 Post author: matt 01 September 2010 01:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (610)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nisan 09 September 2010 06:49:26PM *  9 points [-]

Yeah. When I read that pricing schedule, what I see is Eliezer preempting:

  • enthusiastic singularitarians whiling away their hours dreaming about how everyone is going to have a rocketpack after the Singularity;

  • criticism of the form "CEV will do X, which is clearly bad. Therefore CEV is a bad idea." (where X might be "restrict human autonomy"). This kind of criticism comes from people who don't understand that CEV is an attempt to avoid doing any X that is not clearly good.

The CEV document continues to welcome other kinds of criticism, such as the objection that the coherent extrapolated volition of the entire species would be unacceptably worse for an individual than that of 1000 like-minded individuals (Roko says something like this) or a single individual (wedrifid says something like this) -- the psychological unity of mankind notwithstanding.