You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

timtyler comments on BOOK DRAFT: 'Ethics and Superintelligence' (part 2) - Less Wrong Discussion

6 Post author: lukeprog 23 February 2011 05:58AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread.

Comment author: timtyler 23 February 2011 11:30:17AM -2 points [-]

It is difficult to predict the likelihood of the active prevention of AI development, but the failure of humanity to halt the development of ever more powerful nuclear weapons (Norris & Kristensen 2009) – even after tasting their destructive power – does not inspire optimism.

"Optimism" being code for "preventing machine intelligence from being invented"?

You may want to spell this out - or perhaps substitute the word "pessimism".

Comment author: lukeprog 23 February 2011 03:57:56PM *  1 point [-]

Agreed. Thanks.

Lol, why was this downvoted?

Comment author: Vladimir_Nesov 23 February 2011 05:13:07PM 4 points [-]

While in context of your text it can be inferred that "optimism" refers to prevention of AI development, Tim's suggestion that "pessimism" could be substituted instead is a disingenuous way of proselytizing his own position, unrelated to what he was commenting on since this option would be doubly confusing if actually implemented.

Comment author: lukeprog 23 February 2011 05:54:19PM 2 points [-]

Huh. Well, anyway, I think it will help to clarify what I meant by optimism.

Comment author: Dr_Manhattan 24 February 2011 09:38:16PM 1 point [-]

proselytizing his own position

Which is, for the uninitiated (link preferred) ? thx

Comment author: timtyler 25 February 2011 10:50:18PM *  0 points [-]

Efforts to halt the development of increasingly-powerful machine intelligences seem likely to be made by a faction of humanity labelled by the rest of the humans as terrorists.

So far there has mostly only been the unabomber - but there may be more - and it may not be very much fun.

Comment author: timtyler 24 February 2011 08:42:26PM 0 points [-]

I repudiate the accusation of Machiavellian manipulation.

Comment author: Vladimir_Nesov 24 February 2011 09:25:59PM 1 point [-]

I suppose you could just raise your right hand.

Comment author: khafra 23 February 2011 05:11:28PM 3 points [-]

I didn't downvote Tim, but I considered your usage standard English in referring to the first clause of the sentence, not a coded value judgement. I read it as "...Does not inspire optimism [that active prevention of AI is likely]."

Compare to, "It is difficult to predict the likelihood of John Dillinger's gang successfully robbing first national, but the addition of 8 armed guards To the bank's security plan does not inspire optimism."