private_messaging comments on Work on Security Instead of Friendliness? - Less Wrong

29 Post author: Wei_Dai 21 July 2012 06:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (103)

You are viewing a single comment's thread. Show more comments above.

Comment author: private_messaging 22 July 2012 07:29:14PM *  1 point [-]

And why one should pick a high percentile, exactly, if the priors for high percentiles are proportionally low and strong evidence is absent? What's wrong with assuming 'somewhat above median', i.e. close to 50th percentile? Why is that even really harsh?

Comment author: CarlShulman 22 July 2012 08:00:40PM 7 points [-]

Extreme standardized testing (after adjusting for regression to the mean), successful writer (by hits, readers, reviews; even vocabulary, which is fairly strongly associated with intelligence in large statistical samples), impressing top philosophers with his decision theory work, impressing very smart and influential people (e.g. Peter Thiel) in real-time conversation.

Why is that even really harsh?

It would be harsh to a graduate student from a top hard science program or law school. The median attorney figure in the US today, let alone over the world and history, is just not that high.

Comment author: private_messaging 25 July 2012 02:59:14PM *  2 points [-]

impressing top philosophers with his decision theory work,

The TDT paper from 2012 reads like popularization of something, not like normal science paper on some formalized theory. I don't think impressing 'top philosophers' is impressive.

It would be harsh to a graduate student from a top hard science program or law school.

Or to a writer that gets royalties larger than typical lawyer. Or a smart and influential person, e.g. Peter Thiel.

But a blogger that successfully talked small-ish percentage of people he could reach, into giving him money for work on AI? That's hardly the evidence to sway 0.0001 prior. I do concede though that median lawyer might be unable to do that (but I dunno - only small percentage would be self deluded or bad enough to try). The world is full of pseudoscientists, cranks, and hustlers that manage this, and more, and who do not seem to be particularly bright.