gwern comments on Humans Shouldn't make Themselves Smarter? - Less Wrong

-2 Post author: potato 11 December 2011 12:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (21)

You are viewing a single comment's thread.

Comment author: gwern 12 February 2012 08:46:49PM *  0 points [-]

Copy jailbreaked: http://www2.warwick.ac.uk/fac/sci/psych/people/academic/thills/thills/hillspublications/hillshertwig2011cdps.pdf

I've read it, and it doesn't cite Bostrom; as one would expect, this means it's pretty useless and a retread of Bostrom's paper. The main contribution of the paper, for me, is that it includes one or two useful examples I hadn't covered, and it includes some simple math models showing how U-shaped curves can fall out of optimizing for multiple properties.

EDIT: I emailed a link to Bostrom to the main author, who replied:

I think the arguments are actually quite similar, but from a slightly different perspective. We're both arguing that enhancement is possible, but that an understanding of the evolutionary and cognitive constraints is needed. We further add a bit on the kinds of domains where such trade-offs are most likely.