Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

adamzerner comments on Are wireheads happy? - Less Wrong

109 Post author: Yvain 01 January 2010 04:41PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (95)

You are viewing a single comment's thread.

Comment author: adamzerner 04 May 2014 03:52:44PM 3 points [-]

The big point I took away from this article is that wanting and liking are different, and thus we should be skeptical of "revealed preferences".

But the title seemed to imply that the article wanted to address the question of whether or not we should wirehead. The last paragraph seems to argue that we should be really careful with wireheading, because we could get it wrong and not really know that we got it wrong.

Go too far toward the liking direction, and you risk something different from wireheading only in that the probe is stuck in a different part of the brain. Go too far in the wanting direction, and you risk people getting lots of shiny stuff they thought they wanted but don't actually enjoy. So which form of good should altruists, governments, FAIs, and other agencies in the helping people business respect?

I agree with this, but given that it's a central argument of the article, I think it could use a longer explanation.