nshepperd comments on The Aliens have Landed! - Less Wrong

33 Post author: TimFreeman 19 May 2011 05:09PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (156)

You are viewing a single comment's thread. Show more comments above.

Comment author: TimFreeman 20 May 2011 03:40:08PM *  2 points [-]

caring about simulated torture appears to be cost without benefit.

Generally the benefit of caring about about any bad thing is that if you care about it there will be less of it because you will work to stop it.

Well, Fred cared, and his reaction was to propose exterminating humanity. I assume you think his is a wrong decision. Can you say why?

If you care about simulated torture (or simulated pleasure), and you're willing to shut up and multiply, then anybody with a big enough computer can get you to do anything even when that computer has no inputs or outputs and makes absolutely no difference to the real world. I think it's better to adjust oneself so one does not care. It's not like it's a well-tested human value that my ancestors on the savannah acted upon repeatedly.

Comment author: nshepperd 21 May 2011 06:10:02AM 1 point [-]

That sounds like a flaw in the decision theory. What kind of broken decision theory achieves its values better by optimizing for different values?