MugaSofer comments on Hacking the CEV for Fun and Profit - Less Wrong

52 Post author: Wei_Dai 03 June 2010 08:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (194)

You are viewing a single comment's thread. Show more comments above.

Comment author: MugaSofer 20 February 2013 10:53:15AM -1 points [-]

Well, it was his example. The idea is that they can model our terminal values (as well as anybody else can) but they aren't moved by them. Just like I can imagine a paperclipper that would cheerfully render down humans for the iron in our blood, but I'm not especially inclined to emulate it.

Comment author: TheOtherDave 20 February 2013 02:13:23PM 0 points [-]

I still don't see how you get from observing someone describing not being moved by the same surface-level social obligations as their peers (e.g., attending grandma's funeral) to the conclusion that that person doesn't share the same moral terminal values as their peers, but leaving that aside, I agree that someone doesn't need to be moved by a value in order to model it.

Comment author: MugaSofer 21 February 2013 05:28:50PM -2 points [-]

Oh, it was only an example; he described his experience in much more detail. I guess he didn't want to use a more, well, disturbing example; he had been studying violent psychopaths, after all. (He also claimed his murderous predispositions had probably been curbed by a superlative home life.)