Comment on What is Eliezer Yudkowsky's meta-ethical theory?

Sun, 30 Jan 2011 22:55:54 GMT

It seems clear from the metaethics posts is that if a powerful alien race comes along and converts humanity into paperclip-maximizers, such that making many paperclips comes to be right_human

No one can change right_human, it's a specific utility function. You can change the utility function that humans implement, but you can't change right_human. That would be like changing e^x or 2 to something else. In other words, you're right about what the metaethics posts say, and that's what I'm saying too.

edit: or what jimrandomh said (I didn't see his comment before I posted mine)

Discuss