falenas108 comments on A definition of wireheading - Less Wrong

35 Post author: Anja 27 November 2012 07:31PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kindly 08 December 2012 03:41:24PM 1 point [-]

You don't; moreover, to me at least, it's probably not even immediately obvious what I truly value. Which is how it happens that someone can be wrong about what they want.

But most people are probably alike to an extent, so if you figure out that maximizing pleasure isn't the only thing that's important to you, you might suspect that other people also care about other things besides maximizing pleasure.

Comment author: brazil84 15 December 2012 12:57:49PM 0 points [-]

Well then how do you know your own utility function? Is there any way in principle to test it? Is there any way to know that you are wrong about what you want?