Er, I think you just blew your pretense. Paperclip maximizers care about paperclips, they don't use phrases like "horrible robot that doesn't truly care", they'd be happy to have a universe containing nothing sentient and lots of paperclips.

I worry about my future self not valuing paperclips, which would have the result that paperclips would not be maximized, which is a bad thing as viewed from my present state (though not from that of the horrible monster that doesn't care about maximizing paperclips which I do not wish to become).

I use phrases like "horrible" and "doesn't truly care" because I believe the nearest concepts in my cognition are sufficiently parallel to their meanings under ape cognition.

Also, what pretense?

Or they would be, if they ever bothered to experience happiness, I mean. As opposed to just outputting the action that leads to the most expected paperclips. Hence the term, "expected paperclip maximizer". Don't think of it as having a little ghost inside that maximizes paperclips, think of it as a ghostless device that maximizes paperclips.

On what basis do you claim that humans bother to experience happiness, as opposed to "just" outputting the action that leads to the most expected apeyness?

Aren't you just as much a ghostless device?

(Apparently, this anti-non-human bigotry comes from the top...)