Thanks - your comment implied a concrete example of what I was after: someone who thinks that they would take the 100% altruism pill when in fact they wouldn't, isn't being honest about their values. I found this helpful.

I think it would be reasonable to say that "values" aren't actually a real thing in the first place). I'm using it approximately to mean "things that you care about."

I'd hazard a guess that calling it something different doesn't make it any realer, but we don't need to get into that right now ;-)

EDIT: what I meant by "concrete" in this case was "without reifying values/preferences/caring etc."