"as they please" seems dismissive of how difficult it is. It's that basic to human nature, not just human thinking.
Of course, you may be able to lessen how much you care about your score on the LessWrong game to the point where it doesn't affect you more than epsilon, but assuming you're a human I would be very surprised to find you literally didn't have even the faintest twinge.
"Difficult" too easily becomes an excuse for not doing the work. How "difficult" is it to get a university degree? How "difficult" is it to bike 100 miles?
Sometimes "difficult" just means "I don't want to".
So I see I'm currently at -3 for my two comments above, which I think may be the first time I have ever commented on the votes on my own posts. My reaction: so what? I am sufficiently self-assured (a virtue worth cultivating, and observing one's reaction to one's karma score is one small way of cultivatin...
I'm worried that LW doesn't have enough good contrarians and skeptics, people who disagree with us or like to find fault in every idea they see, but do so in a way that is often right and can change our minds when they are. I fear that when contrarians/skeptics join us but aren't "good enough", we tend to drive them away instead of improving them.
For example, I know a couple of people who occasionally had interesting ideas that were contrary to the local LW consensus, but were (or appeared to be) too confident in their ideas, both good and bad. Both people ended up being repeatedly downvoted and left our community a few months after they arrived. This must have happened more often than I have noticed (partly evidenced by the large number of comments/posts now marked as written by [deleted], sometimes with whole threads written entirely by deleted accounts). I feel that this is a waste that we should try to prevent (or at least think about how we might). So here are some ideas: