Estarlio comments on Rationality Quotes April 2013 - Less Wrong

6 Post author: Vaniver 08 April 2013 02:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (281)

You are viewing a single comment's thread. Show more comments above.

Comment author: Estarlio 08 April 2013 03:14:46PM 0 points [-]

Mmm, that's a good point.

Potentially - If people know you're going to play according to a higher rule or purpose, rather than following feelings, then how much are they going to trust that you're really going to exercise that rule on their behalf?

It'd be like the old argument that people should be allowed to kidnap people off the streets and take their organs - because when you average it out any individual is more likely to need an organ than be the one kidnapped so it's the better gamble for everyone to make. But we don't really imagine it that way, we all see ourselves being the ones dragged off the street and cut up, or that people with unpopular political opinions would be the ones... You can't trust someone who'd come up with that sort of system not to be playing a different game because they've already shown you can't trust their compassionate feelings to work as bounds on their actions. Maybe any friendship they express means as little to them as the poor guy they just butchered.

I wonder how much of it is a trust problem though, and how you'd resolve that. It seems to me that if you knew someone really well, or they didn't seem to be grasping power, they could get away with being ruthless. People seem almost to gloat about how ruthless specops folks and the like are.

Comment author: NancyLebovitz 23 April 2013 12:14:10PM 0 points [-]

My impression is that whistle-blowers tend not to be trusted. It's not as though other businesses line up to hire them.

I think the problem is having moral systems which impose high local costs.