SirBacon comments on The Craft and the Community - Less Wrong

27 Post author: Eliezer_Yudkowsky 26 April 2009 05:52PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (9)

You are viewing a single comment's thread.

Comment author: SirBacon 26 April 2009 08:03:33PM 9 points [-]

"...then there's the idea that rationalists should be able to (a) solve group coordination problems, (b) care a lot about other people and (c) win..."

Why should rationalists necessarily care a lot about other people? If we are to avoid circular altruism and the nefarious effects of other-optimizing, the best amount of caring might be less than "a lot."

Additionally, caring about other people in the sense of seeking emotional gratification primarily in tribe-like social rituals may be truly inimical to dedicating one's life to theoretical physics, math, or any other far-thinking discipline.

Caring about other people may entail involvement in politics, and local politics can be just as mind-killing as national politics.

Comment deleted 27 April 2009 03:32:59PM *  [-]
Comment author: SirBacon 27 April 2009 07:47:32PM 1 point [-]

"With that caveat, this summary and plenty of the posts contained within are damn useful!"

I resoundingly agree.

That said, Eliezer is attempting to leverage the sentiments we now call "altruistic" into efficient other-optimizing. What if all people are really after is warm fuzzies? Mightn't they then shrink from the prospect of optimally helping others?

Hobbes gives us several possible reasons for altruism, none of which seem to be conducive to effective helping:

"When the transferring of right is not mutual, but one of the parties transferreth in hope to gain thereby friendship or service from another, or from his friends; or in hope to gain the reputation of charity, or magnanimity; or to deliver his mind from the pain of compassion [self-haters give more?]; or in hope of reward in heaven; this is not contract, but gift, free gift, grace: which words signify one and the same thing."

There is also the problem of epistemic limitations around other-optimizing. Charity might remove more utilons from the giver than it bestows upon the receiver, if only because it's difficult to know what other people need and easier to know what oneself needs.

Comment author: adamisom 12 February 2012 12:48:32AM *  1 point [-]

"Mightn't" we shrink from optimal helping? "Might" charity be usually an imbalance of utilons?

Yes, we might, it might.

These are important considerations--I don't mean to denigrate clear thinking. But to lie content with hypothetical reasons why something wouldn't work, due to a common hidden laziness of most humans but which we can convince ourselves is due to more noble and reasonable reasons, is to completely miss the most crucial point of this entire Sequence: actually doing something, testing.

I think it's safe to say that the natural inclination of most humans isn't initiating large projects with high but uncertain reward. It's to "just get by", a fact which I must thank you, good sir, for illustrating.... it was intentional, right?

Comment author: cabalamat 28 April 2009 03:08:51AM 1 point [-]

Why should rationalists necessarily care a lot about other people?

They shouldn't, particularly. End goals are not a part of rationality, rationality exists to achieve them.

However, many end goals can be more easily achieved by getting help from others. If your end goals are like this, it's rational for you to solve group coordination problems and care about other people.

Comment author: astray 28 April 2009 09:49:05PM *  1 point [-]

I don't think that b is necessarily an immediate entailment of rationality, but a condition that can be met simultaneously with a and c. The post presents a situation where c is satisficed only through a and b. (It does not take much finagling to suppose that a lonesome mountain man existence in a world ruled by barbarians is inferior in fuzziness and utilons relative to the expectation of the world where a b and c are held to be true.)

Comment author: ryleah 08 October 2014 12:09:00AM *  1 point [-]

Sorry to answer a 5 year old post, but apparently people read these things. You asked "Why should rationalists necessarily care a lot about other people," but all the post said was that they should be able to.