I'm somewhat puzzled by how all the influences you quote are fiction. I read and watched fiction as a child, and the only obvious consequence on my personality has been 1) extremely distorted - I can recognize the influence because I remember it, but you couldn't look at that part of my personality and say "Aha, that came from Disney movies!" 2) tossed out of the window in a recent crisis of faith 3) more influenced by real life than fiction. I've been recalculating a lot of things since as young as 4 (most of which ended up wrong because of lack...
I find this harder to read. The arguments are obscured. The structure sucks; claims are not isolated into neat little paragraphs so that I can stop and think "Is this claim actually true?". It's about you (why you aren't Wise) rather than about the world (how Wisdom works).
I've rarely heard "You'll understand when you're older" on questions of simple fact. Usually, it's uttered when someone who claims to be altruistic points out someone else's actions are harmful. The Old Cynic then tells the Young Idealist "I used to be like you, but then I realized you've got to be realistic, you'll understand when you're older that you should be more selfish.". But they never actually offer an object-level argument, or even seem to have changed their minds for rational reasons - it looks like the Selfishness Fairy just...
Oh, I'm starting to see why the Superhappies are not so right after all, what they lack, why they are alien, in the Normal Ending and in Eliezer's comments. I think this should have been explained in more detail in the story, because I initially failed to see their offer as anything but good, let alone bad enough to kill yourself. I want untranslatable 2!
Still, if I had been able to decide on behalf of humanity, I would have tried to make a deal - not outright accepted their offer, but negotiated to keep more of what matters to us, maybe by adopting more o...
Wait. Aren't they right? I don't like that they don't terminally value sympathy (though they're pretty close), but that's beside the point. Why keep the children suffering? If there is a good reason - that humans need a painful childhood to explore, learn and develop properly, for example - shouldn't the Super Happy be conviced by that? They value other things than a big orgasm - they grow and learn - they even tried to forsake some happiness for more accurate beliefs - if, despite this, they end up preferring stupid happy superbabies to painful growth, it's likely we agree. I don't want to just tile the galaxy with happiness counters - but if collapsing into orgasmium means the Supper Happy, sign me up.
@Jotaf: No, you misunderstood - guess I got double-transparent-deluded. I'm saying this:
So I'm happy with probability being subjectively objective, a
@Eliezer: Can you expand on the "less ashamed of provincial values" part?
@Carl Shuman: I don't know about him, but for myself, HELL YES I DO. Family - they're just randomly selected by the birth lottery. Lovers - falling in love is some weird stuff that happens to you regardless of whether you want it, reaching into your brain to change your values: like, dude, ew - I want affection and tenderness and intimacy and most of the old interpersonal fun and much more new interaction, but romantic love can go right out of the window with me. Friends - I...
Oh please. Two random men are more alike than a random man and a random woman, okay, but seriously, a huge difference that makes it necessary to either rewrite minds to be more alike or separate them? First, anyone who prefers to socialize with the opposite gender (ever met a tomboy?) is going to go "Ew!". Second, I'm pretty sure there are more than two genders (if you want to say genderqueers are lying or mistaken, the burden of proof is on you). Third, neurotypicals can get along with autists just fine (when they, you know, actually try), and t...
I don't see how removing getting-used-to is close to removing boredom. IANAneurologist, but on a surface level, they do seem to work differently - boredom is reading the same book everyday and getting tired of it, habituation is getting a new book everyday and not thinking "Yay, new fun" anymore.
I'm reluctant to keep habituation because, at least in some cases, it is evil. When the emotion is appropriate to the event, it's wrong for it to disminish - you have a duty to rage against the dying of the light. (Of course we need it for survival, we ca...
I'm going to stick out my neck. Eliezer wants everyone to live. Most people don't.
People care about their and their loved ones' immediate survival. They discount heavily for long-term survival. And they don't give a flying fuck about the life of strangers. They say "Death is bad.", but the social norm is not "Death is bad.", it's "Saying "Death is bad." is good.".
If this is not true, then I don't know how to explain why they dismiss cryonics out of hand with arguments about how death is not that bad that are clearly ...
Actually, the Mystic Eyes of Depth Perception are pretty underwhelming. You can tell how far away things are with one eye most of the time. The difference is big enough to give a significant advantage, but nothing near superpower level. My own depth perception is crap (better than one eye though), and I don't often bump into walls.
Nazir Ahmad Bhat, you are missing the point. It's not a question of identity, like which ice cream flavor you prefer. It's about truth. I do not believe there is a teapot orbiting around Jupiter, for the various reasons explained on this site (see Absence of evidence is evidence of absence and the posts on Occam's Razor). You may call this a part of my identity. But I don't need people to believe in a teapot. Actually, I want everyone to know as much as possible. Promoting false beliefs is harming people, like slashing their tires. You don't believe in a flying teapot: do you need other people to?
Eliezer, sure, but that can't be the whole story. I don't care about some of the stuff most people care about. Other people whose utility functions differ in similar but different ways from the social norm are called "psychopaths", and most people think they should either adopt their morals or be removed from society. I agree with this.
So why should I make a special exception for myself, just because that's who I happen to be? I try to behave as if I shared common morals, but it's just a gross patch. It feels tacked on, and it is.
I expected (thou...
Constant: "Give a person power, and he no longer needs to compromise with others, and so for him the raison d'etre of morality vanishes and he acts as he pleases."
If you could do so easily and with complete impunity, would you organize fights to death for your pleasure? Would you even want to? Moreover, humans are often tempted to do things they know they shouldn't, because they also have selfish desires. AIs don't if you don't build it into them. If they really do ultimately care about humanity's well-being, and don't take any pleasure from making people obey them, they will keep doing so.
I'm confused. I'll try to rephrase what you said, so that you can tell me whether I understood.
"You can change your morality. In fact, you do it all the time, when you are persuaded by arguments that appeal to other parts of your morality. So you may try to find the morality you really should have. But - "should"? That's judged by your current morality, which you can't expect to improve by changing it (you expect a particular change would improve it, but you can't tell in what direction). Just like you can't expect to win more by changing yo...
This argument sounds too good to be true - when you apply it to your own idea of "right". It also works for, say, a psychopath unable to feel empathy who gets a tremendous kick out of killing. How is there not a problem with that?
No! The problem is not reductionism, or that morality is or isn't about my brain! The problem is that what morality actually computes is "What should you feel-moral about in order to maximize your genetic fitness in the ancestral environment?". Unlike math, which is more like "What axioms should you use in order to develop a system that helps you in making a bridge?" or "What axioms should you use in order to get funny results?". I care about bridges and fun, not genetic fitness.
Actually, "Whatever turns y'all on" is...
Folks, we covered that already! "You should open the door before you walk trough it." means "Your utility function ranks 'Open the door then walk through it' above 'Walk through the door without opening it'". YOUR utility function. "You should not murder." is not just reminding you of your own preferences. It's more like "(The 'morality' term of) my utility function ranks 'You murder' below 'you don't murder'.", and most "sane" moralities tend to regard "this morality is universal" as a good thing.
I talked to other people about such calls. They called me evil. Apparently, people don't see the proposition "Aid is good" as following from "Aid helps people" (a purely factual claim) and "Helping people is good" (which only evil people deny); it's all in the same mental bucket. So we're pretty much screwed explaining it. Moreover, even when people finally get the distinction, the claims tend to be rejected at the speed of thought - because we all know "Aid is good".