They are irrational. ... Structurally, we’re talking about a cartel, or a mob. Mob in both the “mafia” and the “riot” sense. Collusion to keep unmerited privilege
It is not irrational to want to hang on to power/privilege. A very basic property of a rational agent is to want to increase or at least not decrease its level of capability in the world. Fair competition, when you would lose, is irrational. In fact the very notion of "fair" is hard to define in a general way, but winning is less hard to define.
Similarly, it is not irrational to want to form a cartel or political ingroup. Quite the opposite. It's like the concept of economic moat, but for humans.
all the millions of mental motions involved in trying to understand things accurately. The person who is wrong on purpose wants to just stop all of that motion, forever.
The most important thing for an agent to understand is to preserve itself and its utility function. Perhaps Satre's antisemites, though lacking in IQ, understood this better than we do.
I don't think it will be very difficult to impart your intentions into a sufficiently advanced machine
Counterargument: it will be easy to impart an approximate version of your intentions, but hard to control the evolution of those values as you crank up the power. E.g. evolution, humans, make us want sex, we invent condoms.
No-one will really care about this until it's way too late and we're all locked up in nice padded cells and drugged up, or something equally bad but hard for me to imagine right now.
I think 50% is a reasonable belief given the very limited grasp of the problem we have.
Most of the weight on success comes from FAI being quite easy, and all of the many worries expressed on this site not being realistic. Some of the weight for success comes from a concerted effort to solve hard problems.
I guess there is a gap between the OP's intention and his/her behaviour? Intended to link to something but actually just self-links?
Thanks for your comment! Can you say which country?
Could you tell me how you came about the list of African backward values?
Not in particular, the human brain tends to collect overall impressions rather than keep track of sources.
I'd like the names of all the values I'd need to instil to avoid seeing preventable suffering around me.
This sounds like a seriously tough battle.
Yeah, I mean maybe just make them float to the bottom?
One problem here is that we are trying to optimize a thing that is broken on an extremely fundamental level.
Rationality, transhumanism, hardcore nerdery in general attracts a lot of extremely socially dysfunctional human beings. They also tend to skew towards a ridiculously biologically-male-heavy gender distribution.
Sometimes life throws unfair challenges at you; the challenge here is that ability and interest in rationality correlates negatively with being a well-rounded human.
We should search very hard for extreme out-of-the-box solutions to this problem.
One positive lead I have been given is that the anti-aging/life-extension community is a lot more gender balanced. Maybe LW should try to embrace that. It's not a solution, but that's the kind of thing I'm thinking of.
agree with that isn't just “+1 nice post.” Here are some strategies...
How about the strategy of writing "+1 nice post"? Maybe we're failing to see the really blatantly obvious solution here....
+1 nice post btw
imagine you're in a fistfight with a hungry tiger. Do you want it to be a fair fight, or would you like to try and cheat somehow?