Comment author: skeptical_lurker 10 October 2016 06:21:41PM 4 points [-]

That doesn't mean that there is nothing to do - if you don't know what FAI is, then you try to work out what it is.

Comment author: Lumifer 10 October 2016 06:43:42PM -1 points [-]

And how do you find out whether you're right or not?

Comment author: skeptical_lurker 10 October 2016 06:14:36PM 2 points [-]

We live in an increasingly globalised world, where moving between countries is both easier in terms of transport costs and more socially acceptable. Once translation reaches near-human levels, language barriers will be far less of a problem. I'm wondering to what extent evaporative cooling might happen to countries, both in terms of values and economically.

I read that France and Greece lost 3 & 5% of their millionaires last year (or possibly the year before), citing economic depression and rising racial/religious tension, with the most popular destination being Australia (as it has the 1st or 2nd highest HDI in the world). 3-5% may not seem like a lot, but if it were sustained for several years it quickly piles up. The feedback effects are obvious - the wealthier members of society find it easier to leave and perhaps have more of a motive to leave an economic collapse, which decreases tax revenue, which increases collapse etc. On the flip side, Australia attracts these people and its economy grows more making it even more attractive...

Socially, the same effect as described in EY's essay I linked happens on a national scale - if the 'blue' people leave, the country becomes 'greener' which attracts more greens and forces out more blues. And social/economic factors feed into each other too - economic collapses cause extremism of all sorts, while I imagine a wealthy society attracting elites would be more able to handle or avoid conflicts.

Now, this is not automatically a bad thing, or at least it might be bad locally for some people, but perhaps not globally. Any thoughts as to what sort of outcomes there might be? And incidentally, how many people can you fit in Australia? I know its very big, but also has a lot of desert.

Comment author: Lumifer 10 October 2016 06:42:04PM 3 points [-]

Brain drain has been a concern of some for a long time.

Comment author: DanArmak 10 October 2016 04:18:24PM 3 points [-]

We don't have an AGI that doesn't kill us. Having one would be a significant step towards FAI. In fact, "a human-equivalent-or-better AGI that doesn't do anything greatly harmful to humanity" is a pretty good definition of FAI, or maybe "weak FAI".

Comment author: Lumifer 10 October 2016 04:43:09PM 0 points [-]

If it's a tool AGI, I don't see how it would help with friendliness, and if it's an active self-developing AGI, I thought the canonical position of LW was that there could be only one? and it's too late to do anything about friendliness at this point?

Comment author: DanArmak 10 October 2016 02:55:47PM 2 points [-]

We do know it isn't an AI that kills us. Options b and c still qualify.

Comment author: Lumifer 10 October 2016 03:10:09PM 1 point [-]

Options (b) and (c) are basically wishes and those are complex X-D

"Not kill us" is an easy criterion, we already have an AI like that, it plays Go well.

Comment author: turchin 10 October 2016 02:28:19PM 3 points [-]

Good point, but my question was about what we can do to raise chances that it will be friendly AI.

Comment author: Lumifer 10 October 2016 02:48:06PM *  -2 points [-]

Nothing, because we still don't know what a friendly AI is.

Comment author: Brillyant 07 October 2016 09:31:43PM -1 points [-]

I accept genes are a big part of the picture.

I'm not sure I believe genetics are more important than other factors. And this is not necessarily a simple nature vs. nurture issue. In the case of African Americans' treatment in U.S. history, it's an extreme set of "nurture" circumstances that robbed a group of people of all opportunity for many generations, based on race. I'm not sure "good genes" simply overcomes extremely lopsided (often systemically unfair) circumstances.

Anyway, it won't be resolved here. Thanks for your thoughts.

Comment author: Lumifer 10 October 2016 02:43:36PM *  1 point [-]

I'm not sure I believe genetics are more important than other factors.

You'll have to be a bit more specific. "More important" for what and "other factors" from which set?

it's an extreme set of "nurture" circumstances that robbed a group of people of all opportunity for many generations, based on race.

What do you think are transmission mechanisms which would show how having, say, great-great-grandparents who were slaves affects you now?

You might find it interesting to compare them to East European Jews who 150 years ago certainly weren't slaves, but they were segregated and discriminated against, they faced limitations on what they could own, where could they live, and what could they do, plus once in a while a mob of angry peasants would come and burn down a village. They weren't rich either.

Do you think the somewhat worse conditions of the American blacks explain the gap in outcomes looking at the present day?

Comment author: Jacobian 09 October 2016 12:00:15PM 0 points [-]

You still haven't made a single argument in favor of emotional empathy, other than conflating lack of emotional empathy with, in order of appearance: Stalinism, Nazism, witch hunting, fanaticism. None of this name calling was supported by any evidence re:empathy.

Comment author: Lumifer 10 October 2016 02:33:31PM *  1 point [-]

The argument that I was making or, maybe, just implying is a version of the argument for deontological ethics. It rests on two lemmas: (1) You will make mistakes; (2) No one is a villain in his own story.

To unroll a bit, people who do large-scale evil do not go home to stroke a white cat and cackle at their own evilness. They think they are the good guys and that they do what's necessary to achieve their good goals. We think they're wrong, but that's an outside view. As has been pointed out, the road to hell is never in need of repair.

Given this, it's useful to have firebreaks, boundaries which serve to stop really determined people who think they're doing good from doing too much evil. A major firebreak is emotional empathy -- it serves as a check on runaway optimization processes which are, of course, subject to the Law of Unintended Consequences.

And, besides, I like humans more than I like optimization algorithms :-P

Comment author: Brillyant 07 October 2016 08:23:11PM *  -1 points [-]

Sorry, doesn't hold. Some more convincing studies examined the outcomes of Georgia land lotteries which were effectively a randomized controlled trial where the "intervention arm" got a valuable piece of land (by winning the lottery) and the "control arm" didn't get anything. See e.g. this and other studies.

Interesting.

In regard to the scenario (person A and person B) I gave above, I'm not sure your study refutes what I'm saying. Wealth can be squandered, sure. But wealth, along with a solid education, a well-developed relevant skill in the marketplace, a well-established social and professional network, and a family with a good reputation can be much more persistent.

The opportunity to have enough money to live and have free time plus a good basis for how to live and use that wealth can be sustained over generations.

I am who I am, in part, because of who my parents are. They taught me, for better or for worse, how to handle money; how to relate to people; how to study, work, play, etc. And my parents are who they are, in part, because of their parents. And so on. Generations of my family incubated the new generation's growth into their own efforts to create sustainable wealth. Perhaps this is some of what you mean when you say...

Culture, on the other hand, persists across generations relatively well.

Can you give me some examples of what you mean by "culture persists across generations"?

By the way, while slavery was ended 150 year ago, segregation remained in force until after the WW2 and so is a much more recent phenomenon, within living memory.

Absolutely. And racism still persists and has an effect even today.

Comment author: Lumifer 07 October 2016 08:57:31PM 2 points [-]

But wealth, along with a solid education, a well-developed relevant skill in the marketplace, a well-established social and professional network, and a family with a good reputation can be much more persistent.

The claim is that most of that is biology and heritable. Your ancestors had good genes (again, IQ but not only) which allowed them to gain a skill in the marketplace, construct a social network, create a family with good reputation, and acquire wealth. You have skills in the marketplace, able to adroitly navigate society, etc. primarily because you share genes with your ancestors, not because you inherited some money.

my parents ... taught me

This is the nature vs nurture debate and lately the nature side has been winning. Who and what you are is considerably more determined by your genes rather than by your upbringing. Gwern posted about this here, on LW, or you can google up twin studies (studies of (genetically) identical twins who were separated at birth and brought up by different people in different circumstances).

Can you give me some examples of how "culture persists across generations"?

See e.g. Yvain's review of Albion's Seed.

Comment author: Brillyant 07 October 2016 05:00:29PM *  -2 points [-]

One premise is that if a significant deficit in, say, wealth or education is created for a group of people, then it will be a persistent disadvantage that causes that group of people to lag behind.

Another premise is that slavery wasn't that long ago, relatively.

If, 150 years ago, we had person A start with $100,000 in inherited wealth, a solid education, a well-developed relevant skill in the marketplace, a well-established social and professional network, and a family with a good reputation. And then we had person B start with no money, no education, no marketable skills, no network, no family, no reputation...

If person A and B set out and lived their lives and had offspring, person A with the mentioned significant advantage over person B, I would imagine their offspring would be born into similar circumstances, with the offspring of person A maintaining an advantage over the offspring of person B because of all the obvious reasons people with advantages in wealth, education, etc. tend to maintain an advantage. The advantage may have narrowed (or maybe widened), but the advantage would be carried into the next generation.

Continue this forward 5-7 generations. What would we expect to see? I think we'd see line A maintain an advantage. The advantage may have narrowed (or maybe widened), but the advantage would be carried through generations.

Of course line B could "catch" and surpass line A. It's easy to imagine exceptional scenarios. But it seems probable that line A would enjoy an ongoing advantage.

And this scenario assumes a level playing field for descendants of line A and line B. I don't believe that's been the case in America for blacks and whites. Since the end of slavery, there has been significant discrimination against blacks, much of which continues to the current day.

Comment author: Lumifer 07 October 2016 07:39:31PM 2 points [-]

One premise is that if a significant deficit in, say, wealth or education is created for a group of people, then it will be a persistent disadvantage that causes that group of people to lag behind.

Sorry, doesn't hold. Some more convincing studies examined the outcomes of Georgia land lotteries which were effectively a randomized controlled trial where the "intervention arm" got a valuable piece of land (by winning the lottery) and the "control arm" didn't get anything. See e.g. this and other studies.

Now, if you have a continuing advantage (IQ) that continues to hold while your group mostly intermarries, things are different.

Culture, on the other hand, persists across generations relatively well.

By the way, while slavery was ended 150 year ago, segregation remained in force until after the WW2 and so is a much more recent phenomenon, within living memory.

Comment author: sawahbodien 07 October 2016 11:22:57AM 1 point [-]

Is there a specific bias for thinking that everyone possesses the same knowledge as you? For example, after learning more about a certain subject, I have a tendency to think, "Oh, but everyone already knows this, don't they" even though they probably don't and I wouldn't have assumed that before learning about it myself.

Comment author: Lumifer 07 October 2016 02:37:31PM 2 points [-]

Theory of mind. Locally it's often called a "typical mind fallacy".

View more: Prev | Next