This Failing Earth

19 Post author: Eliezer_Yudkowsky 24 May 2009 04:09PM

Suppose I told you about a certain country, somewhere in the world, in which some of the cities have degenerated into gang rule.  Some such cities are ruled by a single gang leader, others have degenerated into almost complete lawlessness.  You would probably conclude that the cities I was talking about were located inside what we call a "failed state".

So what does the existence of North Korea say about this Earth?

No, it's not a perfect analogy.  But the thought does sometimes occur to me, to wonder if the camel has two humps.  If there are failed Earths and successful Earths, in the great macroscopic superposition popularly known as "many worlds" - and we're not one of the successful.  I think of this as the "failed Earth" hypothesis.

Of course the camel could also have three or more humps, and it's quite easy to imagine Earths that are failing much worse than this, epic failed Earths ruled by the high-tech heirs of Genghis Khan or the Catholic Church.  Oh yes, it could definitely be worse...

...and the "failed state" analogy is hardly perfect; "failed state" usually refers to failure to integrate into the global economy, but a failed Earth is not failing to integrate into anything larger...

...but the question does sometimes haunt me, as to whether in the alternative Everett branches of Earth, we could identify a distinct cluster of "successful" Earths, and we're not in it.  It may not matter much in the end; the ultimate test of a planet's existence probably comes down to Friendly AI, and Friendly AI may come down to nine people in a basement doing math.  I keep my hopes up, and think of this as a "failing Earth" rather than a "failed Earth".

But it's a thought that comes to mind, now and then.  Reading about the ongoing Market Complexity Collapse and wondering if this Earth failed to solve one of the basic functions of global economics, in the same way that Rome, in its later days, failed to solve the problem of orderly transition of power between Caesars.

Of course it's easy to wax moralistic about people who aren't solving their coordination problems the way you like.  I don't mean this to degenerate into a standard diatribe about the sinfulness of this Earth, the sort of clueless plea embodied perfectly by Simon and Garfunkel:

I dreamed I saw a mighty room
The room was filled with men
And the paper they were signing said
They'd never fight again

It's a cheap pleasure to wax moralistic about failures of global coordination.

But visualizing the alternative Everett branches of Earth, spread out and clustered - for me, at least, that seems to help trigger my mind into a non-Simon-and-Garfunkel mode of thinking.  If the successful Earths lack a North Korea, how did they get there?  Surely not just by signing a piece of paper saying they'd never fight again.

Indeed, our Earth's Westphalian concept of sovereign states is the main thing propping up Somalia and North Korea.  There was a time when any state that failed that badly would be casually conquered by a more successful neighbor.  So maybe the successful Earths don't have a Westphalian concept of sovereignty; maybe our Earth's concept of inviolable borders represents a failure to solve one of the key functions of a planetary civilization.

Maybe the successful Earths are the ones where the ancient Greeks, or equivalent thereof, had the "Aha!" of Darwinian evolution... and at least one country started a eugenics program that successfully selected for intelligence, well in advance of nuclear weapons being developed.  If that makes you uncomfortable, it's meant to - the successful Earths may not have gotten there through Simon and Garfunkel.  And yes, of course the ancient Greeks attempting such a policy could and probably would have gotten it terribly wrong; maybe the epic failed Earths are the ones where some group had the Darwinian insight and then successfully selected for prowess as warriors.  I'm not saying "Go eugenics!" would have been a systematically good idea for ancient Greeks to try as policy...

But maybe the top cluster of successful Earths, among human Everett branches, stumbled into that cluster because some group stumbled over eugenic selection for intelligence, and then, being a bit smarter, realized what it was they were doing right, so that the average IQ got up to 140 well before anyone developed nuclear weapons.  (And then conquered the world, rather than respecting the integrity of borders.)

What would a successful Earth look like?  How high is their standard sanity waterline?  Are there large organized religions in successful Earths - is their presence here a symptom of our failure to solve the problems of a planetary civilization?  You can ring endless changes on this theme, and anyone with an accustomed political hobbyhorse is undoubtedly imagining their pet Utopia already.  For my own part, I'll go ahead and wonder, if there's an identifiable "successful" cluster among the human Earths, what percentage of them have worldwide cryonic preservation programs in place.

One point that takes some of the sting out of our ongoing muddle - at least from my perspective - is my suspicion that the Earths in the successful cluster, even those with an average IQ of 140 as they develop computers, may not be in much of a better position to really succeed, to solve the Friendly AI problem.  A rising tide lifts all boats, and Friendly AI is a race between cautiously developed AI and insufficiently-cautiously-developed AI.  "Successful" Earths might even be worse off, if they solve their global coordination problems well enough to put the whole world's eyes on the problem and turn the development over to prestigious bureaucrats.  It's not a simple issue like cryonics that we're talking about.  If, in the end, "successful Earths" of the human epoch aren't in a much better position for the catastrophically high-level pass-fail test of the posthuman transition, than our own "failing Earth"... then this Earth isn't all that much more doomed just because we screwed up our financial system, international relations, and basic rationality training.

Is such speculation at all useful?  "Live in your own world", as the saying goes...

...Well, it might not be a saying here, but it's probably a saying in those successful Earths where the scientific community is long since trained in formal Bayesianism and they readily accepted the obvious truth of many-worlds... as opposed to our own world and its constantly struggling academia where senior scientists spend most of their time writing grant proposals...

(Michael Vassar has an extended thesis on how the scientific community in our Earth has been slowly dying since 1910 or so, but I'll let him decide whether it's worth his time to write up that post.)

It's usually not my intent to depress people.  I have an accustomed saying that if you want to depress yourself, look at the future, and if you want to cheer yourself up, look at the past.  By analogy - well, for all we know, we might be in the second-highest major cluster, or in the top 10% of all Earths even if not one of the top 1%.  It might be that most Earths have global orders descended from the conquering armies of the local Church.  I recently had occasion to visit the National Museum of Australia in Canberra, and it's shocking to think of how easily a human culture can spend thirty thousand years without inventing the bow and arrow.  Really, we did do quite well for ourselves in a lot of ways... I think?

A sense of beleaguredness, a sense that everything is decaying and dying into sinfulness - these memes are more useful for gluing together cults than for inspiring people to solve their coordination problems.

But even so - it's a thought that I have, when I see some aspect of the world going epically awry, to wonder if we're in the cluster of Earths that fail.  It's the sort of thought that inspires me, at least, to go down into that basement and solve the math problem and make everything come out all right anyway.  Because if there's one thing that the intelligence explosion really messes up, it's the dramatic unity of human progress - if this were a world with a supervised course of history we'd be worrying about making it to Akon's world through a continuous developmental schema, not making a sudden left turn to solve a math problem.

It may be that in the fractiles of the human Everett branches, we live in a failing Earth - but it's not failed until someone messes up the first AI.  I find that a highly motivating thought.  Your mileage may vary.

Comments (158)

Comment author: PhilGoetz 26 May 2009 07:57:02PM *  7 points [-]

(Michael Vassar has an extended thesis on how the scientific community in our Earth has been slowly dying since 1910 or so, but I'll let him decide whether it's worth his time to write up that post.)

I put the inflection point near 1970 instead, and a variety of reasons support this:

  • Disappearance of merit scholarships to elite universities in America

  • Explosion of the cost of attending elite universities in America

  • Explosion of income of doctors and lawyers, without any explosion of income for scientists and engineers

  • Leveling off of the US science budget, which had grown exponentially until about 1970

  • Leveling off of the number of scientists trained in the US, which grew exponentially until about 1970

  • Rise of semiconductor-related industries, which had huge commercial returns and have absorbed most commercial research investment money since then (resulting in lower return on investment for research because you need exponentially-increasing funds to get constant output in terms of important discoveries within a single field)

  • Project Hindsight concludes that basic research is a waste of money

  • US enters a prolonged period of cultural economic irresponsibility

  • NASA diverts a high percentage of US brains and research dollars into research with a very low discovery/cost ratio

  • Government regulations on business and research rise dramatically in the 1960s, e.g., FDA regulation goes from specifically naming drugs to be regulated, to requiring all drugs to prove safety and efficacy

But you might be able to come up with just as good a list for some other decade, if you tried.

Comment author: Douglas_Knight 27 May 2009 03:10:23AM 0 points [-]

You are arguing that inputs stopped increasing exponentially in 1970. MV is looking at outputs and doesn't think they're much related to inputs. In fact, I think he's worried that too much focus on inputs has lead to their separation.

Comment author: kpreid 26 May 2009 08:41:02PM 0 points [-]

Do you intend to claim the US is representative of the rest of the world?

Comment author: PhilGoetz 26 May 2009 09:07:35PM *  4 points [-]
  • I know more about the US than about the rest of the world

  • According to some statistics I've seen (which were brief, and I don't know how accurate they were), the US is, today, responsible for about as much basic research as the rest of the world combined. For instance, 309 out of 789 Nobel laureates are American; the non-American winners are dense in Literature and Peace.

Comment author: PhilGoetz 26 May 2009 07:36:07PM 6 points [-]

Indeed, our Earth's Westphalian concept of sovereign states is the main thing propping up Somalia and North Korea. There was a time when any state that failed that badly would be casually conquered by a more successful neighbor. So maybe the successful Earths don't have a Westphalian concept of sovereignty; maybe our Earth's concept of inviolable borders represents a failure to solve one of the key functions of a planetary civilization.

A point good enough to be worth extending. What things other than bits of geography do we have Westphalian borders around? As in: We agree to leave certain topics to be settled according to a certain group of people or method or belief, in exchange for them not claiming dominion over other topics.

Religion, obviously. And this has historically been a good thing. Separation of church and state.

What else?

Comment author: teageegeepea 25 May 2009 03:37:41AM 5 points [-]

Surprised no one linked to this yet on Somalia.

Comment author: billswift 25 May 2009 11:15:50PM 2 points [-]

Another interesting discussion of Somalia is in the comments here, http://esr.ibiblio.org/?p=975#comments , where Eric discusses how Somalia isn't as bad as he would have expected given what he had previously thought the necessary prerequisites for a successful anarchy to be.

Comment author: CronoDAS 26 May 2009 04:48:38AM *  3 points [-]

Doesn't Somalia simply have lots of mini-dictators in the form of local warlords and strongmen, instead of actual anarchy? In other words, something more like the feudalism that evolved in Europe after the fall of Rome, or Japan's Warring States period? (At least, that's what I'd assume you'd have, in the absence of a central authority: lots of little, local authorities.)

Comment author: Douglas_Knight 25 May 2009 10:19:57PM 2 points [-]

The blog post makes it sound like it cherry-picks 1991 "the last year of government" as representative of government, when it's the last year of war, and thus the conditions one would expect to be worst. Actually, the article acknowledges that rebellion broke out in 1988, but it still averages 1985-1990 as five years of government.

Comment author: MichaelVassar 25 May 2009 02:04:32AM 13 points [-]

Plato did advocate eugenics!

Comment author: CronoDAS 24 May 2009 09:20:18PM *  26 points [-]

Indeed, our Earth's Westphalian concept of sovereign states is the main thing propping up Somalia and North Korea. There was a time when any state that failed that badly would be casually conquered by a more successful neighbor.

I have to disagree here. First of all, North Korea has the world's third largest army. Any state that tried to conquer it would have its hands full. Additionally, counterinsurgency warfare has become damn hard these days - consider the Soviet failure in Afghanistan during the 1980s. As Stalin observed, it takes a generation and a half to pacify a country and convert it to your ideology by force.

Second, and perhaps more importantly, conquering poorly defended land isn't profitable any more; some time around World War I, conquest became far more trouble than it's worth. Nobody wants Somalia, even if the rest of the world would be okay with someone marching an army into it. It's just not worth anything. The British Empire, a more modern example of conquest for profit, never occupied Afghanistan. It would have cost far more to subdue the natives than it would ever produce in revenue. Today, far more wealth is created by Internet startups than could be stolen by a modern-day Alexander the Great or Genghis Khan.

To put the worthlessness of Somalia into perspective, here's some numbers:

  • The GNP of Somalia is $2 billion.
  • The market capitalization of Amazon.com is $32 billion. Its revenue in 2008 was $19.1 billion, and its net income was $0.64 billion.
  • Bernie Madoff convinced people to invest at least $10 billion in a completely fraudulent stock fund, and reported $50 billion in bogus returns.
Comment author: Matt_Simpson 24 May 2009 09:42:52PM 6 points [-]

To put the worthlessness of Somalia into perspective, here's some numbers:

The GNP of Somalia is $2 billion.

This is almost assuredly due to the lack of a sound institutional structure which is needed for a market economy to develop. An invading country may be able to bring this structure to Somalia.

One thing Somalia has going for it: ports. An inland neighbor would love to have ports, I'm sure.

Comment author: gwern 25 May 2009 07:51:05PM *  6 points [-]

This is almost assuredly due to the lack of a sound institutional structure which is needed for a market economy to develop. An invading country may be able to bring this structure to Somalia.

It's worth noting that before Ethiopia invaded with tacit US permission*, Somalia was being incrementally conquered and pieced back together by the Islamic Courts Union. The impression of them I got early on, before the US media began to consider them dangerous for being Islamic and fell in line behind the Ethiopian invasion, is that they did a pretty good job of governing - and certainly a better job than either the warlords or the government the Ethiopian installed.

  • Arguably a major fuckup by both parties
Comment author: CronoDAS 25 May 2009 12:40:53AM *  6 points [-]

This is almost assuredly due to the lack of a sound institutional structure which is needed for a market economy to develop. An invading country may be able to bring this structure to Somalia.

Said institutional structure would probably have to involve very few Somalis; broken governments and broken cultures tend to go hand in hand. The current attempt to introduce "rule of law" in Afghanistan is failing miserably in the face of widespread corruption. For example, local judges frequently rule in favor of whomever provides the largest bribe.

One would probably have to use Stalin-esque levels of oppression in order to successfully install such institutions in a lawless land. In the distant past, most rulers had no problems with ordering a few good massacres to keep the local population in line; it's much harder to get away with that today, although the leadership of countries like Syria and Sudan don't seem to be suffering very much.

Comment author: Matt_Simpson 25 May 2009 07:58:48AM *  3 points [-]

One would probably have to use Stalin-esque levels of oppression in order to successfully install such institutions in a lawless land. In the distant past, most rulers had no problems with ordering a few good massacres to keep the local population in line; it's much harder to get away with that today, although the leadership of countries like Syria and Sudan don't seem to be suffering very much

If the invading country can somehow manage to stay out of the public eye, they could oppress as much as they want. However, this is probably more random than anything, though if the invaders are "communist liberators" it might help - though their economic policies probably wouldn't be any good. All things considered, you're right if the conversion is by force.

Ideally, the conversion wouldn't be by force in the strong sense of the word - military police to come in and enforce some law and order, but otherwise live and let live. For this to work, the invaded country must not have any major cultural or ideological conflicts with their invaders, along with some other conditions that we don't know about. These conditions probably aren't in place for any given invader, but it remains a possibility.

Yes, the problem of developing good institutions is vexing. I doubt anyone knows much about how to do it.

Comment author: Douglas_Knight 25 May 2009 04:07:10AM 3 points [-]

Ports certainly are valuable. Ethiopia doesn't want to depend on the Eritrean ports. But it's a lot cheaper to pay taxes for Djibouti to maintain order in its port than for Ethiopia to create order in a Somali port. And to create order on the roads. Also, it's probably expensive to cross the Ogaden plateau. Which brings us to the Somali rebellion in Ogaden, which would surely escalate if Ethiopia annexed Somalia. Maybe if Ogaden gained independence, it could annex Somalia.

But mainly, it's Ethiopia's failure to claim the ports that makes me doubt their worth. I dispute Eliezer's claim that anyone would care. But some sense of propriety, perhaps Westphalian, prevents other countries from recognizing Somaliland.

Comment author: gwern 05 October 2010 05:08:27PM *  5 points [-]

I've been doing a great deal of reading about Korea lately, and I've come to almost the opposite conclusion - that North Korea is a house of cards which resembles a cross between Iraq & East Germany.

It has a large army? Rations for it have been constantly cut and it is growing disaffected; as well, Iraq shows that a large army is just a target. It has 4 divisions of special ops? That practically refutes itself. It has a large airforce? But the recent defecting jet pilot (a remarkable occurrence itself, considering that pilots are supposed to be some of the most loyal and well-treated soldiers) apparently died because his plane had too little fuel due to systemic rationing & shortages.

Insurgency? By whom? Defector surveys show that while nostalgia for Il-Sung is still very strong (similar to Russian nostalgia for Stalin or Chinese for Mao), Jong-Il is disliked thanks to the '90s famine, and his son seems to be even less popular. Further, did East Germany start endless insurgencies after unification? The wealth difference between South and North Korea seems to be even greater than between West and East Germany.

And so on. I'm starting to be persuaded that the only reason North Korea still exists is because South Korea failed to man up and relocate Seoul's contents to Busan or somewhere much further south, and the US - which has effective sovereignty over the entire peninsula even excluding the use of nukes - doesn't want to risk Seoul's loss.

Comment author: CronoDAS 05 October 2010 10:28:21PM *  3 points [-]

Yeah, it's a shitty army, but, as you said, it can still fire artillery shells. :(

As for your example of East Germany, the unification of Germany was voluntary. I don't think the average North Korean would be too happy to be conquered by, say, Japan. (And I don't think the people in East Germany would have been happy to have found themselves becoming part of France.) And insurgents don't have to be supporters of the previous regime; they could simply be out for themselves, or follow some other cause opposed to that of the occupying forces.

Mostly, though, invading North Korea just isn't in anyone's interest. There simply isn't enough wealth to steal to make it worth the billions of dollars it would cost to send an army to invade and occupy it.

Comment author: patrissimo 28 May 2009 11:52:44PM 3 points [-]

This is a great point. Conquering makes sense when natural resources are the main source of wealth in the world (think Spain and the gold & silver in the New World). It does not make sense when ideas are the main source of wealth, as they are now. Occasionally there are resources (oil) which are still worth a war, but much less often.

Comment author: nazgulnarsil 25 May 2009 06:38:42AM 3 points [-]

it takes a generation and a half to pacify a country and convert it to your ideology by force.

then how did colonialism work? it worked because the new war isn't the same as the old war. see: war in the era of squeamishness by the war nerd.

Comment author: taw 26 May 2009 05:14:08AM 3 points [-]

then how did colonialism work?

It's not obvious that colonialism was ever profitable other than as means of grabbing natural resources (especially arable land) in conquered countries.

Comment author: Douglas_Knight 26 May 2009 02:58:51PM 0 points [-]

Colonialism was profitable to the colonists if they could get someone else to pay for the soldiers. But if the army was squeamish, it would have been such a drain on the mother country, it wouldn't have stood for it.

Comment author: CronoDAS 25 May 2009 07:54:43AM 1 point [-]

"Convert to your ideology" is the key here, I think... It's damn hard to wipe out a religion, especially those, such as some variants of Christianity and Islam, that push "your religion is the only thing that matters" up to 11. If all you care about is taking their money, I suppose you could emulate what the Mongols did in Russia and let the locals mostly govern themselves as long as they pay you your tribute.

Comment author: whpearson 25 May 2009 08:17:10AM 0 points [-]

it takes a generation and a half to pacify a country and convert it to your ideology by force.

then how did colonialism work?

While I would dispute that it necessarily takes a generation and a half to pacify all countries, it has become easier to organize and carry out insurrection in this technological era, with mobile phones and high explosives.

Comment author: MichaelBishop 26 May 2009 03:05:48PM *  0 points [-]

17 points? That is how much karma CronoDAS has earned from this comment (as of this writing). Don't get me wrong, it's a fine comment, but 17 points? Maybe I should be more concerned about good comments with zero points, or stupid comments with two points, but this is one more observation leading me to question karma. If the community deems my comment a distraction, I apologize.

Sorry to pick on you CronoDAS, I'll go look through your history and vote up some of your under-valued comments.

Or maybe I'm wrong to think 17 points inappropriate, maybe I should think more on why the community judged it so highly. And/or maybe lots more comments should earn this much karma.

Added: LW is inevitably changing. One can see it in the quantity and character of top level posts, and in how posts and comments earn karma. I suggest that someone make a top level post to discuss it.

Comment author: Apprentice 26 May 2009 03:38:25PM 6 points [-]

I think the high rating of the comment is a reflection of the problem that Eliezer's post was sub-par (especially taking into account that he's, you know, brilliant). Voting up a (partial) rebuttal, even if it isn't great on its own terms, is a reasonably polite way to express this.

(But I'm very new here - this is my fourth comment - so maybe I have no idea what the dynamic is.)

Comment author: CronoDAS 27 May 2009 08:08:04PM 0 points [-]

I'm surprised, too...

Comment deleted 01 June 2009 12:23:14PM *  [-]
Comment author: Vladimir_Nesov 01 June 2009 12:34:35PM *  0 points [-]

Maybe on the successful Earths, mass genocide is acceptable in the case that the country involved is an obvious failure, such as north Korea.

This is a confusion of terms: "acceptable" is a cost-benefit calculation, and the cost of genocide is determined by human nature, by how much we value lives, independent among the Earths in this construction. If a certain variant of Earth considers genocide acceptable, it points to an epic failure of rationality (possibly due to something along the lines of scope insensitivity), and so can't be "successful".

Comment deleted 01 June 2009 01:00:13PM [-]
Comment author: Vladimir_Nesov 01 June 2009 03:16:24PM 0 points [-]

I bet there is a third option, especially if you plan for disaster in advance.

Comment author: MrHen 01 June 2009 01:55:37PM *  0 points [-]

Why are you jumping to genocide instead of just killing the people making the evil virus? What do the people have to do with the failed state?

(Edit) Oh, I hadn't travelled far enough up the tree to see CronoDAS's post. Still, a well targeted mass-destruction seems simpler than killing everyone.

Comment author: MrShaggy 25 May 2009 04:47:53AM 0 points [-]

Yeah, the idea that a certain concept of states is what explains North Korea and Somalia is wrong. Seconding the point on North Korea: it can defend itself quite well, and it's not just the size of the army. Also, compare post-Westphalian but pre-WW2 with post-WW2 to see a difference in terms of conquering other countries and redrawing borders. The difference: a deal between the US and USSR, two countries with enough power to enforce a certain kind of stability in general, and with the collapse of Stalinism leading to an uptick in the exceptions (esp. Kosovo and Russia-Georgia stuff).

Comment author: cabalamat 25 May 2009 06:11:10PM 4 points [-]

There are two other reasons why it's harder to conquer countries now than then.

  1. people are more squeamish now; using Nazi levels of brutality in putting down rebellions would attract consideral moral opprobrium

  2. wealth now comes from highly skilled information workers, who must be at least partly free if they are to be productive; whereas in the past wealth came from farmland, raw materials, and unskilled labourers. The level of repression necessary to hold a territory (and people) against its will is likely to make the acquired terroritory unproductive.

Comment author: randallsquared 25 May 2009 10:58:46PM 3 points [-]

People know now. People are watching in real time (or almost), and so it's more difficult to rationalize that no one will ever find out.

Comment author: MichaelVassar 25 May 2009 02:32:50AM 8 points [-]

The very short version of my thesis on sci/tech change is that we have exponential increases in resources devoted to science and technology as a civilization, linear returns on many scales such as life expectancy, mean IQ, log GDP (which is still of mildly diminishing utility), etc.

Low hanging fruit depletion, the standard explanation for this, is very insufficient to produce the observed effect. Many other plausible effects have been proposed that could contribute to reduced scientific progress, including but not limited to excessive time in grant-writing and existentialism, various factors increasing conformity and selection for conformity locally and globally, and increased (until recently) environmental toxicity. Dysgenics may be a minor factor, decreased variance of all sorts is almost certainly more important, as is degradation in educational standards and institutions. I suspect that economic effects that I don't have time to discuss may be more important.

Comment author: CarlShulman 25 May 2009 04:55:11AM 13 points [-]

"degradation in educational standards" And yet people are successfully learning calculus and the like at younger and younger ages, and getting higher and higher absolute scores on international math and logic tests/IQ subtests. I'd like to see you square this with Flynn.

Comment author: Psychohistorian 26 May 2009 03:14:49PM 5 points [-]

But the relative value of knowledge is falling. If I knew calculus a thousand years ago, I'd have been the most brilliant mathematician alive. A hundred years ago, it'd have been more than I'd need to know for almost any profession. Today, calculus is the beginning of serious math. I need significantly more specialized math education to really be functioning at the top (even in fields that aren't pure math).

I'm not sure our education system is getting worse in absolute terms, though it may be (math and science seem to have lost a lot of gravitas). But, in that it's not getting better, it's getting worse, because demand for highly educated workers is much higher. As compared with a "better" education system, the demand for grad school (especially in math and science) is much lower than it otherwise would be, lowering student quality and student volume in some combination, and probably increasing the average cost of training, as it fails to take advantage of returns to scale that might otherwise be present.

Not to mention public policy is generally constrained by the ignorance of the masses. If your average voter had a college (or postgrad!) level of understanding of economics, do you think policy would look like it does?

Comment author: Douglas_Knight 25 May 2009 10:27:45PM 2 points [-]

Surely the relevant educational standards of those of grad school, not high school. Scientists can use calculus, but maybe they're spending too much time mastering the same tools ("conformity").

Flynn is a good retort to environmental toxicity and dysgenics. (maybe there's increased environmental toxicity 1910-1960, and Flynn is measuring that going away)

Comment author: cabalamat 25 May 2009 06:16:48PM 2 points [-]

The Flynn effect (higher IQs across time) is entirely compatible with the observation that educational standards are falling, which does appear to be the case, at least in some countries for some subjects. For example http://cabalamat.wordpress.com/2009/03/30/do-you-see-with-you-eyes-ears-nose-or-mouth/ or http://cabalamat.wordpress.com/2007/08/31/gcses-are-dumbed-down-and-getting-worse/

Comment author: Cyan 25 May 2009 06:51:45PM *  4 points [-]

The Flynn effect isn't caused by the fact that IQ tests are getting easier. There's an upwards drift (linear in time) in average score for a given fixed test. In order for the average score to be 100 (as it is supposed to be by definition), the IQ testers have to adjust the scoring normalization periodically. The Flynn effect changes are most apparent in the lower part of the distribution -- the lowest scoring people in the current generation score much higher than those of past generations; the highest scoring people are comparable across generations.

Comment author: Douglas_Knight 25 May 2009 10:30:37PM 0 points [-]

IQ tests are getting harder and other tests (SAT, maybe GCSE) are getting easier. Flynn is stronger in fluid intelligence than crystalline. But there is supposed to be a small crystalline Flynn effect. SAT sounds like pure crystalline intelligence, yet it has the reverse effect.

This is really weird. But the Flynn effect is pretty weird on its own.

Comment author: John_Maxwell_IV 26 May 2009 01:47:09AM -1 points [-]

Vassar makes the argument that science funding is increasing exponentially, so mean intelligence scores should be increasing exponentially as well. Personally I'm not sure that science funding is increasing exponentially.

Comment author: knb 26 May 2009 02:39:25AM 2 points [-]

How does it follow that science funding and intelligence scores should be so strongly correlated?

Comment author: John_Maxwell_IV 27 May 2009 04:15:22AM *  -2 points [-]

Oh geez. Here is exactly what he wrote.

The very short version of my thesis on sci/tech change is that we have exponential increases in resources devoted to science and technology as a civilization, linear returns on many scales such as life expectancy, mean IQ, log GDP (which is still of mildly diminishing utility), etc.

In other words, one way Michael Vassar measures the success of science is by observing the ratio of change in average intelligence per year to the number of dollars spent on science per year. Even if intelligence is going up, that ratio could be going down. And if it is, our science spending is getting less efficient (according to one measure).

Got that? It's not too hard.

Edit: Why am I being downmodded? Is it because my interpretation of Michael Vassar's argument is incorrect, or because I am being overly hard on people who can't understand it, or something else? You guys are pissing me off.

Comment author: Kaj_Sotala 25 May 2009 09:56:11AM 9 points [-]

Low hanging fruit depletion, the standard explanation for this, is very insufficient to produce the observed effect.

How come?

Comment author: MichaelVassar 26 May 2009 03:46:28AM 5 points [-]

http://www.blog.sethroberts.net/2009/05/25/the-naysayers/ is pretty relevant to my claim. The point about lithium in particular.
It's implausible that part of the first few percent of the search space explored in all sorts of applications, from treating bipolar disorder to killing insects to making stockings should turn out to be best.

Comment author: Annoyance 26 May 2009 09:42:45PM 6 points [-]

Lithium is being used because it's practically the only thing that works.

Seriously, everything else that's been tried has been useless. And lithium is a terrible, terrible treatment - the blood serum levels associated with gross toxicity is only about twice the effective levels. The old sleeping pills were banned for being too dangerous, and they have a much, much greater safety margin. A twofold serum increase can occur just from dehydration. Furthermore, a significant percentage of people who go through lithium overdoses show clear signs of brain damage afterwards - presumably there're subtler forms of impairment.

Lithium treatment is thus almost certainly exploiting the very early stages of metal poisoning, rather than being a truly beneficial effect. The reason it's still used despite those disadvantages is that manic depression is so extraordinarily destructive - the mania more than the depression, even. Manic-depressives can ruin their entire lives in a few days if they go through a severe bout. And nothing else works.

The only thing research has really done for mental illnesses is rule out some of the more obvious hypotheses. We know what they aren't - we really have no more idea of what they are than we ever did. There are a few exceptions, and they belong to neurology rather than psychology.

Comment author: pjeby 26 May 2009 11:21:00PM *  0 points [-]

Lithium is being used because it's practically the only thing that works.

FFT (Family-focused Therapy), IPSRT (Interpersonal Social Rhythm Therapy), and CBT (Cognitive Behavioral Therapy) have all shown some promise in this area, actually. (Interestingly IPSRT has some crossover with Seth Roberts' "morning faces" hypotheses; part of IPSRT is regularizing social rhythms -- i.e., what faces you see when and for how long.)

Comment author: Annoyance 27 May 2009 07:56:30PM 0 points [-]

I am strongly in favor of non-pharmacological treatments - assuming they work, of course.

I have heard of those strategies before, but frankly if I had manic depression I'd be pursuing them only as adjucts and supplements to lithium. And I think the stuff is literally poison.

Comment author: Vladimir_Golovin 24 May 2009 08:16:54PM 8 points [-]

Michael Vassar has an extended thesis on how the scientific community in our Earth has been slowly dying since 1910 or so, but I'll let him decide whether it's worth his time to write up that post.)

Sounds scary. Michael, if writing up the full post will take too long, could you post a short summary / key facts here in the comments?

Comment author: nazgulnarsil 24 May 2009 08:47:59PM *  16 points [-]

after the civil war a pipeline was built from the heart of academia into the sewage of politics, hoping that the crystal pure waters of science would wash out the muck. no one remembered to install a backflow valve and the sewage of politics simply backed up into academia.

90% of grants come from the same place. You don't need conspiracy theories to explain coordination when everyone is getting checks with the same signature.

edit: before i get down modded to oblivion I'd just like to point out that standard history suffers from severe crippling hindsight bias. history properly interpreted is the search for decisions that had disproportionate impact on the future light cone. Because we dont have access to alternate presents this is extremely difficult and the standard methods strike me as guilty of the same curve fitting that evolution was in its infancy (lamarckianism, social darwinism, other sillyness).

Comment author: Pfft 26 May 2009 03:06:17AM 3 points [-]

You ought to cite the text you are quoting.

Comment author: nazgulnarsil 26 May 2009 05:20:41PM 3 points [-]

i'm genuinely curious about how other less wrong readers feel about UR. The robin/moldbug thread on OB was on a thoroughly boring subject.

Comment author: steven0461 26 May 2009 05:37:17PM 8 points [-]

i'm genuinely curious about how other less wrong readers feel about UR.

Huge fan here. Not sure that Moldbug is necessarily the most reliable thinker of good thoughts, but his good thoughts have almost no overlap with other people's good thoughts, which makes them especially informative.

Comment author: patrissimo 28 May 2009 11:57:54PM 3 points [-]

Yes, exactly. If more people were writing on Moldbug's topics (structural improvements to government, differences between past and present that we completely miss because we are surrounded only by present, shittiness of many modern institutions, especially politics and academia) I doubt I would read him. He tends to exaggerate his theses and make overly sweeping claims (the comments often have good rebuttals), and I try to avoid people who say false things, especially interesting false things. His numerous mistaken comments on prediction markets are a good example.

But in the current intellectual climate, I think he adds a lot of valuable signal. I'm not the most objective b/c his areas of interest strongly overlap with mine, but for me he's a must-read.

Comment author: rhollerith 29 May 2009 02:16:38AM *  0 points [-]

I am in tentative agreement with Moldbug's main points. But like patrissimo says, some of his claims are overly sweeping. Unlike patrissimo, I have no significant personal stake in Moldbug's being right aside from the stake we all have in the health of the state and the society in which we live.

Comment author: CronoDAS 26 May 2009 07:51:32PM 4 points [-]

I see him as an eloquent crank. He's so far out from the mainstream that I can't really endorse anything he says, but he serves as a kind of sanity check, because he makes well crafted (and, sometimes, well-cited) arguments against things people usually take for granted.

(One complaint that I do have, however, is his focus on rising crime rates. The general historical trend in homicide rates has been a steady decrease.)

Comment author: knb 27 May 2009 12:39:34AM 4 points [-]

I agree with this. I think his writings reek of "dark side epistemology". He uses a lot of florid, non-precise, language filled with obscure references that seemed designed to instill reverence rather than educate.

The irony is that I agree with him about many things, but I can't stand him because he seems far too overconfident about the accuracy of his shocking claims.

Comment author: dfranke 27 May 2009 02:06:43AM 1 point [-]

He's so far out from the mainstream that I can't really endorse anything he says

Says the guy who posts on Less Wrong...

Comment author: nazgulnarsil 26 May 2009 08:16:10PM *  1 point [-]

historical data of such a nature is worthless. if the ratio of recorded crime:crime changes how can you extract a meaningful trend? can you take into account the cost of living in areas vs the level of crime? (does it cost more or less today to buy yourself out of crime heavy areas?). trying to do induction over social data is one of the main things I'm in agreement with MM about. It's a waste of time. You can't isolate variables well enough to do proper regressions.

MM using crime as justification for widespread changes to society is one of the weird things about his position, taking into account his position on scientism in the social sciences.

Comment author: gwern 25 May 2009 07:53:08PM 3 points [-]

If you'd like a second source, you could read Charles Murray's Human Accomplishment; he dates decline in excellence to roughly the same time period, although he has no strong explanation of the statistics.

Comment author: roland 25 May 2009 06:27:24AM 2 points [-]

seconded

Comment author: Kaj_Sotala 24 May 2009 11:55:35PM 2 points [-]

Seconded.

Comment author: billswift 25 May 2009 11:25:26PM *  8 points [-]

Since the historically normal state of humanity is either static hunter-gatherer society or a crushing subsitence-agricultural poverty, even North Korea is doing fairly well. Up until about 200 years ago, there was really nothing for most people to look forward to than a life of hard, continuous labor, having hopefully at least one child survive long enough for you to pass whatever you may have accumulated to, and dying. Our world is doing pretty well. Your problem is you seem to be comparing the real world to some fantasy that you think could have been true somewhere.

Comment author: Vladimir_Nesov 26 May 2009 08:33:40AM 1 point [-]

And in this remark, you are comparing the real world to the past that is not present anymore. To understand a system, it's usually instructive to vary its properties and see what follows. If it could be worse, or better, what would it take?

Comment author: blogospheroid 25 May 2009 06:24:13AM *  4 points [-]

And yes, of course the ancient Greeks attempting such a policy could and probably would have gotten it terribly wrong; maybe the epic failed Earths are the ones where some group had the Darwinian insight and then successfully selected for prowess as warriors. I'm not saying "Go eugenics!" would have been a systematically good idea for ancient Greeks to try as policy...

And you shouldn't, too. Ancient India tried both intelligence and warriors, infact it tried a 4-fold caste system.

  • Brahmins - intellects and priests
  • Kshatriyas - Warriors and Rulers
  • Vaishyas - Merchants, traders
  • Sudras - Manual Labour.

It might have worked for a while, and probably did. Indian monuments and works of art, literature and philosophy from that period are good. Faith differences were resolved by dialogue and not by the sword. Trade happened with Egypt and China. Damascus steel originated actually in India. Surgeries took place and the traditional texts prescribed rituals for 120 yrs of life.

And some where in the past, entropy took over. Too many different tribes with different ideas came and the system could not handle them. Education became the ability to articulate properly the texts that were already in place and little new knowledge was added. The prosperity that was previously present was lost, slowly, but surely.

<Edited for formatting list>

Comment author: Eliezer_Yudkowsky 25 May 2009 06:46:49AM 4 points [-]

They were doing deliberate breeding with a notion of heredity? Or just segregation by job into union-castes? There's a big difference.

Comment author: brian_jaress 25 May 2009 09:24:51AM 2 points [-]

They were doing deliberate breeding with a notion of heredity?

Nearly everyone was doing that.

Eugenics always plays at sophistication, but it's rooted in very old (false) folk intuitions.

Comment author: blogospheroid 25 May 2009 09:28:38AM 1 point [-]

I hope I understood your question correctly..

Defenders of the caste system say that the system began just as job segregation, but that doesn't explain the endogamy that is prevalent in the system.

A majority of the people in India still have issues in marrying outside their caste.

The breeding may not have been deliberate as in blood type matching, but the duties of every caste and how a person matched the ideals of his caste were factors in deciding marriage.

Brahmins give their daughters away in marriage to learned pundits. Kshatriyas gave their daughters away in marriage to soldiers who achieved victories and kings who had territory. Vaishyas gave their daughters away in marriage to rich merchants and so on..

Deliberate notion of heridity, yes I think that is true. We match for the patrilineal and matrilineal lineage and avoid marriage with someone who is of the same patrilineal lineage for more than 3 generations and matrilineal for 1 generation.

Comment author: AllanCrossman 25 May 2009 10:15:01AM *  8 points [-]

But this isn't enough to say that India was "doing eugenics". Eugenics involves a conscious effort to ensure that people with "the desired traits" produce more children than other people. Did that occur?

Comment author: blogospheroid 25 May 2009 03:00:21PM 1 point [-]

Interesting question - Probably only in the kshatriya caste where polygyny was practiced. Not so in the other castes.

Comment author: gwern 25 May 2009 07:58:45PM 2 points [-]

OK, so India shows us one way which doesn't work so well. What should we make of other examples?

I'm sure everyone here has read at least a little about the Ashkenazi researches. What did the Jewish ghettos get right? Was the selection pressure too weak in Indian society in general? Or was shooting for multiple targets a bad thing - maybe the Sudras mixed too much with Brahmins and the net effect was nil.

Comment author: Annoyance 26 May 2009 09:36:11PM 1 point [-]

Respectfully, you're making a very big assumption there - that anything at all was "got right".

Before concluding that the eugenic forces the molded the Ashkenazi were beneficial, you should ask yourself: What did they lose?

It's very rare indeed that a population-level genetic change can take place without some tradeoffs being made.

Comment author: gwern 26 May 2009 11:06:57PM 2 points [-]

Before concluding that the eugenic forces the molded the Ashkenazi were beneficial, you should ask yourself: What did they lose?

(Well, maybe I overestimated how much people know about the Ashkenazi.)

What they got was a ridiculously high average IQ (I've seen between 120 and 130). What the population paid for this was a ridiculously high rate of diseases related to the central nervous system.

Comment author: arundelo 26 May 2009 03:50:47PM 1 point [-]

<Edited for formatting list>

List formatting help

Comment author: Annoyance 26 May 2009 09:31:35PM 4 points [-]

Selecting so that the average IQ was 140 would solve nothing. It would be just as destructive as selecting for Greek super-warriors, only more so, because intelligence is dangerous in ways rippling muscles and aggression aren't; the danger of high IQ utterly transcends the brute ability to win physical contests.

Neither IQ, nor the aspects of cognition which it represents, are the solution to our problems. They're responsible for a large part of the problems that confront us in the first place!

Comment author: JoeShipley 27 May 2009 07:35:11PM *  4 points [-]

I don't think this is the case. It seems like we keep running into problems that are more based on our biological heritage rather than our personal intelligence: For example, limitations in our ability to accept evidence that goes against 'sacred' beliefs of a group, the idea that a belief told to you by a trusted peer or authority figure is more valid than something with reputable evidence. This might have been valuable to ancient societies to maintain cohesion, but less so in a world that is increasing piles of uncomfortable evidence against some sets of beliefs.

I think many aspects of our biology seem to stack the deck against us in solving the Big Problems. Conspicuous manipulation in terms of eugenics as they implemented is a horrible crime I couldn't condone, of course, but it may have been a solution that worked if it brought us more intelligent (not in the terms of high IQ but all-around-intelligent) people. Imagine a curve of capability that increases as our knowledge increases; Having a higher baseline means we reach that much higher in the present, possibly to the necessary critical mass to reach the tumbling cascade of solutions so many people hope to see.

On the last statement, intelligence is certainly not the problem, nor is 'intelligence' responsible for the large part of problems that confront us in the first place. Intelligence is just a measure of capability, and we should hope to increase our capability even though it means also increasing the risk inherent in each individual. To hope that our intelligence would stagnate at around the current level is completely defeatist -- We aren't going to solve the problems we've created without the intelligence to deal with them.

Comment author: timtyler 24 May 2009 07:40:35PM 3 points [-]

It seems like a bit of a down post. My impression is that our position is pretty sweet. We face an almost-amazingly benign environment. Indeed, the environment seems better than we have reason to expect on anthropic grounds - curiously so, perhaps.

Comment author: timtyler 24 May 2009 09:46:59PM *  -2 points [-]

How do I reconcile this view with all the doom-sayers? I have a hypothesis about many of them. It seems to me that the same people who claim that there are great risks ahead are often the same people who have plans to RAISE THE ALARM and/or SAVE THE WORLD.

I can understand why people would want to play heroic roles, or be seen to be alerting others to danger. However, doom seems to be an event with extremely poor historical foundations. Based on these observations, my hypothesis is that the heroic effort to SAVE THE WORLD is the cause - and that proclaiming that the end is nigh is one of its effects.

Comment author: timtyler 25 May 2009 04:22:35PM *  -2 points [-]

Well, that went down well.

This is not a new phenomenon:

http://bringontheendtimes.files.wordpress.com/2009/02/end-nigh.jpg

Are there any other plausible explanations for the cult of the apocalypse?

The end of the world is, after all, probably the single most repeated incorrect prediction of all time. The world has repeatedly stubbornly refused to end for thousands of years now - and yet for many the clock always seems to stand at five-minutes-to-midnight.

Comment author: simpleton 26 May 2009 12:48:24AM 3 points [-]

The fact that we find ourselves in a world which has not ended is not evidence.

Comment author: timtyler 26 May 2009 04:56:08PM 1 point [-]

Er, I wasn't citing the existence of the world as evidence, rather pointing to the extended period of time which it has persisted for - which is relevant evidence.

Comment author: timtyler 25 May 2009 06:10:22PM 3 points [-]

Or thereabouts anyway: http://en.wikipedia.org/wiki/Doomsday_Clock

Since these are scientists you might think that they would realise someday that the clock is wrong - but no - it's been about five minutes to midnight for over 50 years! Amazing! Just think how lucky that makes us! Or maybe not - maybe this has something to do with marketing their bulletin.

Comment author: AllanCrossman 25 May 2009 04:55:02PM 1 point [-]

The difference between then and now is that today, there are actually plausible ways it could happen.

Comment author: timtyler 25 May 2009 05:52:32PM *  5 points [-]

I was wondering why p(doom) has apparently been so consistently overestimated. Perhaps another possible reason is attention-seeking. When Martin Rees mentioned a probability of 0.5 on p.8 of "Our Final Century", people paid attention. Politicians are in on the act as well - check out Al Gore. Doom sells. Perhaps scaring people shitless is simply good marketing.

Comment author: steven0461 25 May 2009 02:35:23PM 0 points [-]

the environment seems better than we have reason to expect on anthropic grounds

Could you expand on this? What quality of environment should we expect on anthropic grounds?

Comment author: timtyler 25 May 2009 02:40:30PM 1 point [-]

One that permits the evolution of intelligent agents - not necessarily one that permits them to easily spread throughout the universe.

Comment author: steven0461 25 May 2009 02:47:14PM 0 points [-]

Maybe, but I'm not really convinced. If there's a technological pathway between prehistory and space colonization, it's not a miracle for intelligence to find it; and while the complete nonexistence of such pathways might be a generic feature of planets and biospheres containing intelligence, I don't see why it necessarily would be.

Comment author: timtyler 25 May 2009 03:23:27PM 1 point [-]

It clearly isn't necessarily so, if we are a counter-example, as I am assuming.

I don't claim to have a hard scientific case for my statement. I'm just stating my impression - that we seem to have it pretty sweet, perhaps sweeter than we should reasonably expect.

Comment author: alvarojabril 29 May 2009 05:54:38AM *  1 point [-]

"Indeed, our Earth's Westphalian concept of sovereign states is the main thing propping up Somalia and North Korea."

Sure it is. It hasn't got anything to do with nukes/quagmire. I remember the Westphalian concept of sovereignty propping up Iraq in the spring of '03. How we laughed and laughed. Oh, Westphalia, you dog! I particularly enjoyed the part when Eliezer suggested that what Somalia needs is more Ethiopias.

There's a severe paucity of imagination in this post, or maybe empathy is the word I'm looking for. This planet doesn't fail Eliezer's space opera, it fails people.

Can someone tell me when going into the basement and solving the math problem has made "things turn out all right"? What I'm trying to point out is that SMARTS AREN'T SUFFICIENT. There's always a political framework around those smarts, and it directs them to ill or to good. There's far too little attention paid to this on the site.

"Of course the camel could also have three or more humps, and it's quite easy to imagine Earths that are failing much worse than this, epic failed Earths ruled by the high-tech heirs of Genghis Khan or the Catholic Church."

I would again submit that the relative rapacity and tyranny of our contemporary overlords is a matter of perspective.

"It's a cheap pleasure to wax moralistic about failures of global coordination."

I agree! I'd prefer to wax moralistic about the horrors of global coordination. Before we get to friendly AI we'd better get a grip on friendly I.

The "More Right" parody site is long overdue.

Comment author: CannibalSmith 25 May 2009 01:10:13PM 0 points [-]

PORN ALERT

Comment author: Vladimir_Golovin 25 May 2009 01:56:58PM *  0 points [-]

Explanation for those who don't understand the comment above:
http://www.wordspy.com/words/climateporn.asp

Comment author: Eliezer_Yudkowsky 25 May 2009 03:06:16PM 3 points [-]

Dude, climate change doesn't even register on my radar except for the effects that it has on discourse, such as people sadly assuming that any talk of "global coordination" is about climate change. If all humanity had to worry about was CO2 in the atmosphere...

Comment author: Vladimir_Golovin 25 May 2009 03:13:34PM *  0 points [-]

Of course I didn't mean that you're concerned about climate -- I just wanted to clarify for non-native English speakers that the word "porn" can be used in a non-sexual context (it seems that I have done it in a misleading way), and the "climate porn" is the most frequent example of such usage, as far as I can tell.

Comment author: steven0461 25 May 2009 03:16:29PM 2 points [-]

I still don't get Cannibal's comment. Is all pessimism porn?

Comment author: Vladimir_Nesov 25 May 2009 03:21:28PM 0 points [-]

Or, for that matter, is all negativity pessimism?

Comment author: CannibalSmith 26 May 2009 09:50:23AM 0 points [-]
Comment author: Nominull 24 May 2009 05:31:46PM 1 point [-]

Well, there is that Playstation advertising slogan, "Live in your world, play in ours."

Comment author: nazgulnarsil 24 May 2009 08:44:58PM 1 point [-]

we don't have much of a choice about generalizing from one example in this case.

considering the space of all possible worlds I wouldn't hesitate to put us in the top 10^-30%

Comment author: Emile 25 May 2009 07:50:03AM *  2 points [-]

I assume you're talking about "worlds, whether they include humans or not", otherwise what you're saying seems very very dubious.

Eliezer seems to be talking more about "worlds that include humans", which is a more interesting category.

Comment author: randallsquared 26 May 2009 04:00:23AM 1 point [-]

I dunno about 10^-30, but top 5% seems easy. After all, if you posit that it only took about 10K years for civilization from scratch (and long periods of that were stagnant or in reverse, so I think it's actually much less), and if we take 200K years as the total of human span so far, then we have only about 1 in 20 of the 10K periods we know of in which civilization was developed. If you consider Neanderthals and other hominids separately, it's lower, and that's just technological development. I think it's really peculiar that nuclear weapons and weaponized bio agents haven't been used more, either one of which has the potential to erase civilization, in theory.

In spite of Eliezer's apparent optimism about how much better was possible, I think it's likely that we're clearly in the successful group.

Comment author: JoeShipley 28 May 2009 12:50:39AM 1 point [-]

This strikes a bad chord with me.

We don't accept any scientific explanation that resides on 'Maybe we're just in a particularly rare or special configuration in the universe where this particular thing happens.' We assume we're in an average position in the universe and understand our observations from that framework because it's not good science to just assume you are special or unique and settle for that.

The probability of us just happening to be in the top # of universes out of an absolutely Vast number of universes seems highly unlikely if we have an even given chance of being any of those given universes. Given a set so huge, the vast majority of the cases are, by definition, average and we have no reason to assume we are not an average member of the set.

It disturbs me in some way to think of a universe where nobody has ever had a loved one die, been in a car accident or even accidentally spilled milk. But if every possible configuration must be real, that would mean there is not just one of these universes but a Vast number of them where some of them just had their first car wreck today... Living in one of these ridiculous disturbing branches would probably fantastically screw with your idea of reality.

If instead of by political and social organization and unity of purpose we sorted by 'number of unfortunate events happening' like above, it's intuitive to think we seem to be around the average: nothing ridiculously unlikely seems to persist in our universe, probability seems to roll exactly like we'd expect.

Comment author: nazgulnarsil 28 May 2009 02:18:44AM 1 point [-]

i appreciate the interesting response. here's how I think of it. If you have a one in a million event happen every day you might suspect that something is up with probability. But you can't neglect the fact that there could very well be a million different one in a million events. I dont think observing unlikely events makes it more likely that something weird is going on with your particular universe. just that the search space of unlikely events is large enough that you'll wind up seeing quite a few of them.

Comment author: Vladimir_Nesov 28 May 2009 11:53:58AM *  0 points [-]

Assuming that you are typical may turn out to be as bad as assuming you are special. Any "assuming" is approximation, and depending on the problem the approximation may be either adequate or infinitely disastrous. That's what happens with doomsday argument, for example.

The values of probabilities of specific situations don't particularly matter if you don't approximate. The preference is for actions (i.e. areas in state space) with highest average utility (according to probability measure), independently of the probability measure of those areas as whole.

That is, if you have a huge event, something that can be predicted to happen very likely, with a certain average utility (weighted by probability), and a tiny event with significantly higher average utility, the tiny event is preferred. Ignoring the tiny event because of its tiny probability measure leads to losing that opportunity.

Comment author: JoeShipley 28 May 2009 03:45:23PM 0 points [-]

I agree, but you still need evidence for the tiny event you are ignoring. Acting on the assumption that you are special/in a unique situation without any justification other than a blind guess and a worry that you are neglecting the opportunity is dangerous. It's the <a href="http://en.wikipedia.org/wiki/Mediocrity_principle">mediocrity principle</a>: When we tend to assume something amazing about ourselves, like that the Earth is the center of the universe, we end up finding out otherwise.

Contrast with the anthropic principle, in that we know we must account for the universe being capable of supporting at least one type of intelligent life. The number of ways that could go wrong are already gigantic, so we've already hit the jackpot at once. How many times in a row do we win the lottery?

I see what you mean with the tiny event with high utility, but I mean compare:

1) Driving or walking slightly out of your way for 1 extra minute a day to check if a certain apartment building has opened up a unit you are looking to rent (Low chance, but no reason to squander the opportunity for small cost.)

2) Picking up every piece of paper you see, on the chance that some number of the pieces of paper could be lottery tickets and some number of those tickets could be winning ones. (Extremely high utility, extremely low chance, and most importantly, you don't have any reason to assume or guess somebody is around discarding used lottery tickets: You just know that it is possible.)

The chances described here are above and beyond the second. The top 10^-30% is a truly minuscule set out of the whole. (If still a Vast upon imagining set because we are dealing with Everett branches...) If we are in a particularly special branch, how do we take advantage of that? What useful information does that give us? At worst it will mislead our understanding of the universe and at best it is barely noticeable.

Comment author: Rain 25 May 2009 07:12:58PM *  -1 points [-]

How do you know that this earth doesn't need a North Korea so that people have an appropriate example of how not to do things? And perhaps the global economic crash is saving us from future, even worse, collapses by allowing us to put in regulation before true catastrophe happens.

Perhaps failure, as an aspect of learning, must occur in many ways and through many times to properly teach every generation how to act and how to better themselves and the planet. A 'successful Earth' where North Korea and economic collapses don't exist may just be a fantasized Utopia (as linked in your post), when what we need to access a better future is a Weirdtopia that includes them as counterexamples or pressure points for change.

Comment author: AndrewH 27 May 2009 10:37:06PM 1 point [-]

WRT eugenics and other seemly nasty solutions, it is as they say: sometimes it has to get worse to get better. No option that causes, obvious to the voting population, short term harm but long term benefits, to the population as a whole, is going to be considered by politicians that want to be elected again.

It seems to me that the science and rationality that allow more than a shot in the dark probability of some social engineering project to work only came about recently (for example for Eugenics, post Darwin time). By the time that it was possible to do these sorts of projects, it was not possible to do them because of the national (and international) out-crying that would result.

So this really cuts off a great many possible projects that could benefit humanity in the long term. Is this a good or bad? depends on how far you are looking into the future, and whether or not you think AGI is possible or not!

I hope those nine guys in that basement are working hard.

Comment author: Ryan 27 May 2009 09:35:51AM 1 point [-]

Agreed we're in the successful group, easily. Sucks that NK exists as it is, but they are isolated and have no way to expand or threaten the world system. The fact that we can have websites like this, and people actually can sit in the basement and work on the math means we are doing well, up to this point at least.

My guess is more of the failed earths were long ago. Like humans continue to wander around in small tribes for millions of years and never get beyond stone-age technology. We are eventually wiped out by a meteor or some such.

Comment author: PhilGoetz 27 May 2009 07:18:42PM *  1 point [-]

My guess is that there is a bottleneck still ahead of us.

Evolution => intelligence => complexity => instability => collapse

Many people here seem to think increasing intelligence will help us solve our problems. History indicates that increasing intelligence will increase the number and severity of our problems.

Comment author: JoeShipley 28 May 2009 12:55:45AM *  1 point [-]

Phil, I'm sorry if this sounds negative, but I don't understand this attitude at all. Intelligence is how accurately you can mine the information of the past in order to predict the future. You can't possibly think that all of our problems would go away if you gave everybody in the world a lobotomy? Or is there just some preferable lower-limit to intelligence we should engineer people to?

I think the historical problems with intelligence is an uneven increase in different fields or typical misuse. This isn't a problem with the tool, but the protocols and practices surrounding it.

Comment author: Annoyance 29 May 2009 06:35:24PM 3 points [-]

Intelligence is how accurately you can mine the information of the past in order to predict the future.

Very few people would claim that is an adequate definition of intelligence. The fact that there is a substantial clique of such people here, at this site, does not constitute a validation of the definition.

Comment author: JoeShipley 29 May 2009 07:09:39PM 1 point [-]

Well, let's look at the short list google gives us:

the ability to comprehend; to understand and profit from experience

Capacity of mind, especially to understand principles, truths, facts or meanings, acquire knowledge, and apply it to practice; the ability to learn and comprehend.

Intelligence is an umbrella term used to describe a property of the mind that encompasses many related abilities, such as the capacities to reason, to plan, to solve problems, to think abstractly, to comprehend ideas, to use language, and to learn.

My definition was:

To mine information from the past in order to predict the future.

My definition is certainly more broad, but I think it breaks down to the same thing. In order to do anything in the list you have to use resources of past experience in order to apply information for future experience. I've been using that definition roughly since 'Consciousness Explained' came out, and I've never been in a discussion with somebody who felt it was a ridiculous way of describing the functional nature of intelligence especially in terms of biological utility. Do you just dislike summation and want a long, drawn out definition?

Either way, no matter which definition you use, the capabilities granted by extra intelligence do not generate extra problems, but help you mitigate the problems that come up. I don't really understand the criticism in context with the discussion.

Comment author: alvarojabril 29 May 2009 07:27:54PM *  1 point [-]

Joe, what you are forgetting is that human beings are not governed solely by their intelligence. I think Annoyance was referring to a sort of moral intelligence which isn't in your definition.

And intelligence doesn't generate extra problems? Ever hear of the Cuban Missile Crisis? Or, say, pollution?

Comment author: JoeShipley 29 May 2009 08:00:58PM 2 points [-]

I think those problems weren't caused by too much intelligence, but by too little. I know, intelligence enables these problems to form in the first place -- These entities wouldn't be making the problems if they weren't volitional agents with intelligence, but that seems like a kind of cop-out complaint -- Without intelligence there wouldn't be any problems, sure, but there also wouldn't be anything positive either, no concepts whatsoever.

Pollution is a great example: It's intelligent thought that allowed us to start making machines that polluted. Intelligence allowed us to realize we could capitalize on the well-being of the environment and save money by trashing it.

More intelligence realizes that this is still a value trade off, that you aren't getting something for nothing -- Depending on the rate at which you do this, you could seriously damage yourself and the people around you for the trade-off. You have to weigh the costs with the benefits, and if the benefit is 'some money' and the cost is 'destroying the world', the intelligent choice becomes clear. To continue to act for the money isn't intelligence, it's just insanity, overpowering greed.

The cuban missile crisis may have been caused by intelligence building the structures that led up to it, but the solution wasn't making everyone dumber so they couldn't build that kind of thing -- that just reduces overall utility. The solution is to act intelligently in ways that don't destroy the world.

I see your point about moral intelligence being considered separately though, I hadn't thought of that in the context. It's a more elegant package to wrap everything up together, but not always the right thing to do... Thanks for the reply.

Comment author: alvarojabril 29 May 2009 08:16:41PM *  0 points [-]

So you agree that yes, intelligence is continually generating "extra problems" for us to deal with. As you point out, many of the most pressing problems in the modern world are unforeseen consequences of useful technologies. You just believe that increases in human intelligence will invariably outpace the destructive power of the problems, whereas I don't.

The premise of this diary was many earths, so I'd submit that certainly there are many earths for which the problem of nuclear warfare outpaced humanity's capacity to intelligently deal with it, and that in the end we could very well share their fate.

I'll also note that I fail to see how anyone could conclude from what I've written above that my prescription for humanity is stupid pills.

Comment author: JoeShipley 29 May 2009 08:20:22PM *  1 point [-]

I agree completely. If intelligence-generated problems cannot outpace the solutions total destruction awaits.

I apologize if the stupid pill characterization feels wrong, I just was trying to think of a viable alternative to increasing intelligence.

Comment author: alvarojabril 29 May 2009 08:32:59PM 0 points [-]

I'm glad we've hashed this out. I think that bias about the messianic/apocalyptic role of technology has largely been overlooked on this site, so I was glad to see this entry of Eliezer's.

Regardless of whether or not they're true I tend to think that arguments about the arc of history etc are profoundly counterproductive. People won't vote if they think it's a landslide, either for their guy or against. And I suspect I differ from others on this site in this respect, but I find it hard to get ginned up about cosmic endeavors, simply because they seem so remote from my experience.

And I don't think we need an alternative! What I was trying to point out from the start was that increasing our predictive ability is necessary but not sufficient to save the world. Entirely selfish, entirely rational actors will doom the planet if we let them.

Comment author: cousin_it 05 June 2009 11:16:38AM *  2 points [-]

Devil's advocate mode!

This isn't a problem with the tool, but the protocols and practices surrounding it.

Joe, I couldn't discern any verifiable meaning in this sentence. Both the tool and the protocols/practices contribute to the problem.

You can't possibly think that all of our problems would go away if you gave everybody in the world a lobotomy?

No more nukes. No more surveillance states. No more military/police robots. No more AI threat, nanotech threat, biotech threat. A lobotomy for everyone would increase our chances of surviving the century as a species.

I guess most people would object to an intelligence decrease because they feel it would make them worse off. In a world where growth of intelligence and knowledge leads to multiple high-probability scenarios of global collapse, this stance looks eerily equivalent to defecting in the Prisoner's Dilemma. I wonder what Eliezer, an outspoken proponent of cooperating, would say about global lobotomies viewed in this light.

Comment author: PhilGoetz 01 June 2009 02:47:26AM 0 points [-]

It's not an "attitude".

If everyone's intelligence were increased, and society stayed the same, and society's problems stayed the same, that higher intelligence would do better at solving today's problems than our current intelligence.

But society wouldn't stay the same, and society's problems wouldn't stay the same. People would come up with more complicated organizations, more complicated laws, more complicated financial interactions (credit default swaps), more complicated social roles, et cetera.

We can only hope there is a level of intelligence at which people can appreciate this effect, and design societies that will avoid black swan crashes even at the cost of everyone's expected personal gain.

Comment author: conchis 27 May 2009 09:59:56AM 1 point [-]

but they are isolated and have no way to expand or threaten the world system.

Well, except for the nukes.

Comment author: PhilGoetz 26 May 2009 08:02:57PM -2 points [-]

The best empirical estimate we have for the probability that the Earth will not fail, is the fraction of Earth-like planets around us that have succeeded. (Zero.)

That said, they don't seem to have failed after achieving AI, so I don't know if that really tells us much.

Comment author: dclayh 27 May 2009 10:54:39PM *  0 points [-]

What are you considering "Earth-like planets"? I'm an astronomer and I'm not aware of any (under the usual definition of 0.5-10 Earth masses, with an equilibrium temperature allowing liquid water).

(And I would explain my vote on this post, but doing so in the absence of a request by the poster seems to be a downvotable offense.)

Comment author: PhilGoetz 09 June 2009 03:46:53AM 0 points [-]

We've located enough planets nearby to infer that there are a large number of planets somewhat nearby that could support life.

Comment author: PhilGoetz 27 May 2009 07:20:30PM *  0 points [-]

I'm curious why people hate this comment so much. Is it just that they don't like hearing that we're likely to fail?

I'm also curious why most people haven't upvoted this post by EY. Same reason?

Comment author: Nick_Tarleton 27 May 2009 07:32:26PM 1 point [-]

I didn't downvote your comment, but for me, "they don't seem to have failed after achieving AI, so I don't know if that really tells us much" is an overwhelmingly strong objection to drawing any conclusion about existential risk from the Great Silence.

Comment author: PhilGoetz 09 June 2009 03:44:51AM 0 points [-]

If it's an overwhelmingly strong objection, why would people downvote me for raising it?

Comment author: JoeShipley 27 May 2009 11:07:29PM -1 points [-]

It seems like we have a sample set of zero, as successes are not by definition or axiom noticeable. Certainly possibly noticeable but not required to be so. Failures are also not required to be noticeable. No earth-like planets sustaining life or having evidence of having sustained life have been documented yet. The probability estimate is useless, with a total margin of error.

Comment author: Rain 25 May 2009 07:26:07PM 0 points [-]

The extremely negative aspects of human history should be added in as priors to point to a fairly negative future, up to and including the realization of a man-made existential risk.

Comment author: Ttochpej 30 May 2009 06:13:40PM -1 points [-]

I'd like to suggest an idea from "The Hitch hikers Guide to the Galaxy" and look at our earth as a big computer and people and all its problems as just being parts of the program. I think if you look at it this way and think of all the failures just being the program checking all possible solutions then instead of thinking the earth is failing heaps you can think we've checked out a lot of the different possibility's. If you think of it as in your political systems you have a group of parties, you pick the best two, take there ideas and combine them to produce your government. 3 years later they all come back with new ideas and do it again. That seems a lot like genetic programming to me.

I also think it's interesting to consider the possibility of passing as a Utopian world without the current technology of this world, If there are other worlds in this universe and if there was a Star Trek type of society of aliens that existed I think they would be waiting for the other earths to figure out all their ethical and social problems and perfect those problems before they introduced them self's, not waiting for them to invent technology that they had already invented.

Comment author: MrHen 30 May 2009 04:40:06AM 0 points [-]

It may be that in the fractiles of the human Everett branches, we live in a failing Earth - but it's not failed until someone messes up the first AI. I find that a highly motivating thought. Your mileage may vary.

Perhaps I am missing something obvious (I am severely underversed in MWI), but we cannot see any of the other Earth's, right? Why are we supposed to assume that they are succeeding or failing? If I just need to read up on MWI let me know and ignore this comment.

Bullet-pointed because I like thinking that way:

  • What, exactly, does failed mean?
  • Why does it matter if Earth is failed? Can we do anything about it or is it once failed, always failed?
  • Why do other Earths matter? Are we being compared to them? Can we study them or learn from them?

But visualizing the alternative Everett branches of Earth, spread out and clustered - for me, at least, that seems to help trigger my mind into a non-Simon-and-Garfunkel mode of thinking. If the successful Earths lack a North Korea, how did they get there? Surely not just by signing a piece of paper saying they'd never fight again.

Is the answer to "how did they get there?" possible to achieve?

Comment author: taw 26 May 2009 08:14:30AM 0 points [-]

According to CIA 2008 estimates life expectancy in North Korea is 71.92, which is far higher than global average and even slightly higher than that of EU members Romania and Latvia. HDI for North Korea is only available for 1995 where it was 0.766. Both figures show that life in North Korea is somewhere in the middle of modern world, far better than in real third world, and vastly better than historical average.

It seems to me that North Korea was used as an example for its connotations, not denotations - that's a cheap trick that we should be avoiding.

Comment author: CarlShulman 26 May 2009 03:55:47PM 3 points [-]

Maybe 7 figure death tolls from famine didn't occur in those two years (definitely not 2008), since life expectancy is calculated based on death rates within the different age categories in the particular year. If every fifth year 20% of the population is slaughtered, that could actually raise life expectancy for most years if the death disproportionately affected the unhealthy (as famine might).

Comment author: taw 26 May 2009 04:05:10PM 1 point [-]

According to Wikipedia North Korea had positive population growth even during the famine, so this cannot be the explanation. Even if life expectancy figure for North Korea is too high for some reasons, it still seems to be far better than for most real failed third world countries, especially in Africa.

Comment author: CarlShulman 26 May 2009 05:11:47PM 2 points [-]

Positive population growth means the addition of more low-mortality babies into the population. But certainly if the figures are to be trusted (like the claims of Kim Il Sung's supernatural powers?) that could only explain a portion.

Comment author: Eliezer_Yudkowsky 26 May 2009 01:09:19PM 3 points [-]

This, um, sounds pretty suspicious to say the least. I can possibly see life expectancy in NK being better than life in Somalia, because at least in NK you've only got one dictator to worry about. But as a rationalist, I must indicate confusion and suspicion of the data.

Comment author: taw 26 May 2009 03:21:38PM 4 points [-]

CIA and WHO life expectancy estimates of poor countries differ a lot, I have no intention of arguing which is correct, however by both estimates of life expectancy, and by most other quality of life estimates, North Korea is far above most of Africa, in many cases including rich African countries like South Africa.

I think the reasons you and many other people think North Korea is so bad come from exposure to media. American and Western European media have political reasons to dislike North Korea, and no reason to care at all about most failed countries like Sierra Leone or Lesotho. And "evil oppressive government" is much easier to turn into a good sensational story than run of the mill "thousands of children died of diarrhea because they didn't have access to clean water" - in North Korean story there's a clear evil villain, in Africa there isn't.

As far as I can tell, government oppression tends to be focused on small number of people who are considered (truthfully or not) politically dangerous, and quality of life of most people isn't strongly affected - due to information scarcity I cannot be sure if that's true about North Korea, but it was definitely true about European Communist countries.

Typical third world economic oppression (low GDP + high income inequality + no social safety net) affects larger number of people, and as far as I can tell causes a lot more suffering. And these are pretty much the standard living conditions of humanity for most of the human history, so considering them some sort of spectacular failure would seem rather weird.

Comment author: Apprentice 26 May 2009 02:32:36PM *  1 point [-]

This might be hard to reliably estimate but the WHO gives North Korean life expectancy as 66 years. That doesn't confuse me or make me particularly suspicious.

I wouldn't be surprised if life expectancy on North Sentinel Island is significantly lower but it's possible that average happiness over there is higher. Which society would you prefer your child to be born into, if you had a choice between those two?

Comment author: steven0461 26 May 2009 11:55:17AM 1 point [-]

Are you serious?

Comment author: astray 26 May 2009 05:05:26PM *  0 points [-]

If you look at NK in conjunction with South Korea, it begins to look a lot worse.

(At the same time, you can look at Kenya relative to Somalia and it is just as unflattering.)

Comment author: nazgulnarsil 25 May 2009 01:25:26PM 0 points [-]

what does it say about your nation when your country's capital has by far the highest crime rates in the nation? (Washington D.C.)

Comment author: dclayh 27 May 2009 10:50:41PM 2 points [-]

Well, when DC was founded it was intended to have a permanent population of zero, plus a few servants and slaves. Everything pretty much flowed from there.