Don't estimate your creative intelligence by your critical intelligence

39 PhilGoetz 05 February 2015 02:41AM

When I criticize, I'm a genius. I can go through a book of highly-referenced scientific articles and find errors in each of them. Boy, I feel smart. How are these famous people so dumb?

But when I write, I suddenly become stupid. I sometimes spend half a day writing something and then realize at the end, or worse, after posting, that what it says simplifies to something trivial, or that I've made several unsupported assumptions, or claimed things I didn't really know were true. Or I post something, then have to go back every ten minutes to fix some point that I realize is not quite right, sometimes to the point where the whole thing falls apart.

If someone writes an article or expresses an idea that you find mistakes in, that doesn't make you smarter than that person. If you create an equally-ambitious article or idea that no one else finds mistakes in, then you can start congratulating yourself.

How Islamic terrorists reduced terrorism in the US

13 PhilGoetz 11 January 2015 05:19AM

Yesterday I was using the Global Terrorism Database to check some suprisingly low figures on what percentage of terrorist acts are committed by Muslims. (Short answer: Worldwide since 2000, about 80%, rather than 0.4 - 6% as given in various sources.) But I found some odd patterns in the data for the United States. Look at this chart of terrorist acts in the US which meet GTD criteria I-III and are listed as "unambiguous":



There were over 200 bombings in the US in 1970 alone, by all sorts of political groups (the Puerto Rican Liberation Front, the Jewish Defense League, the Weathermen, the Black Panthers, anti-Castro groups, white supremacists, etc., etc.) There was essentially no religious terrorism; that came in the 80s and 90s. But let's zoom in on 1978 onward, after the crazy period we inaccurately call "the sixties". First, a count of Islamic terrorist acts worldwide:

Islamic terrorist acts worldwide
This is incomplete, because the database contains over 400 Islamic terrorist groups, but only let me select 300 groups at a time. (Al Qaeda is one of the groups not included here.) Also, this doesn't list any acts committed without direct supervision from a recognized terrorist group, nor acts whose perpetrators were not identified (about 77% of the database, estimated from a sample of 100, with the vast majority of those unknowns in Muslim countries). But we can see there's an increase after 2000.

Now let's look at terrorist acts of all kinds in the US:

Terrorist acts in the US, 1970-2013

We see a dramatic drop in terrorist acts in the US after 2000. Sampling them, I found that except for less than a handful of white supremacists, there are only 3 types of terrorists still active in the US: Nutcases, animal liberation activists, and Muslims. If we exclude cases of property damage (which has never terrified me), it's basically just nutcases and Muslims.

Going by body count, it may still be an increase, because even if you exclude 9/11, just a handful of Muslim attacks still accounted for 50% of US fatalities in terrorist attacks from 2000 through 2013. But counting incidents, by 2005 there were about 1/3 as many per year as just before 2000. From 2000 to 2013 there were only 6 violent terrorist attacks in the US by non-Islamic terrorist groups that were not directed solely at property damage, resulting in 2 fatalities over those 14 years. Violent non-Islamic organized terrorism in the US has been effectively eliminated.

Some of this reduction is because we've massively expanded our counter-terrorism agencies. But if that were the explanation, given that homeland security doesn't stop all of the Islamic attacks they're focused on, surely we would see more than 6 attacks by other groups in 14 years.

Much of the reduction might be for non-obvious reasons, like whatever happened around 1980. But I think the most-obvious hypothesis is that Islamic terrorists gave terrorism a bad name. In the sixties, terrorism was almost cool. You could conceivably get laid by blowing up an Army recruiting center. Now, though, there's such a stigma associated with terrorism that even the Ku Klux Klan doesn't want to be associated with it. Islamists made terrorism un-American. In doing so, they reduced the total incidence of terrorism in America. Talk about unintended consequences.



On a completely different note, I couldn't help but notice one other glaring thing in the US data: terrorist acts attributed to "Individual" (a lone terrorist not part of an organization). I checked 200 cases from other countries and did not find one case tagged "Individual". But half of all attributed cases in the US from 2000-2013 are tagged "Individual". The lone gunman thing, where someone flips out and shoots up a Navy base, or bombs a government building because of a conspiracy theory, is distinctively American.

Perhaps Americans really are more enterprising than people of other nations. Perhaps other countries can't do the detective work to attribute acts to individuals. Perhaps their rate of non-lone wolf terrorism is so high that the lone wolf terrorists disappear in the data. Perhaps we're more accepting of "defending our freedom" as an excuse for shooting people. Perhaps psychotic delusions of being oppressed don't thrive well in countries that have plenty of highly-visible oppression. But perhaps Americans really do have a staggeringly-higher rate of mental illness than everyone else in the world. (Yes, suspicious study is suspicious, but... it is possible.)

Dark Arts 101: Be rigorous, on average

15 PhilGoetz 31 December 2014 12:37AM

I'm reading George Steiner's 1989 book on literary theory, Real Presences. Steiner is a literary theorist who achieved the trifecta of having appointments at Oxford, Cambridge, and Harvard. His book demonstrates an important Dark Arts method of argument.

So far, Steiner's argument appears to be:

  1. Human language is an undecidable symbol-system.
  2. Every sentence therefore carries with it an infinite amount of meaning, the accumulation of all connotations, contexts, and historical associations invoked, and invoked by those invocations, etc. Alternately, every sentence contains no meaning at all, since none of those words can refer to things in the world.
  3. The meaning of a sentence, therefore, is not finite or analyzable, but transcendent.
  4. The transcendent is the search for God.
  5. Therefore, all good literature is a search for God.

The critics quoted on the back of the book, and its reviews on Amazon, praise Steiner's rigor and learning. It is impressive. Within a single paragraph he may show the relationship between Homer, 12th-century theological works, Racine, Shakespeare, and Schoenberg. And his care and precision with words is exemplary; I have the impression, even when he speaks of meaning in music or other qualia-laden subjects, that I know exactly what he means.

He was intelligent enough to trace the problems he was grappling with out past the edges of his domain of expertise. The key points of his argument lie not in literary theory, but in information theory, physics, artificial intelligence, computability theory, linguistics, and transfinite math.

Unfortunately, he knows almost nothing about any of those fields, and his language is precise enough to be wrong, which he is when he speaks on any of those subjects. How did he get away with it?

Answer: He took a two-page argument about things he knew little about, spread it across 200 pages, and filled the gaps with tangential statements of impressive rigor and thoroughness on things he was expert in.

continue reading »

Every Paul needs a Jesus

9 PhilGoetz 10 August 2014 07:13PM

My take on some historical religious/social/political movements:

  • Jesus taught a radical and highly impractical doctrine of love and disregard for one's own welfare. Paul took control of much of the church that Jesus' charisma had built, and reworked this into something that could function in a real community, re-emphasizing the social mores and connections that Jesus had spent so much effort denigrating, and converting Jesus' emphasis on radical social action into an emphasis on theology and salvation.
  • Marx taught a radical and highly impractical theory of how workers could take over the means of production and create a state-free Utopia. Lenin and Stalin took control of the organizations built around those theories, and reworked them into a strong, centrally-controlled state.
  • Che Guevara (I'm ignorant here and relying on Wikipedia; forgive me) joined Castro's rebel group early on, rose to the position of second in command, was largely responsible for the military success of the revolution, and had great motivating influence due to his charisma and his unyielding, idealistic, impractical ideas. It turned out his idealism prevented him from effectively running government institutions, so he had to go looking for other revolutions to fight in while Castro ran Cuba.

The best strategy for complex social movements is not honest rationality, because rational, practical approaches don't generate enthusiasm. A radical social movement needs one charismatic radical who enunciates appealing, impractical ideas, and another figure who can appropriate all of the energy and devotion generated by the first figure's idealism, yet not be held to their impractical ideals. It's a two-step process that is almost necessary, to protect the pretty ideals that generate popular enthusiasm from the grit and grease of institution and government. Someone needs to do a bait-and-switch. Either the original vision must be appropriated and bent to a different purpose by someone practical, or the original visionary must be dishonest or self-deceiving.

continue reading »

Why humans suck: Ratings of personality conditioned on looks, profile, and reported match

10 PhilGoetz 09 August 2014 06:48PM

The recent OKCupid blog, which gwern mentioned in Media Open Thread, investigated the impact of three different factors on users' perceptions of each other: authority (reported match %), profile text (present or absent), and looks.

continue reading »

The rational way to name rivers

2 PhilGoetz 06 August 2014 03:41PM

I just read this in the Wikipedia article on the Mattaponi River and it really tickled me. If only all language were so rational!

  • The Mat River and the Ta River join in Spotsylvania County to form the Matta River;
  • The Po River and the Ni River join in Caroline County to form the Poni River;
  • The Matta River and the Poni River join in Caroline County to form the Mattaponi River.

The dangers of dialectic

11 PhilGoetz 05 August 2014 08:02PM

I'm reading The Last Intellectuals: American culture in the age of academe by Russell Jacoby (1987). It contains many interesting and important observations and insights, but also much stupidity. By the last chapter, I was as interested in the question of how a person can be so smart and stupid at the same time as in the author's actual arguments.

continue reading »

Fifty Shades of Self-Fulfilling Prophecy

18 PhilGoetz 24 July 2014 12:17AM

The official story: "Fifty Shades of Grey" was a Twilight fan-fiction that had over two million downloads online. The publishing giant Vintage Press saw that number and realized there was a huge, previously-unrealized demand for stories like this. They filed off the Twilight serial numbers, put it in print, marketed it like hell, and now it's sold 60 million copies.

The reality is quite different.

continue reading »

Too good to be true

24 PhilGoetz 11 July 2014 08:16PM

A friend recently posted a link on his Facebook page to an informational graphic about the alleged link between the MMR vaccine and autism. It said, if I recall correctly, that out of 60 studies on the matter, not one had indicated a link.

Presumably, with 95% confidence.

This bothered me. What are the odds, supposing there is no link between X and Y, of conducting 60 studies of the matter, and of all 60 concluding, with 95% confidence, that there is no link between X and Y?

Answer: .95 ^ 60 = .046. (Use the first term of the binomial distribution.)

So if it were in fact true that 60 out of 60 studies failed to find a link between vaccines and autism at 95% confidence, this would prove, with 95% confidence, that studies in the literature are biased against finding a link between vaccines and autism.

continue reading »

What should a Bayesian do given probability of proving X vs. of disproving X?

0 PhilGoetz 07 June 2014 06:40PM

Consider some disputed proposition X. Suppose there appeared to be a limited number of ways of proving and of disproving X. No one has yet constructed a proof or disproof, but you have a feeling for how likely it is that someone will.

For instance, take Fermat's Last Theorem or the 4-color problem. For each of them, at one point in time, there was no proof, but people had some sense of the prior probability of observing the lack of a counterexample given the space searched so far. They could use that to assign a probability of there being a counterexample (and hence a disproof) [1]. Later, there was an alleged proof, and people could estimate the probability that the proof was correct based on the reputation of the prover and the approach used. At that point, people could assign values to both P(will_be_proven(X)) and P(will_be_disproven(X)).

Is it reasonable to assign P(X) = P(will_be_proven(X)) / (P(will_be_proven(X)) + P(will_be_disproven(X))) ?

If so, consider X = "free will exists". One could argue that the term "free will" is defined such that it is impossible to detect it, or to prove that it exists. But if one could prove that the many worlds interpretation of quantum mechanics is correct, that would constitute a disproof of X. Then P(will_be_proven(X)) / (P(will_be_proven(X)) + P(will_be_disproven(X))) = 0.

Is it possible for this to happen when you know that X is not undecidable? If so, what do you do then?

 

1. The computation is not as simple as it might appear, because you need to adjust for the selection effect of mathematicians being interested only in conjectures with no counterexamples.

View more: Prev | Next