V_V comments on 2012 Survey Results - Less Wrong

80 Post author: Yvain 07 December 2012 09:04PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (640)

You are viewing a single comment's thread. Show more comments above.

Comment author: V_V 03 December 2012 10:00:22PM -1 points [-]

someone's capacity and habits to re-compute a problem's answer, using the algorithmic mind, rather than accept the intuitive default answer that their autonomous mind spits out.

I don't think you could really apply any 'algorithmic' method to that question (other than looking it up, but that would be cheating). It was a test on how much confidence you put in your heuristics. (BTW, It seems that I've underestimated mine, or I've been lucky, since I've got the date off by one year but estimated my confidence at 50% IIRC). Still, it was a valuable test, since most of human reasoning is necessarily heuristic.

most people in the general public don't know Bayes' theorem

Really? What probability do you assign to that statement being true? :D

I'm under the impression that Bayes' theorem is included in the high school math programs of most developed countries, and I'm certain it is included in any science and engineering college program.

Comment author: Swimmer963 04 December 2012 04:01:53AM 5 points [-]

most people in the general public don't know Bayes' theorem

Really? What probability do you assign to that statement being true? :D

I assign about 80% probability to less than 25% of adults knowing Bayes theorem and how to use it. I took physics and calculus and other such advanced courses in high school, and graduated never having heard of Bayes' Theorem. I didn't learn about it in university, either–granted, I was in 'Statistics for Nursing', it's possible that the 'Statistics for Engineering' syllabus included it.

Comment author: dbaupp 04 December 2012 11:53:07AM 2 points [-]

Only 80%?

In the USA, about 30% of adults have a bachelor's degree or higher, and about 44% of those have done a degree where I can slightly conceive that they might possibly meet Bayes' theorem (those in the science & engineering and science- & engineering-related categories (includes economics), p. 3), i.e. as a very loose bound 13% of US adults may have met Bayes' theorem.

Even bumping the 30% up to the 56% who have "some college" and using the 44% for a estimate of the true ratio of possible-Bayes'-knowledge, that's only just 25% of the US adult population.

(I've no idea how this extends to the rest of the world, the US data was easiest to find.)

Comment author: Swimmer963 04 December 2012 04:25:38PM 0 points [-]

You did your research and earned your confidence level. I didn't look anything up, just based an estimate on anecdotal evidence (the fact that I didn't learn it in school despite taking lots of sciences). Knowing what you just told me, I would update my confidence level a little–I'm probably 90% sure that less than 25% of adults know Bayes Theorem. (I should clarify that=adults living in the US, Canada, Britain, and other countries with similar school systems. The percentage for the whole world is likely significantly lower.)

Comment author: Eugine_Nier 05 December 2012 05:42:20AM 1 point [-]

adults living in the US, Canada, Britain, and other countries with similar school systems.

I hear Britain's school system is much better than the US's.

Comment author: Jayson_Virissimo 05 December 2012 12:59:57PM 4 points [-]

Once you control for demographics, the US public school system actually performs relatively well.

Comment author: Eugine_Nier 06 December 2012 04:35:43AM 3 points [-]

Good point.

Comment author: Larks 09 January 2013 02:08:17PM 0 points [-]

The UK high school system does not cover Bayes Theorem.

Comment author: Thasvaddef 09 January 2013 03:23:43PM 1 point [-]

If you choose maths as one of your A-levels, there's a good chance you will cover stats 1 which includes the formula for Bayes' Theorem and how to apply it to calculate medical test false positives/false negatives (and equivalent problems). However it isn't named and the significance to science/rationality is not explained, so it's just seen as "one more formula to learn".

Comment author: Larks 09 January 2013 04:01:49PM 1 point [-]

Offhand, 1/2 young people do A levels, 1/4 of those do maths, and 2/3 of those do stats, giving us 1/12 of young people. I don't think any of these numbers are off by enough to push the fraction over 25%

Comment author: Peterdjones 09 January 2013 03:25:51PM -1 points [-]

the significance to science/rationality is not explained,

Maybe you guys could solve that problem by publishing some results demonstrating its exteme significance

Comment author: DaFranker 09 January 2013 03:45:53PM *  4 points [-]

As far as I know, it's been formally demonstrated to be the absolutely mathematically-optimal method of achieving maximal hypothesis accuracy in an environment with obscured, limited or unreliable information.

That's basically saying: "There is no possible way to do better than this using mathematics, and as far as we know there doesn't yet exist anything more powerful than mathematics."

What more could you want? A theorem proving that any optimal decision theory must necessarily use Bayesian updating? ETA: It has been pointed out that there already exists such a theorem. I could've found that out by looking it up. Oops.

Comment author: [deleted] 10 January 2013 01:56:22PM *  3 points [-]

What more could you want? A theorem proving that any optimal decision theory must necessarily use Bayesian updating?

There already is such a theorem. From Wikipedia:

A decision-theoretic justification of the use of Bayesian inference was given by Abraham Wald, who proved that every Bayesian procedure is admissible. Conversely, every admissible statistical procedure is either a Bayesian procedure or a limit of Bayesian procedures.

Comment author: Peterdjones 05 December 2012 12:53:39PM 0 points [-]

It's not great by international standards, but I have heard that the US system is particularly bad for an advanced country.

Comment author: thomblake 05 December 2012 08:28:57PM 3 points [-]

I have heard that the US system is particularly bad for an advanced country.

In terms of outcomes, the US does pretty terribly when considered 1 country, but when split into several countries it appears at the top of each class. Really, the EU is cheating by considering itself multiple countries.

Comment author: [deleted] 09 January 2013 04:40:23PM 3 points [-]

The EU arguably is more heterogeneous than the US. But then, India is even more so.

Comment author: Nornagest 05 December 2012 08:38:26PM 3 points [-]

How's it being split?

Comment author: thomblake 05 December 2012 09:10:16PM 0 points [-]

I actually thought someone would dig up and provide the relevant link by now. I'll have to find it.

Comment author: Peterdjones 05 December 2012 08:50:04PM 0 points [-]

it appears at the top of each class

You mean comparing poorer states to poorer countries?

Comment author: Jayson_Virissimo 05 December 2012 01:03:46PM 3 points [-]

Actually it is quite good (even for an "advanced country") if you compare the test scores of, say, Swedes and Swedish-Americans rather than Swedes and Americans as a whole.

Comment author: Swimmer963 05 December 2012 02:32:24PM 2 points [-]

I wonder what that's controlling for? Cultural tendencies to have different levels of work ethic?

Comment author: Peterdjones 05 December 2012 08:10:33PM 1 point [-]

Hmmm. So it's "good" but people with the wrong genes are spoiling the average somehow.

Comment author: V_V 18 December 2012 04:05:20PM 0 points [-]

I took physics and calculus and other such advanced courses in high school, and graduated never having heard of Bayes' Theorem.

Must be a problem of the American school system, I suppose.

I didn't learn about it in university, either–granted, I was in 'Statistics for Nursing', it's possible that the 'Statistics for Engineering' syllabus included it.

Did they teach you about conditional probability? Usually Bayes' theorem is introduced right after the definition of conditional probability.

Comment author: Eugine_Nier 04 December 2012 01:35:17AM 3 points [-]

I'm under the impression that Bayes' theorem is included in the high school math programs of most developed countries,

Well, it's certainly not included in the US high school curriculum.

Comment author: CarlShulman 31 December 2012 02:27:12AM 2 points [-]

most people in the general public don't know Bayes' theorem

Really? What probability do you assign to that statement being true? :D

There are national and international surveys of quantitative literacy in adults. The U.S. does reasonably well in these, but in general the level of knowledge is appalling to math teachers. See this pdf (page 118 of the pdf, the in-text page number is "Section III, 93") for the quantitative literacy questions, and the percentage of the general population attaining each level of skill. less than a fifth of the population can handle basic arithmetic operations to perform tasks like this:

One task in this level, with a difficulty value of 332, asks the reader to estimate, based on information in a news article, how many miles per day a driver covered in a sled-dog race. The respondent must know that to calculate a “ per day” rate requires the use of division. A more difficult task (355) requires the reader to select from two unit price labels to estimate the cost per ounce of creamy peanut butter. To perform this task successfully, readers may have to draw some information from prior knowledge.

People who haven't learned and retained basic arithmetic are not going to have a grasp of Bayes' theorem.

Comment author: MugaSofer 09 January 2013 12:56:55PM 0 points [-]

most people in the general public don't know Bayes' theorem

Really? What probability do you assign to that statement being true? :D

I'm under the impression that Bayes' theorem is included in the high school math programs of most developed countries, and I'm certain it is included in any science and engineering college program.

I'm pretty sure Ireland doesn't have it on our curriculum, not sure how typical we are.

Comment author: [deleted] 09 January 2013 01:50:40PM 1 point [-]

I'm under the impression that Bayes' theorem is included in the high school math programs of most developed countries, and I'm certain it is included in any science and engineering college program.

It was in my high school curriculum (in Italy, in the mid-2000s), but the teacher spent probably only 5 minutes on it, so I would be surprised if a nontrivial number of my classmates who haven't also heard of it somewhere else remember it from there. IIRC it was also briefly mentioned in the part about probability and statistics of my "introduction to physics" course in my first year of university, but that's it. I wouldn't be surprised if more than 50% of physics graduates remember hardly anything about it other than its name.