John_Maxwell_IV comments on Good Quality Heuristics - Less Wrong

13 Post author: CannibalSmith 14 July 2009 09:53AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (112)

You are viewing a single comment's thread. Show more comments above.

Comment author: John_Maxwell_IV 15 July 2009 05:06:52AM *  1 point [-]

Quote from brainworkshop.sourceforge.net:

In the original study, participants showed up to 40% gains in measured fluid intelligence scores after 19 days of daily practice.

Fluid intelligence is considered one of the two types of general intelligence. The other is crystallized intelligence. See http://en.wikipedia.org/wiki/Fluid_and_crystallized_intelligence

Comment author: Z_M_Davis 15 July 2009 06:05:56AM *  5 points [-]

participants showed up to 40% gains in measured fluid intelligence scores

' * sputters *

What does that even mean? I know what it means for a rock to be 40% heavier than some other rock, or for a car to be travelling 40% faster than some other car, and I know what it means to go from the fiftieth percentile to the ninetieth percentile, but saying that subjects got 40% more items right on some particular test tells me nothing useful; we only care about the test insofar as it gives us evidence about this intelligence-thingy, and the raw score gives me no basis for comparison. Looking at the actual PNAS paper (hoping that I'm competent to read it), it looks like the experimental group saw a gain of 0.65 standard deviations (Cohen's d) on a test of Gf, said figure which actually tells me something---if we assume a Gaussian distribution, then a score in the fiftieth percentile among the untrained would be in the twenty-fifth percentile amongst the trained. (The control group also gained 0.25 standard deviations, probably due to a retest effect.)

Huh. d=0.65 is pretty impressive ...