itsunder9000 comments on (Virtual) Employment Open Thread - Less Wrong

35 Post author: Will_Newsome 23 September 2010 04:25AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (276)

You are viewing a single comment's thread. Show more comments above.

Comment author: itsunder9000 24 October 2010 11:36:44PM 1 point [-]

Want some brutally truthful tests designed to see how competent you are?

Take the SAT test, , which measures math ability, and verbal ability. Find a few psychology tests that try and measure memorization ability(like, how quickly and well you can memorize a topic)

Why? Because real world success, in intellectual endeavors, is largely a combination of how large your fluid intelligence is+memorization ability+ work ethic. The rest is due to combos of other factors.

Besides the SAT, you can take the LSAT, and study for a few things on there that require specific knowledge. The test is the single largest predictive factor of success in law school, and blind tests of competence.

There are a few other tests you can take. I recommend the AMC, which requires studying some topics outside of the regular school curriculum, but not too much.

Or, you could play starcraft for 3 months, and see how high you end up ranking.

Beyond these,I don't know of many good tests to see how competent you are.

Comment author: katydee 25 October 2010 06:04:26AM 3 points [-]

Are you joking? Starcraft isn't even a well-designed game-- it has all kinds of crazy barriers to entry and elements that explicitly exist to make it unnecessary difficult for people to pick up. Besides, it's easy for even a bad gamer (see: me) to achieve a high-looking ranking (top 25 Diamond) in Starcraft II thanks to its nonintuitive rating and placement system, and true rankings are only maintained for the top 200 people in each region.

Comment author: Will_Newsome 25 October 2010 03:48:41AM 2 points [-]

Yeah, I've done many of those. I took the SAT when I was 12. I've taken a few probably-inaccurate online IQ tests. I've done a few cognitive testing suites at SIAI. I'm in pretty good shape. In general though, there are better frameworks for cognitive testing. It's probable that one could make a neat suite out of PEBL, which is free and very customizable. Fluid g seems over-emphasized. The limiting factor for most rationalists tends to be strong metadispositions for thought, reflection, and drive.

Comment author: topynate 25 October 2010 04:45:26AM 0 points [-]

I've done a few cognitive testing suites at SIAI.

They have those?

Comment author: Will_Newsome 25 October 2010 08:34:00AM 0 points [-]

They're ad hoc, we've used one for a dual n-back study which ended up yielding insufficient data.

Comment author: gwern 27 October 2010 10:21:08PM *  2 points [-]

Any chance you could write up that study? I don't believe I have seen any SIAI-related DNB study; certainly it's not in my FAQ.

(Remember kids: only you can fight publication bias!)

Comment author: Will_Newsome 28 October 2010 04:10:37AM 0 points [-]

We didn't study long enough to get any statistically significant data. Like, not even close. And I think sending off the data (even without names attached) would sorta breach an implicit privacy agreement among those who took part in the tests.

Comment author: gwern 28 October 2010 02:24:37PM 0 points [-]

Jaeggi 2008 didn't necessarily study very long either, some around/less than a week.

(I wouldn't be asking this question, by the way, if you had written more concretely and said something like 'We only studied for 2 days, not long enough to get any statistically significant data'.)

Comment author: JoshuaZ 28 October 2010 04:13:24AM 0 points [-]

Hmm, most people would be ok with that sort of data being sent out in an anonymized form. I'm surprised that you didn't suggest that before hand. Is there any chance you can contact the people in question and get their permission to release the anonymized data?

Comment author: Will_Newsome 28 October 2010 04:24:21AM 0 points [-]

Is there any chance you can contact the people in question and get their permission to release the anonymized data?

We could, but really, there's no information there, no matter how much Bayes magic you use. It's noise. If the data was at all significant then we'd send it out, of course. We might actually have gotten anonymized disclosure agreement from everyone; I don't remember. But it didn't end up mattering.

Comment author: NancyLebovitz 25 October 2010 12:08:52PM 1 point [-]

Shouldn't doing something successfully in the real world be in there somewhere?

Comment author: Relsqui 30 October 2010 01:02:46AM 0 points [-]

Take the SAT test, , which measures math ability, and verbal ability

and wealth.

Comment author: itsunder9000 30 October 2010 05:10:34AM 0 points [-]

Read "the bell curve"

basically, smart parents were more likely to go to a higher ranking school, and move themselves up in the social heirarchy.

Smart people tend to have smart kids. Dumb people tend to have dumb kids. Hence, the scores.

For the race aspect of this, you can find the stats where poor east asian kids do better than rich white kids.At least on the math portion.

Comment author: topynate 30 October 2010 01:58:41AM *  0 points [-]

Yeah, but that only matters from a self-assessment standpoint if the causal graph is wealth --> score <-- ability, whereas for an uncoached entrant it's almost purely wealth --> ability --> score.

Comment author: Relsqui 30 October 2010 03:38:49AM 0 points [-]

Fair enough.

Comment author: lmnop 30 October 2010 02:04:50AM *  0 points [-]

whereas for an uncoached entrant it's almost purely wealth --> ability --> score.

And coaching can't make up a large part of the score difference, either. There's more than 100 points discrepancy on Critical Reading or Math alone between the lowest and highest income groups, whereas coaching only creates improvements of 30 points in Reading and Math combined.