LESSWRONG
LW

Careers
Personal Blog

104

You Are Not Hiring the Top 1%

by Eliezer Yudkowsky
2nd Mar 2007
2 min read
12

104

Careers
Personal Blog

104

You Are Not Hiring the Top 1%
3Gobby
3JMG3Y
14kickstand
4rcriii
2Eliezer Yudkowsky
15Robert_Scarth
1Doug_S.2
9Matt_Simpson
2Stuart_Armstrong
0taryneast
0Alan2
2rdh
New Comment
12 comments, sorted by
oldest
Click to highlight new comments since: Today at 11:15 PM
[-]Gobby19y30

Wow.

I read Joel's article a while back, but I see now that I didn't really grasp the idea. That's pretty profound. Gotta think about that.

And maybe submit a few grant proposals ....

Reply
[-]JMG3Y19y30

And papers. First, it goes to that top journal, the one with the highest citation index, on a wing and a prayer. Then when the almost inevitable rejection slip comes, the paper is reformatted, the reviewers comments are sort of addressed, and goes to the next journal on the list. And so on until ultimately, unless it is really a turkey, it is provisionally accepted, subject to addressing the reviewers' comments at least in the editor's mind. Again the comments are addressed and it becomes another line on the CV.

On the other hand, some of the 20% in "Teaching vs Research" thread on Greg Mankiw's blog were rejected over and over because they were such paradigm shifts. Sort of like picking the cream of the crop students. Some who are picked are duds (false positives) and some of the rejected ones go on to do great work at other institutions (false negatives), leaving one to wonder how good the selection process really is but not being able to do any really good controlled trials to find out.

Reply
[-]kickstand19y140

Consider this: 99% of the human population knows nothing about programming. Thus, any programmer you hire is in the top 1%.

Reply
[-]rcriii19y40

When you get 200 resumes, and hire the best person, does that mean you're hiring the top 0.5%? Think about what happens to the other 199 that you didn't hire.

This assumes that you (1) know what constitutes the best person, (2) that you are even capable of identifying that person, and (3) that the best person for you is the best for all.

To me the problem in hiring is not finding the best 1% (or 5 or 10%), but sorting the good from the bad. Once you have the good, then the problem of which are good for you almost sorts itself out.

Reply
[-]Eliezer Yudkowsky19y20

rcriii, the original "Joel on Software" post discusses that part.

Reply
[-]Robert_Scarth19y151

This might also explain why some women often think that "all men are bastards" - there are a few cads out there in continual circulation and with no intention to settle down, whereas men with honourable intentions have much fewer relationships, and settle down more quickly.

Reply
[-]Doug_S.219y10

There are an awful lot of awful novice writers out there, though; just go to www.fanfiction.net and start reading. On the other hand, there are a couple of really brilliant writers there, too.

Reply
[-]Matt_Simpson14y90

Looks at date of comment. Heh.

Reply
[-]Stuart_Armstrong19y20

Any company who think they are hiring the top 1% are deluded or maybe microsoft. Any company that actually try and really hire the top 1% are heading for swift bankruptcy - you can't afford to take the time and effort to get "the best" of anything in business; you have to go with something that's good and fast.

But people do give up after a while if they can't get anywhere (especially in academia). Maybe you can help overcome the bias if there is some way of measuring how often people have applied in the past?

Reply
[-]taryneast14y00

Nah - Microsoft aren't (not for ten years at least). google and facebook are, though.

Reply
[-]Alan216y00

As a writer, I know the slush pile example is a good one. But I always try to edit and improve a rejected story before sending it on, especially if I've had constructive comments from the editor. Hopefully enough people do this to skew the bias back again, if only a little bit!

Reply
[-]rdh2y20

And, all academic papers everywhere... inverse survival of the fittest in a sense.

It is annoying spending time on reviews while realizing that the paper will just move on to the next journal, likely without incorporating any of your feedback.

Reply
Moderation Log
More from Eliezer Yudkowsky
View more
Curated and popular this week
12Comments

Today's statistical fallacy (slightly redacted by editor) comes from Joel on Software:

Everyone thinks they're hiring the top 1%.  Martin Fowler said, "We are still working hard to hire only the very top fraction of software developers (the target is around the top 0.5 to 1%)."  I hear this from almost every software company. "We hire the top 1% or less," they all say.  Could they all be hiring the top 1%? Where are all the other 99%? General Motors?

When you get 200 resumes, and hire the best person, does that mean you're hiring the top 0.5%?  Think about what happens to the other 199 that you didn't hire.  They go look for another job.

The entire world could consist of 1,000,000 programmers, of whom the worst 199 keep applying for every job and never getting them, but the best 999,801 always get jobs as soon as they apply for one. So every time a job is listed the 199 losers apply, as usual, and one guy from the pool of 999,801 applies, and he gets the job, of course, because he's the best, and now, in this contrived example, every employer thinks they're getting the top 0.5% when they're actually getting the top 99.9801%.

I'm exaggerating a lot, but the point is, when you select 1 out of 200 applicants, the other 199 don't give up and go into plumbing (although I wish they would... plumbers are impossible to find). They apply again somewhere else, and contribute to some other employer's self-delusions about how selective they are.

This might explain some other phenomena I've heard of, such as the "slush heap" of inconceivably awful stories received in the mail by every fiction publisher that accepts unsolicited manuscripts.  When a story is good enough to be published, it's accepted and removed from the system.  Otherwise the hapless author sends it to another publisher!

Perhaps most novice writers aren't quite as dreadful (on average) as editors seem to believe?  Editors will disproportionately encounter the work of novice writers who are not only awkward, but so incompetent as to be unaware of their own incompetence, and so proud that they can't take a hint.

PS:  Two other areas where this might apply:  Students who apply to your program/department for admission.  And, grant proposals.

PPS:  Robert Scarth comments, "This might also explain why some women often think that 'all men are bastards' - there are a few cads out there in continual circulation and with no intention to settle down, whereas men with honourable intentions have much fewer relationships, and settle down more quickly."

Mentioned in
8[SEQ RERUN] Policy Debates Should Not Appear One-Sided
5[SEQ RERUN] You Are Not Hiring the Top 1%