Eliezer_Yudkowsky comments on Negative and Positive Selection - Less Wrong

71 Post author: alyssavance 06 July 2012 01:34AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (262)

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 05 July 2012 02:13:26AM 4 points [-]

What my externally observable percentiles look like:

  • Writing: 99+%
  • Math: 99+%
  • Conceptual originality: 99+%
  • Programming: 95%
  • Conformity / ability to obey incorrect orders: 20%

What my educational credentials look like:

  • Highest level of education completed: 8th grade
Comment author: MBlume 05 July 2012 05:48:14AM 12 points [-]

Programming: 95%

I'm with J and Alex -- are you comparing yourself to people or to programmers? I'm fairly sure FizzBuzz puts one well above 95% in the general population

Comment author: Eliezer_Yudkowsky 05 July 2012 07:04:09AM 0 points [-]

Programmmers.

Comment author: cousin_it 05 July 2012 12:47:29PM *  17 points [-]

Is the 99+% for math also compared to mathematicians?

Comment author: Eliezer_Yudkowsky 05 July 2012 06:04:35PM 6 points [-]

That'd be a much harder question to answer; my talent is specialized toward figuring out the shape of the right theorem to be proved, not the actual proof which is where most modern math concentrates its prestige. (This is an objectively verifiable form of mathematical talent; it means that sometimes Marcello would prove something and I would look at it and say, "That doesn't look right" and at least half the time there'd be a mistake.) I feel insecure about not being an expert in the tools by which most modern mathematicians measure basic competence; I can also apparently make "well, if that's your problem, try transforming it this way" suggestions to someone doing graduate mathematical research at Yale that are accepted as brilliant. I confidently depose that, even taking unusual talents into account, I am not in the literal top tier of mathematical potential - if I can explain basic Bayes better than anyone or was first to state the Lob problem or invented TDT, those outputs drew on at least some non-mathematical high-percentile sections of my brain (explanatory ability in the first case, or what's somewhat vaguely referred to as "philosophical" talent in the other two). I'm also reasonably confident that, given a hundred modern mathematicians, an average of zero will pick the right problem to solve.

I think I'm comfortable at this point with saying that I'm in the top 99+% of writers - I've been picking up "real" books and trying to read them and finding that they seem visibly badly-written to me now that I've written HPMOR. Though I'm still not in the literal top tier; there are basic things in writing that I still don't do too well, despite being outstanding in others, and my new level of skill is just enough to start noticing that Neil Gaiman and Terry Pratchett are doing things way the hell above me.

Comment author: DanArmak 05 July 2012 06:47:16PM 11 points [-]

That'd be a much harder question to answer

"What did you mean when you said 99%" should not be a hard question to answer. "Which alternative is correct" may be hard, but did you have in mind "one alternative is correct but I don't know which"?

Comment author: NancyLebovitz 07 July 2012 01:05:52PM 4 points [-]

Have you written anything about the process of figuring out the shape of the theorem to be proved, and/or identifying the plausibility of a theorem?

Comment author: Tyrrell_McAllister 05 July 2012 09:46:48PM *  2 points [-]

That'd be a much harder question to answer; my talent is specialized toward figuring out the shape of the right theorem to be proved, not the actual proof which is where most modern math concentrates its prestige.

Being able to give some actual proofs is a prerequisite of prestige. But it's not clear to me that it's right to say that mathematics concentrates its prestige there. See, for example, Fields Medalist Timothy Gower's article The Two Cultures of Mathematics (pdf):

The “two cultures” I wish to discuss will be familiar to all professional mathematicians. Loosely speaking, I mean the distinction between mathematicians who regard their central aim as being to solve problems, and those who are more concerned with building and understanding theories.

...

Let me now briefly mention an asymmetry similar to the one pointed out so forcefully by C. P. Snow. It is that the subjects that appeal to theory-builders are, at the moment, much more fashionable than the ones that appeal to problem-solvers.

Comment author: komponisto 05 July 2012 09:59:04PM 0 points [-]

I suspect the distinction Eliezer is making is more akin to the controversial "theoretical vs. experimental" one proposed by Jaffe and Quinn than the traditional "theory-builder vs. problem-solver" one discussed by Gowers.

Comment author: Tyrrell_McAllister 05 July 2012 10:31:39PM 0 points [-]

It's been years since I read the Jaffe–Quinn article. But, as I recall, it was more about the methods used to answer questions, and about how rigorous human-verifiable proofs might give way to heuristic/probabilistic and computer-aided proofs. Eliezer, on the other hand, seemed to be saying that mathematicians concentrate prestige on answering questions (by whatever means the community considers to be adequate), as opposed to "figuring out the shape of the right theorem to be proved".

Comment author: komponisto 05 July 2012 10:45:36PM 0 points [-]

Jaffe and Quinn mainly advocate that labor should be divided between people who make conjectures ("theoreticians") and people who prove them ("experimentalists"). I don't think there is much of anything about probabilistic or computer-aided proofs.

Comment author: Tyrrell_McAllister 05 July 2012 11:31:01PM *  1 point [-]

You are right. Looking at the Jaffe–Quinn paper again, it is closer to the distinction that Eliezer was making. (However, I note that the mathematical "theoreticians" in that article are generally high-prestige, and the "rigorous mathematicians" have to fight the perception that they are just filling in details to results already announced.)

My mischaracterization of Jaffe and Quinn's thesis happened because (1) Thurston replied to their article, and he discusses computer-aided proofs in his reply; and (2) even more embarrassingly, I conflated the Jaffe–Quinn article with the Scientific American article The Death of Proof, by John Horgan.

Comment author: [deleted] 06 July 2012 09:28:12PM *  1 point [-]

figuring out the shape of the right theorem to be proved, not the actual proof which is where most modern math concentrates its prestige.

Many geniuses have a bad reputation for checking all the details and writing them down. Kontsevich and Thurston are good examples. People complain about this but the status hierarchy isn't much affected by those complaints. Low-status mathematicians don't often get away with Thurston's attitude, but nor do they accumulate status by being more conscientious.

Comment author: CronoDAS 06 July 2012 05:13:22PM 1 point [-]

my new level of skill is just enough to start noticing that Neil Gaiman and Terry Pratchett are doing things way the hell above me.

I once got this feeling reading Stephen R. Donaldson's The Runes of the Earth - that this was a level of writing that was way beyond what I could see myself reaching. Oddly, I didn't get this feeling when reading Terry Pratchett, even though I still think that Terry Pratchett is probably a better writer than, say, Shakespeare.

And I don't know what people see in American Gods - I've read over one hundred books I think were better. And I mean that literally; if I spent a day doing it, I could actually go through my bookshelves and write down a list of one hundred and one books I liked more. I couldn't do that for most of Terry Pratchett's novels.

Comment author: Eliezer_Yudkowsky 06 July 2012 08:06:04PM 1 point [-]

I also tried American Gods for a while and found that its charm was mostly lost on me - maybe I didn't get far enough in. Good Omens, on the other hand...

Understand, I always knew that Good Omens was a great book and that I wasn't yet writing that well; it's only now that I'm staring at a Neil Gaiman short story, thinking, "I can tell that he's doing something outstandingly right here that I'm not doing, but it's hard to say exactly what..."

Comment author: NancyLebovitz 07 July 2012 01:02:50PM 1 point [-]

Gaiman frequently doesn't grab me, though I think "A Study in Emerald" is brilliant.

I wish American Gods had been written by someone who understood and liked America better. Why was the computer god a marketing monster rather than a programmer? Or a computer? And I know it's not fair to blame a writer for not writing a different book, but I'd like to see a version of the idea with the guts to engage with actual American religions.

Comment author: TheOtherDave 06 July 2012 08:58:12PM 1 point [-]

American Gods is pretty evenly written; if it didn't grab you in the first fifty pages or so it was probably never going to. (I say this as someone who fell in love with it and considers it among my favorite of his work.)

Comment author: CronoDAS 07 July 2012 12:14:05AM 1 point [-]

I blame the SeinfeldIsUnfunny effect. I've seen GodsNeedPrayerBadly done so many other times that it seemed like a cliche.

Comment author: Desrtopa 07 July 2012 03:02:36AM 1 point [-]

Personally, I disliked that trope even before I'd seen it enough times for it to seem cliche, but I count American Gods among my favorites of Gaiman's work in spite of it.

Comment author: TheOtherDave 07 July 2012 01:12:47AM 0 points [-]

Perhaps. It was far from being my introduction to that trope, but I found it worth reading for something other than the originality of that particular idea. Still, different people like different things in their art.

Comment author: Alicorn 06 July 2012 05:34:50PM 1 point [-]

Oddly, I don't like Gaiman much at all on his own, and I don't like large doses of Pratchett either, but I loved Good Omens - they balanced each other's weaknesses.

Comment author: MBlume 06 July 2012 08:01:13PM 3 points [-]

they balanced each other's weaknesses.

Not at all like this

Comment author: [deleted] 09 July 2012 07:45:28AM 0 points [-]

Oh wow, I have the exact opposite reaction; I love both Gaiman and Pratchett separately, but dislike Good Omens-- they undercut each other's strengths.

I tend to describe it as: "They have a similar worldview, but Gaiman is dark, whereas Pratchett is light. When you put them together the result is a rather bland gray."

Comment author: randallsquared 16 July 2012 02:13:09PM 0 points [-]

I've read over one hundred books I think were better. And I mean that literally; if I spent a day doing it, I could actually go through my bookshelves and write down a list of one hundred and one books I liked more.

I've read many, many books I liked more than many books which I would consider "better" in a general sense. From the context of the discussion, I'd think "were better" was the meaning you meant. Alternatively, maybe you don't experience such a discrepancy between what you like and what you believe is "good writing"?

Comment author: CronoDAS 16 July 2012 10:46:16PM 1 point [-]

A book can be well written and still be bad because of other flaws. Nathaniel Hawthorne's The Scarlet Letter was very well written in a technical sense, but the story itself was boring as hell and Hawthorne's skill couldn't save it.

Comment author: Desrtopa 06 July 2012 08:46:06PM 0 points [-]

I think I'm comfortable at this point with saying that I'm in the top 99+% of writers - I've been picking up "real" books and trying to read them and finding that they seem visibly badly-written to me now that I've written HPMOR. Though I'm still not in the literal top tier; there are basic things in writing that I still don't do too well, despite being outstanding in others, and my new level of skill is just enough to start noticing that Neil Gaiman and Terry Pratchett are doing things way the hell above me.

What of Pratchett's work are you judging by? Middle-Pratchett is top tier, but I'm much less impressed with recent-Pratchett (going back at least a few years before the Alzheimer's diagnosis.)

I get the feeling that a lot of the top experts at writing aren't necessarily experts on writing, because they can and do lose their touch without noticing that something is wrong.

Comment author: DanArmak 05 July 2012 06:43:41PM 4 points [-]

What published software have you written that I should look at? A quick Google search comes up with this, listing Flare and Document Designer. Is there something different you'd rather be known for and judged by?

Incidentally, Googling "Eliezer Yudkowsky software" also returns this link, which is someone's search on pricegrabber.com for "Rationally Speaking Eliezer Yudkowsky Bayles" [sic] for which pricegrabber returns the Dragon Naturally Speaking software. I don't know why this is near the top of Google results, but it Rationally Speaking sounds like a real-life Eliezer Yudkowsky Fact...

Comment author: wedrifid 05 July 2012 07:47:02PM 1 point [-]

What published software have you written that I should look at? A quick Google search comes up with this, listing Flare and Document Designer. Is there something different you'd rather be known for and judged by?

95% of programmers don't have published personally published software.

Comment author: fubarobfusco 05 July 2012 11:56:08PM 3 points [-]

A more general form of the question: "What publicly available evidence is there for this 95th percentile claim?"

Comment author: thomblake 05 July 2012 08:09:43PM 1 point [-]

95% of programmers don't have published personally published software.

Really?

Comment author: gwern 05 July 2012 11:51:41PM 4 points [-]

The Wikipedia article on GitHub claims >1m users (passing the mark in 2011), with around 90,000 unique repositories out of 2m. StackOverflow has a few relevant questions like http://stackoverflow.com/questions/453880/how-many-developers-are-there-in-the-world which give me a vague estimate of perhaps 5-15 million worldwide. 0.1m unique repos to 15m developers is 6.6% and roughly consistent with 5%.

On the other hand, I don't know what 'personally published software' might be. A complete standalone executable or library? I could see most programmers confining their efforts to working on existing codebases, yes, and this would likely cut down the GitHub repo estimate a lot since many of them are no doubt forks with a patch or two of some main repo or dead ends of various kinds.

Comment author: ShardPhoenix 06 July 2012 04:15:03AM *  2 points [-]

You're off by an order of magnitude - it's 0.66%.

Comment author: gwern 06 July 2012 04:22:53AM 0 points [-]

Whups. I just thought 1/15... Well, an order is still within the margins of error here since a GitHub repo count ignores other sites like SourceForge.

Comment author: wedrifid 05 July 2012 08:21:41PM 2 points [-]

Really?

Yes, I'm completely certain. (ie. p=0.6)

Comment author: DanArmak 05 July 2012 07:51:49PM 1 point [-]

Are you implying he's better than 95% just because he has published something? Or what do you mean?

Comment author: wedrifid 05 July 2012 07:53:48PM *  0 points [-]

Are you implying he's better than 95% just because he has published something?

No, I'm saying that it would be misleading to imply the reverse if someone hadn't or to place all that much weight on the published software if they have (except in as much as the published personal software projects establish a lower bound.)

Comment author: DanArmak 05 July 2012 09:00:11PM *  0 points [-]

Well, that's why I asked him if he thought he could be fairly judged based on those two published projects. I didn't go ahead and just judge them, and I won't unless Eliezer says they're worth judging because they do establish such a lower bound for him.

Comment author: J_Taylor 05 July 2012 03:27:05AM 9 points [-]

What population are you comparing yourself to?

Comment author: Ezekiel 05 July 2012 06:26:47PM 9 points [-]

Are these your own estimates, or have you found some objective, accurate test for ranking "Conceptual originality"?

Comment author: Eliezer_Yudkowsky 06 July 2012 01:30:57AM 4 points [-]

I put that in because I didn't think any non-trolls would seriously dispute the 99+% part, not because I knew how to measure it down to the sixth decimal place.

Comment author: CronoDAS 06 July 2012 01:48:45AM 2 points [-]

Highest level of education completed: 8th grade

These days, you can claim to be homeschooled. ;)

Comment author: AlexMennen 05 July 2012 04:30:22AM 0 points [-]

Programming: 95%

Why so low?

Comment author: Eliezer_Yudkowsky 05 July 2012 06:25:45PM 4 points [-]

I haven't put as many skill points into it.

Comment author: AlexMennen 05 July 2012 09:14:54PM 4 points [-]

Ah, sorry, it looks like I was unclear. I meant "What makes you think that so many people are better at programming than you?", not "Why are you so bad at programming?". I had assumed that you were comparing yourself to the general population, although now that I see you have clarified that you were comparing yourself to other programmers, the 95% estimate makes a lot more sense. Giving people estimates of your percentiles without telling them the population you are comparing yourself to is almost useless.