gwern comments on Harry Potter and the Methods of Rationality discussion thread, part 14, chapter 82 - Less Wrong

7 Post author: FAWS 04 April 2012 02:53AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (790)

You are viewing a single comment's thread. Show more comments above.

Comment author: Percent_Carbon 11 April 2012 05:20:55AM 5 points [-]

I am curious about your concern.

Do you want to save EY from a hubris born smackdown?

Do you want to keep public attention off fanfiction so you aren't tempted to publicly defend it and publicly identify as a fanfic fan?

Do you fear a loss of face for the Singularity Institute?

Forgive me for visiting your intentions, if that is unwelcome.

Comment author: gwern 11 April 2012 01:33:33PM 19 points [-]

You only get one shot at the awards. My best calibrated guess is that MoR has a chance at best novel somewhere between 'not a chance in hell' and 5%, while best fanwork moves the odds of victory to 50+%. Which one do you think is better?

(I'm also a little concerned that EY is casually making what looks to me like an incredibly obvious mistake.)

Comment author: TheOtherDave 11 April 2012 01:51:52PM 5 points [-]

My best calibrated guess is that MoR has a chance at best novel somewhere between 'not a chance in hell' and 5%, while best fanwork moves the odds of victory to 50+%. Which one do you think is better?

I expect you meant that as a rhetorical question, but I'm not sure it is. I generally agree with your confidence estimates, but of course it's also worth looking at the payoffs. It's also worth comparing the payoffs for being a Hugo nominee for best novel and a Hugo award winner for best fanwork.

I don't have an informed opinion about those payoffs, just saying that it's not as simple as "50+% chance of winning an award" vs "<5% chance of winning an award."

Comment author: gwern 11 April 2012 02:18:31PM *  10 points [-]

Which is precisely why I am asking these questions, because there are many ways Eliezer could conclude it's a good idea:

  1. maybe, as I already suggested, best novel nominee > best fanfic award
  2. perhaps Eliezer likes the idea of being a best novel nominee or winner so much that he doesn't mind the significantly reduced expected-value
  3. he has non-public information

    • eg. there are famous writers who have told him they will propagandize for MoR and order their fans to vote for it
  4. he has not thought about it in any detail or come up with calibrated probabilities like I have
  5. he plans to publish MoR as multiple books (given its length) and first books in series are the best to go for best novel and later books can shoot their wad on less prestigious awards
  6. the rules favor MoR in some way I am unaware of

    • eg. he thinks he can issue a call for MoR fans to attend and vote, erasing the disadvantages I otherwise accurately assess

etc.

Comment author: Eugine_Nier 12 April 2012 05:36:18AM 4 points [-]

My theory is that Eliezer is overestimating his chances of winning best novel.

Comment author: Alsadius 12 April 2012 10:16:55PM 2 points [-]

5) is not a believable option, since the legalities of fanfic prohibit any conventional sort of publication, and just slapping "Book 1"/"Book 2"/etc. on top of chapter headings does very little.

The rest is good analysis, though.

Comment author: gwern 12 April 2012 10:42:00PM 3 points [-]

since the legalities of fanfic prohibit any conventional sort of publication

No, they don't. They just mean it takes a publisher with a little guts, willing to defend it under fair use grounds (in MoR's case, parody).

Comment author: komponisto 13 April 2012 04:11:39PM 1 point [-]

since the legalities of fanfic prohibit any conventional sort of publication

No, they don't. They just mean it takes a publisher with a little guts, willing to defend it under fair use grounds (in MoR's case, parody)

They would lose, and probably correctly so. If that defense worked for MoR, it could be applied to any situation where someone just made up their own story using someone else's characters, and the whole concept of copyright would be effectively abolished.

(Not that abolishing copyright wouldn't be a policy worth considering...)

Actually, in fact, it seems obvious to me that any publication at all -- "conventional" or not -- of fanfiction is blatantly illegal, just like distributing your own modified version of Microsoft Windows would be.

(Note that "is illegal" is not the same thing as "should be illegal".)

Comment author: gwern 13 April 2012 04:34:26PM 3 points [-]

They would lose, and probably correctly so. If that defense worked for MoR, it could be applied to any situation where someone just made up their own story using someone else's characters, and the whole concept of copyright would be effectively abolished.

Are you under the impression that fair use has never worked before or parody in particular? Because otherwise I don't understand why you are so certain of what you are saying.

Comment author: komponisto 13 April 2012 04:54:08PM *  3 points [-]

I think it's clear that MoR is not (merely) parody, but a literary work in its own right that happens to be derived from an existing work by someone else.

It's a kind of thing that I think ought to be allowed, but which I don't think actually is.

Comment author: gwern 13 April 2012 05:06:17PM 4 points [-]

I think it's clear that MoR is not (merely) parody, but a literary work in its own right that happens to be derived from an existing work by someone else.

Something that could be said with equal justice of The Wind Done Gone.

Comment author: Random832 13 April 2012 04:26:50PM 0 points [-]

It wouldn't abolish the whole concept of copyright - just characters-and-scenarios copyright, of which I am not sure what the actual legal basis it originates in is, or to what extent it has been tested in court.

Comment author: komponisto 13 April 2012 04:44:44PM 1 point [-]

Yes, I meant for the word "whole" to modify the word "concept", not the word "copyright". That is, my sentence was meant to be read as:

[T]he whole concept of copyright would be effectively abolished.

Distinguish between the scope of copyright (i.e. what kinds of items it applies to) and the force of the same (how much activity it prohibits within its scope). The emphasis of my claim was on the force rather than the scope.

Comment author: cultureulterior 12 April 2012 01:28:45PM *  2 points [-]

All you need to vote is a supporting membership, cost $60 or so. You don't have to attend.

As soon as HPMOR is finished (hopefully not soon), I will buy a supporting membership to the next year's worldcon. On that note, let me urge Eliezer to finish HPMOR in the summer of some year, so enough supporting memberships can nominate it by January 1.

Comment author: gwern 12 April 2012 02:29:26PM 2 points [-]

All you need to vote is a supporting membership, cost $60 or so. You don't have to attend.

I'm not sure that materially increases the number of votes one could expect. Gee, only $60...

Comment author: cultureulterior 12 April 2012 02:55:38PM *  1 point [-]

You only need 100 votes to get nominated, and then the nomination itself will get more people reading it.

Comment author: gwern 12 April 2012 03:16:03PM 4 points [-]

That page is old, as I noted in my other comment, and if you read the Constitution (article 3) which governs the Hugo award, the nomination is not so numeric; for example:

Except as provided below, the final Award ballots shall list in each category the five eligible nominees receiving the most nominations. If there is a tie including fifth place, all the tied eligible nominees shall be listed.

and

3.8.5: No nominee shall appear on the final Award bnominatallot if it received fewer nominations than five percent (5%) of the number of ballots listing one or more nominations in that category, except that the first three eligible nominees, including any ties, shall always be listed.

Going back to the 2011 data (and being mindful the vote counts have set records frequently in the 2000s as the convention apparently grows), we see the last place novel is 306 ballots. pg17 gives us the original nomination votes: last place novel there was 78 ballots.

So, yes, MoR could probably get on the ballot if >78 people all remember to register by 31 January of that year (good thing MoR isn't finished yet because it's too late for 2012) so they are eligible to vote on nominations, and actually put MoR #1 on their ballots; see the Constitution again:

Each member of either the administering or the immediately preceding Worldcon as of January 31 of the current calendar year shall be allowed to make up to five (5) equally weighted nominations in every category.

Comment author: LauralH 07 February 2013 08:32:42PM 0 points [-]

I also think this is a good idea, and hereby vow to buy a membership when HPMoR is finished for this purpose of voting it for Best Novel. As pointed out, even being nominated would get it a lot more attention.

I'm hoping for something like Neil Gaiman had when he won and then they banned comics/graphic novels afterwards.

Comment author: Eliezer_Yudkowsky 12 April 2012 10:33:46AM *  2 points [-]

I think the main thing you're missing is that nothing bad happens to me if I don't win. This could serve as a mantra for a whole lot of things in life that are worth trying.

Comment author: gwern 12 April 2012 01:28:14PM 17 points [-]

'Nothing bad happens to' two-boxers either. Do I really need to explain that loss of a gain is as bad as a gain of a loss?

Comment author: JGWeissman 12 April 2012 05:17:22PM 1 point [-]

Dumbledore would say that is why you go for multiple gains in parallel.

Comment author: gwern 12 April 2012 08:08:36PM 1 point [-]

I didn't understand what you meant so I asked on IRC and you seem to be referring to multiple plots.

Comment author: JGWeissman 12 April 2012 08:40:34PM 1 point [-]

Yes, that is the story reference. As it applies here, is there any reason that Eliezer could not attempt to win multiple awards?

Comment author: gwern 12 April 2012 08:59:57PM 8 points [-]

Yes. First, the Constitution specifies that if a work is ever successfully nominated, it cannot be nominated again, so MoR can only be done once. (Examining the categories carefully, pg 6-7, it may or may not be technically possible that MoR could be nominated in one year for Best Novel and then Eliezer himself - on the strength of fandom arising from MoR - nominated for 'Best Fan Writer'.)

Second, the rules get very complex on pg 8 about multiple categories, which is why I did not bring it up before:

3.8.2: The Worldcon Committee shall determine the eligibility of nominees and assignment to the proper category of works nominated in more than one category.

3.8.3: Any nominations for "No Award" shall be disregarded.

3.8.4: If a nominee appears on a nomination ballot more than once in any one category, only one nomination shall be counted in that category.

3.8.5: No nominee shall appear on the final Award ballot if it received fewer nominations than five percent (5%) of the number of ballots listing one or more nominations in that category, except that the first three eligible nominees, including any ties, shall always be listed.

3.8.6: The Committee shall move a nomination from another category to the work’s default category only if the member has made fewer than five (5) nominations in the default category.

3.8.7: If a work receives a nomination in its default category, and if the Committee relocates the work under its authority under subsection 3.2.9 or 3.2.10, the Committee shall count the nomination even if the member already has made five (5) nominations in the more-appropriate category.

I... don't actually know what all that means. Clause 3.8.4 seems to indicate that putting MoR up into multiple award categories would have the effect of splitting and diluting all votes, which seems like a bad thing.

Comment author: TheOtherDave 11 April 2012 02:39:30PM 1 point [-]

maybe, as I already suggested, best novel nominee > best fanfic award

Why, so you did. Careless reading of me... my apologies.

Comment author: NancyLebovitz 12 April 2012 02:24:59PM 2 points [-]

You're assuming that Best Fan Writer and Best Novel are equally valuable awards. This is not even close to true.

There are people who make a practice of reading all the Best Novel nominees, for years after the award is given, and I think people are much more likely to read Best Novel nominees before voting than to get around to the fan writing awards.

If anyone can track down number of votes in the different categories, it would be a way of checking on my opinion.

Comment author: gwern 12 April 2012 02:46:09PM 10 points [-]

You're assuming that Best Fan Writer and Best Novel are equally valuable awards. This is not even close to true.

I have twice already pointed out that possibility.

If anyone can track down number of votes in the different categories, it would be a way of checking on my opinion.

It would be good information, yes. As far as I can tell, there may be some very recent records of recommendations by the Nebula members (and also claims of considerable politicking, so an appeal by Eliezer to fans would be far from unprecedented nor especially effective).

The Hugo voting system is pretty complicated, but apparently they've released detailed statistics since the 1980s - one of the first quotes in that 1997 analysis is

...This idea that hardly anyone votes on the fan Hugos is perhaps the most widespread of the misconceptions I alluded to...

The most recent data is for 2011. Best Novel took 1813 ballots, with 779 vs 753 for #1 vs #2 (as I said, complicated - it's IRV).

The fan categories are fanzine, fan artist, and fan writer; the last had 323 ballots, with 70 vs 40. So in other words, just to get within spitting distance of Best Novel #2, you would need almost twice as many ballots as were cast for the entire category of Best Fan Writer.

You see why I would give MoR for Best Novel 0-5%, and EY for Best Fan Writer 50+%?

Comment author: NancyLebovitz 12 April 2012 03:22:20PM 4 points [-]

I can't find your mentions that the Best Novel Hugo might be worth more than the Best Fan Writer. This doesn't mean I think you're lying or mistaken, but where are they? Were they in some other thread or sub-thread?

I'm not sure if my point that just getting nominated for Best Novel is a huge win in terms of readership has registered. For these purposes, there is no difference I can see between coming in second and coming in last.

I agree that HPMOR doesn't have a great chance of winning Best Novel. It depends tremendously on what the competition is, and I'm assuming we're talking about at least two years from now, so what novels it would be up against are hard to predict. I don't think there are any predictable blockbusters in the immediate pipeline.

Comment author: gwern 12 April 2012 03:33:02PM 5 points [-]

Subthread.

I'm not sure if my point that just getting nominated for Best Novel is a huge win in terms of readership has registered. For these purposes, there is no difference I can see between coming in second and coming in last.

As I suggested, it may be a good idea - but Eliezer did not present that as a reason, has not presented it as a reason, and has not justified it. What makes you think the nomination is better than winning a fan Hugo, besides anecdotes about peoples' reading lists including nominees?

Comment author: NancyLebovitz 12 April 2012 03:45:18PM *  3 points [-]

I'm assuming that the purpose of going for a Hugo is to get publicity and increased readership for HPMOR. If I'm mistaken-- possibly the point is that having a Hugo award is Really Cool-- then going for the win in a less important category would make sense.

I've been in fandom since the early seventies, and it seems to me that people talk about the Best Novel a lot more than Best Fan Writer.

I may be biased, but I think Fan Writing is very much a sub-culture within the sub-culture.

To be fair, even print sf is minuscule compared to tv, movies, and comics. From yet another angle, fanfic has become a huge thing by fannish standards, but I think it's something of a separate branch compared to the sort of fan writing (typically essays, I think, rather than fiction) which gets a Hugo.

Comment author: Eugine_Nier 13 April 2012 03:58:37AM 7 points [-]

If I'm mistaken-- possibly the point is that having a Hugo award is Really Cool-- then going for the win in a less important category would make sense.

I suspect the real logic is: having a Hugo award is Really Cool, having a Hugo for best novel is Even More Really Cool, and Eliezer isn't the type of person to settle for Really Cool in that situation.

Comment author: Alsadius 12 April 2012 10:19:19PM *  2 points [-]

Wait, 800 votes is sufficient to win Best Novel? I think I'm with Eliezer on this now. That may actually be attainable with this fan base(if only because it's vastly easier to mobilize for online works than for paper ones, due to logistical issues)

Edit: I was unclear on the voting process, and am retracting the above.

Comment author: gwern 12 April 2012 10:39:16PM *  6 points [-]

What kind of expectations about the voting for a Hugo did you have that when told it's 800 (rather than 8, 80, 8000, 80000...) strikes you as fantastic? And do you think that there are 800 dedicated MoR readers who would go to Worldcon and rank it #1 in the vote? Remember the infamous 1% rule: for every reader, there's 1% who will leave a comment or review, and out of those, 1% will do something additional. Going to Worldcon and voting is quite something additional.

(Well, one way to answer this would be to put up a poll on hpmor.com asking how many readers attended Worldcon 2011, Worldcon 2012, etc. Liars will inflate the numbers, but it would help get an upper bound.)

Comment author: Alsadius 13 April 2012 02:54:43AM 2 points [-]

Oh, you can only vote in person? I knew part of the Hugo process was online, and assumed that the whole thing was. 800 votes for an online poll is "small-town newspaper sidebar survey" range, winning a major award with that kind of number would be absurd. It makes far more sense if it's embedded in a con.

Correction to my above: Trying to win Best Novel is unbelievable hubris, and it'll be first off the ballot in the rather unlikely case that it makes it on at all.

Comment author: gwern 13 April 2012 02:37:38PM 2 points [-]

No no, see my other comments - you can vote without being physically present... if you don't mind paying $60 by January 31 for the membership which comes with few other benefits than being able to vote. You see the problem.

Comment author: [deleted] 12 April 2012 10:36:57PM 5 points [-]

Keep in mind that "this fan base" would probably vote Methods (or EY, I suppose) in for Best Fan Writer pretty much uniformly, but is likely to be fragmented for Best Novel.

Comment author: Eliezer_Yudkowsky 12 April 2012 07:06:09AM *  5 points [-]

I'm curious as to what would have been your original probability estimate for "Given that Eliezer writes a Harry Potter fanfiction, it becomes the most popular Harry Potter fanfiction on the Internet." Or, for that matter, getting out of the AI Box. Not everything impossible that I try, works - nobody coughed up $1.6 million to get faster HPMOR updates this time around, which I tried because, hey, why not - but to me, not trying for Best Novel, given feedback so far, just seems horribly, horribly non-Gryffindor. To me it seems like you're the one making this obvious, horrible mistake whose reference class of timidity errors could put a shadow over someone's entire life. Don't ask her out, don't interview at the hedge fund, don't try for the scholarship, go for Best Fan Work instead of Best Novel...

Offer 20-to-1 odds against HPMOR winning Best Novel and I'll buy in. Hm, now I'm curious as to which side of the bet Zvi or Kevin would take.

Comment author: gwern 12 April 2012 06:15:14PM *  22 points [-]

I'm curious as to what would have been your original probability estimate for "Given that Eliezer writes a Harry Potter fanfiction, it becomes the most popular Harry Potter fanfiction on the Internet."

I would have assumed that the proper reference class was all your other fiction, which as much as I enjoyed them, were all short compared to MoR even the popular ones like 'Three Worlds Collide'. (One of my favorites, the Haruhi fanfic, was, what, 2 pages on FF.net?) Short fanfics cannot become the most popular, so I would have assigned it a very low probability. Had you asked an estimate for 'wrote a full trilogy of HP fanfic novels', my estimate would be quite different. I won't pretend to know what it would have been. (I remain surprised and amused that it has become as large and popular as it has been, and that you now procrastinate on both your rationality book(s) and the Center by writing MoR. Truly, fortune passes everywhere!)

Or, for that matter, getting out of the AI Box.

Oh, I would've bet for you back on SL4. You already had succeeded in getting SIAI running, after all. (Although here again the counterfactual gets hard - I barely remember what I was like back in 2003-4 when I joined SL4 and IIRC you had already won an AI Box by then.)

Offer 20-to-1 odds against HPMOR winning Best Novel and I'll buy in.

Sure. I am poorer than a church mouse, so I can risk no more than ~$100. How's this:

"For any Worldcon 2013-2017, MoR will win the Hugo 'Best Novel' award. The stakes will be $100 against $5 (non-inflation adjusted). Payment by either Paypal or Bitcoin (at that day's exchange rate on the largest exchange eg. Mt.gox) to the winner or a charity of the winner's choice. In case of any dispute, the verdict will be judged by Carl Shulman or another person mutually acceptable to Eliezer Yudkowsky and gwern."

Hm, now I'm curious as to which side of the bet Zvi or Kevin would take.

I've pinged them.

Comment author: gwern 30 April 2016 12:56:55AM 6 points [-]

Eliezer has conceded the bet & paid me $5.

Comment author: Eliezer_Yudkowsky 13 April 2012 01:01:29AM 13 points [-]

Okay, it's on.

Comment author: [deleted] 03 June 2012 01:32:24AM *  5 points [-]

Can anybody get in on this bet? I would take it as well.

I think the odds of HPMOR winning the Hugo (edited to say: for Best Novel) are far less than one percent. This has nothing to do with my estimation of the literary merits of the fic, and everything to do with my understanding of the literary establishment and its unwillingness to tangle with copyright law.

Comment author: [deleted] 04 June 2012 03:52:46PM 5 points [-]

You know, on reflection I think that this was possibly a kinda snotty way of saying what I wanted to say: that I think gwern is right, and that you'd be better off applying in the Fan Writer category than in the Best Novel category. And I don't think it's true that going for the Best Novel is without cost, because you'd be giving up the chance at the Fan Writer award.

I mean, I'm happy to make the bet because I am very confident that I'll win it, but I don't actually want to punish you for putting your work out there or shooting for a high goal--which is what it sort of feels like, if I make you pay me when you lose.

Comment author: Eliezer_Yudkowsky 03 June 2012 10:01:29AM 2 points [-]

I have looked up the rules and apparently, instead of a plurality vote or a majority vote with runoff voting, people rank all the candidates and can put "No Award" above anything they think sufficiently underserving. This does change my odds, but not enough that I wouldn't try to for a nomination. I'm also not sure that it should change my odds enough not to bet at 20-to-1. How much would you want in for?

Comment author: gwern 03 June 2012 04:51:41PM 10 points [-]

can put "No Award" above anything they think sufficiently underserving.

Cute story I saw 12 days ago on urth.net:

I read an interview with Roger Zelazny, and he said that the reason he called the story "No Award" was because he noticed that, since the ballots were alphabetical by author, he always wound up right before No Award. He wanted to have two "No Award"s in a row and cause confusion. Unfortunately for his dastardly plot ( :) ), it didn't get nominated for anything.

Comment author: [deleted] 03 June 2012 05:02:15PM 4 points [-]

$500 against $25?

Comment author: gwern 13 April 2012 01:24:35AM 5 points [-]

I've added it to the registry & PredictionBook.

Comment author: [deleted] 13 April 2012 03:19:49PM *  3 points [-]

You should make sure, first, that MoR would be eligible for the Best Novel category, given that it's a fan work. I couldn't find anything on the site that stated definitely that such a work wouldn't be eligible, but there was some implication that the award is for original work. Looking over the past winners, I can't find any that aren't a) original, and b) published in a magazine or as a book (i.e. pro or semi-pro, by the Hugo's standards).

Anyway, it seems some provision should be made in case MoR isn't eligible.

Comment author: ArisKatsaris 13 April 2012 05:33:16PM *  8 points [-]

Anyway, it seems some provision should be made in case MoR isn't eligible.

If MoR doesn't win Best Novel because it isn't eligible, then gwern wins, that's clear to me at least.

EDIT TO ADD: I think that, conditional to MoR being an official nominee, I'd assign 40-50% chance to it winning Best Novel. But I think it's the "official nominee" step that's the hard part. I'd assign only 20% chance or less to the commitee allowing it as such an official nominee for Best Novel. For fear of JKR's potential ire, for fear of losing status for the Hugo awards by having fanfiction compete on it, for fear of setting a precedent for other fanfictions.

Comment author: [deleted] 13 April 2012 05:50:44PM 4 points [-]

I'd assign 40-50% chance to it winning Best Novel.

On the basis of your past experience Hugo award winners and nominees? I don't have any familiarity with the genre, so I don't know how MoR stacks up.

For fear of JKR's potential ire, for fear of losing status for the Hugo awards by having fanfiction compete on it, for fear of setting a precedent for other fanfictions.

The first is probably nothing to worry about: JKR has said she's okay with fan fiction, so long as no on tries to make any money and no one tries to publish it in print (whatever that means). This does mean that EY can't count himself a pro or semi-pro author, which might exclude him. I'm not sure.

Comment author: [deleted] 13 April 2012 10:13:33PM 10 points [-]

JKR's statement does not, I believe, have the force of law, it only describes her current disposition, and she's free to go back on it any time. She may consider being nominated for a Hugo to be equivalent to the other things she disapproves of.

Comment author: gwern 06 September 2014 07:46:02PM *  4 points [-]

So 2+ years on, has your opinion changed any? I think the probability has dropped a fair bit*, but I'm trying to simplify my finances, so I'm going to make you an offer: I'll sell you my side of the bet for 20% off, or $4. (Offer good for the next month or so.)

* to expand: I think the decrease in post tempo has destroyed much of the virality & reduced fan ardour, and more specifically, I haven't seen any prominent endorsements of MoR by elites like David Brin over the past year or so, which are necessary to legitimize MoR and make it a contender. You can't win a Hugo just by appealing to some people online, you also have to win over the niche of voters at the convention.

Comment author: Eliezer_Yudkowsky 09 September 2014 04:43:54PM 2 points [-]

Nope.

Comment author: [deleted] 09 September 2014 05:30:29PM *  1 point [-]

That's what you'd call a liquidity preference. *rimshot*

Comment author: gwern 09 September 2014 08:50:16PM 2 points [-]

I admit, it never occurred to me that part of liquidity preference is simply that liquid assets are easier to manage from an overhead/data point of view.

Comment author: Kevin 13 April 2012 12:50:13AM 2 points [-]

I'd take the Eliezer side of the bet if I was confident that HPMOR could compete against an unusually weak slate of nominees.

Comment author: David_Gerard 20 April 2012 12:54:03AM -2 points [-]

Very low. It struck me as a jawdroppingly stupid idea. Then I read it and it was rather good.