DubiousTwizzler comments on Harry Potter and the Methods of Rationality discussion thread, part 25, chapter 96 - Less Wrong

6 Post author: NancyLebovitz 25 July 2013 04:36AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (524)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 25 July 2013 04:47:46PM 14 points [-]

complexity penalty

This is a misuse of jargon.

Comment author: DubiousTwizzler 25 July 2013 05:21:12PM 2 points [-]

Since it seems like these two explanations fit this specific piece of evidence (roughly) equally well, and we know that Quirrelmort is the entity referenced by the prophecy in canon, and that Voldemort is called the Dark Lord in both canon and hpmor, then why wouldn't Dark Lord as Death get a 'complexity penalty'?

If I'm using it wrong, please explain.

Comment author: Manfred 25 July 2013 05:30:18PM 12 points [-]

Complexity means it requires additional things to happen even if you had no evidence.

For example, a more complex hypothesis than "Bob is a human" is "Bob is a human who lives at 123 Fake St."

Voldemort being called the dark lord is evidence, and learning about new evidence does not itself make a hypothesis more or less complex. It's just evidence.

Comment author: DubiousTwizzler 25 July 2013 05:41:54PM 11 points [-]

You're right. Thanks for the correction!

Comment author: ThisSpaceAvailable 27 July 2013 05:54:45AM 0 points [-]

You seem to be saying "A is more complex than B means 'if A then B' ", which is not true. The commonly used term for this is "strength". "Bob is human who lives at 123 Fake St." is strictly stronger than "Bob is human".

Comment author: BT_Uytya 25 July 2013 05:41:59PM *  2 points [-]

You are talking about prior probability. P(Dark Lord is Death|no specific background information) roughly equals to P(Eliezer changes things from canon), which isn't very large; so after updating both with a equally favorable piece of evidence "Death is Dark Lord" is still behind "Voldemort is Dark Lord".

You can assign prior probabilities in various ways, and one of them is giving every hypothesis an appropriate complexity penalty (or you can just judge everything as equally likely, or give everything a simplicity penalty, or penalize every hypothesis according to how many people it affects, or...). Some ways are better than others, but:

1) Why "complexity penalty" should work in fiction, even in a rationalist fiction?

2) Why hypothesis "Voldemort is Dark Lord" is simpler than "Death is Dark Lord" in the sense of program length? One can argue that the former hypothesis points to the specific human from a pool of a 6 billion people (or 100 billion, if you want to consider every human ever lived) while the latter talks about some entity likely to be very basic from the Magic viewpoint.

Hope that clears some of confusion!

Comment author: Eliezer_Yudkowsky 25 July 2013 06:50:04PM 12 points [-]

1) Why "complexity penalty" should work in fiction, even in a rationalist fiction?

Because there will still be an infinite (countable) number of finite hypotheses which could be considered and only a finite amount of probability to divide among them, which necessarily implies that in the limit more complicated hypotheses will have individual probability approaching zero. This will be true in the limit even if you define 'complexity' differently than the person who constructed the distribution.

Comment author: ThisSpaceAvailable 27 July 2013 09:59:06PM *  2 points [-]

Is "A or B" more "complex" than "A"? It seems to me that it generally takes more bits to say "A or B", but the prior for "A" should be smaller than for "A or B". Is there something in the "assign prior according to complexity" heuristic that accounts for that?

Comment author: Benquo 26 July 2013 06:17:13PM 1 point [-]

Hmm, I suppose you could judge the "complexity" of the plot of a fan fic by how much it deviated from Canon.

Comment author: BT_Uytya 26 July 2013 08:23:30PM *  2 points [-]

It's not very useful measure.

So, there is Lesath Lestrange, an original character. Which is more likely: "Lesath thinks that Harry is his Lord" or "Lesath is a 3-level (or any specific number instead of "3") player who wants to decieve Harry, and also he is H&C which is possible because he knows how to fool anti-obliviation wards"?

Your approach will just say "I don't know what to make of it. We have already departured from the canon and I can't work here" with a sad look on face.

EDIT: I re-read my comment, and it seems to be arrogant and condescending. I didn't intend it to be so, and not sure how I should change it, so I figured I should just apologize beforehand. Your approach to assigning priors is reasonable one, it just lacking some vital parts.

Comment author: Benquo 26 July 2013 11:10:44PM 2 points [-]

I agree that it's an incomplete measure. As you point out, we would need some measure of the complexity of divergences from Canon, which requires a more general measure.

Another way to put it would be, I don't think it's unreasonable in a fanfic to assign all the details prescribed in Canon a complexity of zero.

Comment author: BT_Uytya 26 July 2013 11:15:30PM 1 point [-]

This seems reasonable indeed.

(if you are interested, the thing you are pointing at is conditional Kolmogorov complexity)