Eliezer_Yudkowsky comments on Open Thread for February 18-24 2014 - Less Wrong

4 Post author: eggman 19 February 2014 12:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (454)

You are viewing a single comment's thread. Show more comments above.

Comment author: Alejandro1 19 February 2014 04:27:24PM *  12 points [-]

Some Bayesian thoughts on the classic mystery genre, prompted by watching on Netflix episodes of the Poirot series with David Suchet (which is really excellent by the way).

A common pattern in classic mystery stories is that there is a an obvious suspect, who had clear motive, means and opportunity for the crime (perhaps there is also some physical evidence against him/her). However, there is one piece of evidence that is unexplainable if the obvious person did it: a little clue unaccounted for, or perhaps a seemingly inconsequential lie or inconsistency in a witness' testimony. The Great Detective insists that no detail should be ignored, that the true explanation should account for all the clues. He eventually finds the true solution, which perfectly explains all the evidence, and usually involves a complicated plot by someone else committing the crime in such a way to get an airtight alibi, or to frame the first suspect, or both.

In Bayesian terms, the obvious solution has high prior probability P(H), and high P(E|H) for all components of E except for one or two apparently minor ones. The true solution, by contrast, has very high probability P(E|H) for all components of E. It is also claimed by the detective to have high prior P(H) (the guilty party tends to be someone with an excellent motive, they just had been dismissed as a suspect because of a seemingly perfect alibi). However, there is here a required suspension of disbelief, in that in real life there is a very low prior probability of someone plotting a crime (and successfully carrying it out) with a convoluted, complicated plot in order to get an alibi. In real life, the detective's solution would be dismissed because of a low P(H), and the detective's insistence on finding a solution that maximizes P(E|H) at the cost of P(H) would be flawed from the point of view of Bayesian rationality.

Comment author: Eliezer_Yudkowsky 22 February 2014 08:58:28PM 5 points [-]

The question then becomes how this trope should properly be averted in rationalist fiction. (Besides the HPMOR approach.)

Comment author: Alejandro1 22 February 2014 10:24:08PM 0 points [-]

What is the HPMOR approach? Having so many characters be super-intelligent plotters, so that the prior probability that the explanation for something involves a complicated plot is much higher than in real life?

Comment author: solipsist 25 February 2014 12:38:50AM *  1 point [-]

“The concept of 'evidence' had something of a different meaning, when you were dealing with someone who had declared themselves to play the game at 'one level higher than you'.”

--Chapter 86

ETA I was referring to my pet suspect for the hidden hand (who's clever enough to play Dumbledore and Quirrell against each other and leaves scant evidence of her existence). But I think Eliezer was referring to Defense Professor having a high prior and being Voldemort:

“The Potions Master said dryly, "The Defense Professor is always a suspect, Mr. Potter. You will notice a trend, given time.”

--Chapter 79

Comment author: gwern 22 February 2014 11:09:39PM -1 points [-]

My guess is one possible aversion is 'have the protagonist be mind-altered so the obvious clues don't add up', which is one of the leading theories for 'why hasn't Harry figured out yet that Quirrel is Voldemort even though people were figuring that out by like ch20?'

Comment author: Pavitra 23 February 2014 12:01:05AM 3 points [-]

Well, part of it is that Quirrel is Voldemort in canon, which is significant evidence that Harry doesn't have.

Comment author: gwern 23 February 2014 04:01:36AM *  0 points [-]

There's tons of evidence in-universe; even if he shouldn't suspect by chapter 20, then by ch100 the failure has become impossible. (And I recall that knowing about canon was actually a problem for a lot of people: "surely it can't be that obvious? Eliezer would never take such an obvious tack!")

Comment author: hairyfigment 24 February 2014 02:36:13AM 0 points [-]

I personally feel unsure what the Defense Professor wants, if he's the Dark Lord Tom. My tentative guess is, nsgre gur Qrzragbe snvyrq gb shysvyy gur cebcurpl, ur qrpvqrq gung nal fbyhgvba rkprcg qverpgyl 'pbeehcgvat' Uneel gb funer uvf tbnyf jbhyq whfg oevat n arj fcryy vagb rkvfgrapr. Guvf zvtug rkcynva jul ur qbrfa'g whfg qebc n ebpx ba Uneel be fgnaq nfvqr sbe gur pragnhe, bapr ur fgnegf gb ernyyl srne arj fcryyf.

Guvf ulcbgurfvf vapernfrf gur punapr gung Gbz unf tvira Uneel'f arj cneragf n gvzr-qrynlrq vyyarff (gung bayl ur pna erzbir) be bgurejvfr chg gurz va Obk N nf n onpxhc. Fb V'q orggre or evtug nobhg gur Qrnguyl Unyybjf nf jryy.