= 27d567bc2d48d9f40e9ccc20ea370b15)
ChristianKl comments on Harry Potter and the Methods of Rationality discussion thread, part 21, chapters 91 & 92 - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
Comments (366)
The story looks more and more like it will end with Harry destroying the whole world. It would highlite the existential risk that comes from scientists who try to do everything in their power.
I'm expecting a positive ending for a few reasons, one of which is that since this is rationality propaganda I doubt Eliezer wants to portray Harry's super-rationality as having ultimately bad results.
It's rationality propaganda that isn't supposed to encourage people to accelerate the way to unfriendly AI but rationality propaganda that is supposed to prevent unfriendly AI from happening.
As far as the story goes, Harry is very rational but Quirrell is on a level where he outplays Harry. In the end Harry is a bit a projection of how Eliezer sees his own childhold self.
On the one hand Eliezer was very smart and rational. On the other hand he was delusional because he didn't take unfriendly AI seriously as something that can actually happen in reality.
A little bit of knowledge is dangerous. Creating people with enough rationality to do damage but not enough rationality to see the dangers of the whole enterprise isn't in the interests of MIRI.
If the reader learns that just being rational doesn't mean that you and that you better think before you mess with powers outside your control like an AGI, Eliezer teaches a very valuable lesson.
The hero always wins isn't a rationality lesson.
As far evidence in the story goes, Harry is rational because Petunia got a beauty portion from her sister. He sister got told from a centaur that the world would end when she gave Petunia the portion.
It's in chapter 1. (edit: I first mistakenly wrote chapter 10)
Now we have "HE IS HERE. THE ONE WHO WILL TEAR APART THE VERY STARS IN HEAVEN. HE IS HERE. HE IS THE END OF THE WORLD." at the end of chapter 89.
Quirrelmort takes it extremly seriously. He makes a point that when he was hypersmart Voldemort, he respected some sensible boundaries.
Quirrelmort is the person who fears that scientists will destroy the earth. He shares the fear to which Eliezer pledged his life.
-
You're conflating two different reasons there. Also, Lily was not stupid. I find it hard to believe that she could receive an apocalypse prophecy and not share it with Dumbledore at the very least. There is no evidence whatsoever that Dumbledore is aware of a prophecy connecting Harry to the end of the world.
Edit: Also, having gone through Chapter 10, I can't see anything there which supports your theory.
Oh, my mistake. It says at the top http://hpmor.com/?post_type=chapter&p=10 so I thought it was chapter 10. It's chapter 1.
I'm refering to the paragraph:
Lily told Petunia that the world would end when Lily gave Petunia the beauty potion. Lily isn't stupid and would tell that to her sister for no reason.
Let's say a centaur just told Lily that the world would end when she gave Petunia the beauty potion without being in prophecy mode.
At the beginning that was enough for Lily to refuse. But in the end she didn't saw how giving Petunia the beauty potion would end the world in any literal sense so she gave it to Petunia.
Excuse 1) The world will end if Lily is nice to her sister (with no source cited).
Excuse 2) A centaur told Lily not to give Petunia the potion (with no explanation of why not).
These are two completely separate assertions.
Furthermore,
Petunia states that Lily came up with a number of other, equally ridiculous excuses, which means those two shouldn't be assigned any special importance in the list.
From what we know of centaurs, they are rare and typically hostile to humans, which makes it highly improbable that Lily had any sort of meaningful conversation with one.
All prophecies we know of are highly cryptic, and there is no reason to believe that centaurs can decode them well enough to identify two specific, highly obscure humans.
Lily already has far better motives not to give Petunia the potion, namely 1) they dislike each other and Lily doesn't want to grant her sister's wish and/or 2) the potion is very dangerous to take and she doesn't want to endanger her sister's life. Prophecies of doom are a much less probable explanation than either.
If Lily heard what she thought was a prophecy of doom, she would be very stupid not to share it with anyone, say Dumbledore. Lily was not stupid, but there is no evidence that she told anyone about such a prophecy.
If Eliezer would have wanted to foreshadow the fact that rational Harry would go on to end the world in chapter 1, this is what it would look like.
When Petunia says "ricidulous excuses" it means that she doesn't understand the validity of the excuses.
What do you think is Eliezer's motivation for Lily giving ricidulous excuses? Making her look like the person that gives ricidulous excuses?
It's established from the start that Petunia bullied Lily before Lily got magic, and later that Lily is not a very forgiving person, so it's entirely plausible that she just didn't want to use her potion-brewing skills for her sister's benefit, and came up with off-the-cuff excuses not to do so.
The excuse section serves as character development for Petunia. It establishes her troubled relationship with Lily, and the excuses make Lily sound like a petty little girl (which it seems like she was at the time, based on her relationships with James and Severus) rather than cold and harsh as she would have seemed with a flat-out "no" with no reason given. It establishes why Petunia dated Vernon at all, and gives her a chance to talk about her self-image issues and how she wasn't the kind of person who would gravitate to Vernon for his personality (the way canon!Petunia seems to be). It also makes her sympathetic by revealing the extent of her emotional vulnerability with the suicide threat.
We would get none of this had Lily just given Petunia the potion straight away.
Additionally, consider the timeline necessary for your theory to pan out:
Or...
Which would you assign a higher probability?
Conservation of detail. The two excuses mentioned can be assigned greater significance on a meta level.
And an apocalyptic prophecy is much like Pascal's Mugger: the centaur may not be in prophecy mode, so fear-of-embarrassment might keep you from telling Dumbledore, but you'd still rather not take the risk.
"I talked to a centaur and he told me x" is hardly embarrassing. She wouldn't even have to claim to believe it, just say "what do you think of this claim based on your superior experience?" And it's obvious Dumbledore would want to know.
Dumbledore knew something we don't because he secretly helped Lily make a highly dangerous potion in the first place!
Why do you say Dumbledore helped Lily make the potion? Lily was a rising star of Potions herself.
When Dumbledore showed Harry the comments he made in her potions textbook the potion he was commenting on was the Potion of Eagle's Splendor, which is the potion for an increase in the Charisma stat (which technically doesn't have to involve appearance but is often considered correlated with it) in 3rd edition Dungeons and Dragons.
ETA: The other things which makes it more suggestive is that the potion Petunia took was dangerous or rare, else more witches would also have permanently improved their appearance, and a normal potion listed in the standard 5th year text presumably wouldn't be; The suggestion presented was thestral blood, thestral blood was implied to have a role in the permanence of the Cloak and as Harry deduced that potions making isn't creating magic but reshaping that which is there some component in Petunias potion must have an association with Permanence.
I know the blood is used to mark the Deathly Hallow symbol on the Cloak, but could you remind me where it says this relates to permanence? I rather assumed that, since thestrals are invisible to all those who have not seen and comprehended death, the relevance of thestral blood was to do with death and/or hiding from it.
I really really wish I could believe that, but I can't, not in the wizarding world. Felix Felicis, which is extremely difficult to make and disastrous if brewed wrong (and disastrously powerful when brewed right, especially in the hands of children), is to be found in the same textbook.
Hmm, rereading the section of his Azkaban trip where Harry was making his Cloak related discoveries I seem to have confused the fact of the thestral blood symbol empowering the Cloak with someones conjecture in some discussion thread after we learned the law of potion conservation that the thestral blood suggested as a substitution in the eagle's splendor potion could have served as a modifier to make it permanent.
Dumbledore scribbles nonsense in the margins of the Eagle's Splendour recipe of Lily's book =/= Dumbledore helps Lily brew Eagle's Splendour. At most, it confirms that Lily knew how to brew said potion when she was in her fifth year.
Furthermore, even if Dumbledore helped Lily brew a fifth-year potion, there is no reason to believe that he did so secretly, or that he had ulterior motives beyond helping her. Lily was a student he paid rather creepy special attention to - why wouldn't he help her with a special project?
Hmm, that's interesting, Petunia really did get sick for weeks