You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

lerjj comments on Harry Potter and the Methods of Rationality discussion thread, February 2015, chapter 109 - Less Wrong Discussion

5 Post author: Gondolinian 23 February 2015 08:05PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (160)

You are viewing a single comment's thread. Show more comments above.

Comment author: bramflakes 23 February 2015 08:44:39PM 17 points [-]

I show not your face but your coherent extrapolated volition

I got shivers when I read that and realized what the Mirror was. Another thing that ought to have been obvious, in hindsight.

Comment author: lerjj 23 February 2015 08:53:08PM 1 point [-]

Is my vocabulary at fault here? I'm parsing that as "I'm not actually reflecting you [already known], but instead I'm reflecting what I think you want me to"

This sounds like a description of the Mirror from canon. What have we learned that's new?

Comment author: Jost 23 February 2015 09:06:34PM 3 points [-]

It probably doesn’t refer to “coherent extrapolated volition”, but to “Coherent Extrapolated Volition”.

Comment author: lerjj 23 February 2015 09:18:48PM 0 points [-]

now I feel stupid for not doing a google search to see if parts of that sentence were recognised phrases. Of course that's what it means. In fairness though, this is simply a FAI refinement of my first reading- it doesn't show what it thinks you want, but somehow scans your utility function and calculates what to show you.

Either way, the Mirror of Erised still seems to be pretty much standard.

Comment author: linkhyrule5 23 February 2015 09:30:13PM 8 points [-]

Not quite. It won't show you what you think you want, or even what you really truly want this second - it shows you what you would want, if you were were better, smarter, and more the person you wished to be. It's coherent - you should never look into the Mirror and go "on second thought, that's a terrible universe."

For example, Ron would not see himself becoming Prefect or being Head Boy, because in a decade or less he'll have outgrown such ambitions.

Comment author: Benito 23 February 2015 10:52:35PM 0 points [-]

Well... Dumbledore sees his dead family (well, Quirrell thinking he's Dumbledore sees Dumbledore's dead family). Which is like Ron seeing everything he currently wants, rather than utopia.

Comment author: SilentCal 23 February 2015 11:04:28PM 6 points [-]

Could be because this mirror doesn't extrapolate very far, could be because Quirrell's fake Dumbledore doesn't have full human wish complexity.

Comment author: CellBioGuy 24 February 2015 01:48:56AM 3 points [-]

Quirrell's fake Dumbledore doesn't have full human wish complexity.

Strikes me as most likely explanation by far.

Comment author: Nornagest 23 February 2015 11:10:11PM *  1 point [-]

Not quite. It's more like Ron seeing what a more mature version of himself would want, but Dumbledore's pushing 200 and famously wise; he's not going to get much more mature following the path he's taken. You could argue that his worldview isn't self-consistent and that a smarter or less self-deluding version of him would pick up on that, but that seems like it bakes in a conclusion.

I haven't exactly formalized this, but I have the intuition that CEV would be doing more work in aggregating extrapolated values than in extrapolating values in the first place. We can't just have it wave a wand (har) and rid ourselves of heuristics and biases to find our true values; too much of human value is wrapped up in those same heuristics and biases, and from an internal viewpoint none of them are any "truer" than any others. We can envision an aggregation process that plays different people's heuristics and biases against each other in some way to find a least-worst kernel of value; but to do that, it needs those data points.

Comment author: Luke_A_Somers 23 February 2015 10:26:21PM *  0 points [-]

Another part of coherence is that, for groups, it's supposed to reconcile differing viewpoints - to only act on what's shared.

Comment author: cogitoprime 23 February 2015 10:45:27PM 4 points [-]

Sooo it could show the coherent desires shared between all Tom Riddles?

Comment author: gwillen 23 February 2015 11:07:43PM 2 points [-]

At first I thought that fact did not seem interesting, since it's not really expected for more than one person to be looking into the mirror at once.

But then I considered that, as the chapter closed, the mirror appeared to be speaking to BOTH Tom Riddles, and now I'm curious what their collective CEV looks like.