Alejandro1 comments on The Useful Idea of Truth - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (513)
There is the literature professor's belief, the student's belief, and the sentence "Carol is 'post-utopian'". While the sentence can be applied to both beliefs, the beliefs themselves are quite different beasts. The professor's belief is something that carve literature space in a way most other literature professors do. Totally meaningful. The student's belief, on the other hand, is just a label over a set of authors the student have scarcely read. Going a level deeper, we can find an explanation for this label, which turns out to be just another label ("colonial alienation"), and then it stops. From Eliezer's main post (emphasis mine) :
Well, not that floating. The student definitely expects a sensory experience: grades. The problem isn't the lack of expectations, but that they're based on an overly simplified model of the professor's beliefs, with no direct ties to the writing themselves –only to the authors' names. Remove professors and authors' names, and the students' beliefs are really floating: they will have no way to tie them to reality –the writing. And if they try anyway, I bet their carvings won't agree.
Now when the professor grades an answer, only a label will be available ("post-utopian", or whatever). This label probably reflects the student's belief directly. That answer will indeed be quickly patterned matched against a label inside the professor's brain, generating a quick "right" or "wrong" response (and the corresponding motion in the hand that wield the red pen). Just as drawn in the picture actually.
However, the label in the professor's head is not a floating belief like the student's. It's a cached thought, based on a much more meaningful belief (or so I hope).
Okay, now that I recognize your name, I see you're not exactly a newcomer here. Sorry if I didn't told anything you don't know. But it did seem like you conflated mysterious answers (like "phlogiston") and floating beliefs (actual neural constructs). Hope this helped.
If that is what Eliezer meant, then it was confusing to use an example for which many people suspect that the concept itself is not meaningful. It just generates distraction, like the "Is Nixon a pacifist?" example in the original Politics is the mind-killer post (and actually,the meaningfulness of post-colonialism as a category might be a political example in the wide sense of the word). He could have used something from physics like "Heat is transmitted by convention", or really any other topic that a student can learn by rot without real understanding.
I don't think Eliezer meant all what I have written (edit: yep, he didn't). I was mainly analysing (and defending) the example to death, under Daenerys' proposed assumption that the belief in the professor's head is not floating. More likely, he picked something familiar that would make us think something like "yeah, if those are just labels, that's no use".¹
By the way is there any good example? Something that (i) clearly is meaningful, and (ii) let us empathise with those who nevertheless extract a floating belief out of it? I'm not sure. I for one don't empathise with the students who merely learn by rot, for I myself don't like loosely connected belief networks: I always wanted to understand.
Also, Eliezer wasn't very explicit about the distinction between a statement, embodied in text, images, or whatever our senses can process, and belief, embodied in a heap of neurons. But this post is introductory. It is probably not very useful to make the distinction so soon. More important is to realize that ideas are not floating in the void, but are embodied in a medium: paper, computers… and of course brains.
[1] We're not familiar to "post-utopianism" and "colonial alienation" specifically, but we do know the feeling generated by such literary mumbo jumbo.
Thank you! Your post helped me finally to understand what it was that I found so dissatisfying with the way I'm being taught chemistry. I'm not sure right now what I can do to remedy this, but thank you for helping me come to the realization.