Chrysophylax comments on Fake Explanations - Less Wrong

58 Post author: Eliezer_Yudkowsky 20 August 2007 09:13PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (81)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Chrysophylax 29 January 2013 10:58:09PM *  1 point [-]

But in this case it's not the rational thing to say when you use decision theory.

I disagree. The proper response to not knowing the answer is to admit to not knowing and then give your best guess, not to try to hide your ignorance, because if you succeed then the teacher doesn't know you need help. A student who is more concerned with not displaying ignorance than with not being ignorant is not trying to learn, which is not rational. That which can be destroyed by the truth should be, and it probably won't be if you try to avoid finding out what the truth is.

You can easily do worse than maximum entropy if you guess at random.

If you base your guess correctly on an incomplete model of reality, which you've constructed correctly from past observations, you can never do worse, on average, than maximum entropy. More evidence can never lead to less information (as per the Data Processing Inequality).

The key phrase here is "on average". If you guess at random from all possible explanations of a given phenomenon, you will, on average, die before guessing the correct answer. There is a reason the monkeys with typewriters are given infinite time to reproduce Hamlet.

Moreover, as the set of answers considered increases in size, the expected utility from giving any one answer tends towards the expected utility of a wrong answer. As long as giving the wrong answer gives less utility than admitting ignorance, admitting ignorance is almost always the utility maximising option if you don't know.

Furthermore, "getting it right" [...] does not necessarily mean that you possess any anticipation-controllers.

On the contrary, it mean exactly that. Being rewarded for predictive powers improves your model of the world, whereas "I don't know" is an excuse for not knowing.

If I write down a number and then take a number from a table of random numbers, and the numbers are the same, does this mean that I'm psychic? Because if getting the correct answer means that I have useful anticipation controllers then I must be.

"I don't know" is not an excuse for not knowing. That makes no sense whatsoever. "I don't know" is a statement about whether I know something or not, not a statement about whether I ought to know. If you can't admit fallibility then you will never learn anything.

The points you make about the benefits of testing students' knowledge are true. Unfortunately, they miss the point - while it is important not to penalise guessing incorrectly, so as not to dissuade admitting ignorance, it is much better to actively reward admitting that you have tried and failed. If a confused student does not always seek an explanation, the reward for seeking explanations isn't large enough yet. If students are content to remain ignorant, something is seriously wrong with your system for making students less ignorant.

Comment author: V_V 30 January 2013 12:45:38AM 0 points [-]

If students could always get away with an "I don't know" they wouldn't have much incentive to learn anything.

More importantly, the school system main purpose is not to teach you just a collection of facts. It has to teach you how to behave in the world, where you often have to make choices based on incomplete information.

Comment author: Chrysophylax 30 January 2013 06:51:34PM *  3 points [-]

Students who do not care about education do get away with not knowing anything. Detention is not much of a punishment when you don't show up.

It is difficult to prevent a student who cares deeply about eduction from admitting ignorance, since admitting ignorance is necessary in asking for explanations. The difficult task is persuading students who care about doing well to seek knowledge, rather than good marks. These students are not motivated enough to learn of their own accord - they never volunteer answers or ask questions openly, because they care more about not being thought ignorant (or, of course, keen) than about not being ignorant.

The point is not to allow students to "get away with" admitting ignorance. There is a vast difference between not knowing the answer and not wanting to know. Personally, I have never found it hard to tell the difference between students who don't want to know and students who don't want to be judged by their peers.

It has to teach you how to behave in the world, where you often have to make choices based on incomplete information.

It is very rarely a bad idea to publicly admit that you might be wrong, especially when you are guessing. A school that does not teach the importance of separating your beliefs and your ego has failed miserably. Whatever else it has taught, it has not taught its students how to learn.