9 months ago, I designed something like a rationality test (as in biological rationality, although parts of it depend on prior knowledge of concepts like expected value). I'll copy it here, I'm curious whether all my questions will get answered correctly. Some of the questions might be logically invalid, please tell me if they are and explain your arguments (I didn't intend any question to be logically invalid). Also, certain bits might be vague - if you don't understand it, it's likely that it's my fault. Feel free to skip any amount of questions and selectively answer only the ones you like the most. Needless to say, I'm not a psychometrician and I can't guarantee the correlation between someone's rationality and his answers to this test.
1: Assume that exactly 10% of the people in the world are left-handed. Also assume that there are absolutely no differences between left-handed and right-handed people (so that the only groups of people where the expected percentage of left-handers is different from 10% are ones where membership explicitly depends on handedness). For these examples, we are looking at a randomly picked class of 24 students from a randomly chosen school. Note: all the examples are independent and in no particular order.
a) If we randomly pick three students - turns out that all of them are left-handed - do we still expect the average number of left-handers among the remaining 21 students to be 10%?
b) We count 10 right-handers (assuming that we managed to find at least 10 right-handers - if we didn't, we would have changed the group). Among the remaining 14 students, is the average number of left-handers still 10%?
c) We randomly count 10 students. Turns out that all of them are right-handed. Is the average number of left-handers for the rest of the class still 10%? If your answer to this question was different from your answer to b), please explain why was this the case.
d) You happen to know one of the students in this class. You met him one day from a meeting, which was attended by all of the students from three of the classes in the school (out of 13 classes, each class has 24 students) - on that meeting, you randomly picked a left-handed person, out of all the left-handers who were there. Does this fact mean that the average number of left-handers in the remaining 23 students is different from 10%?
e) Out of all the left-handers in the world (about 700 million), you pick one at random. He happens to be from that class. Does this affect the average number of left-handers out of the remaining 23 people? (note that even very low changes in probability count as changes)
2: You are in Bulgaria. The number plates there always have four random numbers from 0 to 9. A person next to you claims to have psychic abilities and he says that the next car that you'll come across will have the number 1337. The next car you come across has the number 1307. You are amazed by this and think that he might have real powers. He was very close to the actual number - what is the probability for someone to guess a number as close as he did, if we assume that he only made a guess?
3: Assume that A and B are psychological factors, both significantly correlated with school grades. It's still possible (but unlikely) to have a good grades with a low score on either of them, or even both of them. Also we assume that A and B are totally uncorrelated, and that the only criteria for acceptance in a university is grades. a) If you are in a university of average quality (with correspondingly average requirements for grades), and you aim to find people who score as high on A as possible, is it a good strategy to place higher priority on people who score as high on B as possible, or should they score as low as possible? Why? b) Does your answer to a) change if the university is of low quality? What if it's of high quality? If yes, why?
4: You have to pick between a certain profit of 10$ or 35% chance of winning 30$. Assume you already are financially stable and have a lot of money. Which is the correct choice, if you want to have as much money as possible?? Why?
(note that even very low changes in probability count as changes)
And you tell me that now? I had been answering the previous questions assuming I was allowed to round numbers of the order of 1/(world population) down to zero...
If it's worth saying, but not worth its own post, even in Discussion, it goes here.