TraderJoe comments on Raising the forecasting waterline (part 1) - Less Wrong

32 Post author: Morendil 09 October 2012 03:49PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (108)

You are viewing a single comment's thread.

Comment author: TraderJoe 10 October 2012 10:24:46AM *  2 points [-]

[comment deleted]

Comment author: TheOtherDave 10 October 2012 02:13:21PM *  1 point [-]

provided I think a question and its negation are equally likely to have been asked, there is a 50% chance that the answer to the question you have asked is yes.

Well, yes. But ought I believe that a yes/no question I have no idea about is as likely as its negation to have been asked? (Especially if it's being asked implicitly by a situation, rather than explicitly by a human?)

Comment author: TraderJoe 10 October 2012 05:48:05PM *  1 point [-]

[comment deleted]

Comment author: chaosmosis 10 October 2012 06:22:14PM 1 point [-]

Ratio of true statements to false ones: low. Probability TraderJoe wants to make TheOtherDave look foolish: moderate, slightly on the higher end. Ratio of the probability that giving an obviously false statement an answer of relatively high probability would make TheOtherDave look foolish to the probability that giving an obviously true statement a relatively low probability would make TheOtherDave look foolish: moderately high. Probability that the statement is neither true nor false: low.

Conclusion: أنا من (أمريك is most likely false.

Comment author: TheOtherDave 10 October 2012 06:31:59PM 0 points [-]

Ratio of the probability that giving an obviously false statement an answer of relatively high probability would make TheOtherDave look foolish to the probability that giving an obviously true statement a relatively low probability would make TheOtherDave look foolish: moderately high.

That's interesting.

I considered a proposition like this, decided the ratio was roughly even, concluded that TraderJoe might therefore attempt to predict my answer (and choose their question so I'd be wrong), decided they'd have no reliable basis on which to do so and would know that, and ultimately discarded the whole line of reasoning.

Comment author: chaosmosis 10 October 2012 07:02:40PM *  -2 points [-]

I considered a proposition like this, decided the ratio was roughly even, concluded that TraderJoe might therefore attempt to predict my answer (and choose their question so I'd be wrong),

I figured that it would be more embarrassing to say something like "It is true that I am a sparkly unicorn" than to say "It is false that an apple is a fruit". Falsehoods are much more malleable, largely as an effect of the fact that there are so many more of them than truths, also because they don't have to be consistent. Since falsehoods are more malleable it seems that they'd be more likely to be ones used in an attempt to insult someone.

decided they'd have no reliable basis on which to do so and would know that, and ultimately discarded the whole line of reasoning.

My heuristic in situations with recursive mutual modeling is to assume that everyone else will discard whatever line of reasoning is recursive. I then go one layer deeper into the recursion than whatever the default assumption is. It works well.

Comment author: TheOtherDave 10 October 2012 07:17:46PM 3 points [-]

I then go one layer deeper into the recursion than whatever the default assumption is. It works well.

Sadly, I appear to lack your dizzying intellect.

Comment author: chaosmosis 10 October 2012 07:26:32PM 3 points [-]

I used to play a lot of Rock, Paper, Scissors; I'm pretty much a pro.

Comment author: gjm 10 October 2012 09:40:07PM 1 point [-]

It is possible that you may have missed TheOtherDave's allusion there.

Comment author: chaosmosis 10 October 2012 10:27:16PM *  0 points [-]

The phrase sounded familiar, but I don't recognize where it's from and a Google search for "lack your dizzying intellect" yielded no results.

Comment author: chaosmosis 10 October 2012 07:04:26PM *  -1 points [-]

My heuristic in situations with recursive mutual modeling is to assume that everyone else will discard whatever line of reasoning is recursive. I then go one layer deeper into the recursion than whatever the default assumption is. It works well.

Preempt: None of you have any way of knowing whether this is a lie.

Comment author: chaosmosis 10 October 2012 07:07:55PM -1 points [-]

The parent of this comment (yes, this one) is a lie.

Comment author: chaosmosis 10 October 2012 07:08:03PM -2 points [-]

The parent of this comment (yes, this one) is a lie.

Comment author: chaosmosis 10 October 2012 07:09:02PM -2 points [-]

The parent of this comment is true. On my honor as a rationalist.

I would like people to try to solve the puzzle.

This comment (yes, this one) is true.

Comment author: chaosmosis 10 October 2012 06:23:34PM -1 points [-]

PBEERPG.

Comment author: TheOtherDave 10 October 2012 06:08:04PM 1 point [-]

I assume you mean without looking it up.

My answer is roughly the same as TimS's... it mostly depends on "Would TraderJoe pick a true statement in this context or a false one?" Which in turn mostly depends on "Would a randomly selected LWer pick a true statement in this context or a false one?" since I don't know much about you as a distinct individual.

I seem to have a prior probability somewhat above 50% for "true", though thinking about it I'm not sure why exactly that is.

Looking it up, it amuses me to discover that I'm still not sure if it's true.

Comment author: CCC 11 October 2012 06:57:12AM 0 points [-]

This is a perfect situation for a poll.

How probable is it that TraderJoe's statement, in the parent comment, is true?

Submitting...

Comment author: chaosmosis 12 October 2012 04:14:11AM *  0 points [-]

I voted with what I thought my previous estimate was before I'd checked via rot13.

Comment author: TraderJoe 11 October 2012 10:44:11AM *  0 points [-]

[comment deleted]

Comment author: TimS 10 October 2012 05:52:48PM 0 points [-]

It seems like my guess should be based on how likely I think it is that your are trying to trick me in some sense. I assume you didn't pick a sentence at random.

Comment author: TraderJoe 12 October 2012 07:34:07AM *  0 points [-]

[comment deleted]

Comment author: TraderJoe 10 October 2012 05:49:12PM *  0 points [-]

[comment deleted]

Comment author: Kindly 11 October 2012 02:44:27PM 0 points [-]

The transliteration does, but the actual Arabic means "V'z Sebz Nzrevpn".

So in fact TraderJoe's prediction of 0.5 was a simple average over the two statements given, and everyone else giving a prediction failed to take into account that the answer could be neither "true" nor "false".

Comment author: TheOtherDave 10 October 2012 06:11:57PM 0 points [-]

Not according to google translate. Incidentally, that string is particularly easy to uncypher by inspection.

Comment author: TraderJoe 11 October 2012 06:40:41AM *  0 points [-]

[comment deleted]

Comment author: thomblake 10 October 2012 06:15:04PM 0 points [-]

Yeah, that's an interesting discrepancy.

Comment author: chaosmosis 10 October 2012 06:17:19PM *  0 points [-]

All questions that you encounter will be asked by a human. I get what you mean though, if other humans are asking a human a question then distortions are probably magnified.

Comment author: TheOtherDave 10 October 2012 06:25:29PM 1 point [-]

Some questions are implicitly raised by a situation. "Is this coffee cup capable of holding coffee without spilling it?", for example. When I pour coffee into the cup, I am implicitly expressing more than 50% confidence that the answer is "yes".

Comment author: chaosmosis 10 October 2012 10:34:36PM 0 points [-]

What I'm saying is that what's implicit is a fact about you, not the situation, and the way the question is formed is partially determined by you. I was vague in saying so, however.

Comment author: TheOtherDave 10 October 2012 10:48:17PM 0 points [-]

I agree that the way the question is formed is partially determined by me. I agree that there's a relevant implicit fact about me. I disagree that there's no relevant implicit fact about the situation.

Comment author: chaosmosis 11 October 2012 02:54:41AM 0 points [-]

Nothing can be implicit without interpretation, sometimes the apparent implications of a situation are just misguided notions that we have inside our heads. You're going to have a natural tendency to form your questions in certain ways, and some of these ways will lead you to asking nonsensical questions, such as questions with contradictory expectations.

Comment author: TheOtherDave 11 October 2012 03:22:07AM 1 point [-]

I agree that the apparent implications of a situation are notions in our heads, and that sometimes those notions are nonsensical and/or contradictory and/or misguided.

Comment author: FAWS 10 October 2012 10:56:54AM 1 point [-]

I disagree with this. The reason you shouldn't assign 50% to the proposition "I will win the lottery" is because you have some understanding of the odds behind the lottery. If a yes/no question which I have no idea about is asked, I am 50% confident that the answer is yes. The reason for this is point 2: provided I think a question and its negation are equally likely to have been asked, there is a 50% chance that the answer to the question you have asked is yes.

That's only reasonable if some agent is trying to maximize the information content of your answer. The vast majority of possible statements of a given length are false.

Comment author: TraderJoe 10 October 2012 05:54:10PM 2 points [-]

Sure, but how often do you see each of the following sentences in some kind of logic discussion: 2+2=3 2+2=4 2+2=5 2+2=6 2+2=7

I have seen the first and third from time to time, the second more frequently than any other, and virtually never see 2+2 = n for n > 5. Not all statements are shown with equal frequency. My guess is that the percentage of the time when "2+2 = x" is written in contexts where the statement is for a true/false logic proposition rather than an equation x = 4 is more common than all other values put together.

Comment author: ArisKatsaris 10 October 2012 11:25:04AM 0 points [-]

The vast majority of possible statements of a given length are false.

That's surely an artifice of human languages and even so it would depend on whether the statement is mostly structured using "or" or using "and".

There's a 1-to-1 mapping between true and false statements (just add 'the following is false:' in front of each statement to get the opposite). In a language where 'the following is false' is assumed, the reverse would be actual.

Comment author: FAWS 10 October 2012 12:45:19PM *  -1 points [-]

That's surely an artifice of human languages and even so it would depend on whether the statement is mostly structured using "or" or using "and".

It's true of any language optimized for conveying information. The information content of a statement is reciprocal to it's prior probability, and therefore more or less proportional to how many other statements of the same form would be false.

In your counter example the information content of a statement in the basic form decreases with length.

Comment author: TimS 10 October 2012 12:54:07PM -1 points [-]

I'm not sure your statement is true.

Consider:
The sky is blue.
The sky is red.
The sky is yellow.
The sky is pink.

Comment author: [deleted] 10 October 2012 01:27:16PM *  1 point [-]

The sky is not blue. The sky is not red. The sky is not yellow. The sky is not pink.

Anyway, it depends on what you mean by “statement”. The vast majority of all possible strings are ungrammatical, the vast majority of all grammatical sentences are meaningless, and most of the rest refer to different propositions if uttered in different contexts (“the sky is ochre” refers to a true proposition if uttered on Mars, or when talking about a picture taken on Mars).

Comment author: Will_Sawin 11 October 2012 06:03:46AM 1 point [-]

The typical mode of communication is an attempt to convey information by making true statements. One only brings up false statements in much rarer circustances, such as when one entity's information contradicts another entity's information. Thus, an optimized language is one where true statements are high in information.

Otherwise, to communicate efficiently, you'd have to go around making a bunch of statements with an extraneous not above the default for the language, which is wierd.

This has the potential to be trans-human, I think.

Comment author: [deleted] 11 October 2012 03:27:04PM *  1 point [-]

But whether a statement is true or false depends on things other than the language itself. (The sentence “there were no aces or kings in the flop” is the same length whether or not there were any aces or kings in the flop.) The typical mode of communication is an attempt to convey information by making true but non-tautological statements (for certain values of “typical” -- actually implicatures are often at least as important as truth conditions). So, how would such a mechanism work?

Comment author: Kindly 10 October 2012 01:22:59PM 1 point [-]

But, on the other hand:

The sky is not blue. The sky is not red. The sky is not yellow. The sky is not pink.

Comment author: ArisKatsaris 10 October 2012 01:02:40PM *  0 points [-]

You need to be more specific about what exactly it is I said that you're disputing - I am not sure what it is that I must 'consider' about these statements.

Comment author: TimS 10 October 2012 02:30:04PM 1 point [-]

On further consideration, I take it back. I was trying to make the point that "Sky not blue" != "Sky is pink". Which is true, but does not counter your point that (P or !P) must be true by definition.

It is the case that the vast majority of grammatical statements of a give length are false. But until we have a formal way of saying that statements like "The Sky is Blue" or "The Sky is Pink" are more fundamental than statements like "The Sky is Not Blue" or "The Sky is Not Pink," you must be correct that this is an artifact of the language used to express the ideas. For example, a language where negation was the default and additional length was needed to assert truth would have a different proportion of true and false statements for any given sentence length.

Also, lots of downvotes in this comment path (on both sides of the discussion). Any sense of why?

Comment author: Morendil 10 October 2012 07:55:35PM *  0 points [-]

The reason you shouldn't assign 50% to the proposition "I will win the lottery" is because you have some understanding of the odds behind the lottery.

Yup. Similarly you don't assign 50% to the proposition "X will change", where X is a relatively long-lasting feature of the world around you - long-lasting enough to have been noticed as such in the first place and given rise to the hypothesis that it will change. (In the Le Pen prediction, the important word is "cease", not "Le Pen" or "election".)

ETA: what I'm getting at is that nobody gives a damn about the class of question "yes/no question which I have no idea about". The subthread about these questions is a red herring. When a question comes up about "world events", you have some idea of the odds for change vs status quo based on the general category of things that the question is about. For instance many GJP questions are of the form "Will Prime Minister of Country X resign or otherwise vacate that position within the next six months?". Even if you are not familiar with the politics of Country X, you have some grounds for thinking that the "No" side of the question is more likely than the "Yes" side - for having an overall status quo bias on this type of question.