conchis comments on Controlling your inner control circuits - Less Wrong

45 Post author: Kaj_Sotala 26 June 2009 05:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (146)

You are viewing a single comment's thread. Show more comments above.

Comment author: conchis 28 June 2009 08:25:10PM *  1 point [-]

I'm afraid I'm struggling to connect this to your original objections. Would you mind clarifying?

ETA: By way of attempting to clarify my issue with your objection, I think the lottery example differs from this situation in two important ways. AFAICT, the uselessness of evidence that a single person has won the lottery is a result of:

  1. the fact that we usually know the odds of winning the lottery are very low, so evidence has little ability to shift our priors; and

  2. that in addition to the evidence of the single winner, we also have evidence of incredibly many losers, so the sum of evidence does not favour a conclusion of profitability.

Neither of these seem to be applicable here.

Comment author: Vladimir_Nesov 28 June 2009 08:36:53PM 2 points [-]

The analogy is this: using speculative self-help techniques corresponds to playing a lottery, in both cases you expect negative outcome, and in both cases making one more observation, even if it's observation of success, even if you experience it personally, means very little for the estimation of expected outcome. There is no analogy in lottery for studies that support the efficacy of self-help techniques (or some medicine).

Comment author: Benquo 30 June 2009 01:04:39PM *  2 points [-]

It sounds like you're saying:

1) the range of conceivably effective self-help techniques is very large relative to the number of actually effective techniques

2) a technique that is negative-expected-value can look positive with small n

3) consequently, using small-n trials on lots of techniques is an inefficient way to look for effective ones, and is itself negative-expected-value, just like looking for the correct lottery number by playing the lottery.

In this analogy, it is the whole self-help space, not the one technique, that is like a lottery.

Am I on the right track?