cousin_it comments on The Correct Contrarian Cluster - Less Wrong

38 Post author: Eliezer_Yudkowsky 21 December 2009 10:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (228)

You are viewing a single comment's thread.

Comment author: cousin_it 21 December 2009 11:34:15PM *  8 points [-]

Clusters of opinion may be accidental, e.g. many lemmings follow Eliezer Yudkowsky who is correct on three topics and wrong on two. Or some other pundit. I think such accidental correlations will drown out whatever useful signal you were hoping to uncover by factor analysis. It's a fishy endeavor anyway, smells like determining truth by popular vote spiced up with nifty math. What if all smart people start using your algorithm? You could get some nasty herd effects...

Comment author: Eliezer_Yudkowsky 22 December 2009 12:24:15AM 8 points [-]

Don't poll LWers using keys previously posted on by EY (or RH). That would just be silly.

Comment author: jimmy 22 December 2009 01:11:14AM 1 point [-]

While that would make it harder to distinguish between LW members, that doesn't mean game over.

If we already expect LW members to be more correct, it still might be usefull to poll LW members about what views they have that are:

1) contrarian 2) on topics that most LW members haven't thought about very hard 3) important

Comment author: Eliezer_Yudkowsky 22 December 2009 01:41:39AM 5 points [-]

Using something along the lines of the Amanda Knox litmus test but with no previous posts on it, one presumes?

Comment author: jimmy 22 December 2009 05:12:26AM 2 points [-]

I thought the Amanda Knox test was fascinating, but mostly for the implications it had about rationality, not so much that the fact that this specific convict is in fact innocent.

Things like the shangri-la diet are closer to what I was thinking, since that has potentially huge consequences on its own.

The closet survey is also close to what I had in mind, with a little less emphasis on my #2. It'd also be interesting to see what happens if that that survey was done again, now that we have a better idea of what the shared beliefs are.

Comment author: wedrifid 22 December 2009 12:32:43AM 0 points [-]

It's a fishy endeavor anyway, smells like determining truth by popular vote spiced up with nifty math. What if all smart people start using your algorithm? You could get some nasty herd effects...

This endeavour is intended to reduce the fishiness of seeking truth by conforming to mainstream opinion (along the lines that Robin advocates). The process Eliezer suggests actually filters out a significant amount of the adverse positive feedback effect.

Comment author: Vladimir_Nesov 21 December 2009 11:46:56PM *  0 points [-]

Fishy endeavor anyway - smells like determining truth by popular vote spiced up with nifty math.

"Determining truth" has connotations with "certainty", which is at odds with the fact that evidence here is assumed to be weak -- something to prime attention, not imprint opinions.

(But I agree that the idea of getting any kind of useful conclusions/info from such a poll doesn't seem realistic.)

Edit: after reformulating the method, I changed my mind.

Comment author: Eliezer_Yudkowsky 21 December 2009 11:52:33PM 0 points [-]

Conclusions, no, but it sure might print out a fascinating list of things to investigate.

Comment author: Vladimir_Nesov 21 December 2009 11:57:50PM 0 points [-]

I expect that all "things to investigate" you'd find would've already been on the radar.

Comment author: Eliezer_Yudkowsky 22 December 2009 12:24:57AM 1 point [-]

I don't, especially if you let respondents suggest additional items and incorporated them. The CCC is large and includes things like (probably) the Shangri-La Diet.

Comment author: Vladimir_Nesov 22 December 2009 12:54:08AM *  1 point [-]

Then the gain is not in turning attention to things considered wrong, but more to things that weren't considered at all. High-quality memetic availability pool allowing to not waste time on false positives. Again, too dramatic an effect to get from a poll, and it's unclear to what area should the finds be tuned. I'm not at all interested in know that cold fusion is real if counterfactually it is.