Robin_Hanson2 comments on The Bottom Line - Less Wrong

49 Post author: Eliezer_Yudkowsky 28 September 2007 05:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (14)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Robin_Hanson2 28 September 2007 06:39:07PM 10 points [-]

For the person who reads and evaluates the arguments, the question is: what would count as evidence about whether the author wrote the conclusion down first or at the end of his analysis? It is noteworthy that most media, such as newspapers or academic journals, appear to do little to communicate such evidence. So either this is hard evidence to obtain, or few readers are interested in it.

Comment author: austhinker 14 March 2011 07:45:39AM *  1 point [-]

"What would count as evidence about whether the author wrote the conclusion down first or at the end of his analysis?":

Past history of accuracy/trustworthiness;

Evidence of a lack of incentive for bias;

Spot check results for sampling bias.

The last may be unreliable if a) you're the author, or b) your spot check evidence source may be biased, e.g. by a generally accepted biased paradigm.

In the real world this is complicated by the fact that the bottom line may have only been "pencilled in", biased the argument, then been adjusted as a result of the argument - e.g.

"Pencilled in" bottom line is 65;

Unbiased bottom line would be 45;

Adjusted bottom line is 55; - neither correct, nor as incorrect as the original "pencilled in" value.

This "weak bias" algorithm can be recursive, leading eventually (sometimes over many years) to virtual elimination of the original bias, as often happens in scientific and philosophical discourse.