You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Perplexed comments on Are Interesting Problems Useful? - Less Wrong Discussion

13 Post author: paulfchristiano 01 March 2011 03:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread.

Comment author: Perplexed 01 March 2011 04:07:16PM 1 point [-]

In the biological sciences, one often finds claims of interestingness or usefulness in the abstracts, introductions, and conclusion sections of research papers. Research may claim to overthrow existing paradigms, for example, or lead to disease cures. Presumably one also finds these claims or promises in research proposals. But I'm not sure how one evaluates research papers and programs for how much interestingness and usefulness they actually deliver.

Some kind of citation metric, presumably. But how do we distinguish between being cited for being interesting vs being cited for being useful?

Comment author: paulfchristiano 01 March 2011 05:21:54PM 0 points [-]

A citation metric seems like a bad way of evaluating usefulness, but a good measure of another type of interestingness (are papers cited often in the next year likely to contain useful insights?)

To determine usefulness we need to look at something other than publications. We can hope to estimate how the state of modern theory affects modern practice---what ideas or modes of thinking are important, what techniques are used in practice, etc. Looking back, we then have some leverage to understand what research programs helped advance our understanding in a relevant way, or were indirectly necessary for the development of practically important techniques.

Comment author: Manfred 01 March 2011 06:13:35PM 1 point [-]

We probably want something automatable, though. Maybe look at the flow of key words and phrases (ones that grouped papers tend to share with each other and not with other papers) from the literature of pure science to engineering and industry?