You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Douglas_Knight comments on Open thread, Mar. 14 - Mar. 20, 2016 - Less Wrong Discussion

3 Post author: MrMind 14 March 2016 08:02AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (212)

You are viewing a single comment's thread. Show more comments above.

Comment author: Anders_H 20 March 2016 05:32:34AM *  2 points [-]

Three days ago, I went through a traditional rite of passage for junior academics: I received my first rejection letter on a paper submitted for peer review. After I received the rejection letter, I forwarded the paper to two top professors in my field, who both confirmed that the basic arguments seem to be correct and important. Several top faculty members have told me they believe the paper will eventually be published in a top journal, so I am actually feeling more confident about the paper than before it got rejected.

I am also very frustrated with the peer review system. The reviewers found some minor errors, and some of their other comments were helpful in the sense that they reveal which parts of the paper are most likely to be misunderstood. However, on the whole, the comments do not change my belief in the soundness of the idea, and in my view they mostly show that the reviewers simply didn’t understand what I was saying.

One comment does stand out, and I’ve spent a lot of energy today thinking about its implications: Reviewer 3 points out that my language is “too casual”. I would have had no problem accepting criticism that my language is ambiguous, imprecise, overly complicated, grammatically wrong or idiomatically weird. But too casual? What does that even mean? I have trouble interpreting the sentence to mean anything other than an allegation that I fail at a signaling game where the objective is to demonstrate impressiveness by using an artificially dense and obfuscating academic language.

From my point of view, “understanding” something <i>means</i> that you are able to explain it in a casual language. When I write a paper, my only objective is to allow the reader to understand what my conclusions are and how I reached them. My choice of language is optimized only for those objectives, and I fail to understand how it is even possible for it to be “too casual”.

Today, I feel very pessimistic about the state of academia and the institution of peer review. I feel stronger allegiance to the rationality movement than ever, as my ideological allies in what seems like a struggle about what it means to do science. I believe it was Tyler Cowen or Alex Tabarrok who pointed out that the true inheritors of intellectuals like Adam Smith are not people publishing in academic journals, but bloggers who write in a causal language. I can’t find the quote but today it rings more true than ever.

I understand that I am interpreting the reviewers choice of words in a way that is strongly influenced both by my disappointment in being rejected, and by my pre-existing frustration with the state of academia and peer review. I would very much appreciate if anybody could steelman the sentence “the writing is too casual”, or otherwise help me reach a less biased understanding of what just happened.

The paper is available at https://rebootingepidemiology.files.wordpress.com/2016/03/effect-measure-paper-0317162.pdf . I am willing to send a link to the reviewers’ comments by private message to anybody who is interested in seeing it.

Comment author: Douglas_Knight 20 March 2016 04:18:43PM 1 point [-]

Without reading your paper, and without rejecting your hypothesis, let me propose other consequences of casual language. Experts use tools casually, but there may be pitfalls for beginners. Experts are allowed more casual language and the referee may not trust that you, personally, are an expert. That is a signaling explanation, but somewhat different. A very different explanation is that while your ultimate goal is to teach the reader your casual process, but that does not mean that recording it is the best method. Your casual language may hide the pitfalls from beginners, contributing both to their incorrect usage and to their not understanding how to choose between tools.

If your paper is aimed purely at experts, then casual language is the best means of communication. But should it be? Remember when you were a beginner. How did you learn the tools you are using? Did you learn them from papers aimed at beginners or experts; aimed at teaching tools or using them? Casual language papers can be useful for beginners as an advertisement: "Once you learn these tools, you can reason quickly and naturally, like me."

Professors often say that they are surprised by which of their papers is most popular. In particular, they are often surprised that a paper that they thought was a routine application of a popular tool becomes popular as an exposition of that tool; often under the claim that it is a new tool. This is probably a sign that the system doesn't generate enough exposition, but taking the system as given, it means that an important purpose of research papers is exposition, that they really are aimed at beginners as well as experts.

This is not to say that I endorse formal language. I don't think that formal language often helps the reader over the pitfalls; that work must be reconstructed by the reader regardless of whether it the author spelled it out. But I do think that it is important to point out the dangers..