Ishaan comments on Aliveness in Training - Less Wrong

9 Post author: katydee 31 October 2013 01:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (36)

You are viewing a single comment's thread.

Comment author: Ishaan 31 October 2013 07:37:59AM *  14 points [-]

While reading primary science literature, I've had the following experiences happen to me on multiple occasions.

1) Read a paper with a surprising result. Later discover it has critical flaws or didn't pass replication. I've learned to increase skepticism with increasingly surprising results. "This study is just wrong because of statistical issues or bad reporting" is now always one of the hypotheses in my mental arsenal, and I've found myself getting a bit better at predicting which results are just wrong using largely the heuristic of "this is too surprising to believe"

2) Form a hypothesis while reading. It gets verified (or falsified) via something you read later. Also, since one typically reads the methods before the results, one gets a lot of practice predicting results. (I don't formally make predictions but I find myself making them automatically as I read.)

Based on these experiences, I suggest that reading primary scientific literature is a good exercise in "alive" epistemic rationality training. The only drawback is that it takes a long time to get sufficiently acquainted with a field.

Comment author: rule_and_line 05 November 2013 12:54:53AM 2 points [-]

While I don't read scientific literature that much, I do make formal predictions pretty often. Typically any time I notice something I'm interested in that will be easy to check in the future.

Will I get to bed on time today? Will I be early for the meeting tomorrow? Etc.

I second the anecdotal evidence that this is a "live" exercise. Sidenote: it took me way too long to realize I needed to write all my predictions down. I spent a few weeks thinking I was completely excellent at predicting things.