You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Open Thread April 16 - April 22, 2014 - Less Wrong Discussion

4 Post author: Tenoke 16 April 2014 07:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (190)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 16 April 2014 03:00:37PM 6 points [-]

You can't detect whether a systematic bias in the sampling method exists by looking at the results.

If you have a prior, you can.

In a slightly more unrolled manner, if the results you are getting are inconsistent with your ideas of how the world works, one hypothesis that you should update is that your ideas about the world are wrong. But another hypothesis that you should also update is that your sampling method is wrong, e.g. by having a systematic bias.