gwern comments on Open Thread April 16 - April 22, 2014 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (190)
What's a good Bayesian alternative to statistical significance testing? For example, if I look over my company's email data to figure out what the best time of the week to send someone an email is, and I've got all possible hours of the week ordered by highest open rate to lowest open rate, how can I get a sense of whether I'm looking at a real effect or just noise?
In that scenario, how much does it really matter? It's free to send email at one time of week rather than another, so your only cost is the opportunity cost of picking a bad time to email people, which doesn't seem likely to be too big.
Our email send by the hour would get far lumpier, so we would have to add more servers in order to handle a much higher peak emails sent per minute. And it takes development effort to configure emails to send at an intelligent time based on the user's timezone.