Possible model extensions:
Does best allow you to add prior information?
You might try adding a prior over the effect size, it would be surprising if it was huge. For example, -30 seems implausibly large to me.
You could also add priors for the group means. You have some pretty good prior information here since there are lots of other posts.
It would be interesting to look at the distribution of post karma. That might be kind of informative, perhaps it would be better to do the analysis on something like a log scale? Obviously it can't be exactly that since there are negative values...
Does best allow you to add prior information?
Supposedly you can add it but you'd have to edit the source, and that's beyond me right now.
You might try adding a prior over the effect size, it would be surprising if it was huge. For example, -30 seems implausibly large to me.
Sure, but the normal distribution is the wrong distribution to be using in the first place. I'm not really sure what... an exponential, maybe?
...You could also add priors for the group means. You have some pretty good prior information here since there are lots of other posts. It w
Full writeup on gwern.net at http://www.gwern.net/Anchoring