You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Metus comments on Fixing Moral Hazards In Business Science - Less Wrong Discussion

33 Post author: DavidLS 18 October 2014 09:10PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (96)

You are viewing a single comment's thread. Show more comments above.

Comment author: Metus 19 October 2014 06:03:02AM 10 points [-]

Those participants are randomly assigned to two groups: (1) act normal, and (2) use Beeminder to track exercise and food intake.

These kind of studies suffer from the Hawthorne effect. It is better to assign the control group to do virtually anything instead of nothing. In this case I'd suggest to have them simply monitor their exercise and food intake without any magical line and/or punishment.

Comment author: DavidLS 19 October 2014 07:05:18AM *  3 points [-]

Thank you. I had forgotten about that.

So let's say the two groups were, as you suggest:

  • Tracking food & exercise on Beeminder
  • Tracking food & exercise in a journal

Do you have any thoughts on what questions we should be asking about this product? Somehow the data collection and analysis once we have the timeseries data doesn't seem so hard... but the protocol and question design seems very difficult to me.

Comment author: pjeby 24 October 2014 05:24:26PM 3 points [-]

I wonder if there should be a group where they still get Beeminder's graph, but they don't pay anything for going off their road. (In order to test whether the pledge system is actually necessary.)

Comment author: Gunnar_Zarncke 19 October 2014 07:16:53AM 1 point [-]

Yes, It should be a task that has a camparable amount of effort behind it.