DavidLS comments on Fixing Moral Hazards In Business Science - Less Wrong

33 Post author: DavidLS 18 October 2014 09:10PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (96)

You are viewing a single comment's thread.

Comment author: DavidLS 21 October 2014 08:18:35AM *  1 point [-]

Okay, sorry I've been away from the thread for a while. I spent the last half day hacking together a rough version of the data collection webapp. This seemed reasonable because I haven't heard any disagreement on that part of the project, and I hope that having some working code will excite us :)

The models are quite good and well tested at this point, but the interface is still a proof of concept. I'll have some more time tomorrow evening, which will hopefully be enough time to finish off the question rendering and SMS sending. I think with those two features added, we will have a reasonable v1.

We will still need to create

  • The main project page & study creation interfaces
  • Questions for use in our initial experiments
  • Participant location and screening criteria
  • Data analysis routines
  • Legal contracts
  • Paper describing what we did -- erdos numbers don't grow on trees :p

Repo is: https://github.com/GeneralBiotics/GLaDyS (I'll move it away from the GB github once we finalize a project name).

Update: Question rendering now works, demo app can be viewed at http://gladys-example.herokuapp.com/

Comment author: JenniferRM 28 October 2014 05:31:33AM 1 point [-]

Cool work! I think it might make sense to create a new top level post to point to the progress and solicit more feedback. Comments down here aren't going to get enough eyeballs, and now that you're getting into the prototyping stage more eyeballs (and associated feedback) would be useful I think.

One thing I wonder, maybe you could have a dummy study set up to test the efficacy of something incredibly simple, like whether "apple eating increases prescience" as a control group for experiments. Some people get the apple condition. Some people get the no apple condition. Every evening participants get a question "Did you eat an apple today?" and "How did your secret coin toss come out, heads or tails?" To be in the study people have to go through a screening process and agree that if randomly assigned to do so, they will buy some apples and eat at least one apple a day, every day for a week.

That way LWers could sign up for it and interact with the software, and workflows like user signup and data collection and whatnot could be experienced and iterated to get feedback on the little practical things before the Serious Science begins in earnest :-)