Time estimation app
At the beginning of each week, enter the things you plan to do during the week, the probability that you estimate of doing them, and the percentage of time you'll spend on various distractions (eg. if you use Rescuetime to count hours of distracted browsing, or the number of movies / TV Series you'll watch during the week), again with confidence intervals.
Then, by the end of the week, you can check your score, and compare it to others!
(This doesn't require a dedicated app, it could be a spreadsheet in google docs shared between a few people, with their email/contacts so they can remind each other to fill in the table once the week is over)
I try to do this by hand, but this would be much more convenient. Also, in addition to using it as a rationality training tool I would be interested in a program that collects this data and then uses it to directly help me make predictions about future projects.
Last month, mobile gaming superstar Angry Birds was out-sold in some countries by DragonBox, a kids game in which players solve alegbra equations.
How does the game work? Jonathan Liu explains:
The key to DragonBox's success is not that it's the best algebra tutorial available, but rather that it's actually fun for its target audience to play.
Others have noticed the potential of "computer-assisted education" before. Aubrey Daniels writes:
Remember what works in reinforcement: Small reinforcements are fine, but the reinforcer should immediately follow the target behavior, and it should be conditional on the specific behavior you want to strengthen.
Video games are perfect for that! Little hits of reinforcement can be given many times a minute, conditional on exactly the kind of behavior your want to reinforce, and conditional on exactly the behavior you want to reinforce.
DragonBox is just a particularly successful implementation of this insight.
One of the goals for the Center for Applied Rationality is to develop rationality games and apps. But it's tricky to think of how to make addictive games that actually teach rationality skills. So I'd like to provide a place for people to brainstorm ideas about what would make an addictive and instructive rationality game.
See also: Rationality and Video Games, Gamification and Rationality Training, Raytheon to Develop Rationality-Training Games.