I think this is a great idea, and I'm willing to offer time toward such a project.
I had a related, overly-ambitious LessWrong project idea (it contained a variant of this one). But I'll post that in a new thread, to keep this one focused.
I look forward to reading about your project.
Note: This was originally posted in the discussion area, but motions to move it to the top level were made.
-----
My own desire to improve my rationality coupled with some posts criticizing LessWrong not too long ago led to an idea. For reference, the posts I mean are these: