I had an idea for a web-based app for evaluating instrumental rationality techniques, something like Digg or UserVoice-based forum where techniques get upvoted, downvoted, merged, separated and discussed. However, I don't currently have a solution for the problem of 'impulse upvoting' ("hey, this technique sounds cool, let's upvote it!") -- I don't know how to make the upvotes reflect long-term usefulness of the techniques.

We must also be aware of the PredictionBook problem. It isn't integrated into LW, therefore it gets little traffic, and, as a result, is underused -- as of this writing, it's not even mentioned in this thread. Lesson to learn: if we want the power tool to work, it must be properly integrated into LW (same login, homepage / sidebar widget, LW moderation policy to redirect relevant discussions there etc.)