I agree. What I was thinking about lately is that we need practical procedures to guide our reasoning. For example we could argue all day long about whether someone should or shouldn't study in college. But is there a practical procedure that could give us or guide us towards a more objective answer?
Even on a very fundamental level I still think there are pitfalls. E.g. I think everyone agrees that as a Bayesian reasoner you should take all evidence into account, but in practice people will just discount evidence against their opinion.
Post by fellow LW reader Razib Khan, who many here probably know from the gnxp site or perhaps from his debate with Eliezer. Somewhat related to a post we also seem to have discussed.
Edit: I linked to the wrong article! (~_~;) Fixed!