This sounds like a huge project to put together from scratch. I recommend looking into some of the existing research on individual differences in rationality, such as Keith Stanovich's books (Who Is Rational? and What Intelligence Tests Miss: The Psychology of Rational Thought seem most relevant) and papers (Stanovich & West 1997 looks particularly useful - they measure people's sensitivity to argument quality on a range of real-life issues).