bigjeff5 comments on The Scales of Justice, the Notebook of Rationality - Less Wrong

41 Post author: Eliezer_Yudkowsky 13 March 2007 04:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: MoreOn 04 February 2011 02:07:39PM 0 points [-]

You're right, of course.

I'd written the above before I read this defense of researchers, before I knew to watch myself when I'm defending research subjects. Maybe I was far too in shock to actually believe that people would honestly think that.

Comment author: bigjeff5 04 February 2011 05:59:43PM 0 points [-]

Yeah, it's a roundabout inference that I think happens a lot. I notice it myself sometimes when I hear X, assume X implies Y, and then later find out Y is not true. It's pretty difficult to avoid, since it's so natural, but I think the key is when you get surprised like that (and even if you don't), you should re-evaluate the whole thing instead of just adjusting your overall opinion slightly to account for the new evidence. Your accounting could be faulty if you don't go back and audit it.

Comment author: Keith_Coffman 03 September 2014 02:53:43AM 0 points [-]

I think we should also separate the subjects of the psychology behind when this might happen and whether or not we are using scales.

It may indeed be the case that people are bad accountants (although I rarely find myself assuming these implied things, and further if I find that my assumptions are wrong I adjust accordingly), but this doesn't change the fact that we are adding +/- points (much like you're keeping score/weighing the two alternatives).

Assuming a perfectly rational mind was approaching the proposition of reactor A vs reactor B (and we can even do reactor C...), then the way it would decide which proposition is best is by tallying the pros/cons to each proposition. Of course, in reality we are not perfectly rational and moreover different people assign different point-values to different categories. But it is still a scale.