NancyLebovitz comments on Open thread, Nov. 16 - Nov. 22, 2015 - Less Wrong

7 Post author: MrMind 16 November 2015 08:03AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (185)

You are viewing a single comment's thread.

Comment author: NancyLebovitz 16 November 2015 07:38:53PM 26 points [-]

http://mindhacks.com/2015/11/16/no-more-type-iii-error-confusion/#comments

Use "The Boy Who Cried Wolf" as a mnemonic. His first error is type 1 (claiming a wolf as present when there wasn't one). His second error is type 2 (people don't notice an existing wolf).

Comment author: gjm 17 November 2015 04:34:02PM 25 points [-]

Nice.

To fight back against terrible terminology from the other side (i.e., producing rather than consuming) I suggest a commitment to refuse to say "Type I error" or "Type II error" and always say "false positive" or "false negative" instead.

Comment author: twanvl 18 November 2015 10:33:27AM 1 point [-]

I find "false positive" and "false negative" also a bit confusing, albeit less so than "type I" and "type II" errors. Perhaps because of a programming background, I usually interpret 'false' and 'negative' (and '0') as the same thing. So is a 'false positive' something that is false but is mistaken as positive, or something that is positive (true), but that is mistaken as false (negative)? In other words, does 'false' apply to the postiveness (it is actually negative, but classified as positive), to being classified as positive (it is actually positive, but classified as positive)?

Perhaps we should call false positives "spurious" and false negatives "missed".

Comment author: gjm 18 November 2015 11:24:29AM 3 points [-]

Huh. That never occurred to me (even though I spend a lot of my days writing code too).

In case you're expressing actual uncertainty rather than merely what your brain gets confused about, the answer is that a false positive is something that falsely looks positive. Perhaps the best way to put it is different, though: a false positive is a positive result of your test (so it actually is a positive) that doesn't match the underlying reality. Like a "false alarm".

Comment author: philh 18 November 2015 10:35:29AM 0 points [-]

Now that I know which is which, this will be very slightly harder for me than it used to be.

Comment author: D_Malik 18 November 2015 08:53:44PM 2 points [-]

Introspecting, the way I remember this is that 1 is a simple number, and type 1 errors are errors that you make by being stupid in a simple way, namely by being gullible. 2 is a more sophisticated number, and type 2 errors are ones you make by being too skeptical, which is a more sophisticated type of stupidity. I do most simple memorization (e.g. memorizing differentiation rules) with this strategy of "rationalizing why the answer makes sense". I think your method is probably better for most people, though.

Comment author: IlyaShpitser 16 November 2015 10:44:27PM 2 points [-]

Nice!

Comment author: MrMind 17 November 2015 07:55:04AM 1 point [-]

Ha, I wasn't even aware of this. Really nice, thanks.