You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Luke_A_Somers comments on The failure of counter-arguments argument - Less Wrong Discussion

14 Post author: Stuart_Armstrong 10 July 2013 01:38PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (43)

You are viewing a single comment's thread.

Comment author: Luke_A_Somers 10 July 2013 06:32:25PM 1 point [-]

There's a kind of "conservation of expected evidence" here: if the critiques had succeeded, you'd have reduced the probability of AI risk, so their failure must push you in the opposite direction.

This doesn't sound quite right. I think what matters is the amount of cogent, non-redundant thought about the subject demonstrated by the failed critiques. If the critique is just generally bad, it shouldn't have an impact either way (I could randomly computer-generate millions of incoherent critiques of creationism, but that wouldn't affect my credence)

Similarly if a hundred experts make the same flawed counterargument, there would be rapidly diminishing returns after the first few.

Comment author: Stuart_Armstrong 11 July 2013 08:54:26AM 1 point [-]

Similarly if a hundred experts make the same flawed counterargument, there would be rapidly diminishing returns after the first few.

Actually, no: because this would be a sign that they aren't capable of finding a better counterargument!

Comment author: Luke_A_Somers 11 July 2013 10:33:52AM 1 point [-]

I thought of that. If they all think of the same thing, they could be going for something obvious but not quite right. Something that pops out at this class of expert and so they don't feel the need to go any further. But if you have an answer to that, that doesn't mean there isn't a remaining problem not available to surface inspection.