(Don't read this if you haven't taken the poll yet.)
For the Vietnam war questions, my and many people's first thought would be that people under 30 would be more likely to oppose the Vietnam War because they are of the age to be drafted. This is an obvious enough idea that even if it turns out to be false, any reasonable explanation would have to mention it, if only to explain that it doesn't apply (and in turn, to either explain that as well, or say that it has no explanation). The lack of mention of such a thing, then, artificially made the given explanation sound less sensible, and as a result I believed the statement to be false when in fact it was true. So this doesn't prove that people find anything convincing with a good explanation, but rather that people find things unconvincing with a poor one.
(Edit: I misread the abortion results.)
Edit2: The Gallup poll at http://www.gallup.com/poll/126581/generational-differences-abortion-narrow.aspx gives a different impression of abortion opinions among the young. If you look at a longer time scale, younger people support abortion more and satt's poll inly shows that they do not because the people who were young in those earlier years got older and kept their opinions.
(Like Jiro's comment, don't read this if you're going to take the poll but haven't yet.)
So this doesn't prove that people find anything convincing with a good explanation, but rather that people find things unconvincing with a poor one.
Fair point. The conclusion to draw, then, should be a more general one: given an observation O and an explanation E of O, people can over-weight E as a piece of evidence about O's probability. (If E sounds plausible it might be taken as de facto proof of O; if E sounds implausible it might be taken as a disconfirmation o...
Over the past year, I've noticed a topic where Less Wrong might have a blind spot: public opinion. Since last September I've had (or butted into) five conversations here where someone's written something which made me think, "you wouldn't be saying that if you'd looked up surveys where people were actually asked about this". The following list includes six findings I've brought up in those LW threads. All of the findings come from surveys of public opinion in the United States, though some of the results are so obvious that polls scarcely seem necessary to establish their truth.
If you've read Eliezer's "Hindsight Devalues Science", you're probably starting to feel déjà vu, and might have guessed that I'm bluffing you to make a point. If so, well done — you're quite correct! But before you assume I'm about to repeat Eliezer's trick and stop there, read the other half of my list:
Here's my twist on Eliezer's twist. It is technically true that the list includes six true findings, but the complete list has 12 items, so half of the statements are false. I made up the false statements as fake variations on the true findings, concocted parenthetical rationalizations for them, and randomly mixed the false claims with the true. I expect a lot of people reading this would, after seeing the full list, have a hard time sorting the true from the false without looking at the data — including the people who nodded along in agreement with the first half of the list.
Totally spurious beliefs about public opinion can have a ring of plausibility, especially because it's easy to invent sensible-sounding reasons why they ought to be correct. The availability heuristic presumably plays a role too, with people inferring the state of public opinion from what their friends & acquaintances think, not accounting for how unrepresentative their social network is. In any event, people's opinions of public opinion are often wrong, and it's worth taking a couple of minutes to look for Gallup poll results and the like online before commenting on public opinion.
Sources. On perceptions of whether the benefits of science outweigh its harmful results, see figure 7-11 from chapter 7 of the National Science Foundation's "Science and Engineering Indicators 2012". On party affiliation, see the polls Gallup runs every month. On abortion views, Pew Research Center has statistics for 2007 through 2012. For a breakdown of beliefs about the Vietnam War by age, consult Hazel Erskine's 1970 article "The Polls: Is War a Mistake?" (Public Opinion Quarterly, 34(1), 134–150); Jim Miller extends the data to May 1971, but presents them somewhat differently. On smokers' regrets, see Geoffrey T. Fong et al.'s 2004 article "The near-universal experience of regret among smokers in four countries: Findings from the International Tobacco Control Policy Evaluation Survey" (Nicotine & Tobacco Research, 6(S3), S341–S351). ↩