You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on The new GiveWell recommendations are out: here's a summary of the charities - Less Wrong Discussion

18 Post author: tog 01 December 2014 09:20PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (17)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 02 December 2014 04:11:35PM 4 points [-]

they have an incentive to represent their results as better than they really are

That's only part of it -- the other part is Goodhart's Law and the fact that they are trying really hard to produce good metrics.

Changes in mortality are really difficult to disentangle

That's not a good reason to search for your keys under a streetlight.

doesn't their approach have an intuitive appeal?

No, not to me. Telling people via mass media that they should behave better doesn't have a great track record :-/

Comment author: AABoyles 02 December 2014 05:36:57PM 1 point [-]

Do you believe samples of self-reported behavior can't be an informative proxy for harder population metrics, like morbidity or mortality?

Comment author: Lumifer 02 December 2014 06:00:31PM 2 points [-]

They could be after you establish the relationship through empirical data.

Comment author: owencb 04 December 2014 05:06:16PM 0 points [-]

Telling people via mass media that they should behave better doesn't have a great track record :-/

I think at least the prevailing view in public health is that it does. This report is a decade old, but was the clearest summary I could find on a quick search. They do emphasise that media campaigns are more likely to be effective when awareness is a major issue and when the desired behaviour change is not that large (both seem true in the case of DMI).

Comment author: Lumifer 04 December 2014 05:22:05PM 1 point [-]

I don't think the report you link to supports your claim. In particular, while it shows some evidence that mass-media campaigns can raise the awareness of an issue, there is no conclusive evidence that they make anyone actually change their behaviour. And that's before we look at the cost-effectiveness of the whole thing.

Comment author: owencb 04 December 2014 05:34:47PM 0 points [-]

They do give a few examples of changing behaviour. For instance:

However, a controlled trial of a TV advertising campaign in central and northern England provides evidence that mass media campaigns may be able to change behaviour. The campaign was effective in reducing smoking prevalence by about 1.2% over 18 months.

However I agree that it doesn't have fantastic evidence of that. But most of my impressions of this come from talking to people who work in public health; my understanding is that at least in rich countries, properly targeted public health campaigns are actually very cost-effective. How this carries over to poor countries is another question, but as a baseline I'd at least assume it's plausible.

Comment author: Lumifer 04 December 2014 05:52:21PM *  1 point [-]

They do give a few examples of changing behaviour.

One -- which you quoted -- and which they offset by the immediately following paragraph which says (emphasis mine):

A study found that the proportion of people who were knowledgeable about the new recommendations increased significantly after the campaign, although it was unclear whether it was TV advertising or other elements of the campaign that made the difference (Hillsdon et al., 2001). However, there was no evidence that the campaign raised levels of physical activity.

Negative evidence is evidence, too.

Comment author: owencb 04 December 2014 07:15:01PM 0 points [-]

There are more examples on the following page (although they are all time series rather than controlled trials, the effect sizes are large enough that it is implausible that they all represent natural background shifts).

I certainly don't think that all public health campaigns are effective, or that awareness always translates into action. I just thought that your statements sounded surprisingly negative about the possibility of them being cost-effective.