If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.
**Part 1: IS EXPERT OPINION A WASTE OF TIME?
Part 2 on 'Which experts to trust', 'Limitations' and 'Practice' available here
To the lay person, graphs are intimidating. Atmospheric science is notoriously complex. Expert judgement is a ‘next best’ option, then perhaps what is socially normative and marketable.
To the lay person, how can expert judgement be interpreted? Who even gets counted as an expert. We frequently hear about a ‘scientific consensus’ but also here from seemingly erudite ‘skeptics’, who use graphs that are compelling but uninterpretable in the broader context of all the information around.
It looks like the naive algorithm for evaluating evidenc, while a naive Bayesian conclusion, is not particularly efficient in some important cases:
This has real world consequences:
I feel climate change is a good example of a thing which is allegedly highly important but extremely complex, where deferral to experts is probably prudent. However, knowing how to relate to expert evidence is then important, particularly if you, like me, are unsure about what to do with all the expertise floating around awhile action is sluggish, prompting me to wonder – what’s going on here?
So why is a structured approach to expert interpretation useful in general. Let my friends from ACERA tell it
After doing some research, I’ve come up with a few notes. They are not in my own words, because they are written about adequately by others:
Who is an expert?
-ACERA
Should we trust experts?
Among experts in ecology: 'No consistent relationships were observed between performance and years of experience, publication record or self-assessment of expertise.'.
-ACERA
My impression is that we shouldn’t naively take the judgements of experts to be simply superior to amateurs/lay people. As counterintuitive as it is: experts are more accurate than amateurs, but amateurs are more precise.
Expert overconfidence is one thing. Expert underperformance relative to simple equations is another:
Given the length it would make more sense to move this to it's own post in discussion instead of having it in the open thread.