You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Locaha comments on Polling Thread - Less Wrong Discussion

12 Post author: Gunnar_Zarncke 22 January 2014 09:14PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (118)

You are viewing a single comment's thread.

Comment author: Locaha 23 January 2014 09:28:42AM -1 points [-]

Polls are almost useless for researching anything but the opinions of the population that takes the poll.

Submitting...

Comment author: Oscar_Cunningham 23 January 2014 09:24:47PM 7 points [-]

All the information you can gain from them factors through "the opinions of the population that takes the poll".

Comment author: Locaha 24 January 2014 08:17:32AM -1 points [-]

If you poll people about the likelihood of pixies, I guess you can learn something about their beliefs. You will learn nothing about pixies, though.

Comment author: [deleted] 24 January 2014 07:38:49PM 7 points [-]

Well, people are more likely to believe in pixies in worlds with pixies than in worlds without pixies. It's just that your prior is so low that even the posterior will be negligible.

Comment author: fortyeridania 25 January 2014 07:25:06AM *  1 point [-]

You will learn nothing about pixies, though.

As long as their beliefs aren't totally independent of the facts, those beliefs will constitute evidence (one way or the other) of the facts. Thus learning their beliefs would be informative about pixies.

Comment author: Locaha 25 January 2014 10:52:54AM -1 points [-]

Thus learning their beliefs would be informative about pixies.

Learning their beliefs would be informative about something.

Do a mental experiment, replace pixies with Jesus.

Comment author: RowanE 25 January 2014 11:39:32AM 5 points [-]

Learning people's beliefs about Jesus is informative about Jesus, it's just you already know that a lot of people believe in Jesus so there's very little new information.

Comment author: fortyeridania 26 January 2014 02:56:59AM 0 points [-]
  1. Do you dispute the truth of the sentence that precedes the one you quoted? Here it is again: "As long as their beliefs aren't totally independent of the facts, those beliefs will constitute evidence (one way or the other) of the facts."

  2. Replacing "pixies" with "Jesus" should not change whether people's beliefs are informative about Jesus. It may change the degree to which their beliefs are informative, for the reason /u/RowanE mentioned.

  3. I am not suggesting that learning people's beliefs about pixies would be incredibly informative. I am only suggesting that it would be more informative than not learning about such beliefs.

  4. Here's a thought experiment I often find helpful, tailored to the pixie-belief question:

Imagine Omega has come to you with a question: Are pixies real? She further tells you that a correct answer will result in an eternity of bliss for you and everyone you care about, and that an incorrect answer will result in unspeakable suffering for the same people. (The point is, a lot is at stake.) Then here is the key part of the scenario: Before you answer, she hands you an envelope marked "What People Believe About Pixies." You can open it and get accurate information about people's beliefs about pixies, or you can not open it. (Also, to make this work, we have to assume that you currently don't know anything about people's beliefs about pixies. Otherwise, the question becomes the value of info about pixie beliefs at the current margin, rather than simply the value of the info.) There's no cost (or reward) from opening it, beyond the information you thereby obtain.

Would you open the envelope before answering?

If your answer is no, then we can conclude that you really do consider people's pixie-beliefs to be completely devoid of information about the reality of pixies. But if you would open the envelope, can't we conclude the opposite: that you consider their beliefs to be entangled with the truth, however tenuously?

(I like this thought experiment because in the past it has helped me see when I am believing in belief instead of, as I had supposed, just believing. I think I starting doing it after reading this 2011 Yvain post.)

Comment author: Oscar_Cunningham 24 January 2014 08:23:26AM 0 points [-]

That's because I already have strong opinions about pixies. If I polled people about something which they knew well and I knew badly, then I would learn something about whatever it was.

Comment author: Prismattic 23 January 2014 03:30:00PM 1 point [-]

Should probably distinguish between voluntary-response and randomly sampled polling...

Comment author: arundelo 23 January 2014 04:34:59PM 1 point [-]

I answered "no" assuming that "the population that takes the poll" means literally "the people that take the poll". I probably would have answered "yes" had I considered it to mean "people similar to the people that take the poll (in some relevant way or ways)".

Comment author: Locaha 23 January 2014 08:40:59PM -1 points [-]

You may have missed the word almost. :-)

Comment author: [deleted] 24 January 2014 07:37:16PM 0 points [-]

No “I don't know” answer?