You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

thomblake comments on 2012 Less Wrong Census Survey: Call For Critiques/Questions - Less Wrong Discussion

20 Post author: Yvain 19 October 2012 01:12AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (479)

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 19 October 2012 03:00:06PM 3 points [-]

I'd split the Children question into “how many children you have” (write-in) and “do you hope to have more children in the future” (with answers “yes, soon”, “yes, later on in my life”, “no” and “not sure”).

Yes. That question is asking two different things, which a survey question should never do (in the extreme, that's called a "loaded question").

Comment author: [deleted] 19 October 2012 11:01:02PM 0 points [-]

Well, if one interprets “asking two different things” broadly, any question with more than two answers is doing that, e.g. the one about sexual orientation is asking whether you're sexually attracted to males and whether you're sexually attracted to females. (Maybe I'd split that one, too, as Facebook does.)

Comment author: thomblake 22 October 2012 01:56:52PM 2 points [-]

It depends on whether you end up covering all of the possibilities. It's fine to ask something like this (though it's phrased badly and confusing):

Which of the following movies have you seen?

  • Iron Man
  • The Hulk
  • Both
  • Neither

But this would not be good:

Have you seen Iron Man?

  • Yes, and I liked it
  • No, I hate comic book movies

The point is to not have any respondents who could not truthfully select one of the options in a single-punch list, or at least one option in a multi-punch list. The above question offers no response for folks who haven't seen Iron Man but don't hate comic book movies, or folks who have seen Iron Man but didn't like it.

Comment author: [deleted] 22 October 2012 02:15:30PM -1 points [-]

Well, technically the question about children in the draft doesn't do that (except for ambiguities such as how to count dead children, or people who are exactly indifferent about having children in the future), but I still think it divides personspace in a weird way.

Comment author: thomblake 22 October 2012 02:21:12PM 1 point [-]

Yes, technically there's no excluded middle problem there. Instead, it's gathering information about future child-wanting only for those with no children, which is a different problem.