The first draft of the 2012 Less Wrong Census/Survey is complete (see 2011 here). I will link it below if you promise not to try to take the survey because it's not done yet and this is just an example!
2012 Less Wrong Census/Survey Draft
I want three things from you.
First, please critique this draft. Tell me if any questions are unclear, misleading, offensive, confusing, or stupid. Tell me if the survey is so unbearably long that you would never possibly take it. Tell me if anything needs to be rephrased.
Second, I am willing to include any question you want in the Super Extra Bonus Questions section, as long as it is not offensive, super-long-and-involved, or really dumb. Please post any questions you want there. Please be specific - not "Ask something about abortion" but give the exact question you want me to ask as well as all answer choices.
Try not to add more than five or so questions per person, unless you're sure yours are really interesting. Please also don't add any questions that aren't very easily sort-able by a computer program like SPSS unless you can commit to sorting the answers yourself.
Third, please suggest a decent, quick, and at least somewhat accurate Internet IQ test I can stick in a new section, Unreasonably Long Bonus Questions.
I will probably post the survey to Main and officially open it for responses sometime early next week.
Current status of these suggestions:
"What activities do you enjoy? Check all that apply"
[] Fishing
[] Boating
[] Hiking
[] Climbing
The reason is that I haven't been able to figure out how to computer process these effectively; I end out with rows of boxes like "hiking,fishing" or "fishing,boating,climbing" and it's apparently beyond my limited skills to get SPSS to separate these out into separate chunks of information. I could do it like this:
Do you enjoy fishing?
[] Y
[] N
Do you enjoy boating?
[] Y
[] N
And so on, but the more options you want, the less happy I am doing this. Or, teach me a good way to solve this problem using Google Forms and SPSS.
I am reluctant to change questions that have been on the survey since previous years. For example, Will's suggestion to change the Politics question is good, except that if we did it we would no longer be able to confidently say something like "Less Wrong has gotten more liberal since the last survey". I would rather just include a political compass in the Bonus Questions, plus maybe maybe a more complicated one-word political affiliation question.
This is also part of my beef with "other", along with the fact that it's going to mean people who are 99% similar to one option but don't feel it perfectly describes them are instead going to pick something that gives us zero information. I very much agree with Vaniver here. I might or might not add it.
I'm balancing ability to totally perfectly capture all answers with ability to let people who just want to take a basic survey do that without answering a thousand mostly-similar questions. So while I understand that it might be theoretically desirable to separate out for example race vs. ethnicity, or country of birth vs. country of residence, or asexual romantic relationships versus sexual romantic relationships, I'm reluctant to bloat any section too much more than it's already bloated - especially the one on sex. I can already see someone like that tabloid reporter from a while back going "And also, the latest Less Wrong survey included 256 questions about your sex life!"
Can I get around the ethnicity problem by replacing "White (Non-Hispanic)" with "Latino"? It seems like it should work, but I'm suspicious because none of the US surveys I've encountered have ever done it.
Kind of want to avoid beating a dead basilisk.
IQ suggestions sound good.
ACT suggestion sounds good.
Most other bonus question suggestions sound good.
Happy to include Big Five test, AQ test, etc in the Unreasonably Long Bonus Questions section.
Will fix the Singularity question
Will probably fix moral views question to mirror PhilPapers version, even though that screws up past-survey-comparison
Will correct all typos
Political question solution:
Add an "other" option, then make a copy of the political question for THIS survey only, minus the "other" option, and ask "What would you have selected if "other" was not present?"
You can compare the results of the second question to past surveys and the first question to future surveys and therefore have a sense of whether LessWrong has moved in a particular direction.
Or, alternately, add a question below the political question saying:
"If you'd had an "other" option on the politics question, would you have used it?"