LESSWRONG
LW

Comment Permalink
saturn130

Here's one that closely imitates Raven's Progressive Matrices and claims to have been calibrated with a sample of 250,000 people: http://www.iqtest.dk/

Here's another one: http://sifter.org/iqtest/ . I can't find any mention of where the questions came from or how it's calibrated, but it's shorter and doesn't require Flash.

Neither one asks for an e-mail address or any identifying information. They might be too easy for some on LW, but harder ones tend to cost money. As Viliam_Bur pointed out, any free online test's validity is questionable, but the first one is basically a direct copy of a "real" test, and neither one has any apparent ulterior motive. Anecdotally, they were both within 10 points of each other and my "real" score.

Reply
Showing 3 of 6 replies (Click to show all)
drc500free00

Some data points: IQ (age 7, 14, 20) = ~145-150 S-B SAT (age 16) - 1590 = ~150 S-B iqtest.dk (age 29) = 133 S-B sifter.org/iqtest (age 29) = 139 S-B (159 euro scale)

I don't use my spacial skills in my daily work they way I used to use them in my daily school work, and both online tests seem to measure only that.

I found the second test much more difficult - there wasn't enough information to derive the exact missing item, so you had to choose things that could be explained with the simplest/least rules. There were some where I disagreed that the correc... (read more)

Reply
0MarkusRamikin
I got 130 on the first one and 156/137 on the second. Going with the lower result for the purpose of Yvain's survey. I found the second result a little suspect because a lot of questions on the second test made little sense to me. I would often see 2-3 possible answers that made more or less equal (small) sense to me, and had to take a gut feeling guess on which the author might have possibly meant. Maybe I just got lucky. Or my gut is a better thinker than I suspected.
1A1987dM
The first test gave me a score a few points below that on the Mensa site I did a few years ago, but I gave up early on a few questions (I had about 10 minutes left when I finished). One weird thing about it is that there were so many questions based essentially on the same idea, which makes me think it would be possible to have a test with not-too-much-worse accuracy but half as many questions (unless they intended to test ‘stamina’ as well -- but I'd guess that that varies more for a same person depending on how much they've slept recently than across people).
See in context
by Scott Alexander
1 min read
699

101

The final straw was noticing a comment referring to "the most recent survey I know of" and realizing it was from May 2009. I think it is well past time for another survey, so here is one now.

Click here to take the survey

I've tried to keep the structure of the last survey intact so it will be easy to compare results and see changes over time, but there were a few problems with the last survey that required changes, and a few questions from the last survey that just didn't apply as much anymore (how many people have strong feelings on Three Worlds Collide these days?)

Please try to give serious answers that are easy to process by computer (see the introduction). And please let me know as soon as possible if there are any security problems (people other than me who can access the data) or any absolutely awful questions.

I will probably run the survey for about a month unless new people stop responding well before that. Like the last survey, I'll try to calculate some results myself and release the raw data (minus the people who want to keep theirs private) for anyone else who wants to examine it.

Like the last survey, if you take it and post that you took it here, I will upvote you, and I hope other people will upvote you too.

Surveys
Personal Blog

101

Mentioned in
2011 Less Wrong Census / Survey
New Comment
699 comments, sorted by
top scoring
Click to highlight new comments since:
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings
[-]jferguson400

Shouldn't you ask when the respondent thinks the Singularity will occur before mentioning the year 2100, to avoid anchoring?

Reply
[-]Xachariah230

I hate cognitive biases. I read your comment right before I went to take the test. "Ha!" I thought to myself, "clearly members of Less Wrong wouldn't be as effected. Why even bother mentioning it?" And then I clicked on the link while I thought about the singularity. "Hmm, 2100 is a decent year maybe it'll be 20 years before that though..." And I filled in my race/education/sex. "Hmm maybe it would be after that though, due to...oh god, it's the anchoring effect! Quick think of other numbers! 2090! 2110! Damnit. 1776! Wait that won't work..."

And as I slowly worked my way down, by brain tried in vain to come up with alternate years. Until I finally reached the problem. "Is this really what I think, or am I just putting this answer because of that comment in the thread?" But it didn't matter. The numbers were in the box, and I couldn't convince myself to change them.

There it stood: 2100.

PS. Yvain, any chance you could look at the mean/median/mode/standard deviation of that problem before and after you changed the questions around? I'd be very interested in seeing how people were effected by anchoring.

Reply
5FiftyTwo
Also possibly better to ask if before when for the same reason. And differentiate between blank = 'it will not occur' and 'no opinion.'
1Dorikka
If the survey is still going on, might want to remove your mention of the year 2100 as well, also to avoid anchoring.
0Incorrect
It's not.
[-]Scott Alexander330

After reading the feedback I've made the following changes (after the first 104 entries so that anyone who has access to the data can check if there are significant differences before and after these changes):

  • Added an "other" option in gender
  • Moved "date of singularity" above question mentioning 2100 to avoid anchoring. Really I should also move the Newton question for the same reason, but I'm not going to.
  • changed wording of anti-agathics question to "at least one person"
  • added a "don't know / no preference" to relationship style
  • clarified to answer probability as percent and not decimal; I'll go back and fix anyone who got this wrong, though. If you seriously mean a very low percent, like ".05%", please end with a percent mark so I know not to change it. Otherwise, leave the percent mark out.
  • Added a "government work" option.
  • Deleted "divorced". Divorced people can just put "single"
  • Added "economic/political collapse" to xrisk
  • Added "other" to xrisk
  • Added a question "Have you ever been to a Less Wrong meetup?" Please do NOT retake the survey to answer this question. I'l
... (read more)
Reply
[-]NancyLebovitz100

Should anyone retake the survey? I'd be willing to if you can cancel the my first version-- I'll give the same answers on the Newton question.

Not as good as if someone can find a satisfactory IQ test, but could you add an SAT option for intelligence measurement?

I used percents for all my probabilities, including the one which was .5.

Reply
3dbaupp
Could you also add an ATAR/UAI, A-levels, Abitur and IB option? (It might be better to add a box asking for marks/certificate received upon leaving high school and the name of the program; with sufficient respondents there may be enough data to say meaningful things)
[-]Randaly100

Some of us are still in high school.

Reply
1RobertLumley
I'd also be willing (I'd probably rather) retake the quiz. But there is a problem with calibration at that point, with the question about Newton.
4SilasBarta
Also, do I understand you correctly that the beings (conceivably) running the universe as a simulation do not count as supernatural/gods for purposes of the supernatural/gods questions?
4Jayson_Virissimo
Yeah, I thought the theism question was the worst of all. Have you ever met a theist that answered "ontologically basic mind-stuff" when asked what God is? Me neither. Other than that, thanks Yvain!
2feanor1600
I assumed when taking the survey that those running the simulation are outside our universe and so ontologically basic.
4Luke_A_Somers
Those people outside the simulation could exist with or without ontologically basic mental features. The questions are totally orthogonal.
-1taw
Is there even theoretical way of distinguishing these two cases? I'd assume the only possible answer is "they" do.
3RobinZ
I think the percentage of LW meetup attendees is positively correlated with how quickly people take the poll, unfortunately.
2thomblake
I feel like several of the single-punch questions should be multi-punch. Both "profession" and "Work status" gave me pause. Also, I had to figure out what the right thing to fill in for "family religion" was, since we had several. And there are several extremely common moral views not represented in your list of moral theories. One of the more popular is "All moral theories have some grain of truth, and we should use a combination along with our intuition". For questions like this, you might use as your model the Philpapers survey, though I also worry that this question might not make a lot of sense to most people without at least rough definitions alongside the answer choices.
0Armok_GoB
About the politics question: What if you come from a place/subculture where none of those even exist and have barely even heard of them?
0SilasBarta
About the government work issue, if I work for an aerospace company that gets all of its business from the government, does that count as "for profit" or "government work" for purposes of the question?
0Kaj_Sotala
I believe that would usually be considered "for profit".
0[anonymous]
I changed my estimated probabilities to reflect percentages, but didn't mark them with a percent sign because the version of the survey I took explicitly said not to. It's mostly irrelevant anyway, these probabilities weren't even accurate to two orders of magnitude.
[-]hamnox230

Took the survey.

I think I failed it.

Reply
9Insert_Idionym_Here
I missed newton by over 150 years. Pray for a curve.
[-]rntz230

On the "Political" question: I identify with none of those. I understand the question is about which I identify with most, but all of the options have views on both social permissivity and economic redistribution. I am socially permissive, but have no belief one way or the other on redistribution/taxes. I simply have insufficient knowledge of that area to make a judgment. Perhaps it would be better to have two different questions - one for each of social views and economic views?

For "Religious views": I am an atheist but would not self-identify as either "spiritual" or "not spiritual". If a person asked me which I was, I would ask them what they meant by spiritual. I answered "Atheist but not spiritual", on the very weak grounds that I suspect I do not satisfy most other people's conceptions of spirituality; but really, the word is very ill-defined.

Reply
7Cthulhoo
I second rntz remarks, I had very similar issues with both questions. As a side note I would have been also interested in knowing how many people here are from non-english speaking countries (or at least outside the US). Anyways, this is a very interesting project, I'll be looking forward for the results!
5CharlesR
I chose not to answer the politics question for the simple reason that I didn't want to do something that could hijack my thinking.
3selylindi
If there is a political self-description category in future surveys, another option possibly worth adding is "anarchist". Yeah, it's rare, but the closest option available was "socialist", which is still very dissimilar. Incidentally, for those who are interested in political categorizations that might translate better across countries (and who have an OkCupid account), check out the Political Objectives test. A caveat is that, as the test itself notes, it is still specific to the countries and centuries that constitute the modern world, as "The assumption behind this test is that the three most important objectives of all-issues political movements in the modern era have been Equality and Liberty and Stability."
0thomblake
Interesting. I wonder if this might be framing too much - it seems like if someone accepted this, then a political movement that valued only two of those might a priori be classified as not "all-issues".
[-]DanielVarga220

Thanks, Yvain! For the next survey, please consider country of residence and first language as questions.

Reply
[-]DeevGrape220

I've been lurking on here for a long time, and just now registered to get a free karma point for taking the survey.

Reply
[-][anonymous]210

I did take the survey, however I found something I was unsure of what to put down and had to type in an explanation/question about:

It was for the question: "By what year do you think the Singularity will occur? Answer such that you think there is an even chance of the Singularity falling before or after that year. If you don't think a Singularity will ever happen, leave blank."

If I think the singularity is slightly less than 50% likely overall, what should I have put? It seemed off to leave it blank and imply I believed "I don't think a Singularity will ever happen" because that statement seemed to convey a great deal more certainty than 50+epsilon%. However, if I actually believed there was a less than 50% chance of it happening, I'm not going to reach an even chance of happening or not happening on any particular year.

As a side note, after taking that test, I realized that I don't feel very confident on a substantial number of things.

Reply
5Solvent
I think that there need to be two separate questions here. Probability of Singularity, and year it happens if it does. For instance, I'd guess about 70% chance of a singularity at all, but if it happens, 2040 would be about my expected date. You can't describe these two statements in just one number.
4A1987dM
Same here. But I voted 2150 because I think it's 50% that it happens before 2150, 20% that it happens later, and 30% that it never happens.
1Solvent
Oooh, good answer. I hadn't thought of that method.
1bogdanb
I interpreted this as “there is an even chance of the Singularity falling before or after, [assuming it does]”. That is, if you think the probability that the Singularity will happen is something low like 1%, you should answer a year such that the probability it happens by that year is 0.5%. The only way you can’t answer it is if you’re sure it won’t ever happen. (For example, if I thought a Singularity is very [...] very hard to achieve, I might answer 5000 AD or 500000 AD, depending on how many “very” there are, even though I might put a very low probability on our civilization actually surving that long.)
0robertzk
Given the expected date would be skewed to infinity by a non-zero estimate of the Singularity not occurring, you can probably put your estimate of the year X so that P( S <= X | C ) = 0.5, where S is the statistic "Year singularity will occur" and C is the event "Singularity will occur".
[-]JoshuaZ200

For the gender question it may make sense to have a generic "other" option. The monogamous/polygamous question should also maybe have a no preference option also.

Edit: And finished.

Reply
[-]Viliam_Bur210

I think it is generally good to avoid "other" options as much as possible.

There are a few biases related to filling questionnaires. For example, many psychological tests ask you the same question twice, in opposite direction. (Question #13 "Do you think Singularity will happen?" Question #74: "Do you think Singularity will never happen?") This is because some people use heuristics "when unsure, say yes" and some other people use heuristics "when unsure, say no". So when you get two "yes" answers or two "no" answers to opposite forms of the question, you know that the person did not really answer the question.

Another bias is that when given three choices "yes", "no" and "maybe", some people will mostly choose "yes" or "no" answers, while others will prefer "maybe" answers. It does not necesarily mean that they have different opinions on the subject. It may possibly mean that they both think "yes, with 80% certainty", but for one of them this means "yes", and for the other one this means "maybe". So instead of measuring their ... (read more)

Reply
[-]NancyLebovitz100

There are a number of types of snowflakes.

If you decide in advance that you aren't going to listen to anyone who doesn't fit your categories, you might be missing something.

Reply
[-]Viliam_Bur150

You can have:

a) a survey, where everyone's individual differences are rounded into a few given categories;

b) a collection of blog articles, where everyone describes themselves exactly as they desire; or

c) a kind of survey, where some participants send a blog article instead of data.

Both (a) and (b) are valid options, each of them serves a different purpose. I would prefer to avoid (c), because it tries to do both things at the same time, and accomplishes neither. An answer "other" sometimes means "no answer is even approximately correct", but sometimes is just means "I prefer to send you a blog article instead of survey data". The first objection is valid, and is IMHO equivalent to simply not answering that question. The second objection seems more like refusing the idea of statistics. Statistics does not mean that people who gave the same answer are all perfectly alike, but ignoring the minor differences allows us to see the forest instead of the trees.

I guess the "special snowflake bias" is officially called "narcissism of small differences". The psychological foundation is that we have a need of identity, which is threatened by similar things, not different ones. So when something is similar to us, but not the same, we exaggerate the difference and downplay the similarity. From outside view we are probably less different than from inside view.

Reply
8NancyLebovitz
That last varies-- sometimes people are exaggerating differences which are pretty meaningless. Sometimes the people setting up the classifications actually have an incomplete picture of the existing categories.
6thomblake
There's an established way of correcting for this in market research (and other fields): coding. Let's say you have the following list: 1. utilitarian 2. deontologist 3. virtue ethics 4. other (please specify) Then you have someone go through all the typed-in responses, and when someone types in "special snowflake utilitarian" you code that as a 1 rather than a 4. This is also done for completely open-end responses. Sometimes something like "additional comments" will on the back end look like: 1. positive 2. negative 3. neutral
1MixedNuts
Problem is that survey results will be treated as if everyone had exact answers, as opposed to picking the least terrible approximation. (I do have a known preference, dammit! It's just the subject of Big Debate whether it counts as mono or as poly.)
-2Relsqui
So how you do decide which options merit inclusion? Which snowflakes are special enough--or, I suppose, mundane enough? And what's the harm in counting how many snowflakes aren't, even if you don't ask them exactly what type they are?
9Rubix
Agree, especially with regard to mono/poly question. Nearly forgot; I did complete it. Thanks for your work, Yvain!
[-]kpreid190

Would it not be useful for the “Degree” question to distinguish between the two no-degree cases of current undergraduate students and not-trying?

Reply
1quinsie
I feel it would be.
[-]Kevin190

Thanks for doing this, I just took it. With the gender question, in addition to the transgender questions, it's maximally inclusive to include a non-binary "genderqueer" option.

Reply
[-]daenerys180

Took the survey and finally created an account on here.

Looking at the comments, it seems like I am not the only one who used the survey as an impetus to create an account or a first post. I would be interested to see if there was a significant increase in the number of new accounts while the survey is running (as opposed to the average number of new accounts when there is no current survey).

...Also I took the IQ test posted in the comments.. Yeah, it has me as a good 15 points lower than what I was tested as in school also.

Reply
7wedrifid
Then I'm certainly not going to do it! Thanks for the warning. ;)
3Alicorn
I approve of your screenname!
0daenerys
Thanks! :)
0[anonymous]
Mind me asking which one exactly?
0daenerys
This one posted by Dustin. I was in the 140s in school, but only got like 126 on this one. Maybe because it focuses so much on the one type of problem?
[-]komponisto180

Survey now completed.

EDIT:

if you take it and post that you took it here, I will upvote you, and I hope other people will upvote you too

Let the record reflect that this comment currently has a negative score! :-(

EDIT2: No longer the case, obviously! :-)

Reply
[-]mindspillage180

I took it.

I think some of the "pick one" options were too broadly grouped, though any multiple-choice is going to be. I'd have preferred a "no preference" for "relationship style", for example, and more political options. Also I'm not sure what counts as "participates actively" in other groups--I've been a member of transhumanism-related groups for over a decade, for example, but am mostly a lurker; I did not check the box.

I would have been interested in seeing a question about involvement in offline activities like local meetups, or participation in IRC/other LW venues.

Thanks for running the survey!

Reply
0Luke_A_Somers
I thought there was a 'no preference' option on relationship style, and I took it before your post.
[-]HonoreDB180

Done. Definitely went through the whole "check the publication date"--whoop of victory--worry I was underconfident routine. Except silently because there's a sleeping person less than a foot away.

I'm amazed at the range of possibilities I considered for some of those probabilities. I definitely do not have a solid grasp of reality.

Reply
[-]rochester170

I took the survey and this is my first comment on lesswrong :)

Reply
5kilobug
Welcome on Less Wrong ! Don't hesitate to read Welcome to Less Wrong and introduce yourself there.
1Normal_Anomaly
Apologies for the nonproductive comment, but something weird happened to your formatting. I'm seeing ~1cm of space between each word.
2pedanterrific
URLs break wordwrap; it treats it as one word. May I suggest Markdown's hyperlink syntax, where [LessWrong](http://www.lesswrong.com) = LessWrong?
0kilobug
You're right, fixed, and thanks for suggesting it.
[-]Simon Fischer170

Filled out the survey. The cryonics-question could use an option "I would be signed up if it was possible where I live."

Reply
6RomeoStevens
or I will be signing up as soon as I have a steady paycheck.
[-]Prismattic170

Does lurking time count for "how long in the community"?

Reply
5pedanterrific
Err. I didn't count it. It might be interesting to break up the question into "how long have you actively participated in the community" and "how long have you been reading the site".
5RobertLumley
I counted it.
2Klao
I half-counted it. I counted from the time when I finally created an account at lesswrong.com.
1pre
I counted it, coz I'm mostly just a lurker here anyway. Far too busy!
1RobinZ
I counted it.
0wnoise
I don't remember that far back, so I used my earliest comment (imported from Overcoming Bias) as the date.
[-]Username160

Yvain, one very important question that I think you missed: Do you currently have an account on Lesswrong?

I personally don't, and glancing through the number of 'first post' comments here, I believe that the ratio of lurkers to active users may be significant. (This is a throwaway account, and I am making an exception this once because there would be no other way to get information from the lurkers.)

Reply
7Scott Alexander
Good point. I hope that the "karma" question will take care of some of the problem, but I should have distinguished more finely.
[-]mkehrt160

Issues with the survey:

  1. As mentioned elsewhere, politics is Americentric.
  2. Race race seems to be missing some categorizations.
  3. If you are going to include transgender, you probably should call the others cis. Otherwise you run the risk of implying transgendered people are not "really" their target gender, which is a mess.
  4. The question of academic field was poorly phrased. I'm not an academic, so I assumed you meant what academic field was most relevant to my work. But you really should ask this question without referring to academia.
  5. The academic question and the question about field of work need more options.
  6. Expertise question needs CS as an answer :-)

EDIT: Overall, it's pretty good.

Reply
[-]AlexMennen160

Took it.

My family is of mixed religious background, so I just arbitrarily used my mother's religious background for those questions. You might want to make the answer choices a little more flexible.

Reply
2MixedNuts
Here too. Why not check boxes rather than radio buttons?
[-]MixedNuts160

I know "male, female, FTM, MTF, other" is a standard gender/sex question, but I don't know why. A problem is that it implies that "FTM" is a distinct category from, rather than a subset of, "male" (ditto for female). This would be better if other questions had answers that were subsets of other answers, but you seem to try hard not to do that. This could be fixed by phrasing it as "cis male", but then you'd get people complaining about "cis" and "trans" not being a perfect dichotomy and complaining about the confusing word and so on. This could also be fixed by splitting the question into "gender (male/female/other)" and "Are you trans? (yes/no)", but then you'd get other complaints.

I wouldn't have been too far off on the Newton question if I had been able to remember the mapping between century numbering and year numbering. I ended up two centuries off. Fortunately I took that into account when calibrating.

Also, for the record: I'm not "considering cryonics". I'm cryocrastinating. Cryonics is obviously the best choice, and I should be signing up for it in the next five seconds. I will probably die while not signed up for cryonics, and that will be death by stupidity, and you will all get to point and laugh at my corpse.

Reply
8Emile
I don't think that implication creates confusion in the mind of anybody answering the survey, i.e. most people know what to answer. It's somewhat debatable whether it makes "more sense" to classify a FTM transsexual as male because of the gender role to which they identify, or as female because of the chromosomes they have, so sidestepping the whole question by using four categories seems like a reasonable solution for a survey (or at least, if I was doing a survey, that's why I'd use those four categories). Using things like "cis male" might make the questions more technically accurate, but it won't make anybody less confused about how to answer, and will probably make some more confused.
6MixedNuts
FTM transsexuals usually consider it offensive not to be classified as men (either by being classified as non-men or by avoiding the question), though arguably we could take the stick out of our asses.
5[anonymous]
Unless you actually do a karyotype test on an individual you don't know what chromosomes they have, and that can't be inferred with certainty from assigned gender at birth, primary or secondary sexual characteristics, or similar macroscale traits. A non-negligable portion of the population have chromosomes that don't correspond to XX/XY, and said anomalies do not reliable correlate to a transgender identity.
6JGWeissman
I don't want to point and laugh at your corpse. Please implement what you consider to be the obvious best choice. If you don't know how to get started, contact Rudi Hoffman. He will walk you through the process. Get started today.
0[anonymous]
What a weird assortment of questions apparently only tangentially related to cryonics.
3JGWeissman
I am not sure which questions you are referring to. Some questions on the form are related to getting a life insurance policy to pay for cryonics.
1[anonymous]
Hence "apparently".
5ata
I was going to raise exactly that issue and suggest that solution. What complaints would you expect, though? I don't know if I'd really expect any non-trans LWers to be insulted at the mere suggestion that the question is worth asking. I'd have liked having that option too.
2smk
Me too. Also, I would have liked to see monogamous and non-monogamous instead of monogamous and polyamorous.
3thomblake
Is that a standard gender/sex question? As someone who's been programming market research surveys for several years, I've never seen anything like it. Yes, as someone with no skin in the game, so to speak, I was nonetheless uncomfortable disclosing not just the gender "male" but also the initial state of my genitalia. What kind of person asks about a baby's junk?
[-][anonymous]100

What kind of person asks about a baby's junk?

Most of them, by implication if nothing else. The minute they can't do so subtly, things get nasty.

Reply
3Bugmaster
Yeah, that confused me too. What's the point of asking that question in the first place ? Just to collect more features for some clustering model, or what ? Then why not ask people's age or weight or hair color, as well ?
3khafra
More people on LW care about the gender of LW participants than care about the weight or hair color of LW participants. As I recall, the survey did ask for age.
[-]A1987dM140

As for me, I was surprised it asked about my racial background and my family's religion but not what country I grew up in or live in.

Reply
0thomblake
Yes, the 'race' question was particularly weird since it did not have reference to the country of origin. Normally, surveys conducted in different countries have very different breakdowns of what 'race' is supposed to mean. At least it had both the British and American versions of "Asian".
7A1987dM
Yeah, I don't think many people outside North America would break up White into Hispanic and non-Hispanic. (At least, it didn't say “Latino” -- I didn't find out what it's supposed to mean until recently, and as a result, being Italian, I had classed myself as a Latino a few times.)
9taw
The survey says a lot about how Americans categorize the world. It might be more informational than the results.
8saturn
The US Census Bureau uses this odd system for historical/political reasons. I don't think it reflects very much how Americans categorize the world. I don't know why Yvain used it, I don't think he's even American.
[-]Klao160

I completed the survey. Thanks, Yvain, for doing it!

The option "Atheist but spiritual" gave me a pause. What does it actually mean?

Reply
[-]thomblake120

"Atheist" refers to the lack of a belief in gods. "Spiritual" includes all sorts of other supernatural notions, like ghosts, non-physical minds, souls, magic, animistic spirits, mystical energies, etc. Also, "spiritual" can refer to a way of looking at the world exemplified by religions that some atheists consider a vital part of the human experience.

Reply
8TheOtherDave
I've noticed some people using "spiritual" to describe notions they consider aesthetically sublime and morally uplifting but not well understood, when they are not particularly motivated to understand them, without any commitment to their being supernatural. This may be what you refer to in your second meaning, I'm not sure. There is, of course, a lot of potential overlap here with supernatural notions.
1thomblake
Yes, that's roughly what I was referring to.
4Klao
So, a person who doesn't believe in god, but still thinks that he has an "immortal soul" or something? Thanks for explaining!
8[anonymous]
I can't speak for anyone else, but in my case it'd refer to someone who is an atheist and materialist ontologically, but who finds aesthetic reward and mental stability in certain forms of ritual and narrative applied to relatively specific domains of life (like holidays, rites of passage and other culturally and cognitively-significant stuff, as long as it's been vetted to strip out the more obvious kinds of crazymaking and irrationality such things can induce).
4Klao
I guess, this is similar to the second part of thomblake's comment. Thank you for explaining this! But, if it really can mean such different things, then that particular in the survey question wasn't formulated very carefully.
2JoshuaZ
My impression was that something like that was intended. However, this seems to be a conflation of different categories. The normal category that occurs in this sort of context is "not religious but spiritual" which seems to generally mean people sort of like what you describe but also who ascribe to various supernatural entities (e.g. god, ghosts, spirits, maybe faeries). When given the choice between "atheist" and something like "no religion" or "none" such people will generally not put down atheist. And such people look demographically very different from atheists and agnostics. See e.g. this Pew study. My impression is that the religion questions were not phrased in a way that showed much familiarity with the underlying demographics or how such questions are generally phrased. In this particular context that's ok because I suspect that there are a fair number of people here who are atheist-but-spiritual under your definition but very few people here who would fall into the "not religious but spiritual" notion that is a subset of the nones in the general population.
2FiftyTwo
Certain forms of Buddhism are religous but not theistic, so possibly they'd count? Gave me pause also, a clarification/more options would be useful.
[-]Gedusa160

This is great! I hope there's a big response.

It seems likely you're going to get skewed answers for the IQ question. Mostly it's the really intelligent and the below average who get (professional) IQ tests - average people seem less likely to get them.

I predict high average IQ, but low response rate on the IQ question, which will give bad results. Can you tell us how many people respond to that question this time? (no. of responses isn't registered on the previous survey)

Reply
[-]saturn220

I think it would be more informative to ask people to take one specific online test, now, and report their score. With everyone taking the same test, even if it's miscalibrated, people could at least see how they compare to other LWers. Asking people to remember a score they were given years ago is just going to produce a ridiculous amount of bias.

Reply
[-]dspeyer130

I think it would be more informative to ask people to take one specific online test, now, and report their score.

Are there any free, non-spam-causlng, online IQ tests that produce reasonable results (i.e. correlate strongly to standard IQ tests)?

Reply
1taw
Mensa organizes cheap standardized IQ testing worldwide with many available dates. I don't care for everything else they're doing, but at least that is a very valuable service to the world.
-1Viliam_Bur
No chance. To calibrate a serious IQ test, you need to test (1) many (2) randomly selected people in (3) controlled environment; and when the test is ready, you must test your subjects in the same environment. Online calibration or even online testing fail the condition 3. Conditions 1 and 2 make creating of a test very expensive. This is why only a few serious IQ tests exist. And even those would not be considered valid when administered online. And there is also huge prior probability that an online IQ test is a scam. So even if they would provide some explanation of how they fulfilled the conditions 1, 2, 3, I still would not trust them.
4Vladimir_Nesov
If you have a test thus calibrated, you can use it to evaluate tests that can't be calibrated in the same way.
0Viliam_Bur
Will this evaluation include giving both tests to many randomly selected people and comparing the results?
8Scott Alexander
It's a bit late now, but if you recommend a particular test that's valid, short, and online, I can try that on the next survey.
[-]saturn130

Here's one that closely imitates Raven's Progressive Matrices and claims to have been calibrated with a sample of 250,000 people: http://www.iqtest.dk/

Here's another one: http://sifter.org/iqtest/ . I can't find any mention of where the questions came from or how it's calibrated, but it's shorter and doesn't require Flash.

Neither one asks for an e-mail address or any identifying information. They might be too easy for some on LW, but harder ones tend to cost money. As Viliam_Bur pointed out, any free online test's validity is questionable, but the first one is basically a direct copy of a "real" test, and neither one has any apparent ulterior motive. Anecdotally, they were both within 10 points of each other and my "real" score.

Reply
6gwern
Incidentally, I keep a list for DNB purposes in http://www.gwern.net/DNB%20FAQ#available-tests focused on matrix-style tests. Doesn't include that sifter.org one, though.
0saturn
Wow. Wish I would've thought to google 'iq site:gwern.net'.
0gwern
Wouldn't necessarily have helped - Google's excerpt for the DNB FAQ doesn't mention the list of tests. Kind of have to know it's already there.
1A1987dM
The first test gave me a score a few points below that on the Mensa site I did a few years ago, but I gave up early on a few questions (I had about 10 minutes left when I finished). One weird thing about it is that there were so many questions based essentially on the same idea, which makes me think it would be possible to have a test with not-too-much-worse accuracy but half as many questions (unless they intended to test ‘stamina’ as well -- but I'd guess that that varies more for a same person depending on how much they've slept recently than across people).
0drc500free
Some data points: IQ (age 7, 14, 20) = ~145-150 S-B SAT (age 16) - 1590 = ~150 S-B iqtest.dk (age 29) = 133 S-B sifter.org/iqtest (age 29) = 139 S-B (159 euro scale) I don't use my spacial skills in my daily work they way I used to use them in my daily school work, and both online tests seem to measure only that. I found the second test much more difficult - there wasn't enough information to derive the exact missing item, so you had to choose things that could be explained with the simplest/least rules. There were some where I disagreed that the correct answer had a simpler rule-set. The problem style is also highly learnable, and I question the diagnostic value of "figuring out" that you're looking at a 3x3 matrix where operations occur as you move around it, but various cells have been obscured to make the problem harder. Not including instructions makes it feel like there's a secret handshake to get in.
0MarkusRamikin
I got 130 on the first one and 156/137 on the second. Going with the lower result for the purpose of Yvain's survey. I found the second result a little suspect because a lot of questions on the second test made little sense to me. I would often see 2-3 possible answers that made more or less equal (small) sense to me, and had to take a gut feeling guess on which the author might have possibly meant. Maybe I just got lucky. Or my gut is a better thinker than I suspected.
0ArisKatsaris
Got 135 on the first test. Got 139 on the Stanford-Binet/USA scale (stdev 16) in the second. This seems about right. But since the second one was polite enough to tell me which answers I got wrong, I have to call bullshit on it: some of the "correct" answers it claimed made no sense, and seemed more wrong and illogical than the ones I had placed.
0NancyLebovitz
I got 107 on the first test (which seems implausibly low), and 138 on the second (which seems reasonable).
1Prismattic
I tried the second one after reading this and had similar results: 118 on the first one (implausibly low); 137 (stdev16) on the second one (sounds about right). Though if I was taking this more seriously I'd probably have to weigh the facts that my kids were being more distracting when I took the first one, and I ate flaxseed shortly before taking the second one.
0NancyLebovitz
I took the first one under reasonably good conditions, and the second under about the same conditions a little while afterwards. The first one seemed like a test of endurance as much as anything-- it was as though my ability to focus was running out on the last ten questions or so, and possibly as though it would have been somewhat easier if I'd been in better physical condition. General question about that sort of puzzle-- how much can effort help with them? Can they be solved reliably given more time (and probably a chance to write down theories and guesses), or does inspiration have to strike fairly quickly?
0MarkusRamikin
Interesting question. On the first test, I went through many of them quickly - some of them obviously pattern-matched to the same kind of a puzzle - but also solved a number by staring at them for a few minutes, refusing to give in to my brain's "I don't see any patterns, this doesn't make any frakking sense, can we do something else now?". I'm certain given 10 or 20 more minutes I'd have done better. And come out with a headache, probably.
0NancyLebovitz
My eyes were hurting after the first test, and this continued (less intensely, I think) into the second, even though reading on the monitor isn't generally a problem for me. There may also be sensory issues involved in scores-- I was running into trouble anyway, but having to distinguish between very dark gray squares and black squares in one of the later puzzles didn't help. If I had more of a different sort of intelligence, I would have thought of fiddling with my monitor settings. I'm inclined to think that practice/information could help a lot with the puzzles-- having a repertoire of possible patterns is going to make solutions easier than trying to find patterns cold. Possibly as a result of not being entirely pleased at that 107 score, I'm doubting the whole premise of IQ testing-- that it's important to find out what can't be improved about people's minds. Part of this is the arrogance problem-- how complete is your knowledge of the possibility of improvement, anyway?-- and the other part is wondering whether all those resources could be better put into learning how to improve what can be improved. The other thing is that I've had some recent evidence that the ways the parts of the mind are interconnected aren't completely obvious. I've been doing some psychological work on fading out self-hatred, and the results have been being less frightened about what I post (I decided before taking the IQ tests to post my scores, but there was still a bit of a pang), easier and faster typing-- not tested, but I do seem somewhat apt to write at greater length (this seems to be the result of feeling less need to over-monitor so that typing can be a low-level habit), less akrasia (still pretty bad, but the desire to do things is happening more often), and the ability to walk downstairs more easily (I have some old knee injuries which can be ameliorated by better coordination-- but I haven't been working on coordination).
0ArisKatsaris
In this type of test, I can solve generally about all except about 4 of them almost immediately with some seconds of thought. I skip those few, then return to them at the end, and in the minutes that remain manage to make an educated guess for say two of them, while having to leave two more to complete chance.
0saturn
Interesting. Did you find the questions in the first test more difficult than the second? I did notice that the first test relies a lot on mental rotation.
0NancyLebovitz
I found the last third or so of the questions in the first test much more difficult than almost anything in the second.
5Viliam_Bur
There are two ways an IQ test can fail: a) it can be miscalibrated; b) it can measure something else than IQ. If you only want to know your percentile in LW population, (a) is not a problem, but (b) remains. What if the test does not measure the "general intelligence factor", but something else? It can partly correlate to IQ, and partly to something else, e.g. mathematical or verbal skills. Also you have a preselection bias -- some LWers will fill the survey, others won't.
2kilobug
Don't forget those of us who aren't native English speakers. Didn't try it again recently, but I used to have a 5-10 points difference between an IQ test in French (my native language) and English. Word-related questions are of course harder, but even for the rest, I'm not sure if it's because it took me longer to process the English (while the IQ is time-limited), or just that decoding a non-native language use more brain power (leaving less for solving the problem). But anyway, I score better in my native language than in English, and I answered with my score in native.
2Paul Crowley
Yes - I'm quoting an IQ test I did as a kid which had a suspiciously high score, I'm pretty confident I'd get a much less spectacular score if I did one today.
[-]wedrifid100

Yes - I'm quoting an IQ test I did as a kid which had a suspiciously high score, I'm pretty confident I'd get a much less spectacular score if I did one today.

Awesome. Definitely don't do another one then. (Unless you need to diagnose something of course!)

Reply
8torekp
Are we encouraged to estimate IQ from SAT tests and the like? That's what I did. That could reduce the excluded-middle bias that Gedusa mentions.
7CG_Morton
I underwent a real IQ test when I was young, and so I can say that this estimation significantly overshoots my actual score. But that's because it factors in test-taking as a skill (one that I'm good at). Then again, I'm also a little shocked that the table on that site puts an SAT score of 1420 at the 99.9th percentile. At my high school there were, to my knowledge, at least 10 people with that high of a score (and that's only those I knew of), not to mention one perfect score. This is out of ~700 people. Does that mean my school was, on average, at the 90th percentile of intelligence? Or just at the 90th percentile of studying hard (much more likely I think).
6cata
If you're in the median age band for Less Wrong, you misread the estimator. The "SAT to IQ" table is for the pre-1995 SAT, which had much more rarefied heights. The "SAT I to IQ" table is for the 1995-2005 SAT. (I did the same thing.)
1CG_Morton
You are quite right. My scores correlate much better now; I retract my confusion.
2Desrtopa
And of course, there are also SAT prep services which offer guarantees of raising your score by such and such an amount (my mother thought I ought to try working for one, given my own SAT scores and the high pay, but I don't want to join the Dark Side and work in favor of more inequality of education by income,) and these services are almost certainly not raising their recipients' IQs.
0Gedusa
I didn't think of that - given that a huge chuck here have probably taken such tests, if Yvain allowed such an estimation, it would be very helpful. Yes! That's what I was thinking of :)
5pragmatist
I've never taken an IQ test, so when I was responded to the survey I considered estimating my IQ based on my SAT and GRE scores. The result, according to the site torekp linked to, is surprisingly high (150+). I think I'm smart, but not that smart. Anyone have any idea if these estimators should be trusted at all?
5Viliam_Bur
What is your evidence? I am not trying to convince you either way, but in my experience people aren't very good at estimating their own IQ.
0pragmatist
My IQ according to the estimator would put me in the 99.995th percentile, but it seems to me that at least 5% of my friends and acquaintances are at least as smart as me. Part of this is probably selection bias, but I doubt that could account for it completely. I don't move in particularly exalted circles. EDIT: If you had asked me to estimate my IQ before I consulted the website, I would have said 135. I'd probably still say that, actually. I'm guessing the GRE-to-IQ conversion is useless above some ceiling.
0[anonymous]
FYI, if you're in the median age band for Less Wrong, you misread the estimator -- I know, because I made the same mistake. Clicking "SAT to IQ" on the left shows a table for the test prior to a re-centering in 1995, whereas "SAT I to IQ" shows the table for tests given between 1995 and 2005. The latter's top end is much less exceptional.
4Mark_Eichenlaub
GRE quantitative scores are not useful for high-IQ estimates because 6% of people get perfect scores. A perfect GRE verbal score is roughly the 99.8th percentile, as can be inferred from the charts in this pdf: http://www.ets.org/Media/Tests/GRE/pdf/994994.pdf It shows that the percent of people with a perfect scores varies between less than 0.1% and 1.5%, depending on field, but it is usually 0.1% or 0.2%. (The 1.5% field was philosophy.) Because many non-native English speakers take the test, it's likely that one ought to adjust that percentile a bit lower. That's among people applying to grad school, which is a higher-IQ group than the general population, but not by so much that 99.8th percentile among grad school applicants correlates to the 99.996th percentile among the general population, as that site (http://www.iqcomparisonsite.com/GREIQ.aspx) claims. That would be impossible assuming more than one in fifty people in the applies to grad school. If we attribute a perfect GRE score to the 99.8th percentile, then looking up that percentile on the chart on the same page, we get an IQ score >142 for 1600 on the GRE.
1dbaupp
That link should probably point to this (without the dot at the end).
0Mark_Eichenlaub
thanks
4Nornagest
I've only got the one data point, but my tested IQ is within a couple points of what that site predicts from my SAT score. I took the tests almost a decade apart, though, so this could be coincidental; scores for both tests aren't that stable over that kind of timeframe, I don't think.
2Normal_Anomaly
My (limited) background knowledge is that SATs, GREs, etc. are designed for people near the average, and give imprecise results for the highest IQs. You're probably in that range the tests aren't very good for.
2Vaniver
I wouldn't trust it. My GRE estimated IQ by that is wildly higher than my professionally measured IQ. Also check out:
2thomblake
The scores are highly correlated. One must assume those charts are from a reliable source. So... yes?
3pragmatist
Does the correlation remain if you conditionalize on, say, having an IQ higher than 130?
1thomblake
Well, not with that attitude.
5quentin
I was wondering if the IQ-calibration question was referring to reported or actual IQ. It seems to be the latter, but the former would be much more fun to think about. Also, are so many LWers comfortable estimating with high confidence that they are in the 99.9th percentile? Or even higher? Is this community really that smart? I mean, I know I'm smarter than the majority of people I meet, but 999 out of every 1000? Or am I just being overly enthusiastic in correcting for cognitive bias?
0thomblake
I'd estimate with high confidence that I'm higher than that. Subjectively, I've only met a couple of people in my life who seem definitely smarter than me. And I've barely met anyone who was malnourished or lacking in education. That said, there is the "everyone else is stupid" bias. ETA: In case it wasn't clear from the outset, on the outside view, most people with this notion are wrong, and there's a recursive problem in justifying that I'm special. But intelligence tests, though imperfect, are a good hint.
4quentin
I'm not contradicting you at all, but I'm just curious: how do you know that you are smarter than virtually everyone you meet? If there is anything more to it than an intuition, I'd love to know about it. I've always wondered if there was some secret smart-person handshake that I wasn't privy to. Personally, I'd say the lower 80 or 90% immediately identify themselves as such, but beyond that I try to give others the benefit of the doubt. Maybe they aren't interested in the conversation, don't want to seem intelligent, or or just plain out of my leauge. I don't value humility very highly at all; but there aren't many things that would convince me I or someone else was demonstrably in the top fraction of the top percentile. Also, I've been intuitively aware of the optimism bias for as long as I can remember, and estimates like ".1% and 99.9%" trigger my skepticism module hard.
5thomblake
I was mostly going by the handshake.
0thomblake
I'd agree with that statement, revising it up to at least 95%. Once you've got it down to more than 19 in 20 people you meet being obviously-dumb, it's worth the effort to inspect the others more carefully, since it's always good having really smart people around. I'm much more familiar with people thinking 95% is an orders-of-magnitude higher estimate than 80%, and so I tend to adjust others' carefully-thought-out estimates outward rather than inward, unless they are 0 or 1. ETA: It's worth noting that one of the huge signals smart people give off is the "OMG you're talking about something that requires intelligence I'm so happy to have met a smart person because that happens to me less than 5% of the time" reaction, which if rarer than I think would significantly throw off my estimates.
1dbaupp
Seeming "obviously" dumb and actually not being in the top 5% are very, very different. A person might just be tired, or stressed, or distracted and so not exude intelligence. Or, they might be acting a little less intelligent than they actually are, maybe for social reasons.
4[anonymous]
I predict with 70% certainty that we will get an IQ in the range of 140-145 again, though I think it will be a bit lower than last time. I'm very surprised if it's outside 130-150. (Also took the survey. Would like more "other" options so I can ramble about my totally different opinions on many issues, but whatever.)
3Normal_Anomaly
Awesome. I said my IQ was 140 and 50% probability that I was higher than average, because I figured I'd be almost exactly average.
0pedanterrific
(I hope you didn't actually put "140ish", right?) I'm actually surprised the lower bound on the previous survey was 120. I would have figured more of a U-shaped curve.
0Normal_Anomaly
I put 140. Fixed.
-1RobertLumley
Oh wow, is that what the IQ average was last time? Can I update my probability that mine will be higher?
2[anonymous]
Last survey in 2009:
1kilobug
For myself I took my result to the Mensa online pre-test, that I did for the purpose of calibrating myself a few years ago. It's not a fully professional test (and not done in test situation), but I consider it valid enough to be more than pure noise.
0A1987dM
Same here. (I rounded the result to the nearest ten, also because I don't remember the last digit for sure.)
[-]komponisto160

(how many people have strong feelings on Three Worlds Collide these days?)

Many, according to some.

(Of course to actually get the answer, you would presumably have to...take a survey. :-) )

Reply
5Nominull
I still find myself thinking about Three Worlds Collide from time to time. The alienness of the aliens and the alienness of the humans (legalized rape?) made an impression.
[-][anonymous]160

Thanks for putting this together, Yvain! Recommendation to the Powers That Be: promote this to the main page so that more people notice it.

Reply
1dspeyer
For non-lurking time, there's no need to ask, is there? Just pull the signup dates from the user database for everyone who has posted recently.
0mindspillage
Unless you changed accounts at some point.
[-]Skeeve150

I'm not sure what it is about a survey that gets me to stop lurking at a community and actually create an account, but there you have it. Maybe it's just the chance to tell my 'story' anonymously.

Reply
0Normal_Anomaly
Welcome to LW!
[-]Solvent150

I took it a few hours ago, and only just then realized that I apparently can get karma from saying so.

Reply
[-]Nominull150

Posted. It wasn't clear whether the IQ calibration question was whether your IQ would be higher than the reported IQ of respondents or the actual IQ of respondents, and also whether that included respondents that didn't answer the IQ question.

Reply
7A1987dM
I assume the former. How the hell would Yvain be supposed to find out who's right, if the latter was meant?
[-]Giles150

Everyone should take the survey before reading any more comments, in case they contain anchors etc.

I took the survey. My estimates will be very poorly calibrated (I haven't done much in the way of calibration/estimation exercises) but I'm hoping they'll at least be good enough for wisdom-of-the-crowds purposes and more useful than just leaving blank.

Minor quibble: shouldn't "p(xrisk)" be "p(NOT xrisk)"? Just worried about people in a hurry not reading the question properly.

Reply
[-]kilobug150

I took the survey, I found the "Moral Views" question very hard to answer to, folding "moral views" in one of 4 broad categories is surhuman effort for me ;) but I did my best.

Also, not wanting to enter a political debate here and now, but your definition of "communism" seems a strawman to me.

Reply
-1[anonymous]
The definition of communism is certainly a straw man. It's not surprising that LWers don't know the difference between Stalinism, Social Democracy, and don't know about Anarchism at all, but I was still disappointed.
[-]RobinZ150

I've encountered people online who would want an "Other" option for the Gender question.

Also, my only possible answer to "Relationship Style" is "I don't know."

Edit: Survey filled, though. Left Relationship Style blank.

Reply
[-]Anny1140

Survey taken. :)

Reply
[-]Divide140

Just took it.

About the probability questions: I thought you were supposed to answer them instantly for your intuitive stance at the moment, without additional research, though I see some of responders apparently did research. Perhaps it should be better specified what is meant.

Reply
[-]pete22140

I just took it. My issue, which I haven't seen mentioned yet, is with the use of "agnostic" as a midpoint on the scale between theism and atheism. I realize that's a common colloquial use now but I don't get how it's a meaningful category -- unless it's meant to refer to negative atheism, and the "atheism" answers refer to positive atheism? And in the historical use of "agnostic" I think it's a separate category altogether that could overlap with both atheism and theism.

Overall I found the questions very interesting though, and I'm curious to see the results.

Reply
7JoshuaZ
It makes sense if one means by "agnostic" not "cannot be known" but "I don't know" or "I'm unsure." This makes sense in a general context and even more so in a a Bayesian context. In that context, one would have something like theists mean people that P(God exists) is high, atheists estimate that P(God exists) is low, and agnostics are in the midrange.
3pete22
OK, that makes sense. But then isn't this just a less-accurate version of the P(God exists) question?
4JoshuaZ
To some extent, but not everyone may have a specific probability. And different people may outline the specific probabilities differently. Asking it as theist/agnostic/atheist also is implicitly asking about sociological, psychological, and epistemological norms at the same time due to the connotations of each of those terms.
5pete22
I agree that it could be asking about which label people identify with and how that reflects those various norms, and that would also be an interesting question -- but in that case it should have been worded differently, or there should have at least been an "other" category. The way it was presented suggests an exhaustive scale.
3jdgalt
I don't like that practice. "I am an atheist" is not a good proxy for "I am a Communist."
[-]DoubleReed140

Filled out the survey. Neat!

I didn't know those versions of morality. There wasn't an option for "don't know" but I guess leaving it blank is the same thing.

Reply
[-]RobinZ130
  • Consequentialism: anything is good which has the preferred results.
  • Deontology: behavior is good when it comports with the given moral code.
  • Virtue ethics: people are good when they are possessed of the proper character traits.

To modify an example from the Stanford Encyclopedia of Philosophy: a Good Samaritan is widely agreed to be a good person, but the reasons vary:

  • A consequentialist calls them good because they improved the life of the victim they stopped to help;
  • A deontologist calls them good because they acted in accordance with moral edicts such as "Do unto others as you would have them do unto you".
  • A virtue ethicist calls them good because they have a charitable and benevolent nature.
Reply
3Sabiola
Hm... maybe I am a consequentialist, after all. But I try hard not to think of people as good or bad. What the Good Samaritan did was a good thing, because it helped the victim. And of course people with a charitable and benevolent nature will tend to do good things more often, as will those who follow good moral edicts.
1RobinZ
Sure - that attitude would be entirely compatible with consequentialism.
0DoubleReed
Thanks, I guess I'm a deontologist until proven otherwise.
2TheOtherDave
Until proven otherwise? Can you unpack that a little? What would such a proof look like?
3DoubleReed
Haha, I don't know. Given that I was just introduced to it, I don't know even really know the arguments for/against. I've so far only come up with arguments in my head, and they point me toward deontologist.
[-]wedrifid140

The cryonics question is broken! I couldn't answer it without suspecting it would be misleading. My p would be incredibly low but only because my p for the human species surviving is low. This is a technically correct way to answer the question but I am not at all confident that everyone else would answer literally, including the obvious consideration "if everyone else is dead, yeah, you die too". Or, even if everyone did, I am not confident that the appropriate math would be done on a per-participant level in the results for the p(cryo) to be meaningful.

Reply
3A1987dM
I answered that question interpreting it literally, even though “I'd assign probability 1% that a randomly-chosen person cryopreserved as of 1 Nov 2011 will be eventually revived” doesn't imply “I think that approximately 1% of the people cryopreserved as of 1 Nov 2011 will be eventually revived”, since the probabilities for different people are nowhere near being uncorrelated.
2Luke_A_Somers
FWIW, I factored the chances of cataclysm into my estimate.
2[anonymous]
This criticism also seems to apply to the existence of God, supernatural things, and etc.
-1jdgalt
I gave a low probability, not because I don't think that reviving people is possible, or discoverable soon, but because I see some political trends today that I think are very likely to result in mobs destroying the facilities before we can be revived. (And even if that doesn't happen, sooner or later some country is going to use nanotech in military ways, which -- if the human race survives -- may well result in the entire field being either banned or classified and staying that way.) But I'm signed up, because it's a bet I can't lose.
1dlthomas
How does that follow? Don't you lose if you aren't revived, be it because of social collapse, mobs unplugging you, or even just because you die in an informationally irrecoverable way?
[-]Nornagest140

I took the survey. I'd really have liked an "other/no affiliation" option on the politics question, though, or a finer-grained scale. I suppose I could just have left it blank, but that seems not to transmit the right information.

Reply
[-]Alicorn140

I took the survey :3

Reply
[-]Leonhart130

Took it.

(Regarding the phrase "ontologically basic mental entity"; in my head, I always hear it in the voice of Raz from Psychonauts.)

Reply
[-][anonymous]130

Took the survey.

Thought you might have included an option for "reactionary" on the political orientation question. The distinction between reactionary, and libertarian or conservative is substantial even given the fact that the match isn't supposed to be perfect.

The global warming question might be more discriminating if the question were whether someone thinks that the mainstream view on AGW is scientifically valid within reason. The question as it stands is vague, hinging on the interpretation of "significant".

Otherwise a good survey!

Reply
7Mardonius
But who self-identifies as a reactionary? That said, there are a number of large holes in the political question. A Left Anarchist is going to feel severely pissed off with having to choose between state socialism and anarcho capitalism.
2knb
Lots of people. I've seen a number of reactionary blogs discussed here, so there probably are several self identified reactionaries.
[-]Cody130

Took it. First post as well.

Reply
2Normal_Anomaly
Welcome to Less Wrong! Now that you're officially out of lurkdom, I hope you stay.
[-]ChrisPine130

Just took the survey. It was odd how only the word "Other" was translated into the Norwegian "Andre"... and everything else was in English.

Reply
[-]taw130

Liberal, for example the US Democratic Party or the UK Labour Party: socially permissive, more taxes, more redistribution of wealth

Socialist, for example Scandinavian countries: socially permissive, high taxes, major redistribution of wealth

Only an American could have written something like that... Political "ideologies" apparently do not translate between countries in any way. It's like asking Muslims if they feel closer to Catholics or Lutherans.

The test has also a problem with extremely low "probability" events like "God existing". There's really no meaningful number between a vague "theoretically possibly just extremely unlikely" (and number of 0s you put there doesn't really mean anything) and "literally impossible 0%" here.

Reply
6Larks
Also, US Republicans and UK Tories aren't that great a natural category; the UK Conservative Party is currently moving to legalise gay marriage, for instance.
4taw
Politics is simply incomparable between countries. Usually various parties are clustered around some country-specific consensus, and distance between mainstream parties within a country is much smaller than distance between consensus centers between countries or even across time. Neither positions nor even issues are similar. You may as well ask in survey if someone is pro-EU or anti-EU. Most people in Europe have some opinion about it, and in many countries it's a major area of contention, but asking non-Europeans about it is quite ridiculous.
3A1987dM
Yes, but I don't think a broader, more abstract classification would be infeasible or completely useless. For example, I like the one of The Political Compass.
3kilobug
Asking for political compass scores on the survey could be nice, indeed. Plotting Less Wrongers on the 2d charter, one dot for one person could revel interesting clusters.
0DoubleReed
I always thought it was a typically a 3D charter. Socially Authoritarian/Libertarian, Fiscally Liberal/Conservative, and Foreign Policy Interventionist/Isolationist.
4A1987dM
I don't think the foreign policy is anywhere near as important as the other two: for example, most people are seldom directly affected by it. And in small, neutral countries such as Switzerland such an axis would be nearly meaningless.
2DoubleReed
I don't know about this considering the massive amounts of globalization we have now. Foreign Policy is a pretty big, complicated topic. Outsourcing, wars, foreign aid, military alliances, sanctions, etc.? What? Switzerland has had a pretty big history of isolationism. If anything they have a very strong view. How is that meaningless?
0A1987dM
Because an individual's score on such a scale would tell something about their country but very little about the individual.
0DoubleReed
That's the exact same argument as the other people saying the political ideas of Socialist/Liberal/Libertarian is completely dependent on country. That doesn't have anything to do with Foreign Policy.
0kilobug
It doesn't contain the foreign policy axis (and the "fiscally liberal/conservative" is named "economic left/right", which is less ambiguous than "liberal/conservative"). Some people also include a different "politically authoritarian/libertarian" axis, different from the "socially authoritarian/libertarian" (which does make sense, for example Cuba nowadays is very liberal socially speaking, but not so much politically speaking), but the Compass doesn't, it keeps it simple down to two axis.
-3A1987dM
FWIW, I've just taken the test for the umpteenth time, and I score Economic Left/Right: -5.38, Social Libertarian/Authoritarian: -5.13. (Through the years I've always been in the southwestern quadrant, but when I was younger I used to be a little bit northwest of where I'm now.)
-3taw
Political Compass is just more vagueness and American bias. Plotting that would have some entertainment value, little more.
4A1987dM
What? It's British, actually...
5[anonymous]
Scandinavia == Socialist was hard for my Eastern European brain to process. Also Moldbuggians (there are bound to be a few considering so many LWers read Unqualified Reservations) will be saddened one can't put Jacobite / neocamerialist / restorationist / reactionary in there.
4taw
Scandinavian countries (+ UK and Netherlands, which seem to cluster closer with them than with the rest of EU) top most indexes of "economic freedom" / "ease of doing business" etc. And they still have monarchies over there, with state-church separation happening only recently, or not yet. And Sweden has large private school system etc. Or they have huge taxes, very comprehensive welfare state system, allow gay marriage or some other type, have a lot of out of wedlock marriage, extremely high rate of women participation in workforce etc. Depending on which features you focus on, you can make them appear "extremely liberal", or "extremely conservative" by US metric. It will be stupid categorization either way.
7jdgalt
"Out of wedlock marriage" would be a neat trick. :-)
2dlthomas
That, or typical, depending on just how you cut things...
2CSalmon
Scandinavian countries top the indexes on metrics other than taxation, government spending and "labour freedom" while the monarchs (and arguably, the churches) are mainly if not solely symbolic. If labels are ignored I think "socially permissive, high taxes, major redistribution of wealth" describes these countries very well.
3DSimon
Sounds to me like you're talking about a probability of 0+epsilon, which is mentioned in the survey as what "0" will be interpreted as. Did you find that unsatisfactory for some reason?
[-]endoself130

I took the survey. Sorry I asked you to keep my data private, but I precommitted to doing so in order to improve the quality of my responses.

Reply
[-]XFrequentist130

Like all the cool kids, I took the survey. You should too!

Scientia potentia est!

Reply
7Bugmaster
Out of curiosity, when will the results be published ? And what will the analysis tell us ?
[-]khafra130

Good idea, and a good set of questions. However, while I might say I'm fairly knowledgeable about a few topics anywhere else, the feeling of going far out of my depth is one I associate strongly with LW. As an example, I would expect the list of those who could hold a heavy AI discussion with LW's resident experts to be about 5 people.

Also, "exists" when referring to the entire observable universe, makes me a bit tense. In our past light cone? In our future light cone? In a spacelike interval? It makes a big difference.

Reply
[-][anonymous]110

I think the phrasing there will probably cause weird effects. For example, it seems most LWers have only vague ideas of biology and medicine, and I can talk confidently with a biology researcher or physician of average ability, so I felt happy checking that box. If everyone reasons like me, we’ll see lots of checks in that box, not because people here are expert in biology and medicine, but because we aren’t.

Reply
3khafra
Good point. It's sort of like the "guess 2/3 of the average guess" game, confounded by whatever dunning-kruger effect we enjoy. Also, heavy discussions online are less cognitively stressful than heavy discussions at, say, a LW meetup (which we should still do sometime).
3pedanterrific
Composed entirely of LW's resident experts?
0homunq
Nah. It's not that hard to understand what's said and thus not be out of one's depth; much much easier than saying something original and correct, which I think they are capable of at times.
0RobinZ
That ambiguity didn't even occur to me!
[-]komponisto130

The "Anti-Agathics" question is ambiguous:

What is the probability that any person living at this moment will reach an age of one thousand years?

Two possible meanings (which, at least for me, would result in very different numbers):

  1. Given a randomly selected person living at this moment, what is the probability that they will reach an age of one thousand years?

  2. What is the probability that at least one person living at this moment will reach an age of one thousand years?

Reply
8Vaniver
I believe the 2nd one is intended, though I agree with you that switching to something like "at least one" would make it unambiguous.
0komponisto
I'm ready to hit the "submit" button as soon as Yvain confirms (or denies) this...
2[anonymous]
Oh, dear. I assumed he meant the first one.
5pengvado
Another ambiguity: Does the anti-agathics mean 1000 consecutive years, or does it include successful cryonics as a special case?
4wedrifid
Assume 1000 animated years. :)
2NancyLebovitz
That's what I figured out. I'd be interested to know what proportion gave an estimate for 1000 year lifespans which is at least as high as their estimate for revival from cryonics. I suppose it's possible that suspended animation is incompatible with great longevity for those alive now, but it's hard to think of a mechanism. Perhaps genetic modification is required for longevity, and the tech for revival can't simulate that.
0Vaniver
Hm. This was my position before, and apparently I forgot about it when assigning my probability for the anti-aging question. Oops.
0pedanterrific
Hypothetical: if that were the case, would it be better not to thaw out cryonics patients as soon as it becomes possible to, in the hopes that the longevity problem would be solved in the future?
0NancyLebovitz
I suppose it depends on how likely rejuvenation is to be solved. If it's looking unsolvable, then reviving the person asap makes sense-- there's probably less culture shock in dealing with a less distant future.
2Vladimir_Nesov
This question also heavily depends on the irrelevant fact of whether FAI should keep variants of original individuals, or there is something better that it should therefore do instead. In 1000 years, it's FAI or bust, so this directly controls the answer. But presumably motivation for this question is "Will the future be good in this here sense?", while the estimate is lower if the future can be even better...
[-]J_Taylor120

I took the survey. If it is not too late to receive Karma for taking the survey, I would not mind.

Reply
[-]bryjnar120

I took the survey.

Like several other people, I was a bit bothered by the P(God) type questions. For some of those, my belief depends on an argument for the impossibility of, say, God, rather than on any particular evidence. In that case, am I supposed to take into account my uncertainty as to the validity of my argument? Or just put 0?

Reply
6dlthomas
How do you distinguish between 1) a universe wherein a genuinely omnipotent agent is impossible, and 2) a universe with a genuinely omnipotent agent who makes it seem like a genuinely omnipotent agent is impossible?
5bryjnar
It's not so much the "genuinely omnipotent" bit that I have philosophical problems with as the idea of "ontologically basic mental entities". I don't think this is the place to go into it fully, but suffice it to say that nowadays I'm not sure if that even makes sense. If I don't think a situation makes sense, how can I assign it a probability? Of course, I could weigh that against the probability that I'm mistaken, but I'm not sure whether we're meant to take that kind of thing into account.
8dlthomas
My understanding is that we're absolutely supposed to take that sort of thing into account.
0bryjnar
Yeah I think you're right; I hereby retract my worries!
0jdgalt
The only way I've found is to attack the idea of omnipotence on the basis of logic. If the questioner is allowed to insist I "consider the possibility of a universe where logic isn't valid," I can only dismiss his question as nonsense.
2CharlesR
Yeah, I wasn't sure how to interpret the God question either. If asked, I admit the possibility of a "creator being" that is not supernatural (in Carrier's sense). But that option wasn't in the survey as far as I could tell.
0bryjnar
Me too: if we're in a simulation, then whoever's running the simulation would count.
[-]baiter120

I took the survey and really enjoyed it. Thanks! It was mostly clear but I'm not gonna lie -- had to look up the morality definitions (except consequentialism). Perhaps a very brief definition would help.

Reply
[-]BruceyB120

Took it!

For the probability questions, I think it might have been useful for people to be able to specify confidence in their estimate. An estimate of X% from someone who is familiar with almost all of the relevant arguments and evidence is different from an estimate of X% by someone with only a cursory understanding of the issue. Then we can target the subjects people are most uncertain about to produce the most informative discussions.

Reply
4homunq
A good bayesian way to make that question quantitative would be, "If we ask you again in 10 years, how much do you expect your number to change? Express your answer as a factor of the percentage or the inverse percentage, whichever is smaller. So 1 would mean you expect no change, and 3 would mean you expect, with about 50% confidence, that your estimate and its inverse will both be more than a third and less than triple of what they are today." I know that it should really be a matter of p(1-p) but that's close enough. Oh, and taken, so one of the karma here is for that.
0selylindi
If I expect that my estimate will change in the future, why not change it now? I grant that it is highly likely that my estimates will change, but I don't know whether any particular estimate will change upward or downward, so for now they stay put. I suppose what anticipation of change in a probability estimate practically means is that you expect new pieces of evidence to come in and that you have a fairly good idea what the magnitude of evidence will be, just not the sign.
1homunq
I don't know which direction it will change, but for things I'm unsure of I expect more movement than for things I know more about. In bayesian terms, a weak prior.
3dlthomas
It would also be very interesting to compare the variance in those with a low certainty with the variance of those with a high certainty.
[-]juliawise120

One problem with the political question: Socialism is not what they have in Scandinavia. That would be social democracy (technically a form of government that's supposed to evolve towards full socialism, but they don't seem to have done that). It's unclear what option one is supposed to choose to mean "What they have in Scandinavia" rather than actual socialism.

Reply
[-]thomblake100

political words like "socialism" mean very different things in different places, so a description like "what they have in Scandinavia" is supposed to pin down the extension enough for you to work out the intension.

Reply
5juliawise
I don't know anyone in Denmark or the US who calls Scandinavian governments "socialist". Is that a common way to describe Scandinavian governments in some other country?
5thomblake
Usually the primary word I hear used to describe governments in Scandinavia is "socialist". See (from the front page of Google hits for the words Scandinavia and socialism): http://www.nytimes.com/2004/10/13/business/worldbusiness/13iht-compete.html http://mises.org/Community/forums/t/5616.aspx http://answers.yahoo.com/question/index?qid=20081016132725AAoGdNo http://www.freerepublic.com/focus/f-news/2213173/posts http://www.thefreemanonline.org/featured/scandinavian-irony-socialism-meets-liberalization/ http://en.wikipedia.org/wiki/Democratic_socialism In the US, I mostly hear the word "socialism" used as an umbrella term for any governmental economic redistribution.
1juliawise
Point taken. I will point out, though, that most of those links point out that socialism per se does not exist in Scandinavia, but rather democratic socialism/social democracy.
2kilobug
Here they are called "social democrats". To me socialism is supposed to mean collective ownership of means of production (through cooperatives, government or any other mean), not "just" wealth distribution within a globally capitalist economy. Put then, the "parti socialiste" in France is social-democrat, not wanting socialism... Even when there is no will to make things actually fuzzy, words are sometimes treachery. When in a field like politics, they are abused from in various ways... and when you add cultural differences and lossy process like translation on top of all that... welcome to the joy of not understanding each other at all. I guess that's what he put the details about what he meant for each word. We may not agree on the labels, but we understand from the description in which category we fit the best.
[-]Antisuji120

Filled out. For the probability questions that I thought were very close to 0 (or 100) I thought about how many times in a row I would have to see a fair coin land heads to have a similar level of credence, and then translated that into percentages. A fun exercise.

Also, my calibration was a little off on the last question.

Reply
[-]malthrin120

Filled out.

Reply
[-]dbaupp120

I have a feeling that some people might answer some of the "what is P(...)?" with a probability rather than a percentage (i.e. 0.5 when they actually mean 50%). (I almost did it myself)

(EDIT: However, some people (such as myself) also used 0.5 to mean 0.5%, so an automatic conversion is probably impossible.)

Reply
3RobertLumley
Oh whoops. I did this. Worst of all, I noticed that he wanted percentages, and forgot to go back and change it... Hopefully this is obvious to see and for him to fix...
3Normal_Anomaly
Argh, I did it too. Fix mine too please?
1Dorikka
I also almost did this. Repeatedly.
[-]Scott Alexander110

This survey is now closed. I'll have data eventually.

The answer to my question from November 12 was 970 people.

Reply
0Craig_Heldreth
Eagerly anticipating your analysis and the subsequent discussion. Thanks again!
[-]ancientcampus110

Huh, I'm surprised that I'm not at all the first lurker to make an account just for this.

Reply
[-]Alejandro1110

Took it. Thanks for the effort you are putting into this.

Reply
[-]TerminalAwareness110

Alright, I finally made an account. Thanks for the push, though this had little to do with why I've joined. I liked the probability parts of the survey, though I know I need to improve my estimates. Political section might be better done with a full-fledged Question section just devoted to it. Perhaps a later survey? I can't wait to see the results.

Reply
[-][anonymous]110

Took it. Though I had a hard time answering what religion my family would abide to, my dad is an agnostic I think, but I'm not even sure what my mother believes in . . . No one I know very well practice religion (not just believing) either so it has never been a big part of my life, might be because I'm from Sweden.

Reply
[-]JoachimSchipper110

I took it as well. One comment: my mother and father adhere(d) to different flavours of Christianity in different degrees. This made it somewhat hard to answer that question fully (I went with my father because he cares most, but my mother's views probably had more influence on me.)

Reply
[-]Jack110

Moral views should probably be two questions-- one about the existence of moral facts and one about favorite normative theory (with "None" "Other" or "Particularist" as a fourth option).

Reply
[-]Sniffnoy110

Took the survey.

Reply
[-]spriteless110

Took it. It's been awhile since my last IQ test so I did not answer that one, and I don't think I'm gonna be in the top 50% at all.

Reply
[-]free_rip110

Taken. Moral views question gave me a bit of trouble, I didn't agree with any of them. Another option like 'There is morality, but I don't define it in any of the ways above' would be nice.

In general I thought the categories covered things pretty well.

Reply
0Sabiola
I agree! I too, think that there is such a thing as morality, but I'm not sure how to define it, and I don't agree with any of the options.
0drc500free
That's how I felt. There is such thing as a personal moral code or system, and we can examine what happens to groups of people who are running various types and mixtures. We can try to determine which moral memes have the best outcomes, and are most likely to spread and be executed closely, and we can try to follow those codes. Maybe that's pragmatic ethics, but the way morality is used in the survey implies that I'd believe in a single correct way of executing morality at the individual, day-to-day level. It's like asking whether I believe in being a carnivore, an herbivore, or a plant. The option "other" option is "morality doesn't exist," which is a bit like are you a) christian, b) jewish, c) muslim, or d) religion doesn't exist.
[-]Xece110

Thanks Yvain. Just took the survey, can't wait for the results!

Reply
[-][anonymous]110

Survey taken. :)

Reply
[-]Emily110

I took the survey :)

Reply
[-]Lapsed_Lurker110

I filled out the survey, but I left a number of questions blank, on the basis that I don't feel qualified to answer them. I would have left the year of singularity question blank too, but it said that doing that meant I thought it definitely wouldn't happen.

Reply
8xv15
I took the survey too. I would strongly recommend changing the Singularity question to read: "If you don't think a Singularity will ever happen, write N for Never" Or something like that. The fraction of people who think Never with high probability is really interesting! You don't want to lump them in with the people who don't have an opinion.
2homunq
I would probably be an N, but I'd need a better definition of "singularity". In fact, I think the question would be generally more interesting if it were split into three: superhuman AI, AI which self improves with moore's law or faster, and AI domination of the physical world at a level that would make the difference between chimpanzee technology and human technology small. All three of these could be expressed as probability of it happening before 2100, because such a probability should still have enough information to let you mostly distinguish between a "not for a long time" and a "never".
0[anonymous]
I would probably be an N, but I'd need a better definition of "singularity". In fact, I think the question would be generally more interesting if it were split into three: superhuman AI, AI which self improves with moore's law or faster, and AI domination of the physical world at a level that would make the difference between chimpanzee technology and human technology small. All three of these could be expressed as probability of it happening before 2100, because such a probability should still have enough information to let you mostly distinguish between a "not for a long time" and a "never". Oops... this was meant to be a
[-]CharlesR110

Filled out.

Reply
[-][anonymous]110

I took the survey. I would trust my probabilities for aliens, espers, and time travelers as far as I can throw them. I don't really think any number I could give would be reasonable except in the weak sense of not committing the conjunction fallacy.

I second the anchoring effect in the Singularity question. Based on previous comments I had written before, I would have expected a far more distant year than the one I gave in the survey. Oops.

Also, I missed the Principia question by ten years, and gave myself 80% confidence. I don't know if that was good or bad. How would I go about estimating what my confidence should have been?

I was disappointed that mathematics fell under the "hard sciences", but I suppose we can't all have our own category.

Reply
3Normal_Anomaly
The confidence question was "how confident are you that you are within 15 years of the right answer?" which you were. You assigned 80% probability to the true outcome. That's pretty good.
[-]Desrtopa110

For the Existential Risk question, I would have liked to see an option for societal collapse. It wouldn't have been my number one option, but I think the prospect of multiple stressors in conjunction, such as international economic and food crises, leading to a breakdown of modern civilization is more likely than a number of other options already on the list.

Reply
7pedanterrific
Okay, but... including the deaths of 90% of humanity? That's the sticking point, for me - I could see maybe 50% of humanity, but 90 seems like too much. (90 seems like too much for nuclear war, too, for that matter.)
3Desrtopa
If society collapses, we would lose the ability to support most of humanity. I wouldn't expect it to result in the loss of 90+% of the population within the space of a decade, but I could definitely see it dropping by that much. I don't think it's all that likely, but I would definitely rate it above a natural pandemic wiping out 90% or more of the population.
3pedanterrific
Agreed. (Not to mention 'asteroid strike'. Did anyone even pick that?) I put 'man-made pandemic', myself.
[-]Wandering_Sophist100

Took the survey; I mostly lurk but have posted occasionally.

Reply
[-]lessdazed100

Perhaps future surveys should have exhaust valves channeling people's need to express themselves:

1) In any number of words, what is your theory of gender? (essay section)

2) On unsophisticated government forms that only have the options "male" and "female", which do you select? (multiple choice, two options)

3) Sex with people who gave the same answer to 2), yay or boo? (multiple choice, two options)

4) Sex with people who gave a different answer to 2), yay or boo? (multiple choice, two options)

5) In any number of words, what are your political views? (essay section)

6) Which nine of the following ten political terms most poorly describe that position (multiple choice, ten options).

etc.

Reply
5JoachimSchipper
Another proof that survey design is hard: should I answer "yay male/male sex, I strongly support same-sex " or "boo male/male sex, I am not interested?" Or, taking a page from Alicorn's book, what about those who say "yay male/male sex, I'd like to be interested in men?" (I'd expect this to be a statistically detectable portion of test-takers.) Also, making people write essays just to throw them away is not a terribly productive use of anyone's time.
0TheOtherDave
In the meantime, I suppose individuals can approximate the same behavior by writing such things in a file on their hard drive. It won't affect processing of the survey, of course, but then it wouldn't really do so anyway. Longer-term, presumably the goals we want to achieve with a question should drive the options we provide for answers. If we want to correlate demographic category with other answers, then we really don't care about demographic categories that cover fewer than 5% or so of the population, since such correlations would be even less useful than baseline, but we do care about standardizing answers. If we want to know how LessWrong readers identify themselves because we're curious, we don't really care about standardizing answers, but we do want to let respondents use their own terms to describe themselves. Etc.
[-]False_Solace100

Another lurker who took the survey. I suppose I should go find the newbie thread and introduce myself.

I was extra wrong on Principia. Almost disturbing to think how recent it was...

Reply
1FeepingCreature
Semi-rare poster. I was almost two-hundred years off. I think it might be the latin title that throws people.
0jknapka
I was over 100 years off, but in the opposite direction.
[-]Keratin100

I took the survey.

Reply
[-]Craig_Heldreth100

I took your survey. There may be small errors in a couple of my answers. I can hardly wait to see your explanation of what you are doing with those "calibration questions" like "what is your estimate of the probability that your answer to Newton's Principia publication date is within 15 years of the correct answer"?

Also if there is some sort of sampling theory surveying practice FAQ that explains the use of such questions I would be interested in reading it.

Reply
[-]simplicio100

I've taken the survey, and have the uncomfortable feeling that the odds I gave for several interrelated propositions were mutually inconsistent.

Reply
5Dustin
Yes, I had the same feeling when I finished.
[-]robertzk100

I took the survey and could feel my affective heuristics generating random near-the-ballpark numbers.

Given I am a mathematician and have no idea how to actually compute any of those probabilities (or what that would even formally mean, say in a probability measure space), I let those numbers stand without further scrutiny.

Reply
[-][anonymous]100

After lurking on LessWrong for several months, I just made an account today and took the survey. :) I'm curious to see the results.

Reply
[-][anonymous]100

I took the survey.

The political section is begging for a one line write in, seriously. Please consider adding on in addition to the pick one option poll. I'm not having warm fuzzies for any of the groups and had to bite my tongue and pick one I really really dislike, just because the alternatives are so much worse and one of the alternatives, while probably quite popular a choice, will be misinterpreted if I chose it.

Reply
[-]Scott Alexander180

From your perspective, that makes sense. From my perspective - I don't intend to ever look at this data. I'm going to import it into SPSS, have it crunch numbers for me, and come out with some result like "Less Wrong users are 65% libertarian" or like "Men are more likely to be socialist than women."

If you put "other" - and this applies to any of the questions, not just this one - you're pretty much wasting your vote unless someone else is going to sift through the data and be interested that this particular anonymous line of the spreadsheet believes in strong environmental protection but an otherwise free market.

Looking at the answers, I really shouldn't have allowed write-ins for any questions - I was kind of surprised how many people can't settle on a specific gender, even though the aim of the question was more to figure out how many men versus women are on here than to judge how people feel about society (I considered saying "sex" instead, but that has its own pitfalls and wouldn't have let me get the transgender info as easily. I'll do it that way next time.)

I was particularly harsh on the politics question because I know how strong the temptation is. I think next survey I'll give every question an "other" check box, but it will literally just be a check box and there will be no room to write anything in.

Reply
[-]arundelo110

I was kind of surprised how many people can't settle on a specific gender

You could cut the gordian knot by borrowing Randall Munroe and Relsqui's solution for the xkcd color survey, which was to ask about chromosomal sex:

Do you have a Y chromosome?

[Don't Know] [Yes] [No]

If unsure, select "Yes" if you are physically male and "No" if you are physically female. If you have had SRS, please respond for your sex at birth. This question is relevant to the genetics of colorblindness.

Reply
[-][anonymous]130

Technically, isn't it the number of X chromosomes that matters to colorblindness? It's just that people with Y chromosomes almost always have one X chromosome, and people without them almost always have two.

Reply
3Relsqui
You're correct; we asked for Y chromosomes rather than X chromosomes because it's way easier to have an extra X and not know it than to have a Y and not know it. So if we ask about Y, we can rough-sort into "probably XY" and "probably XX" groups and then look at the statistics for chromosomal deviations within those groups.
0homunq
... especially if they're responding to xkcd polls.
[-]pengvado100

You have some reason to believe that Klinefelte's syndrome (XXY) is less common among xkcd readers than among the general population?

Reply
0homunq
I thought I did. Now that I've followed your link, I realize that even if it were less common, it would probably only be marginally so, so I withdraw my comment above.
6[anonymous]
Most people don't actually know their karyotype, and are often surprised to learn that it's not always what you assume. You can't necessarily infer chromosomes from external appearance and self-identification reliably; you have to look at the actual chromosomes to be sure.
5Prismattic
If I'm not mistaken, you don't need a DNA test for this. A cell sample under a strong microscope will show the barr bodies for XX (this won't distinguish XXY, but that's pretty rare).
0[anonymous]
Looking at the barr bodies is not a karyotype test. A test that can't detect whether or not someone is not XX/XY sufficient to actually tell you the information you need to know your chromosome type. Yes, in terms of strict probability most people will be one of those. The test of the method is how well it handles edge cases (not at all); this is of considerably greater importance when you're talking about those edge cases.
2Relsqui
Also, rereading that explanation, I'm annoyed at how I worded it. It's okay, but my trans*-inclusive vocabulary has improved since then and I could do better. Hell, just "if unsure, select 'yes' if you were born with a penis" would have been sufficient.
4Alicorn
I'm not sure how any of these wordings of questions handle people with ambiguous genitalia.
0Relsqui
Fair point. I'm not sure either; I think I'm relying on a given individual who is e.g. intersex either a) knowing that, and being able to make a better-educated guess about their chromosomes than any heuristic I offer, or b) not knowing that, which I'm willing to assume correlates well to having genitals that either do look like a penis or don't.
5lessdazed
Perhaps the politics question would be better phrased negatively: All you have to care about is the lowest number, and anyone who wants to do more with the numbers is able to. People would be less inclined to complain about cultural focus or balance issues.
0kilobug
I second that idea, but even then the cultural focus/balance issues will remain when a word and a "definition" are given in a way that appears to be a strawman or a very US-centric view of things. Maybe remove the words ("libertarian", "socialist", ...) and just give the one-sentence definition ?
0lessdazed
What people primarily seem to want is a more diverse list. Increasing the word count per entry makes that less feasible. As one source of complaint is, as you imply, the linking of a term with a description, what if descriptions were eliminated all together? I could begin a political survey discussion post asking people to PM me a one to three word description of a view they endorse or almost endorse, as well as another view they think important. I would update the main page to reflect submissions so more of the same wouldn't be submitted. Then the political ideology list could be trimmed down a bit somehow, and people could do a despise-style survey in which they express their disapproval of each. As the previous LW survey had about 150 takers, I would expect about that many people going through the trouble of sending me submissions, and many would be redundant, and perhaps by consensus or fiat a representative list of 35 or so could be set for the survey. Would that be a reasonable number of one or three word phrases to scan? It would be an order of magnitude more effort to read that many political sentences. The despise survey might reveal interesting things that the approval one did not - for example, we might find we have many transhumanists that dislike libertarianism and monarchism, and hate everything else. Or meta-contrarian people who approve of currently popular movements and no fringe ones. I don't know.
2kilobug
I fear eliminating the descriptions would lead to even more problems, since words like "libertarian", "socialist" or "communist" don't mean the same depending of your cultural background. I would have answered the question differently if the descriptions were not given, and I don't think I'm the only one. Or maybe, could we just ask for Political Compass score ? Would be a straight-forward question and easy to exploit later on, even if a bit caricatural. And if people don't want to take the full Political Compass test, they can still say roughly where they stand on the two axis.
0lessdazed
LCPW, so one should describe something like how much one despises the best relatively sizable minority position of each.
5duckduckMOO
Having read it, I realise this post may seem or be overly critical. Oh well. But what the results will actually show, if 65% of people pick libertarian, is that 65% of people Identify with libertarianism more than the other options. This is obviously possible wthout being a libertarian. One could even just hate libertarianism slightly less than the other options and identify most with it. As well as people who's political views aren't well deliniated by any option, there are a few people who are apolitical and would have to just pick at random. or one could be forced to hammer a square peg into a round hole. Multiple choice and no choice for "none of the above" for something like this means hammering square pegs into round holes or abstaining if you don't strongly lean one way or another. if you think you'll put a box for other in next survey why not put it in this survey? even an uncounted other option allows people who'd rather have their choice not count than be identified with one of the options given not to add a tally to one and gives you the number of people with that preference which is interresting in itself. The rest of this post is ideas for minor modifications to wording. Can't you just change it to "sex" now? "With what race or ethnic group do you most closely identify?" Some people might identify most closely with a race other than their own. I don't think the intent is to allow for this but until I read the post this is a reply to, if I did identify with another race more strongly than my own i'd answer that way were i to fill out the survey. Maybe just ask what option best describes or approximates your race. maths might be the field of a non-trivial percentage of less wrong readers. I think martial arts would go along nicely with self help, pickup artistry and meditation as an option for the communities question. All are relatively common self-improvement things, as is less wrong. Also I think members of competive gameing (card games, board ga
5[anonymous]
Virtue Ethics got in the current poll because it was a common enough write in by posters. I consider the write in option to be useful in some spots because that way one can figure out if one is missing certain common clusters. I am quite willing to bet that some political categories that are rare or fringe elsewhere may be prominent on Lesswrong, simply because high IQ people are more likley to try and consistently conform to a particular ideology than low IQ people. I mean Libertarian and Communist are (depending on the country) basically such exotic positions, imagine someone making a poll not expecting to find significant numbers of either on Lesswrong. How exactly could he figure this out and add those two? Oh sure on a different forum, people might just say, well I'm X-terian and a lot of other people are or something to that effect, but that seems a pretty rude thing to a LWer with our politics taboo. I for one don't want to know what any particular poster's ideological leanings are! Information is always good but our brain is literally built to be hijacked by such information.
4Oligopsony
Kibbitzing off acts as a good filter here.
-2jdgalt
I wasn't and still am not sure what "Virtue Ethics" is supposed to mean. My personal ethics are based on the libertarian "non-aggression principle," in other words, don't violate the rights of other persons, and beyond that, do whatever you want. (Which does not mean I don't see a point to charity -- I just see charity as one of many things you might do with your money or time because it makes you happy. In my experience, enough people feel that way that it's rare for anyone to starve or freeze unless he behaves so badly that he doesn't deserve to be helped.) Apologies if this violates a politics ban, but I can't really answer an ethics question without going there. As far as the objective "existence" of morals: it's a meaningless idea. Even if there is just one God, his opinion doesn't automatically become The Truth any more than yours or mine does. Ultimately, morals/ethics are a matter of taste and nothing more. But they're a unique exception to the old saw "there's no accounting for taste" because your moral code determines whether you can be trusted (to do any particular thing someone else expects of you, a question that of course depends on who and what it is).
7dlthomas
This would be deontological: you are ethical if you are following the rules. Per my understanding of it, virtue ethics looks to the traits of the individual moral agents. It is good to be a compassionate person. A compassionate person is more likely to give to charity, and so giving to charity may be indicative of virtue, but a person is ethical for being compassionate, not for the act itself.
5katydee
If only...
5ArisKatsaris
You're describing a deontological branch of ethics, I think. As for virtue ethics, I believe virtue ethicists evaluate the morality of a deed based on whether it ennobles or debases the doer. In short, "charity is good" because it instills to you habits of charity that makes you a better person. But perhaps a virtue ethicist would be better fit to explain it (and my apologies to them if I got it wrong).
3TimS
You've taken a sufficiently coherent political philosophy and pressed it into service as a moral philosophy, where it doesn't fit. The principle "do not harm" doesn't imply that you should (may?) give to charity because it makes you feel good. It only implies the converse, that you should give to charity if it makes you feel good. But [Edit: one] purpose of a moral theory is to tell you when (if ever) to give to charity (and what charity to give to, etc.)
1wedrifid
I tend to like moral theories to also tell me whether or not to eat babies. Or is wanting the purpose to be a tad more general than charity donation just me?
2simplicio
There is a nice critique of this libertarian view of ethics here.
0[anonymous]
Okay, first things first: my initial reaction to a certain line in your comment was a reflexive downvote, but after a minute I reconsidered; applying the principle of charity, it's more likely that I've misinterpreted you than that you actually meant what I found ridiculous. So, to clarify: Surely, surely you are not blaming the victims of starvation? Also, secondly: WP has an okay summary, but the short version is: an act is moral or not based on the character and intentions of the actor. It sounds like your ethics are rather more deontological (i.e. rule-based).
4thomblake
Only ask one question at a time. If you wanted info about "transgender" then ask a "transgender" question. Example: Are you transgender? * No * Yes, F->M * Yes, M->F * Yes, but I prefer not to specify * Prefer not to answer Of course, this logically excludes those who would prefer to answer but are Yes - other, but your earlier point about 'other' applies if you don't want to code open-ends.
3thomblake
Seriously, dude, coding. Surely someone would be willing to volunteer to code a couple hundred open-ends. It should take like 5 minutes if you're willing to use broad brushstrokes. And if most of the raw data is made public, the later sifting for interesting tidbits is crowdsourced.
2Scott Alexander
Well, sure, you could do that. But if I decided to hand-code all of the political write-ins into standard political terms like "liberal", "conservative", "etc", then all I'd end up with is a list of people's political preferences in a few bins of standard political terms. Which is exactly what I have now when I don't allow write-ins. This way is easier for me and allows people to choose their bin themselves rather than have me try to guess whether some complicated philosophy is more conservative than libertarian or vice versa.
9dlthomas
But does not allow for the creation of new bins, if we spot different clusters.
6thomblake
What dlthomas said. If 20% of your respondents wrote in "anarchist", then you have a new punch.
2Relsqui
I disagree; it might be important to identify oneself as something which is not one of the presented options, even if no one cares what other thing you are. For example ... ... I'm genderqueer, and when I take demographic surveys it's important to me that I'm not counted in either the "men" or the "women" group. Firstly, it would be lying, and secondly, it would be lying in a way which perpetuates the invisibility of my actual identity. That may not be a big deal to the survey writer, but it's always a big deal to me.
2mwengler
I think next survey I'll give every question an "other" check box, but it will literally just be a check box and there will be no room to write anything in. I love that! The urge to signal is almost irresistable when there is a place to write something in. I took the survey but you don't have to rec me as I've lost like 35 karma points in the last month and I'd like to see how low I can go. Mike
2TheOtherDave
Ultimately, the question becomes how you will interpret the difference between no-answer and checking a particular box. If no answer by convention means "I don't know the answer to this question," then it makes sense to have a "I know the answer, but it's none of the choices you give" box (aka "other"). It may also make sense to have a "I know the answer, but it's more than one of the choices you give" box. Or a "I know the answer but don't want to tell you" box. Etc. Or, not. Much as people get annoyed by being asked to categorize themselves, that is basically the point of this sort of survey, and nobody is obligated to take it. There's no particular reason you should change your strategy to alleviate our annoyance.
5thomblake
There's also a validation issue. A blank could mean "I accidentally scrolled past this question without noticing it". The standard for online surveys is to (where appropriate) include choices for "Other", "None", and "Prefer not to answer", and then force a response for every question so that you know nothing was accidentally skipped.
6thomblake
That said, online surveys often fail at this, for instance having "gender" questions with just the 2 options (they should at least have an "other") or only accepting as "valid" answers that do not fit the entire population (For example, a survey for doctors with no explicit age cutoff limited ages to <99; at the time, there was one practicing doctor older than that - he would just have been given an error message that his age was "invalid".)
2dbaupp
Would it be possible for you to write down the ideas/suggestions you've had about the next survey(s) somewhere (possibly the LW wiki)? We might be able to use your expertise from these first two surveys to try to establish a good and (more) standardised survey that can be run easily every year or so.
0magfrump
Would it be possible in the future, rather than having a write-in or group identification, to do something like political compass coordinates? This would have the benefit of allowing people to express views that don't fit into camps without having the opportunity to write lots of words no one will read.
-2[anonymous]
Right now for the politics question, you have three(!) different strains of neoliberalism, social democracy, and Stalinism. That's hardly representative of the global political spectrum, and I'm honestly surprised that anyone designing that question on a survey would make that mistake.
2Emile
Alternative complaints: ... or: Yes, anarchists, monarchists, theocrats, etc. might object that their view isn't represented, but I think that limiting the possibilities was still the right choice (see also the objections to the gender question). Keeping the focus on LessWrong away from politics seems best.
9lessdazed
If only "nitpickers" was a political position, then all of this trouble could have been avoided.
-4[anonymous]
The current limitation of possibilities doesn't keep the focus on LessWrong away from politics. It focuses on certain types of politics. Further, if you're calling Labor or the Democrats leftist, or the Libertarian party anti-state, you're just wrong by almost any metric worth caring about. It wouldn't have been hard to have one option for each of capitalist/pro-state, leftist/pro-state, capitalist/anti-state, and leftist/anti-state. That would have captured all modern political alignments, and anything more specific could be another option. As it stands, that question is totally useless to me, and probably to most other leftists. So any conclusion like "women are more likely to be socialists" will be equally meaningless. Most socialists don't even consider European social democracies to be socialist.
[-]Grognor100

I just took the survey but am still concerned about the ambiguities.

Reply
[-]FiftyTwo100

Re the politics question, I'm not a communist but I don't think any sane modern communists would use the soviet union as an example of communist government. They officially claimed the government was a transitional stage towards self governing collective utopia.

Reply
6Oligopsony
In Soviet parlance, the Soviet Union was a socialist society but could be fairly described as having a communist government. Of course if you're an anti-revisionist or Trotskyist or Judean Popular Front or the like things get more complicated, but my guess is that anybody who self-describes as "communist" will have picked that option regardless of the description, which is, to be sure, weird on a couple of levels. Like most fringe-but-widely-known groups they're used to being described in ways that are slightly off.
[-]magfrump100

I'm very happy that this survey is being retaken! Looking forward to seeing the results.

Taken. My two cents as everyone's:

Under academic field, there were specific fields for statistics and "other hard sciences" but not a specific field for abstract mathematics, which I was surprised by.

agree with others that the political categories were too linear and a libertarian socialist option would have been nice.

My estimate for Newton's Principia was off by 27 years... so my confidence was a bit high but not too much.

Reply
0A1987dM
None for physics either.
4byrnema
But physics is clearly a hard science?
[-]qualityisvirtue100

Took it. I liked the calibration questions a lot.

Reply
[-]atorm100

I took this survey.

Reply
[-]shirisaya100

I took the survey and was annoyed to realize that I didn't have a strong enough background to have informed answers to several questions.

Reply
0windmil
That's about how I felt when I took it. Still fun whipping out those uninformed estimates to show what silly things I think.
[-]Nick_Roy100

Taken. Thanks Yvain, I appreciate this effort!

Nitpick: why no "Other" categories for Participation and Expertise?

Reply
0[anonymous]
Edited to add: I posted my own ideas concerning SI and social business in the comments. What are yours? Also, addressing some valid points made in the comments, what are some other innovative ways to fund SI?
0cata
What's the point? Surely everyone is a member of some community and has expertise in something! Everyone would check "Other."
1Nick_Roy
True. It might be interesting to see if any hidden commonalities among Less Wrongians exist, however, if the "Other" option comes along with a "fill-in-the-blank" field. It might also be a good idea to include this "Other" option in addition to the other options to avoid everyone checking "Other".
[-]Nectanebo100

I took the survey, but unfortunately, when I saw "If you don't know enough about the proposition to have an opinion, please leave the box blank", I left all of the probability boxes blank afterwards because I just didn't feel like I could give an answer I would be happy with, even for some of the questions that could be described as clear-cut. Maybe next survey I'll be able to provide more useful details.

Reply
[-]arundelo100

I took the survey. Thanks Yvain!

Reply
[-]Prismattic100

I don't really understand why divorced would be separate from single and looking (or single and not looking, if the marriage was especially traumatizing). Also, one could be married and looking if one is polyamorous.

Reply
0[anonymous]
It carries, or rather did carry quite a bit of information, though I doubt anyone on LW would have bothered to use it so it was superfluous. But honestly I'm not sure why "married" is a separate option according to these criteria.
[-]Prismattic150

From what I have observed, a more informative question if one wanted to meaningfully sort participants here would be:

Do you have children?

a) No, and I do not expect to in future.
b) No, but I might like to in future.
c) Yes.

Reply
2[anonymous]
Excellent suggestion.
[-]Rain100

There's no option for public sector (government) for Work Status. Non-profit may be misleading if it contains that as well.

Reply
[-]JJXW90

Took they survey. Interested in the results. Interestingly enough, I have had an account for a month or two now, but have not posted anything until now. Thanks for putting this together Yvain.

Reply
[-]jasticE90

Took the survey, but this post will make the reported karma score inaccurate

Reply
-6A1987dM
[-]meterion90

Like many others, I made an account for this survey.

Reply
[-]Karmakaiser90

I took the survey.

Reply
[-]knb90

I took the survey.

Reply
[-]suzanne90

I've taken the survey, and realised that I really need to practise making probability estimates.

Reply
5Morendil
We all need to. :)
[-]selylindi90

Survey taken.

I had fun doing the background research to be able to give a number to the P(Aliens) questions. :) The topic has, of course, come up many times, but never before for me in association with a community where the social norms favored a careful, quantitative answer.

When answering the Newton question, I was surprised at the shape of my probability distribution for the answer. It definitely wasn't a gaussian, a uniform distribution, or other form that I've worked with. This was simply due to the knowledge I started with, which was vague proposit... (read more)

Reply
3occlude
I enjoyed this too. Tried to calibrate Aliens 1 with Aliens 2, and found that what seemed like a modest estimate for Aliens 2 (still a shot in the dark due to too many Drake unknowns, but what the hell) created an enormous probability estimate for Aliens 1. More convinced than ever that we are not alone.
[-]beoShaffer90

Took it a while ago, but forgot to comment till now.

Reply
[-]zefreak90

Took the survey

Reply
[-]cata90

I took it, but I would never post a content-free comment just for the sake of a few karma!

The results should be fun to see, so thanks for taking the time to do this.

Reply
[-]gjm90

I didn't like the ethics question, because it could be interpreted as asking about one's theoretical position on metaethics, or about one's actual values, and the two can diverge. Specifically: I bet there are quite a lot of people on LW for whom something like the following is true: "I don't believe that moral judgements have actual truth values separate from the values of the people or institutions that make them. But I do have values, and I do make moral judgements, and the way I do so is: [...]".

Reply
[-]A1987dM90

In the singularity year question, I interpreted that to mean “50% that a singularity occurs before YYYY, 50% that either it occurs later or it never occurs at all; leave blank if you think it's less than 50% that it ever occurs”, even though, taken literally, the first part of the question suggests “50% that the singularity occurs before YYYY, given that it ever occurs”. Given that my probability that no singularity will ever occur is non-negligible, these interpretations would result in very different answers.

Reply
4Luke_A_Somers
Yes. My estimate was based on "Keep adding years until the cumulative probability is 50%", which did eventually terminate, but at a much higher year than if I were to assume it is to occur.
1wedrifid
Given what the presence of just one person who believes the probability that a singularity will ever occur is about 50.01% and who applies this heuristic I hope the results of the survey aren't limited to giving us the mean!
0michaelsullivan
If you look at the results of the last survey, that's exactly what happened, and the mean was far higher than the median (which was reported along with the standard deviation). I agree, it would have been a big improvement to specify which sense was meant. Also, answering year such that P( | ) would be the best way to get a distribution of answers on when it is expected. So that's what I did. If you interpret the question the other way, then anyone with a 30-49.9999% chance of no singularity, has to put a date that is quite far from where most of their probability mass for when it occurs lies. Suppose I believe that there is a .03% probability of a singularity for each of the next 1000 years, and then decaying by 1/2 every thousand years after that. That puts my total singularlty probability in the 52% range, with about half of my probability mass concentrated in the next 1000 years. But to answer this question literally, the date I'd have to give would be around 7000AD, even though I would think it was about as likely to happen by 3011AD as after 3011AD.
0wedrifid
This giving of numbers that that fall short of a full probability distribution really can be misleading at times, can't it?!
[-]spuckblase90

I took it. Thanks for this, I'm excited about the results.

Reply
[-]Kutta90

I praise Yvain for this.

Reply
[-]ata90

I took the survey.

Reply
[-]Troshen80

Thanks for putting together the survey. It prompted me to do a couple things, including start posting here.

I was about 100 years off with Newton. Dang it!

Troshen

Reply
[-]jdgalt80

I took the survey.

I didn't like it because some of the questions offered too narrow a range of answers for my taste. Example: I consider the "many worlds" hypothesis to be objectively meaningless (because there's no possible experiment that can test it). The same goes for "this universe is a simulation."

As for the "singularity", I see it as nearly meaningless too. Every definition of it I've seen amounts to a horizon, beyond which the future (or some aspects of it) will be unimaginable -- but from how far past? Like a physical horizon, if such a "limit of vision" exists it must recede as you approach it. Even a cliff can be looked over.

Reply
3lessdazed
Is this an explicit premise of MWI, or is it a logical consequence of the premises, or is it based on current technology and understanding? Even if it is one of the first two, suppose all other interpretations made testable predictions. Would the question asking one to estimate the chances MWI is correct be useful?
0jdgalt
It's a logical consequence of the premises. The instant there's a split, all branches except the one you're in become totally and permanently unreachable by any means whatever. If they did not, the conservation laws would be violated. If all other interpretations made testable predictions, it wouldn't be enough unless you could somehow eliminate any possibility that didn't make the list because nobody's thought of it yet. It's like the fallacy in Pascal's Wager: all possible religions belong in the hat.
3lessdazed
So if for thousands of years science can't think of anything better than hidden variables of the gaps, collapse at a level we can't detect because of its scale, and MWI, MWI is "objectively meaningless"? If somehow the room for hidden variables is eliminated, and the collapse is falsified, it's still "objectively meaningless"? It's scientifically meaningless, maybe, but that's like saying evidence is inadmissible in court because it results from a search conducted without a warrant. It doesn't imply the crime wasn't committed by the culprit. http://lesswrong.com/lw/in/scientific_evidence_legal_evidence_rational/
-1jdgalt
I can't make sense of your reply. The first "sentence" isn't a sentence or even coherent. But perhaps I myself could have been clearer by saying: The instant there's a split, all branches except the one you're in effectively cease to exist, forever. Does that help?
5thomblake
Yes it is. Maybe this rephrasing would help:
0jdgalt
I don't know what you mean by "science can't think of anything better". I'm simply using the standard that a statement is objectively meaningful if it states some alleged objective fact. I reject the notion of hidden variables (except possibly the core of oneself, the existence of the ego) as un-Bayesian. With that one potential exception, all objective facts are testable, at least in principle (though some may be impractical to test). I fail to see how one can be rational and not believe that. I'm not saying this to insult, but to get an explanation of what you think I've overlooked.
0thomblake
You should re-write this as a reply to the person who made those claims.
[-]FAWS80

Took the survey. Why are posts stating that being voted up?

Reply
4dbaupp
8wedrifid
Oooh, I took it! Vote me up too.
9[anonymous]
Does karma hunger ever go away? I've often wondered how EY feels about being up voted or down voted.
8komponisto
I think it's the derivative of one's karma that really matters. (Even more specifically in my case, it appears to be something like the logarithmic derivative of individual comments that I really care about...)
[-]wedrifid150

The comparative karma of my comments to the surrounding comments also seems to matter to me. Specifically if am arguing with someone who is saying something transparently logically absurd and their comments are higher than mine it invokes both disgust and contempt.

Reply
2komponisto
Yes, that too. In fact, since the default tendency is for descendant comments to score lower than their parents, I find it particularly insulting whenever a direct reply to one of my comments has a higher score (if there is any challenge or disagreement involved).
6Emile
You know saying that is just begging people to find clever self-referential ways of making that happen.
3Normal_Anomaly
Nice try.
0A1987dM
BTW, I wonder if the “karma for the last 30 days” meter counts the karma for stuff which I wrote in the last 30 days, or for whatever was up/downvoted in the same period, no matter how long ago I wrote it.
2shokwave
It was the former for a short while and is now the latter.
2Dan_Moore
I took the survey too. Thanks for creating it.
0dbaupp
Sorry, the grandparent wasn't clear, but I'm not the one who made it. You'll have to thank Yvain.
[-][anonymous]80

Took it. It might be worth differentiating between people who identify with a particular political group and people who just happen to skew a little more in one direction than another.

Some of my probabilities might be a bit off, too, as I'm not entirely sure about factoring x-risks into the lifespan questions. A better way of specifying various very small probabilities would also be appreciated.

Reply
[-]Metus80

Took the survey, hoping for valuable data soon.

Reply
[-]Steven_Bukal80

I took the survey. Thanks for putting this together.

Reply
[-]amacfie80

I thought it was nanoweapons, not gray goo, that was the risk of nanotechnology.

Reply
5Nominull
Nanoweapons that aren't used to kill everyone aren't an existential threat, they're just a threat to the enemies of the people with the nanoweapons. I guess you could argue that nano-proliferation could set up a scenario like we have now with the nuclear standoff, but we already have a situation like that, with the nuclear standoff. Not easy to see why that should be more worrisome.
6JoshuaZ
Increasing the number of possible weapons that can contribute to total war increases the chances that such a war will occur especially if the number of actors who have them goes up. Worse, if nanoweapons turn out to be easier to make than nukes once one has the basic knowledge, then a Saddam Hussein or a Ghaddafi type could easily ruin everyone's day.
[-]Bill_McGrath80

I'm fairly sure there is no cryonics available in my area - perhaps this could be added as an option in future surveys?

I felt I didn't have a strong basis to answer many of the P(x) questions, but I answered some as best I could, and left others blank. I also wasn't sure whether being a regular poster on an atheism forum would count as being an active member of a community - I selected "no".

Thanks for the survey, and I look forward to the results!

Reply
0Bill_McGrath
Also, just realized I misunderstood the 0+epsilon/100-epsilon for those questions. Apologies in advance - there are some extra zeroes in there!
[-]Alex_Altair80

Just took it. Quite fun! I wish I had an hour for each of those probability questions.

Reply
[-]beriukay80

Took survey. Boy was I wrong about Newton!

Reply
[-]Jonathan_Graehl80

"P(many worlds)" is the same as for any other interpretation that makes the same predictions. Depending on how you understand "more or less correct" I'd approach 100%.

Since it's unclear what's meant by the survey question, I didn't answer.

Reply
2[anonymous]
I didn't really understand how I was supposed to give a probability for this.
1thomblake
Yes, I answered the same way. "More or less correct" to me includes all interpretations that make the same predictions, so close to 100%.
1dlthomas
I think this confuses model with interpretation. It's clear that the model makes good predictions, and is in some sense correct. Interpretations are a question of what else is behind the model - if it is making substantially different predictions, it is an interpretation of a different model. That is my understanding, anyway...
1pragmatist
Why do you assign identical priors to all empirically equivalent interpretations? You really think there is basically no chance of a collapse or hidden variable interpretation being true? Why?
1Jonathan_Graehl
Why shouldn't I? I only prefer the simpler of two stories that make everywhere and always identical predictions, because it's more pleasant -- but I can't find it any more likely. I thought the notion of a universal prior was to normalize to the shortest equivalent description. If collapse vs. many worlds are equivalent in their predictions, then my universal prior gives the same answer for them both. You slightly misunderstood me. As far as I understand them, they're all equivalent with respect to any measurements I can perform. So I give them all near 100% chance of being "more or less correct".
0pragmatist
The "equivalent" in your characterization of the universal prior does not mean "empirically equivalent". If you read it that way, then you're not doing Solomonoff induction. This is false. There are possible experiments that distinguish many worlds from its collapse and hidden variable competitors.
1Jonathan_Graehl
I wasn't claiming to do Solomonoff induction, or claiming to use a universal prior. I think you know the definitions of those better than I do, but I'm not sure you understood that I stipulated that the competing theories be empirically equivalent everywhere and always - not just in my experience so far. I don't know of any stronger notion of equivalence, so if you'd like to specify what equivalence you think I should be using, I'm all ears (I do know that there are syntactically verifiable equivalences, but I don't consider those to be any stronger). Maybe. Although I don't completely understand QM, I've heard that MWI is experimentally indistinguishable from at least one other interpretation. I'd appreciate a reference to any experiment that should separate MWI from its competitors.
6pragmatist
Consider a conspiratorial interpretation of quantum mechanics according to which the universe is genuinely local and deterministic, but the initial conditions of the universe are jerry-rigged so that all measurements made by sentient creatures fit quantum statistics (even though events in general do not). This theory is empirically equivalent to many worlds. It seems clear that there are several senses in which it is not equivalent to many worlds. And I think there is good reason to assign it substantially lower prior probability than many worlds, since one would need to specify the entire initial condition of the universe in order to predict correlations that many worlds predicts based simply on Schrodinger's equation.
0Jonathan_Graehl
That's a useful demonstration of the intuition behind "simpler is more plausible". Still, if it were possible to know that your jury-rigged-setup story were everywhere and always (not just up-til-now) empirically equivalent to MWI or whatever, then I'd really bite the bullet and call it absolutely equivalent.
2pragmatist
Fair enough. Incidentally, if you're looking for a rigorous justification of Occam's razor, the best one I know of is Kevin Kelly's.
6pragmatist
David Deutsch has a paper called "Three experimental implications of the Everett interpretation". I can't find it online, unfortunately. The experiments are infeasible with current technology, but the fact remains that many worlds makes different predictions than orthodox QM. The basic idea is easy to grasp. Copenhagen says there are certain sorts of systems (observers, or measuring devices) that can collapse superpositions but do not themselves enter into superposed states. Many worlds says that these systems do enter into superpositions. There are possible measurements (very difficult to conduct, admittedly, given the size of these systems) that can tell us whether or not such a system is in a superposed state.
0Jonathan_Graehl
Thanks. I'll take your recollected word for it.
[-]ChrisHallquist80

I disliked the moral philosophy question. I felt comfortable putting down "consequentialist," but I can see how someone might feel none of the answers suited them well. I would have made the fourth option simply "other," and maybe added a moral realism vs. anti-realism question.

See the Phil Papers survey. On the normative ethics question, "other" beat out the three "standard" moral philosophies, and there's no indication that everyone in that category is a moral anti-realist.

Also, for the Newton question:

My answer:... (read more)

Reply
3RobinZ
I would recommend writing out both your guess and the correct answer in words and in rot13, to avoid acting as a spoiler for others. Edit: That is: "friragrra bu svir" for your guess and "fvkgrra rvtugl frira" for the answer.
[-]Suryc1180

Filled out the survey; the calibration questions really forced me to explore my reasoning behind some of my immediate intuitions.

Oh and by the way, second post ever!

(back to lurking)

Reply
[-]Dentin80

I took the survey. You should too!

Reply
[-]nshepperd80

Hmm. For the anti-agathics question I'm wondering if I should be taking into account the probability of x-risk between now and 3011. The question looks like it's about our technical ability to solve aging, which means I should answer with P(someone lives to 1000 | no XK-class end-of-the-world scenario between then and now)? (Though of course that conditional is not what was written.)

ETA: in other words, see wedrifid's comment just above.

Reply
0homunq
I believe in quantum MW (among others) and so I am 100% sure that in some universe there will be a 100-year survivor. But I answered for the average branch. Probably worth clarifying.
2wedrifid
100% is a rather big number. To the extent that if you are wrong your entire model of the world is unable to recover!
0homunq
Actually, in the survey I said 99.9%. Which I rounded to 100% here because it wasn't my main point.
0orthonormal
Similarly here- I answered the cryonics/anti-aging/x-risk questions for the typical Everett branch, since I presume that makes them comparable to the responses of people who find MWI less likely.
[-]Relsqui70

Came out of activity hibernation to take this. Thanks for seeing a thing that needed doing and choosing to do it!

Problems with the gender field have already been discussed; the sexuality question has some of the same issues. "Gay" and "straight" don't really make sense for people with nonbinary gender, and many people interpret "bisexual" as referring to "both" genders (male and female), as opposed to a more inclusive "queer" or "pansexual." I do honestly appreciate how much effort you've put into making the survey as inclusive as it already is, though.

Reply
[-]Shabs4270

One more long time lurker (over RSS) who just created an account to take the survey and comment. Probably my favorite survey I've ever taken, I'll direct a few friends to it as well and try to get them to start reading the site.

Reply
[-]Mercurial70

I just noticed this:

Like the last survey, if you take it and post that you took it here, I will upvote you, and I hope other people will upvote you too.

I suppose that means you'd like to know that I took it about two weeks ago. Sorry for not mentioning that earlier!

Reply
[-]Rabscuttle70

Took the survey; lurk lots and should probably get more involved. First steps can be going to the London meetup. +-10 on publishing yeah, but overestimated my uncertainty to be safe.

Reply
[-]AmagicalFishy70

Just finished the survey. I'm very much an LW lurker, who apparently succumbs to some type of self-confidence bias. Though I know nothing of probability theory (thus why a lot of the questions were left blank), I gave myself a 10% chance for the publishing-question. (Was that a randomized question?) After a bit of consideration, I said [YEAR]—it was first published in [YEAR + 37]. I wasn't too far off.

Maybe that same bias is what deters me from ever actually posting anything.

Reply
4Anny1
You should think about deleting the year, it screws with the calibration question. This question was put in to test the quality of your guesses, or more specifically the quality of the probabilities you assigned. I read your comment before taking the survey and was unable to give an honest guess.
2AmagicalFishy
Ah! Sorry, I hadn't though of that. All corrections done.
[-]groovymutation70

I took the survey! I also assumed the probabilities were meant to be first-glance intuitive. I wish I'd known people were actually doing research, for I would have done the calculations!

Reply
[-]michaelsullivan70

I took the survey, but didn't read anything after "Click Here to take the survey" in this post until afterwards.

So my apologies for being extremely program-hostile in my answers (explicitly saying "epsilon" instead of 0, for instance, and giving a range for IQ since I had multiple tests). Perhaps I should retake it and ask you to throw out the original.

I did have one other large problem. I wasn't really clear on the religion question. When you say "more or less right" are you talking about cosmology, moral philosophy, histo... (read more)

Reply
0A1987dM
Same here about the religion question. I deliberately entered a completely useless answer to it for that very reason.
0michaelsullivan
Perhaps I should have entered "mu".
[-]hairyfigment70

Took the survey. My probabilities sometimes contradict each other because I tried to take the outside view into account, and found no consistent way to do so before giving up.

I did get Newton almost exactly right.

Reply
[-]faul_sname70

I just finished the survey. I had given myself a 15% probability of being correct on the Newton question, and was off by significantly over 15 years. However, I should have calibrated that as 30%, as I knew the century but had no idea when in the century he published the book.

Reply
2thomblake
Yes! I made the same mistake. If you know the century, there are only about (10/3) mutually-exclusive 30-year periods. Thus, the lowest your maximum probability out of all 30-year periods should be about 30%, and the one that you actually guessed should be at least a little higher than that. (of course, if your guess is within 15 years of the century boundaries, some of that probability mass is going to get splinched).
[-]Spurlock70

Survey taken, looking forward to the results.

Reply
[-]JStewart70

I just took the survey. I was pretty sure I remembered the decade of Newton's book, but I was gambling on the century and I lost.

I think quibbles over definitions and wording of most of the probability questions would change my answers by up to a couple of orders of magnitude.

Lastly, I really wanted some way to specify that I thought several xrisks were much more likely than the rest (for example, [nuclear weapons, engineered pandemic] >> others).

Reply
1mwengler
I nailed the 2nd edition date without meaning to.
[-]Sophronius70

Done. Seemed like a pretty good survey overall. Like others, I was confused by some questions though. Didn't know how to answer family religion, especially since I wasn't sure how far back I was supposed to look. Also, how exactly would it be determined when the singularity occurs? The moment human-level ai is reached? Seems to me that it would be more of a gradual (though still relatively sudden, all things considered) process.

The probability questions were interesting. I guess the questions about Newton and IQ relative to the average were there to accou... (read more)

Reply
[-]Raemon70

Took it. Sort of embarrassed that I don't know my IQ.

Reply
8TheOtherDave
Why does that embarrass you?
6Nornagest
Don't be. It's not like knowing that score will actually open any doors for you or constrain your anticipations in any meaningful way; in all likelihood you already know what problems you're smart enough to tackle to a much greater precision than an integer in the range 0-~160 can possibly give you. I only know it because I was tested at my parents' or school's behest in childhood. I certainly wouldn't pay for it as an adult.
0mwengler
I used my score from when I was 7. I'm pretty sure I am smarter than that based on SAT & GRE but I never learned how to translate those to IQ.
-3Oligopsony
If anything I feel like it's embarrassing to know it.
4thomblake
Remember, it's never cool to not know something.
4mindspillage
I don't feel like it's embarrassing to know it--why embarrassed? (I remember first learning mine by overhearing my parents talking about it.) It might be embarrassing if you put too much weight on it over practical ability, or if you waved it around as a substitute for convincing argument. But I don't see too much cause for embarrassment in simply knowing it.
0Nominull
Are we as a community setting up social norms against knowledge now?
3ata
One (currently slightly downvoted) comment doesn't seem like much of an indicator of a growing community social norm. Does anything else give you that impression?
1thomblake
The comment indicating embarrassment seems to suggest a norm.
[-]ata140

I assumed that was more based on cultural norms than LW norms. Generally people don't discuss their IQs in polite company (or potentially-high-variance-IQ company, maybe), especially high IQs, because of the risk of being seen as bragging about something that other people may not view as high-status. In discussions outside LW I've heard people be somewhat condescending toward people who even admit to having gotten their IQs tested, as it's often associated with intellectual pretension. (And, in turn, being seen as claiming high status in a way that actually marks one as low-status is associated with social unawareness.)

Reply
4Oligopsony
Your supposition was correct; I also meant it to be a little more light-hearted than it seems to have been interpreted. (Full disclosure: I don't know, but I did rush over to consult the SAT/GRE conversion chart when it was posted, which is probably worse.)
2Risto_Saarelma
It would also be very easy to lie about your IQ if talking about your own IQ was socially acceptable.
0thomblake
Agreed
[-]Morendil70

Filled out the survey yesterday.

Reply
[-]Eneasz70

Survey taken. Made me put hard numbers on fuzzy feelings, which is good.

I wonder how my answers compare to those I gave last time... is there any way to check?

Reply
[-]Jonathan_Graehl70

Median date of singularity: if I think there's a >50% chance of (total) human extinction before this event, I can't provide an answer.

(If, for whatever reason, i have <50% chance of Singularity, I can't answer).

Reply
0nshepperd
Surely "median date" just means the date at which it's equally likely to occur before as after. That is, if the singularity has a 30% chance of ever happening, it's the date before which it's 15% likely to happen.
4Sniffnoy
That assumes you interpret not happening as being a separate third category, but for these purposes it seems more reasonable to consider it as always happening after (i.e. happening at time infinity), since we want lower probability of it happening soon to cause the median date to increase.
0Jonathan_Graehl
Yes, that was my thinking.
[-]Mass_Driver70

Og take survey. Og deny validity of single-factor, linearly ranked intelligence measurement, though. Og increasingly fond of Dr. Gould.

Reply
3[anonymous]
You do know Jay Gould is rather unpopular here right? Edit: Yes on second thought this is clearly a joke.
[-]r_claypool70

I just finished the survey. My estimate for the Calibration Year was 200 years wrong. How embarrassing, I need to learn the basics.

Reply
2Emile
That's only embarrassing if you gave a probability of 75% of being +- 15 years. If you put 10 or 20%, you're fine.
0thomblake
I was 95% sure of the century, and was right about that much - but my 20% probability of +- 15 years didn't make any sense in hindsight, given the information that I had. Embarrassing since lately I've been talking a lot about both probability and the history of philosophy after Newton.
[-]Peter Wildeford70

I think there is a difference between "I have looked over all the evidence intensely and find the evidence and counter-evidence to weigh precisely in balance such that my estimate of the probability of event X is 50%" and "I don't know anything about X, so I will default to 50% even if it isn't reasonable".

It's the difference between "I know fair coins produce heads 50% of the time" and "what's a fair coin?". I wanted the second option when talking about many worlds -- I just haven't read the sequence on quantum mechanics yet, and I haven't read anything outside the sequences on quantum mechanics either. I just have an educated layman's understanding.

Reply
[-]pedanterrific70

First thing I did upon completing the survey: looked up Principia Mathematica and gave a little whoop of self-congratulation.

Reply
9Prismattic
First thing I did was look up Principia Mathematica and pat myself on the back for providing a sufficiently low confidence estimate. At least I was in the right century.
2A1987dM
My answer was 17 years off, and I gave 60% confidence. (Assuming a Gaussian distribution, 60% confidence for +/- 15 years means a standard deviation of 17.8 years, so I still was within 1 sigma.)
2[anonymous]
Does a Gaussian distribution really make sense here?
5Emile
As an approximation that makes calculations easier, I think it does (though it gives too high a probability to Newton publishing his book next week).
5A1987dM
Also, “too high”? Seriously? The log-odds against (x − μ)/σ being more than 19 are about 800 dB; I'm not sure I'd be comfortable with assigning such a great confidence about a non-tautological proposition about the real world. (Except “Emile will torture 3^^^3 people unless I give him/her $5” and similar, of course.) :-)
5khafra
I'll bet 100 bitcoins against .00000001 bitcoins that Sir Isaac Newton will not publish the historical Principia Mathematica next week. Edit: After considering the additional coinflips required to bring even that large a difference in money up to the relevant level, I think I'm going to withdraw my offer. Before I earned back my stake laying bets like that, I'd run into a situation where time travel had been commonplace for centuries but there was a huge conspiracy to keep it secret from me, or something like that.
2kilobug
100 against .00000001, that is, 10^2 against 10^-7 has a log-odd of 90 dB, very far from 800 dB. Didn't check the 800 dB of army1987, but if he's right on that, your bet is way below his odd. Edit : wrote 9 dB instead of 90 dB at first, sorry, hope noone saw the broken version ;)
3khafra
Yup. Unfortunately, bitcoins are not currently subdividable any further than that, and I'm not rich enough to bet more. However, I'd be willing to throw in "and you don't have to pay up the .00000001 bitcoin unless a coin comes up heads 220ish times in a row." Is this a general method for adjusting bets on long odds that make money impractical? I just thought of it.
3dlthomas
I would take that bet, except that I am insufficiently sure in my understandings of the rest of reality if I happen to win to be confident that I'd want 100 bitcoins in that eventuality. ETA: I should note that I didn't run the numbers, 0.00000001 bit-coins is something I'd be willing to risk on a 1:2^220 chance for the amusement involved. It should not be taken to reflect a general policy of accepting wagers at what my estimate of these odds would be if I did decide to work them out more rigorously...
2A1987dM
Well, I think most real-world applications of Gaussian distributions aren't that satisfactory more than about 5 sigma away from the mean, anyway.
0A1987dM
Not if for some reason you are nearly sure that it was before/after a certain date (which I wasn't); I felt that to a first approximation a normal distribution described my beliefs (as of the time I was answering) decently enough, but YMMV.
2[anonymous]
Certainly you're sure that Newton didn't live before 1000 AD and didn't survive to 1800 AD. Immediately a Gaussian prior can be improved, substantially. See Emile's comment above as well.
2A1987dM
Meh. On a Gaussian prior of mean fvkgrra friragl, s.d. 18, knowing that it's between 1000 and 1800 (or even between fvkgrra uhaqerq and friragrra svsgl) doesn't change that much, does it. (Edited to rot-13 the years... sorry for anyone who read them before taking the test.)
0dlthomas
I was entirely sure (20 decibels, at least) it was before gur Nzrevpna Eribyhgvba. That plus "some padding but not too much" got me within the margin of error, but I only gave 2 decibels of confidence that it would be.
0kilobug
For myself I confused Newton's birth date and the date of the Principia Mathematica :/ So I was off more than 15 years, but still not too bad. I gave a 50% confidence to it, 15 years is too short on that time frame, my memory of dates isn't good enough.
0thomblake
I made a similar mistake.
0JoshuaZ
Huh. Apparently I was underconfident in that I was only 7 years off from the correct date and for the calibration estimated I was 65% sure I was within +/- 15. My logic to get my year estimate: Tnyvyrb qvrq gur fnzr lrne Arjgba jnf obea, naq ur fgnegrq qbvat fhofgnagvny jbex nebhaq fvkgrra uhaqerq. Vg gura gbbx gur Vadhvfvgvba n juvyr gb qb nalguvat naq ur fcrag znal lrnef haqre ubhfr neerfg. Fb Tnyvyrb pbhyq abg unir qvrq zhpu orsber fvkgrra guvegl. Fb Arjgba unq gb unir obea nebhaq fvkgrra guvegl gb fvkgrra sbegl. Arjgba jebgr Cevapvcvn jura ur jnf nyernql fbzrjung byq. Fb +sbegl lrnef tvirf nebhaq fvkgrra rvtugl. V jnf nyfb cerggl fher gung Cevapvcvn jnf choyvfurq fbzrgvzr va gur frpbaq unys bs gur friragrrgu praghel, fb gung jnf n (zvyq) pbafvfgrapl purpx. Ubjrire, V rkcrpgrq zl qngr gb or zber yvxryl bire engure guna haqre naq va guvf ertneq V jnf jebat.
4Vaniver
So, rot13 doesn't do much to obscure numbers.
0JoshuaZ
Good point. I've replaced the numbers with numbers that have been spelled out so the rot13 does now obscure them.
2dbaupp
That doesn't mean you were underconfident; with a confidence of 65% you are correct 65% of the time.
0JoshuaZ
Yeah, but the fact that my estimate was pretty close to the correct date suggests that some underconfidence may have been at work. If someone had stated the exactly correct year, and had estimated only a 51% chance that they were in the correct zone, we'd probably look at them funny.
2dbaupp
Maybe, but getting very close with low confidence is entirely possible with these estimation-calibration tasks: a uniformly chosen year between 1600-1800 could be the exact year but the confidence of such a guess is always 15%.
2JoshuaZ
That's a good point. So a single data point like this doesn't really say much useful for my own calibration.
0dbaupp
Yup. You might already know about it, but PredictionBook seems to get touted around here as a good method to calibrate oneself (although I haven't used it myself).
1JoshuaZ
Yes, I've used it quite a bit. So far the main thing I've been convinced of from it is that my calibration is all over the place.
0RobertLumley
I wasn't...
0JoshuaZ
How far off were you?
0RobertLumley
One century. I said svsgrra svsgl I think. Or maybe svsgrra friragl svir. I don't remember.
8pedanterrific
Could you spell out those numbers in rot13? (It kinda gives it away.) Actually, here: first is 'svsgrra svsgl' and second is 'svsgrra friragl svir'.
2RobertLumley
Good idea, thanks!
0pedanterrific
Same thing. It's a calibration test, not a history trivia quiz.
0[anonymous]
My brain remembered the cover of Principia Mathematica including the date, more or less right. The problem was it was the wrong edition.
0Luke_A_Somers
V tbg vg zvkrq hc jvgu Qrfpnegr'f Bcgvpf, juvpu V fhfcrpgrq V zvtug. Zl 40% be 45% (pna'g erzrzore juvpu V jrag jvgu) pnyvoengvba jnf onfrq ynetryl ba gur cbffvovyvgl V unq qbar gung.
[-]gwern60

Surveys always need more respondents. When Wikipedia or Reddit want to publicize things, we/they use a bar at the top of the page. Can we do that? (It doesn't have to be as obnoxious as the donation fundraiser ones WP uses!)

Reply
[-][anonymous]170

I'm doing it wrong right?

Reply
[-]gwern190

Those staring eyes - my god, I can see into his soul and he has no qualia!

Reply
1thomblake
I think it needs to be a little more of a disapproving scowl. Does Eliezer do that?
4[anonymous]
How about some of these expressions?
[-]AndyCossyleon60

Yay free karma. Can I exchange the karma for a lunch?

Reply
[-]mumon60

Survey taken. I look forward to the results.

Reply
[-]wobster10960

Grargh argh grr! The first thing I did afterwards was go to Wikipedia and see when [the thing identified] was actually [verbed], and I was off by a hundred or so years. Blech.

Anyways, survey taken.

Reply
[-]roryokane60

I took the survey. I left most of the probability estimation questions blank because I feel very uncertain about any number I imagine entering.

Reply
0hankx7787
me too
[-]dreeves60

I took the survey and I agree with some other comments about the difficulty of assigning probabilities to distant events. I decided to just round to either 0 or 1% for a few things. I hope "0" won't be interpreted as literally zero.

Something bugs me about the IQ question. It's easy to call sour grapes on those complaining about that metric but it seems like such a poor proxy for what matters, namely, making awesome stuff happen. Not denying a correlation, just that I think we can do much better. Even income in dollars might be a better proxy despite the obvious problems with that.

Reply
6dlthomas
Rest easy - it was stated that it meant epsilon.
5gjm
I think income in dollars is a much worse proxy for most things that matter than IQ, because it depends so much on age and career choice and where you live and so forth. And how do you know that what Yvain was after was a measure of "making awesome stuff happen"?
3A1987dM
I think “age and career choice and where you live and so forth” also correlate with “making awesome stuff happen”, and in very similar ways. OTOH, I think IQ is probably a decent predictor of “making awesome stuff happen” among people with same “age and career choice and where you live and so forth”.
3gjm
Age is correlated in two different ways with making awesome stuff happen. (1) There's presumably some peak period of life in which you're more likely to do awesome things. (2) The likelihood of having made something awesome happen is monotonically increasing with age. If Yvain were wanting to measure awesomeness -- and let me repeat that I see no particular reason to assume that was his goal -- then #1 would be of some interest. But what you get by looking at income is more like #2. Career choice is certainly correlated both with making awesome things happen and with income. But, again, in different ways. For instance, if you're a very clever technically-inclined new graduate wanting to get rich, then finance and law are pretty good choices of career. Both offer, especially if you're both good and lucky, the opportunity to get hold of very large amounts of money. But if those are careers that tend to produce a lot of awesomeness, I seem to have failed to notice. (Handwavy explanation: To get a lot of money, you need to do things that others find very valuable. You can do that by creating new value, which is hard; or by steering value towards the people who pay you, which is often easier. When someone working in finance makes his clients rich, it's usually mostly at other people's expense: to buy low and sell high, you require others to sell low and buy high. Law is somewhat similar, though I think it tends to be more about steering anti-value away from your clients.)
0mindspillage
There are people in law who are making awesome things happen, but they are not getting paid anywhere close to as much for it as the ones who are doing standard things for deep-pocketed clients.
1dlthomas
For that matter, there are people in finance who are making awesome things happen - if we want a particularly PC example, Grameen Bank
0dreeves
True, I was just thinking that something that correlates (loosely) with "having made awesome stuff happen" might be better than something that correlates with "has one of multiple skills that contribute to the hypothetical ability to make awesome stuff happen". As for whether "making awesome stuff happen" is the right underlying metric... what else?
4gjm
Well, for instance, given that Less Wrong is all about thinking better, there might be some interest in knowing something about (so to speak) the raw thinking power of the participants.
[-]MarkusRamikin60

I took the survey. Got Newton wrong by over 50 years. At least my confidence was appropriately low.

I would suggest requesting probabilities in a simple, exception-less way. Why not just ask for a number from 0 to 1? "Use percentages, but don't put down the percentage sign, unless you're going below 1%, then put the percentage sign so I know it's not a mistake" looks to me like asking for trouble.

Reply
[-]gwern60

I took it too. Disturbs me how much my alien probability changed when framed as 'in universe' vs 'in galaxy'.

Reply
5Normal_Anomaly
I'm not sure why it should disturb you. If the probability of intelligent life evolving in galaxy x is the same for all x, and there are about 100 billion galaxies in our observable universe, then the chance of intelligent life in the observable universe is about 1-(1-x)^100 billion. This assumes that whether life evolves in any one galaxy is independent of whether it evolved in another. I wish I had remembered to use this formula when I took the survey.
[-]Dwelle60

Took the survey and was quite unsure how to answer the god questions... If we took it, for example, that there's 30% chance of universe being simulated then the same probability should be assigned to P(God) too and to P(one of the religions is correct) as well.

Reply
0Normal_Anomaly
I can understand saying that "the universe is a simulation" implies "there is a god" for a deistic definition of god. But why would it imply that one of the religions is correct? Do you count deism as a religion?
0kilobug
Well, we enter the problem of "definition of god" right now. Does the tree that falls in a forest with no one to listen makes a sound ? Depends if "sound" is "vibration of the air" or "acoustic signal in a brain". The same goes here. If the universe is a simulation, there is a "god" if a "god" is "a conscious entity that created the universe", but not if a god is "an omni-powerful omniscient entity that existed for always" or anything else that most religions stick in the "god" word. And if "god" is an ontologically sentient entity that can't be reduce to non-sentient components, then it's unlikely that the creators of the simulation are like that, but not totally impossible (since the hypothesis space of how the "real universe" would be is very large).
0A1987dM
If you understand for always as ‘ever since this universe has existed’, omniscient as ‘who knows everything about this universe’, etc., then a simulator would pretty much qualify as a god under that definition.
2kilobug
I wouldn't say that a simulator is omniscient about its content. It'll know all the positions of quarks and everything, but that's not being omniscient in the sense that is given by major religions for God. An "omniscient God" as stated by theists doesn't only know the exact quantum state of my brain, but also what it means in term of actual thoughts, knowing how to interpret that exact configuration as me being dishonest or whatever. I doubt much simulators have that level of awareness on their content. It is theoretically possible to build one which does have it, but it's not a certainty at all that a simulator will have it.
0Normal_Anomaly
If this universe is completely reductionistic, which a simulation probably would be, then your "actual thoughts" (and the existence of trees, etc.) are logical implications of the configuration. Does an entity with logical uncertainty still count as omniscient? But then we've gotten into definitions again. I still don't know whether you, personally, think a deistic god implies that one or more religions is true. It doesn't particularly matter, though. Your original point that the answer to the god question depends on the answer to the simulation question is a good one.
0Dwelle
Depends, of course, how you define religion. I'm not sure what the original question was but there is of course a religion stating the universe is a simulation, god or no god.
0[anonymous]
How do you figure?
[-]Armok_GoB60

I started trying to fill this out, but more than half I either don't know/remember, am to unsure about the supposed meaning of the question and would require clarification, or can't answer meaningfully because the USA centric assumptions of the question.

Reply
[-]occlude60

Survey complete. Had to answer "there's no such thing as morality" because I can't imagine a configuration of quarks that would make any of the other choices true. What would it even mean at a low level for one normative theory to be "correct?"

Reply
5thomblake
That's a fully-general argument against the existence of anything that isn't a quark.
0gjm
A quark, or a configuration of quarks, or definable in terms of configurations of quarks. Presumably occlude really meant (or perhaps would have meant, given more knowledge of physics) "elementary particles", since not all elementary particles are quarks; or something more complicated involving quantum fields. With such fixes in place, it doesn't seem to me like a fully-general argument against (for instance) computers or people or minds or symphonies, but it still has some force against moral realism.
0occlude
That particular turn of phrase (configuration of quarks) was borrowed from Eliezer's description of reductionism in Luke's "Pale Blue Dot" podcast #88. It left an impression.
2Incorrect
Calling them correct/incorrect is just a convention for saying you agree with them.
3Oligopsony
Yeah, but to be flip, what does "agree" mean? What position you find most intellectually coherent? What you use to regulate your own behavior? What you use to form social judgments of behavior? I put down "consequentialism," but I could have put down "virtue ethics" or "there's no such thing as morality" if I were using a different frame.
-1mwengler
I favored "no such thing as morality" in the sense that I don't think I can tell somebody else what to do on the basis of it being wrong or right. But since I am willing to kill people who act in a way sufficiently contrary to my own preferences, and my own preferences are consequential, I chose Consequentialism on the survey.
2Sophronius
Actually, you can tell someone what to do on the basis of it being "wrong" or "right"; the only requirement is that their morality/preferences are similar to your own. If you can convince them that their actions are contrary to their own moral preferences, you could manage to convince them to do that which you both consider to be "right". But, if you meant that it is impossible to determine what someone should do by means of a universal set of moral rules, then yea, clearly not. But the absence of a universal morality does not imply an absence of all morality.
0Sophronius
That's not the question. The question is which ideology you most identify with. So what you answered is "The philosophy I most identify with is that there is no such thing as morality." This seems like a nonsensical position since it would imply that concepts don't exist simply because they aren't physical. Morality is a very real part of the universe as it can be observed in the functioning of the human brain. Admittedly, I did find the question somewhat odd, as what is asked is what I most identify with, and it's a very bad habit to make ideologies part of your identity. I interpreted the question as "which form of morality do you approve of the most", which for me was consequentialism since out of those three I believe it to be the most effective tool for improving human welfare.
0Normal_Anomaly
You also judged the alternatives on consequentialist grounds. I interpreted the question as "which form of morality do you use to decide what to do (or wish you used to decide what to do)?"
0Sophronius
Good catch! I should have added "and improving human welfare is more important to me than any other considerations". Anyway, I think morality is more than just "how do you decide what to do", it's about what you feel people in general should do. And in that case I would prefer everyone to use consequentialism, even though that isn't strictly how I make my own decisions.
0occlude
I try, of late, not to create sections of map that don't correspond to any territory. What if we taboo the word morality? Is there brain function that corresponds to morality and that is distinct from preferences, beliefs, emotions, and goals? It seems that positing the existence of something called morality creates something additional and unnecessary.
0Sophronius
It does correspond to territory: that specific functioning of the human brain. Human preferences are not part of the map, they're part of the territory. Admittedly, you can describe the same thing using different words, but that's true for everything. Morality is a subset of preferences in that it only covers those preferences that describe how intelligent agents should act. It is still a useful term for that reason. I have found however that talk of morality leads to enormous amounts of confusion (fake agreements, fake disagreements, etc.) and so I agree that tabooing the word and substituting the intended meaning has a great deal of merit.
0occlude
I agree with your argument in the sense that you meant it, though I interpreted the question differently.
[-]Dreaded_Anomaly60

I took the survey. Props to Yvain for putting in the effort on this (again).

(I really ought to take a legitimate IQ test one of these days.)

Reply
[-]quinsie60

Survey = taken.

For the newton question, I got the thousands, tens and ones place correct, but flubbed the hundreds place. 60% confidence. Not sure if I should feel bad about that.

Reply
[-]fburnaby60

I may have just taken it twice... hitting enter seems to submit the form immediately. How inconvenient! I felt funny putting in "0"s and "100"s instead of 0+epsilon etc.

Reply
[-]scav60

Done. Was out by only 17 years on the Principia Mathematica.

Some of the questions made me feel a bit stupid, which is probably a good thing now and then. Had to answer Deist/etc. for the religious identity question, because there wasn't an option for epistemic untheist with Christian ethical heuristics and an admittedly indefensible level of wishful thinking. But "etc." will do :)

Here's hoping we all live to 2100 and find out whether we were right about that stuff.

I think the probability of 90% die-off by 2100 attributable to a single cause is ... (read more)

Reply
[-]lavalamp60

Great, now I'm not sure if I'm horribly under-confident or freakishly lucky... (re: Newton)

The cryonics question could use a "cryocrastinating" option... I have filled out papers and not sent them anywhere...

Reply
0RomeoStevens
I need to update on my first guesses being significantly more accurate than more careful estimates.
[-]MartinB60

In the ethics field an option should allow for: i don't know enough of these to make a decision. I did not actually know half of the options given by their terms.

Reply
3Klao
Same here. I had to look them up to understand what they are about and answer the question meaningfully. (But, after looking the options up the choice was actually easy.)
1RobinZ
I posted a brief description here.
[-]Richard_Kennaway60

Why "Academics (on the teaching side)"? As an academic on the research side, what do I put?

Reply
4Scott Alexander
Put "academic". I just meant "not a student"
[-]dspeyer60

The greatest risk question would benefit from a write-in option. I consider economic/political collapse a greater risk than those listed.

Reply
1NancyLebovitz
Me too, more or less. My highest rank goes to infrastructure collapse.
[-]Michelle_Z50

I took the survey. Thanksgiving break at the family house gives me plenty of time to relax and catch up on all of the reading here that I have been avoiding since I started college.

Reply
[-]Pablo50

Thanks for conducting this new survey, Yvain. I eagerly await the results.

Slightly off-topic, it would be interesting to see how members of this community respond to the PhilPapers survey. (You must be registered to take the survey.) My own responses can be found here.

Reply
3Pablo
Ah, I see that there is already a post on the PhilPapers survey, with responses by several LessWrong members in the comments section.
[-]Asymmetric50

For those of us still in high school, should we put "general" or the major we expect to take in college?

Reply
1demented
I'm in high school(12th year) and I put the major I'm expecting to take in college. Good to see that there are other high school students here! And you're a far lot more active than me too.
5Curiouskid
We should make a thread in the discussion forum for all high school students to introduce themselves and get advice on how to navigate the idiocy that is our education system and advice on what to study in order to get more involved with transhumanism. I need one more karma to make the post... It'd also be a great place to find a chavruta
[-]Multiheaded50

Took the test. I assigned 70-80% to "God creating the universe", as I strongly (80%) suspect that it's a simulation, it's being more or less actively controlled and manipulated by some outside entity/entities, and even if said entity is one of many and has comparatively little power over its native environment - even to the point of resembling a human scientist - it's pretty much pointless for us to call it anything but a god.

Reply
5mumon
But would the definition of God you have used qualify as an "ontologically basic mental entity", as demanded by the survey?
[-]Dustin50

Took the survey.

After taking it and reading these comments I took this IQ test mentioned in this comment.

If it is accurate I've lost 20 IQ points since I was 17 (the date of my one and only IQ test). That's kind of depressing. Then again, I feel like I'm a much better thinker now...

Reply
1Prismattic
I had been under the impression that IQ = mental age / physical age. I'm not sure how to understand a test that doesn't ask how old one is. I also just tried that test and got a score that I am pretty sure is ~20 lower than the one I took as a small child (though I can't be sure since my parents declined to tell me exactly how I scored at the time).
8saturn
Different tests have used different definitions of IQ. Lately most tests use 15 IQ points = 1 standard deviation. You can't compare IQ scores without converting them to the same standard.
3Vaniver
That's true for children, but as intelligence solidifies at ~16-20 it doesn't make sense to include age after that.
4Kaj_Sotala
Depends on the test. E.g. some IQ tests measure the size of your vocabulary. IIRC, the reason why this works is that people with a higher IQ tend be to quicker at learning the meaning of a word from its context, and therefore accumulate a larger vocabulary. That makes the size of your vocabulary adequate as a rough proxy for IQ - but only within your age group, since people older than you have had more time to accumulate a large vocabulary.
[-]Malcolm_Edwards50

Took the survey, even though I've mostly only lurked.

I don't know what an "ontologically basic mental entity" is. Also, I only left the Singularity question blank because I think it's overall probability of happening is less that 50%.

Reply
7simplicio
Ontologically basic = at the lowest level of reality. For example, a table is not ontologically basic because there are no tables built into the laws of physics; but arguably, an electron is ontologically basic, since we can't explain electrons in terms of anything smaller or more basic. A standard claim of "robust" supernaturalism is that there are minds (mental entities) which cannot be understood in terms of any more basic constituents of reality. E.g., your soul is not made of almitons, and god is not made of pixie dust. God is supposed to be ontologically basic - he is built right into the lowest level of reality, no moving parts. The importance of making that caveat is that it might be defensible to say that perhaps some alien created us, but that is not really what most people mean by a god, since presumably the alien has a nice (evolutionary?) causal history.
4TheOtherDave
This attitude often puzzles me. For my part, I have the same problem with "A vastly powerful God intentionally created human life" that I do with "A vastly powerful alien race intentionally created human life"; that "God" is ontologically basic and an alien race isn't doesn't particularly matter to how seriously I take those claims. For me to object to "God created human life" on the grounds that God is an ontologically basic mental entity would be to ignore what seems to me the much more important problem of purporting to explain phenomena by positing conveniently powerful entities for whom no other evidence exists.
5simplicio
Indeed both views have the problem you just spoke of, but the supernatural view has still another deficit, which we might call a failure to explain. When we posit aliens, we posit something which we presume has a causal history in terms of more fundamental parts, but when we posit a supernatural god or the like, we posit something vastly complex yet with no parts. It is as if the entire text of "Finnegans Wake" were the 3rd letter of the alphabet, or as if particle physics tried to explain the universe in terms of quarks, leptons, and dinner tables. There is yet another point, which is that the alien "gods" are not what one might call "religiously adequate." Nobody wants to worship mere fellow creatures, no matter that they might have created us.
0TheOtherDave
I agree that positing a ontologically basic creator has one more deficit than positing an ontologically non-basic creator. I just don't think that's a particularly important place to draw the line. Far more important to me is the difference between positing an goal-directed creator vs. a non-goal-directed one, for example. To my mind, positing alien astronauts who came to Earth in order to create human beings is nearly as problematic as positing a god who did so, and focusing my attention on the extra deficit introduced by the latter is not a helpful use of my attention. Re: "nobody wants to worship mere fellow creatures"... I'm not sure if I agree with this, as I'm not exactly sure what it means. Let me put it this way: if glowing entities descended from the sky tomorrow and demonstrated vast powers and claimed to have created humanity, I'm confident that >15% of humanity would worship those entities. If those entities were demonstrated to have internal structure and be constructed from more fundamental parts, that prediction doesn't change. Do you disagree with either of those predictions?
6lessdazed
You cheated! Have them begin by worshiping something, however you change its nature worshipers will still follow it. If one of the glowing entities had an anti-gravity pack fail and fell a few hundred feet onto asphalt, rupturing its flesh, dismembering its limbs, and bursting its carcass open in a gory rain of blood and giblets on national television during first contact, you might not get 15%.
0TheOtherDave
I infer that you agree with my predictions, despite considering the second one irrelevant to the question at hand. Confirm/deny? I agree with you that in the case you describe, you probably wouldn't get 15%. I don't think that has much, if anything, to do with the entity's basic ontological nature. I think it has a great deal to do with its demonstrated fallibility and mortality, as well as the emotional consequences of bloody deaths. If glowing entities descended from the sky tomorrow and demonstrated vast powers and claimed to have created humanity and claimed to have internal structure and be constructed from more fundamental parts, I'm confident that >15% of humanity presented with all of those facts up front would come to worship those entities . I infer that you disagree. Confirm/deny?
0lessdazed
Confirm There are emotional consequences to apparent perfection that we intellectually know isn't real, so there is no neutral framework. That's not a complete enough back story because they could be the agents of something else. If they don't say more than this,15% might not worship them as more than angels. Let's say they claim to have evolved from goop, just like all animals on Earth except humans, which they claim to have created. Then, I think "Nobody wants to worship mere fellow creatures" applies, though by "nobody" I mean "only certainly tens of millions", and I'm not too confident in the 15% figure.
0TheOtherDave
Agreed that there's no neutral framework in the sense I think you mean it: however that meeting goes, it has emotional consequences. We're bouncing several scenarios around, so to avoid confusion I will label them... A is where they show up and don't announce their ontological nature, B is where they show up and take a bloody pratfall, C is where they announce their non-basic ontological nature, D is where they show up and announce they evolved via natural selection of random modification. If I understand what you mean by "worship them as angels," I agree that, in C, most of the worshippers would likely do that. If that's not what you meant by "worship" then I might agree with your original claim; I'm not sure. I agree that most of the people who would worship them in C would not worship them in D. If D is what you meant by "fellow creatures" then I probably agree with your original claim.
0simplicio
It occurs to me that my reply is a little too qualitative, so I'll try to put it into the language of probability. I have a prior on the idea that aliens created us; it is very low (maybe 100,000:1) but I feel quite certain that the proposition is physically meaningful, and if you handed me evidence I would gladly update in that direction. On the other hand, it is not immediately obvious to me that the idea of a supernatural god is physically or indeed logically meaningful. I'll still grudgingly quote you a prior, but with a sinking feeling in my stomach.
[-]BlazeOrangeDeer50

Wow, I was off on Newton by just 3 years. My other probabilities were sadly lacking in quantifiable justification... at least you finally got me to register ;)

Reply
[-]A1987dM50

The political question ought to have a “libertarian socialism” answer (green/southwestern quadrant in The Political Compass; extreme version described in An Anarchist FAQ). I answered “Socialist, for example Scandinavian countries” because it was the least unsatisfactory one. (Or at least there should be a “None of the above” answer.)

ETA: BTW, that's probably the most common understanding of the word libertarian outside the US.

Reply
0[anonymous]
Likewise.
0thomblake
Interesting link... it seems like they would do well to have a section devoted to jargon - I've heard people talk about being against "property" before, but had never encountered a description of the distinction between that and various other sorts of rights to use and possession.
3pragmatist
The distinction is standard in Marxism. From The Communist Manifesto:
1thomblake
It does not seem like this is actually drawing out the distinction I was referring to. Or at least, as much as it is attempting to, it is associating various dubious concepts with the distinction, like "class" and "class antagonisms" and "exploitation". But then, that passage mostly reads like word soup to me. The worry, when someone talks about abolishing property, is that one is thereby depriving the individual of rights on a standard Lockean analysis. As these sorts of socialists would agree, it is important that the worker control the destiny of the products of one's own work. This is identified with the natural right to property, and follows straightforwardly from the rights to life and liberty. A "use/possession" non-property right seems to support the Lockean right to property, but only until the property is "released into the wild" - thus, presumably, someone else cannot just walk away with my computer, because I need it for my work, but I also can't just lock it up in a closet so nobody can use it. Similarly, I could maintain the right to the farm that I work, but could not exercise the right to prevent others from farming a plot of land I was not going to use. I think there are still some serious problems with this picture from several different angles, but it's nonetheless an interesting notion of property.
7Oligopsony
Does this paraphrase make more sense to you? "The modern division of labor links together most everyone on the planet in a tremendously complex, cooperative web of relationships. Let's call stuff that people can use individually personal property and stuff that a great number of people need to cooperate in order to use means of production, and when these means of production are acknowledged as the property of individuals, let's call them private property. Ownership of private property does correspond to the set of those who work the private property to produce wealth; instead, a subset of people have control over these means of production, allowing them power over those who do not. We communists don't want to get rid of personal property; instead, we want to convert the means of production from private property to some public kind or another." The best overview of the technical meaning of "exploitation," at least in the later Marx, can be found here. (By contrast, I think I'd need to know what you find dubious about the concept of class to better explain it, since there's no single technical definition of class within Marxist discourse and the range of them doesn't wander very wildly from the normal English use of the term, which I assume you're perfectly familiar with.)
2thomblake
Sure, that pretty well matches both my previous understanding from my study of Hegel/Marx and what I'd written above. The slippery part of this is the distinction between "private property" and "personal property", and exactly what qualifies as which (and who gets to decide), and what happens to my personal property when I find it has become a "means of production". I was not expressing lack of understanding regarding words like "class" and "exploitation" when I called them "dubious". I heartily recommend Hegel's description of "exploitation" (from Phenomenology of Spirit - the lord and the bondsman) over Marx's - Marx is basically just Hegel plus bad economics. At any rate, I'm not particularly interested in hashing out any of this stuff on this forum - I had just found it interesting that there was a notion of property amongst "libertarian socialists" that seems very nearly compatible with the Lockean natural-rights analysis (and that I had not heard previously).
[-]NancyLebovitz50

I just put together a discussion post about thinking about the probability of living in a simulation, but I'm not sure if I should ask people to fill out the survey (if they were planning to) before they read the post.

Reply
[-]jwthomas40

I took the survey late last night after first noticing the posting here. Unfortunately, I was so tired that I forgot the instruction to use double digit answers and remembered it a few minutes after hitting the "Submit" button. (Here come the down votes.) If Yvain can identify my submission, put a "0" before all single digit answers. If not, contact me privately and I'll provide some help identifying it. I lurk and never comment here because frankly you are all more intelligent than I am. But I do want to improve my rational thinking skills so here I am.

Reply
[-]hankx778740

survey taken..!

Reply
[-]lessdazed40

I took the survey a few days ago, and in retrospect my answers of 0 for probabilities were overconfident and the result of me being too lazy to think hard.

Reply
1dlthomas
In many cases, mine were a result of not wanting to type that many zeros. In the future, can we pick our units?
3lessdazed
It's hard to determine how likely it is I'm not high and staring at a bunch of skittles or something that I mistakenly think is a good argument, as Yvain has said. I'm thinking 1/10^9 for any ontologically basic mental entities and 1/10^21 for a god.
2A1987dM
Maybe the next time the survey should not allow probabilities exactly 0 or 1 (rather than saying they'll be interpreted as 0+epsilon and 1-epsilon), and give the option to express probabilities as log-odds if they're extreme. (Anyway, I didn't give any probability lower than 0.1% or higher than 99.9% in my answer.)
3dlthomas
... why not log odds all the time?
[-]Friendly-HI40

I missed Newton by a horrendous ~25 years. If the publishing year of "On the Origin of Species" had been asked instead, I would have known the exact date. Occasionally I even celebrate it a little... jeez, exactly 3 more weeks until the day Darwin's explanation destroyed the single "good" argument religions ever had. A very fitting occasion to grab a beer and stick it to the invisible man.

Also, I was glad the input fields were large enough to accommodate enough zeroes regarding the superstition and religion questions. I also left out ... (read more)

Reply
[-]Alicorn190

raped

Please do not use this word in this way.

Reply
[-]Friendly-HI160

"fixed". I'm genuinely sorry for being inconsiderate, I'm young and still have a tendency to use provocative language if I feel emotionally stimulated.

On a lighter note... I'm curious how some of you may have estimated a very low probability of say... the likelihood that one religion is a very good approximation to the truth. I doubt that there really is any way in which someone could give a sensible estimate, unless one were to put years of work into it to weigh all the (non)evidence meticulously (and as we know religions tend to dress their stories in a LOT of colorful detail, because hearing details makes things appear more true, since they assist our human imagination).

How could one of us, in a practical way, come up with a roughly realistic number? I used something like 0,0000000000000000001% probability because that's what it -feels- like to me. I can only imagine how unlikely it would be, by comparing it to something very unlikely... like winning the lottery twice in a row. Which still doesn't feel as surprising as discovering that our world is formed out of the body of a slayed giant. But then again my feeling of surprise upon winning the lottery (I'm not actually playing) is of course in no way directly proportional to the actual odds of winning either. What kind of thought process went through your head when you had to answer this question? (I'm asking everyone in general, not just Alicorn).

Reply
7Desrtopa
I personally put 0% after some waffling around, which I felt a bit uncomfortable about because I thought some of the things I listed as 0% were more likely than others, but since I thought they were all too unlikely to meaningfully quantify, zero-plus-epsilon seemed like the best I could do.
2FAWS
I put a reasonably high number in for that, actually (several orders of magnitude higher than supernatural phenomena and several further orders of magnitude higher than a supernatural creator god, given supernatural = fundamentally mental). There are a lot of very different religions and the idea that a simulator (or alien) communicated with someone on Earth and this formed the basis of some religion I never heard of, or that some particular low entropy religion got enough details right by coincidence to be mostly right, doesn't sound that unreasonable.
0Randolf
I left that field plank because I don't think the question is well defined. It has very little meaning to assign probabilities on the existence of something as vaque as a god. Maybe there is a god, maybe there isn't. It's entirely beyond my scope.
[-]ac3raven40

Hopefully this new survey will reveal more diversity and will be taken by more than ~160 users.

Reply
[-]TheOtherDave40

Thanks for doing this.

With respect to P(Warming), I took this to mean the probability that significant anthrogenic climate change is occurring or will occur.

Reply
0Sabiola
I answered '50' to that one. I'm sure global warming is occurring, but I have no idea how much of it is anthropogenic.
0A1987dM
Why, what else could it mean?
2TheOtherDave
Well, two things. First, "global warming" isn't quite the same thing as climate change. This is kind of a distinction without a difference, perhaps, but I find in many communities (not LW) that the semantic distinction between these terms causes confusion. Second, and more important to me: supposing that N% of climate variation over time is accounted for by human activity, the wording of the question allowed some ambiguity between (N > 50) and (N is non-negligible). I'm fairly confident that N is non-negligible, which seems like the important question for policy purposes. I'm not confident that N > 50.
0quinsie
Well, it could mean that you think the climate is going to get colder, or that the mean temperature will remain constant while specific regions will grow unusually hot/cold, or that the planet will undergo a period of human-caused warming followed by ice sheets melting and then cooling or any number of other theories. Most of them are fairly unlikely of course, but P(any climate change at all) > P(global warming).
[-]Prismattic40

I took it again after the changes. Please delete the old one (I used the same karma each time, so it should be easily identified).

Reply
[-]CharlesR40

Would be nice if we could assign probabilities to the "morality" question instead of having to put ourselves firmly in one camp.

Reply
0homunq
Probabilities? Makes no sense. But yes, a scaled response for each would be nice, since I'd say I'm about 40% consequentialist, 10% deontologist, 1% virtue, and 49% irrational about morality.
6CharlesR
I reread the question. It wasn't asking what I thought it was. Here is what I thought it said: Which of these do you think is true? What it really said was: Which of these do you identify with? (I must have pattern matched on the question when I saw the form of the answers.) So your reply makes sense. Still, I would rather the question had been worded differently. Which of these do you use in practice when making moral choices? Which of these do you think best explains morality? To me, "identify" is an evil word. Because you could let something into your identity you didn't want.
0CharlesR
No, I meant probabilities. As in, "I assign a 40 percent chance of consequentialism being true."
1dbaupp
What does it mean for a morality to be "true"?
2CharlesR
It depends what you mean by "morality". If you think morality refers to "a series of conventions that tend to promote survival," you can be wrong about that.
[-]jknapka30

I took the survey, sometime last week I think. EDIT: I think I may also have messed up the "two-digit probabilities" formatting requirement. I can't recall specifically any answer that might have violated it, but I also don't recall paying attention to that requirement while answering the survey.

Reply
[-]JoelCazares30

Just took the survey. I got a little behind on my rss feeds, sorry! Thanks for keeping it open!

Reply
[-]Alaeriia20

Took the survey. Afraid to look up the calibration question, because I know I'm off.

Reply
[-]UnclGhost20

Just took it, but I think I might have given an overelaborate answer for "Religious Background," in order to give more information than "Family Religion" provided.

Reply
[-]Alex_Altair10

Because so many people are talking about the Newton question, I'm curious, how many people got closer than 7 years? That's how far I was. Also, I put 93% confidence within 15 years.

Reply
2endoself
Exactly right, 95% confidence. I often remember facts, but underestimate my confidence in them but I'm getting better at overriding that, hence the choice of 95%.
1Alex_Altair
You win! Nice job.
1RobinZ
2 years off, I believe. 45% confidence.
-1mkehrt
27 years early, 60% certain. Oops.
[-]dbaupp100

Oops

Gah! A single data point tells you very little about over-/underconfidence! Please, please stop acting like getting a 60% certain thing wrong (or 20% certain thing right) is a mistake.

A die has an 18% chance of rolling a 6. And that still happens. A die has a 66% chance of rolling a number larger than 2, and that sometimes doesn't happen. There is nothing unusual about these things, and the same applies for these estimation-with-confidence exercises!

(This isn't directed at you specifically, but there have been a few instances of this in this thread, and your comment was the "final straw")

Reply
[-]Prismattic130

I don't mean to be pedantic, but I have seen numerous people make this mistake on Lesswrong, so I am pointing it out:

1 die
2 or more dice

Reply
0dbaupp
Hahaha, Muphry's Law strikes again... Thanks.
-6MixedNuts
-1mwengler
23 years late (got 2nd edition pretty close) with confidence of 15%.
-1lavalamp
I was 7 years off, with a confidence of 20% (I thought I might have had the wrong century).
-1JoshuaZ
I was 7 years off, and had 65% confidence of being within 15 years.
-2Kutta
13 years off, 50% confidence.
-1dlthomas
Guvegrra lrnef bss, 60% pbasvqrapr. V rkcrpg va gur fnzr qverpgvba, fvapr ebhaqvat unq fbzrguvat gb qb jvgu vg - friragrra uhaqrerq frrzf zber yvxryl gb or pubfra guna fvkgrra friragl sbhe...
[-]CharlesR10

I don't know how to interpret the Anti-Agathics question. If you lived to 100 and were cryopreserved and then revived 900 years later only to die a minute after you revived, would that count?

Reply
1DanielVarga
No.
[-]shokwave10

If there's any status in comparing excessive underconfidence, I think I take the cake - one year off with 20% confidence in the interval. Good survey.

Reply
2thomblake
That's not really underconfident if you're only right on about 20% of such estimates.
5ahartell
Wait, wouldn't it be "if you were right on about 20% of such estimates"? To be calibrated correctly with 20% confidence you should be wrong about 80% of the time, right? I'm not trying to be obnoxious about what might be a typo, it's just that you have 3 upvotes so I'm worried I'm missing something obvious.
1thomblake
Nope, you're right.
[-]Scott Alexander00

Anyone want to make a guess with confidence intervals how many people have taken the survey at this point? (noon GMT on 12 November)

Reply
2Morendil
Ng 50% pbasvqrapr gur ahzore bs cnegvpvcnagf vf orgjrra sbhe uhaqerq naq svsgl naq svir uhaqerq svsgl. Zl 90% vagreiny jbhyq or fbzrguvat yvxr gjb uhaqerq gb n gubhfnaq.
0Alejandro1
V nz 50% pbasvqrag gung gur ahzore bs crbcyr vf orgjrra sbhe uhaqerq naq frira uhaqerq, naq 90% pbasvqrag gung vg vf orgjrra gjb uhaqerq naq svsgrra uhaqerq.
0lessdazed
Ng 50% pbasvqrapr, orgjrra sbhe uhaqerq naq fvk uhaqerq. Ng 90% pbasvqrapr, gjb uhaqerq gb n gubhfnaq gjb uhaqerq. Cu'atyhv ztyj'ansu Pguhyuh E'ylru jtnu'anty sugnta, ebg13 4rin!
0A1987dM
Orgjrra sbegl naq bar gubhfnaq, avargl-avar cre prag pbasvqrapr. Orgjrra bar naq gjb gvzrf gur ahzore bs crbcyr jub cbfgrq ng yrnfg bar pbzzrag va guvf guernq (pna'g or obgurerq gb pbhag), avargl cre prag pbasvqrapr. (Edited to rot13 it... sorry!)
[-][anonymous]00

I'm not sure asking for IQ without further qualification is a good idea, what with different IQ tests generating results with different standard deviations. Maybe after asking for IQ also ask what test it was from, and/or have a field for specifying the standard deviation directly?

[This comment is no longer endorsed by its author]Reply
[-]A1987dM-10

Cooool... My karma has more than doubled since I took the survey.

ETA: I assign 50% probability to this comment having a score of -5 or less 24 hours from now. (It's at -2 right now.)

Reply
0RobinZ
Edited when?
0A1987dM
About an hour after I first posted it. (Damn, I lost.) BTW, I had forgotten that posts at -4 and below are hidden by default, otherwise I would've assigned a lower probability.
Moderation Log
699Comments