Tell Your Rationalist Origin Story

30 Post author: Eliezer_Yudkowsky 25 February 2009 05:16PM

To break up the awkward silence at the start of a recent Overcoming Bias meetup, I asked everyone present to tell their rationalist origin story - a key event or fact that played a role in their first beginning to aspire to rationality.  This worked surprisingly well (and I would recommend it for future meetups).

I think I've already told enough of my own origin story on Overcoming Bias: how I was digging in my parents' yard as a kid and found a tarnished silver amulet inscribed with Bayes's Theorem, and how I wore it to bed that night and dreamed of a woman in white, holding an ancient leather-bound book called Judgment Under Uncertainty: Heuristics and Biases (eds. D. Kahneman, P. Slovic, and A. Tversky, 1982)... but there's no need to go into that again.

So, seriously... how did you originally go down that road?

Added:  For some odd reason, many of the commenters here seem to have had a single experience in common - namely, at some point, encountering Overcoming Bias...  But I'm especially interested in what it takes to get the transition started - crossing the first divide.  This would be very valuable knowledge if it can be generalized.  If that did happen at OB, please try to specify what was the crucial "Aha!" insight (down to the specific post if possible).

Comments (399)

Comment author: RobinHanson 26 February 2009 02:30:44PM 9 points [-]

Are you sure "rationalist" is a good label here? It suggests the claim that you are rational, or at least more rational than most. "Rational" has so many associations that go beyond truth-seeking.

Comment author: Eliezer_Yudkowsky 26 February 2009 04:01:23PM *  8 points [-]

We need some kind of word that means "seeker after less wrongness", and refers pragmatically to a group of people who go around discussing epistemic hygiene and actually worrying about how to think and whether their beliefs are correct. I know of no shorter and clearer alternative than "rationalist". There are some words I'm willing to try to rescue, and this is one of them.

Comment author: Jay 27 February 2009 04:14:18AM -1 points [-]

"Skeptic"?

Comment author: Davorak 10 December 2010 09:55:40PM 1 point [-]

The James Randi definition of skeptic seems to have much overlap. I would guess that what EY is looking for has James Randi definition of skeptic as a subset of EY's rationalist belief processes.

Comment author: Daniel 27 February 2009 04:28:14AM 8 points [-]

Perhaps it's not worth complaining, but historically "rationalist" was contrasted with "empiricist." Descartes, Leibniz, and Spinoza were rationalists, while Locke and Hume were empiricists. Obviously that's not a contrast you mean to be invoking, though maybe that use of "rationalist" is rare enough that there's no risk of confusion.

Comment author: bizop 27 February 2009 05:23:00AM 1 point [-]

@Daniel, I agree with this observation. Minimizing being wrong is a pretty recent intellectual development. Epistemic minimax is probably logically a better name, although it sort of sucks.

Comment author: MichaelVassar 28 February 2009 07:42:13AM 4 points [-]

We don't want to minimax since we aren't playing a zero sum game. We just want to maximize expected utility with a few caveats and with a few blanks filled in.

Comment author: MichaelVassar 28 February 2009 07:46:42AM 6 points [-]

More recently, rationalist has tended to have a meaning closer to its current one, but with strong negative affect associated with it. Peter Drucker, for instance, seems to use it as a term of reproach in "Adventures of a Bystander", to mean the sort of small souled narrow-minded person who thinks that they can be right and others wrong and are allowed to say so because they have reasons for their beliefs instead of having made them up to express feelings but the assumption is that one shouldn't do this because doing it leads to communism, fascism, or other forms of authoritarianism. If people don't have the right to believe what they want then some authority must have the right to tell them what to believe. Traditional conservatives can associate this attitude with communism and other badness. Basically, rationalism is used to mean affiliation with authoritarian regimes who claim the prestige of science.

Comment author: Kenny 27 February 2009 05:04:21AM 2 points [-]

'Info-maximizers'? It's too bad we can't use 'philosopher' – you'd think you just provided it's definition.

Comment author: cdj 27 February 2009 06:52:59AM 0 points [-]

How about "asymptotist"? A Google search suggests it is available.

Comment author: Tiiba 27 February 2009 07:24:42AM 5 points [-]

Apparently, "aletheia" is Greek for truth, and "veritas" is Latin. You can pick either and stick "phile" at the end. So, say, veritophile.

(My reliable source is two minutes with online dictionaries)

Comment author: Kenny 27 February 2009 04:57:10AM 7 points [-]

'Aspiring rationalist'? I don't get a sense that Rationality significantly diverges from truth-seeking, especially the philosophical sense of the concept. What associations of 'rational' are beyond truth-seeking?

Comment author: thomblake 27 February 2009 04:36:31PM 1 point [-]

An interesting question. I've been unwilling to accept EY's use (rescue) of "rationalist", though that might just be because I've been calling myself an "irrationalist" (in the spirit of Nietzsche's "amoralist") for many years now (for some values of "many").

Comment author: anonym 27 February 2009 11:59:40PM *  0 points [-]

I agree that rationalist has baggage in the minds of most people, and it evokes rationalization and related antithetical concepts for many.

If Less Wrong expands the community and shapes future discussions on rationalist topics in the way that I expect it to, this might just be the last good time to coin a new term.

I nominate righters and truthers, in that order.

Comment author: Johnicholas 28 February 2009 12:35:54AM 0 points [-]

In my dialect of english, "righter" and "truther" have unpleasant connotations about as strong as the connotations around "rationalist".

My dialect may be different than yours, of course.

Comment author: anonym 28 February 2009 02:20:10AM 1 point [-]

What is your dialect? In my dialect (Californian American), neither word has much of a connotation at all. They both have a vague feel of something I might read in a modern science fiction book talking about different factions of posthumans, or something in that vein, but I don't think most people where I live (in the SF bay area) would think they have any connotation. I was intentionally trying to think of a new word without any pre-existing baggage.

Comment author: Johnicholas 28 February 2009 02:54:34AM 0 points [-]

I live in the american northeast.

To be specific, "Righter" sounds to me like religious right and righteousness. "Truther" sounds like 9-11 truther and Colbert's truthiness. It might just be me.

Comment author: anonym 28 February 2009 03:13:03AM 1 point [-]

Interesting. I've heard right-winger, but never righter alone. I hadn't heard of 9-11 truther, but that definitely rules out truther for sure. I am familiar with truthiness, but it didn't come to mind for me in thinking about truther. It's interesting how idiosyncratic language is, especially when it comes to connotation.

Comment author: thomblake 28 February 2009 03:01:40AM 1 point [-]

"righter" is straight out - it sounds like "writer" in spoken English. .

Comment author: anonym 28 February 2009 03:18:08AM 1 point [-]

It would be clear from context which was intended. English has many homophones, and they don't seem to cause much difficulty. Is that not your experience with the many existing homophones?

Comment author: thomblake 01 March 2009 04:10:01AM *  1 point [-]

I wouldn't say that English has 'many' homophones. And yes, I think they're generally very annoying, when they can be used as the same part of speech. There isn't much confusion between 'led' (past tense of 'to lead') and 'lead' (the heavy metal). However, it always takes a moment to catch up when someone uses 'right' as a verb, and I imagine 'righter' would be even worse, especially as an obscure jargon term.

Comment author: anonym 03 March 2009 01:47:23AM 1 point [-]

We are getting a bit off-topic, so this is my last post in this thread.

I'd argue that this constitutes many (note the restrictions too, which result in excluded entries).

With regard to how noticeable homophones are, it feels to me like there is a priming effect due to the context, which results in the sense that was intended being obvious and coming to mind effortlessly. For example, cents and sense sound the same in some dialects, but I doubt many would even consider interpreting the sound in question as cents if they heard the previous sentence spoken. I think most homophones are like that, most of the time, and that it usually takes effort to even notice them, as when trying to think of a pun. I will grant you though that righter and writer are more alike in terms of their meaning, and thus easier to confuse, but I just wouldn't consider that sufficient reason to not even consider it as an option.

Comment author: CronoDAS 27 February 2009 04:42:57AM *  1 point [-]

I read my father's issues of Skeptical Inquirer magazine as a kid. So, well, I basically grew up in this kind of culture.

(I comment as "Doug S." on Overcoming Bias.)

Comment author: MichaelVassar 28 February 2009 07:40:23AM 4 points [-]

But the Skeptics aren't even very good traditional rationalists. They are just a step up from the Objectivists and four or five steps up from mainstream America.
The question is about when you started looking for sometimes lonely truth in places where people normally look for affiliation.

Comment author: kluge 27 February 2009 05:00:04AM 3 points [-]

I have very few memories of my childhood (or indeed anything older than a few weeks), but perhaps the turning point I remember was in Lutheran confirmation school when the priest was discussing conscience. I realized that the notion of God was actually superfluous and everything that had been said would stand as well without it. After this I looked at every discussion and explanation with different eyes and soon lost my faith, although I dind't officially leave religion until four years later after high school.

I was never very religious, probably because my family belongs in church but that doesn't really show in daily life. Still, I did believe and getting rid of that made did a big difference. My mother has told be that at some of the first years in school I was confused because I had asked her about why world exists and been told about Big Bang and in the school the teacher had told that it was greated by God. So I might have gotten a few years of hints before getting it. :)

Currently I'm studying theoretical physics and until recently my rationalism has been what Eliezer would call Traditional Rationalism and what you get from scientific education, but it has been changing since I discovered Overcoming Bias and especially Eliezer's posts. They've been mind-expanding to read, I'm in debt to all of the contributors. It remains to be seen if I can actually turn them into pragmatic results. Hopefully LW can help me and everyone else on that journey.

Comment author: outlawpoet 27 February 2009 05:02:42AM 1 point [-]

I first began to separate the concept of truth-seeking from specific arguments of fact late in life, as a teenage catholic who was given a copy of The Case Against God.

Comment author: Kenny 27 February 2009 05:12:46AM 2 points [-]

The Fountainhead

Comment author: chiao 27 February 2009 05:23:34AM 4 points [-]

When I realized in graduate school how difficult it was to resolve disagreements, and how disturbingly common crucial disagreements were.

Comment author: inklesspen 27 February 2009 05:31:42AM 5 points [-]

I think the thing that made me a seeker-after-rationalism is the same thing that made me an agnostic: Greg Egan's Oceanic.

I grew up in a fundamentalist household and had had one moment of religious euphoria. Oceanic made me confront the fact that religious euphoria, like other euphoria, is just naturalistic phenomena in the brain. Still waiting on my fundamentalist parents to to show evidence for non-naturalistic causes for naturalistic phenomena.

Comment author: Marcello 27 February 2009 05:46:06AM *  10 points [-]

I think I began as a rationalist when I read this story. (This was before I had run across anything Eliezer wrote.) I had rationalist tendencies before that, but I wasn't really trying very hard to be rational. Back then my "pet causes" (as I call them now) included things like trying to make all the software transparent and free. These were pet causes simply because I was interested in computers. But here, I had found something that was sufficiently terrible and sufficiently potentially preventable that it utterly dwarfed my pet causes.

I learned a simple lesson: If you really want the things you really want, then you need to think carefully about what those things are and how to accomplish them.

Comment author: Cassandra 27 February 2009 06:18:01AM 3 points [-]

I believed very strongly that my mind was not functioning correctly and I wanted to find techniques to be able to sort through what was real and not real. This led me to begin a very rigorous program of self-examination where I picked at and questioned everything that I am and might become. I continue to do this now but I have learned that I at least seem surprisingly sane compared to my previous view of my self. I have also always had a very strong sense of curiosity tied up with a very impulsive nature. Over time I just experimented with all sorts of things with not much fear of the consequences.

What really turned me on to rationalism specifically was Eliezer's posting on Overcoming Bias. He inspired me to try to go into the field of math and science in large part because I couldn't understand barely anything he said and what I did understand supported several pre-conceived notions I held that made me feel superior to other people.

Trying to fix that now. Yep.

Comment author: Lawliet 27 February 2009 06:43:09AM 6 points [-]

Something always felt wrong when somebody said "because I say so", so the truth from others couldn't be trusted. I knew I wanted never to become the kind of person who answers with "because I say so".

Comment author: HalFinney 27 February 2009 06:48:17AM 3 points [-]

Perhaps a more fundamental question is, why do you want to be "rational"? Where rational means, as Eliezer suggests, less wrong, more right(!), more accurate in your beliefs.

It seems obvious that there are practical advantages to being more accurate on many issues. Choosing what route to drive to work, deciding whether to bring an umbrella, wondering if you should ask so-and-so out, you want to get it right.

OTOH there are well established situations and circumstances where you will do better to be wrong. You'll often do better to agree with your social peers, especially on issues where being wrong has little negative impact, like who should be President.

So what is the "rational" thing to do, given these realities? Is it really rational to seek after truth knowing that it is going to hurt you? Wouldn't a true rationalist try to improve his circumstances and maximize his happiness, choosing to accept that this will mean believing falsehoods?

Comment author: badger 27 February 2009 07:23:38AM *  5 points [-]

I had a broad interest in science and philosophy as an adolescent, but the first issue I really had to confront was religion. My parents are Mormon, and the town I grew up in predominantly LDS, so I felt an enormous pressure against expressing the most basic doubts. It took a significant amount of research before I felt confident leaving my religion behind. Once I had broken the initial barrier, my mind was made up quickly, but I wanted to form an airtight case I thought should convince anyone. The friction this generated between myself and my family, girlfriend, and friends felt almost unbearable at the time, but now I feel much more resilient against social pressure.

Carl Sagan's The Demon-Haunted World was my first exposure to traditional rationality. I took this book to heart as a teen. I progressed through some of the standard canon of Plato, Aristotle, Descartes, Locke, Hume, Rand, Shermer, Dawkins, Hofstadter, and Dennett. I discovered transhumanism through Anders Sandberg's site, which helped me flesh out some of the ideals I picked up in science fiction. I think I came upon Overcoming Bias soon after it formed through Tyler Cowen or Bryan Caplan and their enthusiastic praise of Robin. I've been a daily reader since then.

As far as recent influences, Eliezer has been by far the single strongest shaper of my beliefs. Jaynes, Gary Drescher's Good and Real, and Keith Stanovich's The Robot's Rebellion have also been major contributors over the past couple months. I'm becoming more aware of my biases and still acquiring new insights daily.

Addendum: The posts that first brought me to OB were We Can't Foresee to Disagree and The Modesty Argument. The article that really clarified the distinction between Bayesian and traditional rationality was A Technical Explanation.

Comment author: Todd 27 February 2009 07:28:56AM 5 points [-]

Anselm's a priori proof for the existence of God. 1982. I was young, thought the argument was elegant and remarkable - and somehow flawed. I had to figure out why.

Comment author: bmon 27 February 2009 08:39:01AM *  2 points [-]

I've resolved not to blame myself as much as I used to, I was young and not at all sure how to deal with the fact that my dad was dying. That and I didn't quite know he was dying, as my parents effectively told us lies of omission about his condition. That's part of what lead me to understand that there are real evils in this world, a realization which put me on track to being the best I can be...

Anyway, I know now that I was only quasi-rational then, and that this was partially the cause my mistakes. Mistakes which caused grief and wretchedness that I can sometimes hardly bare. I'm on track now though - never again.

Comment author: Patrick 27 February 2009 09:12:14AM 3 points [-]

There were two big rationalist cascades that I have gone through.

The first was kicked off at age 14 when I learned about the idea of a logical fallacy, which lead me to going through a binge at wikipedia in an effort to learn all of the ones listed. This directed me to the skeptic's dictionary and Carl Sagan's baloney detection kit, as well as some books listing common errors in thinking.

After about a year, I thought I had a pretty good grasp of what counted as a good argument, one that didn't fall in to any of the traps that I was aware of, I was aware of hundreds of traps you see. In retrospect, that should have tipped me off to a deeper problem. Luckily, I didn't work on anything important with that mindset, just hung about in forums and IRC showing off my "rationality".

After doing that for about two years, on my last birthday, I received a copy of Godel Escher Bach as a present, and saw Douglas Hofstadter make an abridged version of the idea in the Principia Mathematica, an axiomatic, logically rigorous way to do number theory, and it became apparent to me that informal ways of "proving" things were just inadequate. Shortly afterward I discovered Overcoming Bias, where Eliezer's essays greatly inspired me to think rationally when I don't need something proved. Going through SICP and learning the mathematical basis of Newtonian mechanics hammered home the logical, axiomatic approach.

Here's hoping the trend continues and I experience a third cascade in another few years.

Comment author: [deleted] 27 February 2009 10:34:06AM *  4 points [-]

deleted

Comment author: Florent 27 February 2009 10:54:23AM 1 point [-]

When I was a kid, I had an uncle who claimed he was able to use telekinesis to move glasses. Strangely, when I asked him to show us his talent, it was never the good time ("I'm too tired", "it's too dangerous"...). From then I started questionning every weird claims/beliefs.

Later, as a teenager, I understood that the most important thing to do was, well... doing as much good as possible in the world (quite obvious indeed, but not for kids, and not for most adults - just try to ask them what is the most important thing they can think of).

I then thought that an effective way to do good was to remove pain, and I became a transhumanist. The achievement of an AGI became my strongest wish. But since I'm neither a cognitive scientist nor a programmer, I chose to raise the public awareness by making a movie.

I've been on this project for several months now, this will be a kind of Permutation City but with REAL fun (needless to say I totally agree with Eliezer's latest posts about utopias). I don't know how long it will take to do it, or even if it will even be made, but I think it has a huge potential.

Ok, I haven't talked only about the origins, but, well, that's my rationalist story.

Comment author: Eliezer_Yudkowsky 27 February 2009 11:05:57AM *  2 points [-]

Added a post scriptum, see above.

Comment author: AnnaSalamon 27 February 2009 11:31:48AM *  8 points [-]

Could you specify what you mean by "getting the transition started" or "crossing the first divide"? I'm surprised by the question.

In both my own history and the people around me (both people I know from rationalist communities, and people more representative of the broader American public), I tend to see fairly continuous gradations of rationalist skill and of rationalist disposition/goals, without an obvious "first step" to notice.

Comment author: Raw_Power 15 December 2010 03:36:12AM 1 point [-]

I think he's looking for a trigger we can activate in normal people. But I've read most of these stories and so far it seems the vast majority among us had a natural disposition for this ever since babydom. We could ask those who 'didn't have that disposition to give more details?

Comment author: NQbass7 27 February 2009 01:37:56PM 6 points [-]

I don't remember a time when I wasn't in some sense interested in rationality in some sense... but I can remember one time being at a bookstore and seeing Bertrand Russell's "Why I Am Not a Christian" (this being back when I was one) and thinking "Maybe I should read that and see what the other side says." I came home with it and my mom saw it and asked why I would want to read that when it might make me doubt. I clearly remember thinking about it and responding with something along the lines of "If you don't know both sides, how could you possibly know which one is right? Wouldn't you rather be right than keep the same wrong beliefs?" I don't know that it was a turning point for me, but it was the first time I had really had that thought out loud (and it was probably the start of my deconversion and subsequent start down the road of rationality).

Comment author: RobinHanson 27 February 2009 01:41:54PM 20 points [-]

How rational was your transition to rationality? A sudden transition seems more suspicious, as that looks a lot like the sudden transitions humans tend to make between social groups. After all, there is usually little social benefit to sitting between social groups; social rewards come more to those firmly within one group or another. A gradual transition, on the other hand, seems more plausibly to match the more steady rate at which relevant info arrives on such topics. How much more relevant info could you really have obtained via one story or essay? Whatever your conscious thoughts, if you had a sudden transition I'm guessing that was your subconsious mind thinking something like "Yes, this looks like a good social group to join."

Comment author: Johnicholas 27 February 2009 03:10:57PM 4 points [-]

I've heard a story about a cat:

The cat sat sunning itself by the window for several hours. Then it got up and walked off. My roommate said "That's how we can tell a cat has complex inner life - apparently uncaused but decisive action."

Surely decisive action has more possible causes than social groups?

Comment author: RobinHanson 02 March 2009 03:30:45AM 1 point [-]

It is sudden large belief changes that are suspicious, not decisive acts.

Comment author: Raw_Power 13 December 2010 06:22:23PM 3 points [-]

How about when one does not hold one belief to be prominently truer than another, but holds on to one consistent set of beliefs that their view of the universe and their morality are based upon, and which they cannot change gradually, because that would lead to inconsistency, and then one goes and accumulates enough evidence against the individual beliefs of one set and in favour of those of another set to decide to change sets entirely.

Religion-coded and other similar worldviews are not buffets, you either take the whole menu or nothing at all. You can't divide it in bits the same way you would treat, for example, Marxism. It's all or nothing.

Comment author: Nornagest 13 December 2010 07:24:19PM *  1 point [-]

Seems the moral here is that humans already have a common internal mechanism for overturning belief systems that has nothing to do with rationality: outlining it completely would take me more research and probably enough space for a top-level post (it hasn't been addressed directly as far as I can tell), but it's related to the cult attractor and you can see suggestions of how it works in conditions like Stockholm syndrome.

Being a lot more common over the set of all humans than having accurate intuitive access to a truly rational procedure for deciding between elements of belief systems, it makes sense to consider it a more likely cause for your own decisions in the absence of evidence for such a decision procedure.

Comment author: Eliezer_Yudkowsky 27 February 2009 04:38:41PM *  15 points [-]

I feel that perhaps you are being too cynical. There's such a thing as an insight snapping into place and recoding a lot of old information.

And there's such a thing as force building up for a long time against resistance, and then the resistance breaking; this is not sane, per se, but it's how I would describe my own sharp transition in 2003. I certainly don't think you could describe that as joining a social group.

Actually, I'd think there would be a lot of sources for sharp mental transitions. Just having to choose locally a preference between A and B will generate sharp transitions whenever A < B swaps to B > A and that means other things have to follow.

Comment author: badger 27 February 2009 10:56:39PM 8 points [-]

I agree with Eliezer here, but Robin also has a point. I think we should distinguish between the transition away from one position and the transition towards another. Because falsification is relatively easier than confirmation, once the right evidence falls into place, a rationalist should expect to quickly abandon prior beliefs. The problem arises if something else quickly fills the void without being thoroughly tested. I saw a couple high school friends fall into the trap of thinking the opposite of stupidity is intelligence after leaving religion behind.

Beware a slow transition away from old beliefs as much as a sharp transition to new ones.

Comment author: Kevin 01 March 2009 09:12:38AM *  1 point [-]

That's what happened in my transition.

Comment author: RobinHanson 02 March 2009 03:29:27AM 2 points [-]

Yes, joining social groups isn't the only possible cause of sudden belief changes, but since the relevant info should have been coming out pretty gradually, it is still hard to see how a sudden large belief change could be that rational. I suppose one could more suddenly see an implication of evidence one had long held, but then the suddenness should be attributed to have realized that some point of view was possible at all. A sudden move to a point of view one had already recognized as possible would harder to describe as rational.

[I also mean this comment to reply to other comments besides Eliezer's but this system offers no easy way to express that.]

Comment author: Eliezer_Yudkowsky 02 March 2009 04:39:10AM 2 points [-]

If the belief change we're talking about is becoming more rational, then the implication is that you've been irrational up until that point and failing to integrate evidence.

Saying "I've been such an idiot!" is a further factor discriminating in this direction.

Comment author: Davorak 10 December 2010 09:47:57PM 0 points [-]

Sudden transition are suspicious and cation should be applied when switching world views. It does seem like you are jumping to conclusions in your guess: "Whatever your conscious thoughts, if you had a sudden transition I'm guessing that was your subconsious mind thinking something like "Yes, this looks like a good social group to join." This is a very narrow guess which you have not backed up with evidence. I also can not find supporting evidence in my own observations and/or reading. While it is a possibility it still seems likely to be an over simplification.

Knowing that a previous belief system has been falsified(by some of it's foundation being disproven or thrown into doubt) it is perfectly fine to tentatively apply a new system of beliefs to experimental verify there correctness.

Comment author: Raw_Power 13 December 2010 06:16:45PM 4 points [-]

I don't know, man. For me, joining the "rationalist" tribe only means trouble, socially speaking. It is not a tight or rewarding community, it lacks solidarity and structure, and we can't seem to agree on suff. However, I would be fooling myself by denying that being inmersed in a European environment that actively enouraged me to not only ignore the edicts of my native religion but to also positively disbelieve in it may have had a role in making a position as a Muslim untenable. However, my change as a rationalist... in the Lesswrong meaning of the term... you could say I had always been a rationalist, ever since I was a small child. The turning point religiously was "Religion's Claims Of Non-Disprovability", which, like many articles here, managed to tie many loose ends that were worrying me for years and made all the puzzle snap together. What Lesswrong did was help me organize my thoughts and show me the natural conclusions of the thought threads that I was intellectually horrified of following on my own. It helped me become more myself, so to speak. So, no, mostly it wasn't a "good social group to join" rationale, though it certainly was a deal-sweetener.

Comment author: Desrtopa 13 December 2010 06:30:54PM *  0 points [-]

I can't speak with authority on his mental state at the time, but I was a participant in the online conversation during which his transition occurred, and I would say that it seemed like a click moment. He had already been grappling with religious issues and attempting to reconcile them in a rational way, and had started to make a headway on the sequences, and in the course of that conversation, he seemed to realize that there were simple and obvious reasons why the approach he had been taking didn't make sense, that the mistakes were correctable, and that by making a generalized effort to recognize and avoid those sort of mistakes, he could make his reasoning more correct.

He already had the relevant information, but the connection was a relatively sudden event.

Edit: wrote this after seeing Raw Power's comment in the recent comments bar without noticing the date of the comment he was responding to. I interpreted it as a question to Raw Power.

Comment author: Jason 27 February 2009 01:55:27PM *  2 points [-]

Reading Thaler's Anomalies' series for my Intro to Behavioral Econ class during undergrad- oddly enough, I hadn't before questioned the validity of the rational actor model.

Comment author: Vladimir_Nesov 27 February 2009 02:40:11PM *  15 points [-]

I never believed in God, even though my parents are casually religious. The idea was simply prohibited by absurdity heuristics. At the same time, I was surrounded by believers in supernatural, alternative medicine, and had a couple of memories of apparently supernatural events. The specific God was absurd, but the invisible dragon of supernatural explanation was clearly true. I knew things normal people didn't, I knew that my alternative medicine worked while all those silly doctors didn't believe in it, I knew that supernatural exists. This gave a clear feeling of superiority.

I started to part with supernatural at University, on Traditional Rationalist grounds. I studied physics, and there was nowhere for supernatural to hide. Mystical retreated in a dark corner of the garage, not allowed to touch real things, not allowed to show in specific tricks, but still lingering as uncertainty. I called myself agnostic back then, taking pride in having an open mind, not excluding the supernatural or even a more abstract God, while not believing in them.

The systematic breakthrough started less than two years ago, when I began thinking about AI. Before then it didn't occur to me that my own beliefs can be treated as reductionistic phenomena, something that has to obey certain laws, which I can reason about, not just with. The supernatural and religion turned out to be mere symptoms of a more important problem, poor mental hygiene, and in their explicit form left the list of matters of concern.

Comment author: Raw_Power 13 December 2010 08:56:02PM 1 point [-]

But... didn't you say your alternate medicine and stuff actually worked? You don't need to throw the baby with the hot water (or whatever): techniques that work but have bogus explanations that still help in their practice (and I see that a lot in martial arts) simply need better, leaner explanations, but ignoring an empirical phenomenon entirely on the ground that its explanation sucks is not a very good idea. A few days ago I had my first Zen session. The sensation was unique, the results immediate, the explanation (harmony with the universe) bullshit/useless for deriving consequences, but useful for getting the position right. There's obviously more to it that "sitting before a wall in a contrived position", but what exactly?

Comment author: Vladimir_Nesov 13 December 2010 09:24:42PM *  1 point [-]

But... didn't you say your alternate medicine and stuff actually worked?

I said that I knew that it worked, not that it worked. I'm not moved by your argument that aimed to exploit that particular hypothetical point of confusion.

Comment author: Cassandra 27 February 2009 02:48:26PM *  5 points [-]

After thinking about it more and looking back on my own life I think I have figured out at least four things that led me to this path.

  1. When I was very young I learned that I was a person and that people are separate things. When I think my thoughts are my own, when I act my actions are my own. This can as a very great shock to me. How is it possible that I, of all people, had an identity which is separate from others? I could not see the dividing line between me and others and I could barely even understand why we weren't all one big group mind acting in union but I knew as I sat there in class one day, looking at other people, that both I and they existed and we were apart.

  2. Once I knew that I could think and could act I slowly over time learned that I was in fact responsible for my actions and thoughts and the consequences of them. The way this happen was strange. I still had a hard time believing that other people could think and act themselves but I knew that when my actions harmed other people they seemed to feel pain or become upset. And this caused me to become upset. I had no intuitive answer for why this was so but it was plainly obvious that it was. Because of this I decided that other people likely function according to the same rules as me.

  3. The toughest bit for me to swallow was the idea that I was never safe. There is no truth, no plan, no philosophy or set of rules that will keep me from making mistakes. Because of this much of my life has been trying to escape from fear. I took refuge in any mode of thought that seemed to promise an escape from uncertainty, from my personal responsibility. And every time I learned that reality was more complex than my philosophy and deeper than my understanding. I could never escape from myself, from my thoughts or from the consequences of my thoughts. And I could never escape from my failures.

  4. To recognize and accept that I did fail and very often is what led me into my current state. If failure happens then what are the reasons? This is where I am now in my personal journey and this is the stage that I stumbled into contact with this social group.

Comment author: pre 27 February 2009 03:09:41PM *  1 point [-]

I don't know really, certainly I can recall no specific incident. I suspect just the lessons in logic needed to learn to program computers properly, the basic lessons in the scientific method taught at school.

My folks are Christian, and I was still at Sunday School till I was about 14, but not really taking it seriously, still going just for the sake of a quiet life. By the time I was 18 at Uni I was certainly talking friends out of their theism, mostly by pointing out contradictions in their beliefs and challenging others to find some in mine. Then altering my beliefs when they occasionally found some.

Frankly my memory of my childhood is so appalling it'd be hard to have any confidence in a story if I told one.

Here we are nearly twenty years after that and drifting across a couple of OB posts from Eliezer through links elsewhere, probably during the QM series, maybe a bit before, led me to put OB into my RSS feed.

I'm always so far behind reading my RSS feed that feels like the discussion is over by the time I read anything there though, so never posted.

Pre..............

Comment author: Emile 27 February 2009 03:10:42PM *  14 points [-]

I don't remember any sudden move towards rationality - I was raised in a godless household in a mostly godless country (France). I've always been pretty interested in science-fiction and in religion (though not as something I might believe in).

What pushed me a bit more towards rationalism:

  • Maths classes that required a lot of demonstrations (and having to be able to do them again on the blackboard with an examinator)

  • A physics teacher who insisted that we always include an uncertainty factor throughout our calculations, and not give excess decimals (I've noticed that I tend to think in terms of probability distributions more than others around me)

  • Questioning a lot of my political opinions, and noticing when my brain was "up to no good", for example when EvaluateAsLeftWingOrRightWing(idea) was being called before EvaluateTruth(idea).

  • Getting annoyed with atheists who consider religion to be the only domain where one can be irrational

  • Working as a programmer, which doesn't leave much place for wishful thinking

  • Reading Overcoming Bias daily

Comment author: Johnicholas 27 February 2009 04:50:47PM 13 points [-]

Regarding working as a programmer, I entirely agree.

I don't know of any other discipline, even math, where one is more repeatedly confronted with one's mistakes.

Comment author: Vladimir_Nesov 27 February 2009 06:06:23PM 3 points [-]

Yet you are not forced to think about your own thinking.

Comment author: anonym 27 February 2009 10:04:23PM 4 points [-]

If you want to learn from your experience most effectively and efficiently, and to stop making the same kinds of mistakes, with subtle variations, again and again, it is necessary to engage in reflection about the erroneous thoughts that caused the bug/problem and the thoughts and mental processes that were absent but could have prevented the problem. It depends how much one cares about improving, and how quickly, but for anybody who seeks mastery, I don't see how you can avoid thinking about thinking.

Comment author: David_Gerard 13 April 2011 08:22:12PM 3 points [-]

Working as a programmer, which doesn't leave much place for wishful thinking

I wish some of the programmers I've worked with realised this.

Comment author: KatjaGrace 27 February 2009 03:53:40PM 8 points [-]

Must everyone begin as not trying to be rational? I probably did too then, but I don't remember it. Trying to be correct by making your thought processes accurate seems like a pretty obvious thing to do (I assume that's what's meant by rational). I've rarely been so shocked as when I realized (at about 12 I think) that it's normal and not embarrassing in society to have opinions for 'arbitrary' reasons. I'm still kind of puzzled about what else you would think you were doing, even if you are delusional about your success. What did you folk transition here from?

Comment author: Jack 27 February 2009 03:55:12PM 3 points [-]

My sense is that people value the truth to varying degrees. Further, people encounter barriers to pursuing the truth to varying degrees. Whether or not someone ends up here is likely a function of them caring about truth enough to make the relevant social and psychological sacrifices to get past the barriers.

For me, I don't remember when I started caring about whether or not my beliefs were true. I know that the moment the possibility of God's non-existence was put to me I immediately became an agnostic- and an atheist when I learned about the scientific method, Karl Popper, etc. I was raised Catholic ostensibly but my mother is a Unitarian (though one who believes in a fair bit of New-Agey gobbledygook) and my Catholic father is a doubter and extreme skeptic. The areas I've lived in have always been fairly non-religious and relatively non-Christian (until I attended a Catholic university).

The answer to the question "what got the transition started?" is probably a just knowledge of the rationalist position and hearing an unbiased version of rationalist arguments. What made the transition possible was valuing truth and having few significant barriers to pursuing the truth. What makes people value truth, I suspect, usually comes before most people's conscious memory and not recognizable at the time.

However, I did have an experience that increased the how much I valued truth-My parents got divorced and told me contradicting stories. Hypothesis 1: Being lied to increases one's subjective value of truth. Hypothesis 2: Being lied to by people who answered all of your initial questions and guided your initial decisions increases one's subjective value of truth.

Comment author: botogol 27 February 2009 04:38:38PM 9 points [-]

Eliezer asks "how did you come to rationality?" It surprises me how many people answer: "this is how I lost my religion"

Clearly you can't be rationalist, while also being religious, but there is a more to rationality than simply absence of religion..

Anyway... personally: there's no one moment, but I'm a natural born sceptic and persistently urious analyst. Perhaps rationality attracted because it seems like methodical, organised, analytical scepticism

Single biggest book: Hofstadter's G-E-B, right when it first came out. I just didn't know there could be a book like that....

Comment author: thomblake 27 February 2009 04:52:57PM *  4 points [-]

I went to a very good Catholic elementary school, one run primarily by priests trained by Jesuits. The priests commonly visited classes, and anything could be interrupted to have an impromptu theological or philosophical discussion. The classes encouraged questioning and doubt in all areas of study. We actually read philosophers such as Plato, Descartes, and Aquinas in the later years.

While I doubt that every child who went through this experience with me came out an ardent seeker of truth, I nonetheless believe this had a huge impact on who I'd become. Also, I should note that I've heard most Catholic schools aren't this awesome.

Comment author: thomblake 16 March 2009 08:14:20PM 1 point [-]

Did I really say "Dominicans"? I meant "Jesuits", of course.

It's been a while.

Comment author: Raw_Power 13 December 2010 11:54:29PM 0 points [-]
Comment author: steven0461 27 February 2009 09:08:57PM 1 point [-]

I could never stand when people made thinking mistakes, especially me.

I got into OB-style rationalism via Eliezer's writings on the Thing Not To Be Named. I got into that subject via >H and futurist sites (McCarthy, Bostrom, Sandberg, Pearce, Moravec, Hanson).

Comment author: jimmy 27 February 2009 10:06:52PM 4 points [-]

I never had a sharp transition to rationality. I have been an "aspiring rationalist" for as long as I can remember. Though there were a few significant events, it was mostly just a gradual improvement.

Now that I think of it, my upbringing seems almost ideal for creating a rationalist. My dad is probably the most rational person I know, and although my mom is normally very rational, she would occasionally get upset about something and be extremely irrational. Not only was I raised by atypically rational people, but I also had practice dealing with irrationality. The fact that the only irrationality in my genes is intermittent (when emotional) and mild may have even acted as a "vaccine".

One of the driving forces for me to actively try to be rational (as opposed to just not letting myself be knowably stupid) was that I enjoyed being contrarian on issues where people cared and were wrong. It was enjoyable to find things that people get wound up about, think about them rationally and see what crazy sounding ideas come up (stuff like Robin's proposals for fixing health care).

Another driving force is that I hate to lose (being wrong), so that I made sure to express uncertainty when I wasn't certain, and changed my mind when necessary to stay on the "winning team". It was ok to be 75% sure of something and change your mind (hell, it should happen one time in four), but when one claims p ~=1, being wrong is an obvious failure of rationality. This helped me prevent wild overconfidence at the extremes of the scale.

Comment author: Raw_Power 15 December 2010 03:32:51AM 2 points [-]

The way you do this... that's almsot exactly how I used to operate. Even today, my never taking a vulnerable position in an argument has earned me the ire of people who accused me of always wanting to be right. As if there was something wrong with that!

Comment author: olimay 27 February 2009 11:06:54PM 6 points [-]

I can't trace my present efforts at rationality back to one "Aha" moment; and trying to do so feels akin to applying the Sorites paradox to subjective experience: lots of problems there. But, for what it's worth, I remember certain events and thoughts I associate with "breakthroughs"--spans of time after which, I became more eager and aware of my own biases.

Here are a few that I remember:

Like many other people, confronting my religious beliefs was a milestone. I'd grown up Roman Catholic, and as a child Christian myth and metaphysics excited my imagination. As I encountered other belief systems I found interesting I tended to engage in apologetics (aka feeding my confirmation bias). Through people I respected in the martial arts I was introduced to aspects of Buddhism and Taoism that seemed, to me, to have some truth to them. Maybe this is akin to what Robin Hanson describes: I wanted to bridge the gap between social groups that I liked. Internally, I began to adjust my religious beliefs to be looser, more "mystical", less dogmatic, to accommodate the beliefs of other people. The big breakthrough happened while taking survey course in Western literature that included readings in Judaic and Christian texts. Looking at these texts from a strictly literary perspective had a big effect on me. I panicked and read The Case for Christ, but in the end I concluded that a strictly literary perspective on the Bible was the really most valuable way to actually engage with "The Bible" if you're actually searching for truth. In my head I saw a thousand exegetical scholars and apologists spread across history, all frantically waving their hands.

"How dangerous is self preserving belief," I thought, staring down at the tracks, waiting for the downtown A train at 34th Street. "And how utterly comfortable." I felt immensely alone in that moment, scared about having to confront the people I care about and their treasured beliefs, and say, "You're wrong."

An experience last year made the idea how biases can just friggin screw things up much more apparent to me. I had a friend and mentor I admired as one of the most a) intelligent and b) altruistic people I'd ever met. In short, what happened was she accused me of doing something bad to her that I did not do. I didn't hear this from her directly: she just stopped talking to me, and I had to really bug our mutual friends. What was she had accused me of doing was utterly ridiculous, but I understood that it would be nearly impossible to convince her otherwise. My friend is the kind of person who makes negative conclusions about people with immense consternation, something I used to think was a virtue. But once she had decided I, an important and close person, had done something bad, no level of discussion could convince her otherwise. She could muster the equivalent of a thousand apologists to defend her existing belief. (Example of intelligent people shooting themselves in the foot.) Aside from the fact that I had just lost a very dear and important friend, I was angry, so angry that someone so good and smart could make such a fatal error. We talk about cognitive biases in public policy, in global catastrophic risk, as an obstacle to human progress and knowledge. But here I experienced a very dramatic and personal example of irrationality's consequences. Likely she'll go on the rest of her life with the belief that a close friend of hers had betrayed her. I do think that avoiding the destruction of the world, and preventing the purposeless deaths of all people is a more important to study rationality. This was just an up-close reminder to me that the dangers of irrationality are here, now, and devastating consequences do lie in wait. I wish I didn't need such an experience, and I know should be careful with hos it influences my beliefs and actions in the future. Robin Hanson's point is especially relevant here when he asks if our transition to rationality was rational. This was a very emotional reaction to a bad occurrence. Yet it is what, at least initially, increased my desire to be, shall I say it, Less Wrong.

Comment author: anonym 27 February 2009 11:16:45PM 2 points [-]

A critical thinking class in which nothing was sacred and everything was suspect. We spent a semester uncovering the fallacies, lies, and manipulative rhetorical devices in advertisements, television and movies, government propaganda (related to sex, drugs, the military, etc.), journalistic publications, academic papers, wisdom our parents taught us, and much else.

Comment author: AnnaSalamon 27 February 2009 11:59:16PM 3 points [-]

Where was the class? What did you read?

Comment author: anonym 28 February 2009 02:14:21AM 3 points [-]

The class was at college (in the USA). And I ended up reading philosophy (I assume you meant your question in the British sense of read), which I partly regret. It would have been better to do math at school and philosophy on the side, rather than the reverse.

Comment author: Swimmy 28 February 2009 01:18:39AM 30 points [-]

I was raised in a religious household and took it very seriously. At the same time, I always enjoyed skepticism and debunking, because I was always entertained by such things. But when it came to philosophy I was completely full of it. I got away with it by living in an area where I only encountered other Christians, not many atheists. When I did actually encounter some atheists, I would do some hand-waving about how there was something Deep and Intellectual about Christian apologetics that they were missing.

I dated someone who was extremely, well, hippie. Completely non-judgemental about even the most absurd hypotheses. I really hated that kind of attitude--where was her intellectual curiosity? So I got more into specific skeptic arguments. I fell in love with James Randi and watched almost every video of him that existed on Youtube at the time. But I waited to apply any of the lessons to the Big Question. Christianity was a huge part of my life; my entire family is still very seriously Christian, and a huge chunk of my social network used to be.

I started reading Overcoming Bias because, hey, Mason econ student, why wouldn't I read another great blog? There are several lessons on that site that I still summon all the time in arguments, but it took some internal realization to understand what applied where.

First, if I hadn't been trained in orthodox statistics--if I didn't know specifically what methods science used--I never would have gotten many of the arguments. I would have been happy to get this training much earlier in life. That's a basis by which "science can't know anything" arguments immediately fall apart.

From there, these are the posts that most helped me and why.

First, being raised in a presuppositionalist church, I had to be convinced that it really did come down to evidence and not assumptions. For this, "How to Convince Me That 2 + 2 = 3" was a good starting point, and it even helped me address some false claims in Austrian Economics. "Religion's Claim to be Non-Disprovable" also helped, but it took a while for me to get to the point that I was willing to look at this argument head-on with the idea that I should consider it with my best judgement rather than dismiss it as missing-the-point.

To get there, I needed the point made in "The Bottom Line": it is illegitimate in epistemology to start from the bottom line. That is rationalization, which can take more than one form. I thought back to my education in geology, where I was presented with indisputable evidence that the earth was several billion years old. Back when I was taking that class, I researched creationist arguments on the internet and found that all of them had been soundly refuted. But instead of immediately questioning my religion, I put all of that away in a box, to be dealt with later. When I brought some of it up to my mom, she said, "Tim, you're creative enough to come up with some kind of explanation that can fit." I accepted this back then: indeed I was, though I never seriously tried. But to even have such a thought is to outright admit that you're wrong beforehand, that the only way to reconcile your opposing beliefs is to come up with a fancy lie.

Then I was more receptive to "Religion's Claim to be Non-Disprovable." Eliezer presents the best defense against presuppositionalism I've ever seen: presuppositionalism is to be found nowhere in the Bible. It is evidentialist through and through. Miracles are presented as evidence of God, are cited constantly throughout as proof of the One True God above all the others. Paul's entire defense against the Roman government in Acts is simply, "The claims I'm making about miracles are true and here are the witnesses."

So I decided I finally had to see if I could reconcile the fact of the discovery of natural sciences with the Bible. I never found Intelligent Design convincing, quite frankly because I had begun to respect the biologists who dismissed it more than the religious leaders who touted it. But of course as I researched it individually anyway, well. I needed a better theory of evidence, which I got from "A Technical Explanation of Technical Explanation" and "The Conservation of Expected Evidence." Bayes + my traditional probability training started working their way into my mind, so I could evaluate different evidential claims much better than before.

Also important was "Occam's Razor." I had never seen a technical definition of Occam's Razor provided, and I was suddenly floored by the outright wrongness of arguments like, "God is the simplest explanation for the universe."

There's more to the story than that. After all, changes like this never have one true cause. I began to see the disconnect between my thoughts about morality ("I have to admit that homosexuality is wrong") and my feelings about it ("But I can't feel like my gay friends are really bad people"). I started getting kind of disgusted by the sheer number of bad Christian arguments parroted about like it was nothing. The entire time I was studying economics, which I put a lot of stock in, and theories about interest rates being evil, the necessity of Christian governance, and so on, all started to look less and less like God's wisdom and more like the same old ignorance that every society has.

It was this feeling of disgust that forced me to finally admit I didn't consider myself a "Christian" anymore, and the arguments I had gathered in my mind in the mean time that led me to fill the gap with "atheist."

This is all relatively recent, so it is in much better detail than the other influences. Surely there must have been something in my brain that led me to be able to reject Creationism long before I ever considered myself a "rationalist."

Comment author: Cyan 28 February 2009 06:32:18AM *  1 point [-]

My origin story began when I stumbled across Probability Theory: The Logic of Science. From it, I learned that I didn't have to make up an ad hoc method for grappling with uncertainty each time I encountered a new data analytic problem, and that the general rules encompass a great deal more that data analysis.

Comment author: Kellopyy 28 February 2009 12:44:25PM 2 points [-]

At best I might call myself aspiring rationalist (like Kenny elsewhere in this thread suggested) because I fail very often as rationalist.

As for experiences that have led me to try to be more rational...

I read Sophie's world[1] when I was about 14 years old and that inspired me to think I how I could tell if I wasn't actually living in a 'real world'.

I was curious about different beliefs humans have in my teens and if there might be truth to some of those beliefs (and which ones). After finding local christianity unsatisfying for several reasons and looking for alternatives I ended up reading a spell on internet forum that had a strong point about what works [2]

After enrolling to study psychology I read and completed excercises in SICP[3] for various reasons. It was very inspiring to read and especially 4. chapter (Metalinguistic abstraction) was very enlightening. I think that both programming and learning psychology both increased my yearning for being more rational.

There could be other events too.

  1. http://en.wikipedia.org/wiki/Sophie's_World
  2. http://www.chaosmatrix.org/library/chaos/rites/buff.html
  3. http://mitpress.mit.edu/sicp/
Comment author: Ziphead 28 February 2009 01:06:53PM 7 points [-]

I can’t remember a time when I was not very much concerned with rationality. I think my father (a neuroscientist) encouraged those kinds of ideas from the time I was learning to speak my first few words, always reasoning with me, nudging me to think straight. I developed a deep interest in science from about the age of five and there was never any competition from other ways of viewing the world. Things like game theory and heuristics and biases came to me much later (when studying economics), and although I was excited about it, it didn’t really rock my world. I had always been searching for tools with which to improve my own thinking, these just happened to be unusually powerful ones.

Although I don’t remember any awakening to rationalism, I do remember some early clashes with irrationalism, which I think was quite formative. From the beginning, I had taken rationalism for granted. As I started to interface with the world outside my family, I realized that the norm was in fact massive irrationalism, and this drove me crazy. The prime example was when I encountered religion.

My parents were second-generation atheists, and socialized exclusively with other atheists. Also, I had the good fortune to grow up in a country where a vast majority of the population is nonreligious. For these reasons I didn’t even know that such a thing as religion existed until I was about eight years old. At that point, I joined a classmate from elementary school to an after school activity group arranged by a church. I came home afterwards and told my parents about the stories I’d heard about this person called Jesus. They said simply that if I wanted to go there and listen, that was okay, but it was important that I realize from the beginning that the stories were just stories, as in any book of fiction. That was the first and last thing my parents ever tried to teach me about religion.

Some time later I realized that religious people actually believed the biblical stories, without any kind of reasonable evidence, and I found this absolutely horrifying. I remember feeling deeply offended that such ignorance could exist, and still it took a long while for the full scale of the offense to sink in. A couple of years later I slept over at a neighboring family’s apartment and was shocked when, shortly before going to sleep, the parents of the family expected me to get down on my knees and pray. They were equally shocked when I said that I had no idea how to pray. In any case, I was thoroughly disgusted by this first encounter with actual people actually practicing religion, and ever since, I’ve had to struggle just to keep a straight face when I meet religious people. (My parents advised me to take it easy and tolerate religious people, saying that some of them actually were good and decent people, it was just that they happened to have this slightly “childish” aspect to their characters, which should be tolerated in the same way as, for example, low intelligence.)

I never read Overcoming Bias for the rationality stuff. Although I have certainly learned a lot from these posts, I have never felt that they were very revolutionary for me personally (allthough I guess they would be for most of the world). My main interest here is Mr Yudkowsky himself. I have a life-long interest in the nature of genius, and reading the things he writes seems to me an unusually unobstructed view into the mind of a living and ever-developing genius. What he happens to be writing about at the moment (I’ve been following his work for over five years now) is of secondary importance.

Comment author: Yvain 28 February 2009 09:25:39PM 39 points [-]

Since it would be impossible to disentangle and explain all the different factors, and all the studies say people are terrible at determining what events influence them anyway, I'll just tell the event in my transition to rationalism that makes for the best story:

When I was around five, my kindergarten teacher decided to initiate my friends and I into the Great Miracle Of Life by bringing an incubator full of chicken eggs into the classroom. I watched them hatch, loved the little chicks, and (after some time and other events including a bad experience at a meat-filled Asian restaurant) decided to become a vegetarian and eat neither meat nor eggs.

When I was about eleven, I got quite into politics, and like most people in my area ended up as a typical liberal. And so I was of course pro-choice: why should we respect the rights of fetuses when they're just a collection of cells and not even really alive?

It took me a while to realize that I was simultaneously refusing to eat eggs because potential-chickens were valuable living beings who deserved respect, and condoning abortion because potential-humans weren't.

If I'd been a little older and a little cleverer, I'd have made up some typical political excuse why it was really about freedom or human rights or society or something (or else just learned the difference between fertilized and unfertilized eggs!)

But I was young and innocent enough to take a moment to think "Maybe my brain is just telling me what it thinks I want to hear in each situation, instead of really thinking things through. I should find a way to stop that."

Comment author: Raw_Power 13 December 2010 06:25:01PM 0 points [-]

Some days one wonders if saving the angst such an effort implies might be worth it. Then again, some of us just can't help ourselves: thinking things through is more of a compulsion than a choice.

Comment author: swestrup 28 February 2009 10:05:21PM 49 points [-]

As far back as I can remember I have wanted to be a scientist and to walk the path of rationality. What comes to me as a watershed moment was when I was 15 or 16 an my very Christian Grandfather came to visit. He told me that since I had a very scientific mind, he was giving me a scientific gift. It was a thin book with a title something like "Scientific Proof of the Bible".

Afterwards I remember sitting for what felt like hours in my room, staring at the closed book. "What if I was wrong?" I kept asking myself with dread. What if there really was scientific proof of the existence of God and what I had always taken to be the nonsense of the Bible? What if going to church and praying really WERE things I should be doing? If so, how could I justify not going. What was the guiding principal of my life, anyway?

In the end, I decided, my guiding principal was "Truth at any cost." If I was wrong, I wanted to KNOW I was wrong, and I would deal accordingly. So, I picked up the book and started reading, and within a few minutes I was laughing in relief as there wasn't a cogent argument or scientific proof, or even the slightest bit of rationality in the entire thing.

But my Grandfather had given me a great gift, although not the one he thought. From then on, I was willing to lose arguments since my desire was to know the actual truth, and not to merely have the comfort of thinking I was right. That, as they say, has made all the difference.

Comment author: Eliezer_Yudkowsky 28 February 2009 11:49:59PM 6 points [-]

I've just got to say awwww to this one.

Comment author: Normal_Anomaly 17 December 2010 01:04:29PM 7 points [-]

This is a nice one for irony. "Oft evil will shall evil mar indeed."

Comment author: PhilGoetz 01 March 2009 06:07:22AM *  14 points [-]

Christianity drove me to rationalism. I went to a Catholic college where we had to take 2 semesters of theology and 3 semesters of philosophy.

We studied Aquinas for weeks. Knowing that Aquinas was generally regarded as the smartest person in the Middle Ages, I was stunned by the stupidity of his arguments. Aquinas could not have been stupid. Therefore, social pressure was capable of warping the minds of the smartest people on the planet for a thousand years. Therefore, it could be warping my mind right now.

Another thing we did was to study a parallel edition of the gospels. That means that it has one column each for Matthew, Mark, Luke, and John. Laying them out side-by-side, I saw many places where Matthew, Mark, and Luke had identical sentences. They couldn't have come up with the same grammar and word choice independently. At least 2 of them had copied from someone else. I had studied the Bible all my life, and was surrounded by hundreds of people who also studied the Bible regularly. Some of them had read it every day for decades. And none of them had ever noticed this; or if they did, they didn't mention it. (It is universally known to Biblical scholars; but most churches take a dim view of Bible scholars.) I realized that they couldn't see it, no matter how smart they were or how much they read the Bible, because their preconceptions prevented them from looking for it.

I was astonished that most Christians have never read the entire Bible. If you believe that God wrote one book in which he said everything he wanted to say to the world, you would read that book. Yet even being aware of this, I found it hard to read. (To this day I suspect I may not have read Haggai.) I knew that this meant my rationality was broken (although at the time I attributed it to sin).

But now I remember an earlier event: I was about five. I was in the car, on a long trip with my family. Traffic stopped. There was an accident ahead. I saw a little dog walking away from the accident, down the road. I said that it was probably from one of the cars in the accident, and that I wanted to get out and pick it up before someone hit it. My parents said that was foolish, and that the dog could be dangerous. Then someone hit it. And I realized that I had been right - and that the fact that there were hundreds of grown-ups around me in their stopped cars, and none of them had done anything, didn't mean a thing.

Comment author: PhilGoetz 01 March 2009 06:26:31AM *  4 points [-]

I might not be a rationalist by Eliezer's definition. Eliezer said that there must be a rational solution to Newcomb's paradox. I find that belief irrational. (Although there may be a rational solution to Newcomb's paradox.) Rationalists don't have faith in rationalism.

Comment author: insaneabd 01 March 2009 06:22:51PM 4 points [-]

Or maybe the evidence he has justifies his belief in the possible solution to the paradox, and similarly for you. Its only after you two share your evidence and fail to agree that one of you can be called a non-rationalist (on these grounds).

Comment author: PhilGoetz 01 March 2009 09:17:07PM 4 points [-]

No. He believes he has a proof now. But he said that he tried to build a proof because, before finding a proof, he believed there must be a proof - and it seems, from what he wrote, that he found the lack of such a proof offensive. That's faith.

Comment author: Eliezer_Yudkowsky 01 March 2009 09:20:07PM *  4 points [-]

That's a mixture of Trust in Bayes and the original driving purpose that causes me to define the word "rationality" a certain way. In any case, I did find an elegant answer and so I have no reason to label the driving intuitions involved as wrong.

Comment author: Kevin 01 March 2009 09:05:32AM *  36 points [-]

My family is Jewish and we all went to a Reform synagogue. This sect of Judaism is very liberal in the scheme of things, making it very clear that the bible is not literally true and accepting of just about anything, even agnosticism (if not atheism).

At the age of 16, Reform Judaism has a confirmation ceremony where one makes a statement of faith to the assembled congregation. I realized that I couldn't go up in front of a crowd and in good faith profess a belief in God. I had understood all of it to be just stories for a long time, at least since the age of 13, but I hadn't quite realized that meant I was an atheist. I just never really thought about it, but when I finally did it seemed obvious in retrospect. I ended up reading a poem to the congregation and it was very well received as it was the shortest speech given that day.

The next year, I decided I wasn't going to go to synagogue for the High Holidays (where my liberal synagogue had 3 hour long worship services). My parents weren't quite sure how to react, but they told my grandparents and my grandparents responded by deciding they weren't going either. This particular decision set off a chain reaction where it was determined that no one in my family from my grandparents on down were believers and we had all just been going along for each other's benefits. On the holidays now, my 92 year old grandfather always mentions how nice it is that the holidays give us reason to get the entire family together.

Comment author: Eliezer_Yudkowsky 01 March 2009 11:38:07AM 13 points [-]

Every now and then I hear a story about (or meet in person) someone who not only left but managed to deconvert their whole family.

I wish, so dearly, that I could devote the time to at least seriously trying that...

Comment author: Kevin 02 March 2009 03:18:31AM 11 points [-]

I mostly just got lucky based on the circumstances. My little brother has fallen in with the 12 step program, though. It's working for him but it's nature is so anti-rationalist that it pains me somewhat. He started believing in God again; I threw some basic paradoxes at him and he just responded by saying he never really thought about it. I think he'll grow out of it eventually.

I went to Israel last year and was surprised and delighted to see that the country was positively European in its religious attitudes. Almost half of the people are non-believers, but I would be seriously afraid to try and deconvert any Orthodox practitioners, even or especially if they were family. They can get rather angry.

Comment author: insaneabd 01 March 2009 06:20:04PM 4 points [-]

It was happening slowly while I was growing up. I can remember many small times when I was breaking away from tradition and the beliefs of my parents and family. Things started to speed when I discovered OB and Eliezer... Then I started university.. A very rigorous course in maths emphasizing the axiomatic approach to maths. A very logical course in physics. Then I started reading the quantum physics sequence, something I had not done before. I read No Safe Defense, Not Even Science (http://www.overcomingbias.com/2008/05/no-defenses.html) and that was the crucial "Aha!" point that pushed me over the edge. This was only a few months back. And here I am.

Comment author: [deleted] 02 March 2009 04:03:33AM 2 points [-]

I don't remember BECOMING a rationalist, just going through life thinking how stupid everyone was.

When I was seven or so, I asked my mother if she and dad believed in god, and she gave some handwavy answer about believing in a kind of magical force to the universe, like in star wars, and I thought "Boy, that's stupid."

I don't use the word "rationalist" to refer to myself, because it throws me in with you lot, most of whom I still think are stupid.

Comment author: Vladimir_Nesov 03 March 2009 03:25:10PM *  2 points [-]

By this logic you may as well not call yourself a human, "because most humans are stupid".

Comment author: [deleted] 04 March 2009 08:33:33PM 4 points [-]

To my way of thinking, "rationalist" has a certain stink to it, it has connotations of people sitting around arguing about arguing, writing pages of tedious probability math using "prior probabilities" they pulled out of their asses.

In one sense, being a rationalist just means that you try to be rational. But it seems like a stupid thing to wear on your sleeve, because everybody tries to be rational.

There's a sense in which objectivism is just the belief that reality is mind-independent. But I don't go around calling myself an objectivist either.

Comment author: Nick_Novitski 13 March 2009 05:27:38PM 2 points [-]

Not everyone tries to be rational. Some people despise rationality because of the same stink you attribute to it, or because of others. To them it might connote atheism, or linking themselves to low-status entities like "the man" or "the sheeple."

A rational person is someone who applies rationality. A rationalist is someone who advocates the application of rationality, just as a racist is someone who argues the fundamental importance of racial status and history, or a "homosexualist" is someone who (purportedly) wants to make homosexuality part of all our lives.

There's a dangerous potential to be confused between (for example) "objectivity" (the belief you mention) and "objectivism" (membership in the low-status group you mention).

Comment author: tsprad 03 March 2009 05:48:03AM 10 points [-]

Some of my earliest childhood memories, age 4 maybe, are of Sunday School, enjoying the stories and the socializing, but being secretly astonished that the sweet little old ladies that ran the Sunday School made such a show of believing in their stories, of pretending they could actually communicate telepathically with a character in a story.

On reflection, I'm not so much surprised that I didn't accept the BS, but surprised that I knew instinctively not to question them about it and rock their boat.

But then, more recently I've started worrying that one of these days the mothership is going to come back and pick me up and debrief me. "What have you learned from over fifty years of living on this planet, among these people, as one of them?" And I'll have to admit I don't understand this species at all.

Comment author: Raw_Power 13 December 2010 09:21:45PM 2 points [-]

Well, I am utterly shocked that at such a young age you didn't even consider the possibility that God was real and that you could pray to him. Seriously, what gives? Where did this sense of distinction between fiction and reality come from? How did you distinguish the Bible from, say, History?

Comment author: Nornagest 13 December 2010 10:02:10PM *  2 points [-]

Well, what are your boundaries on "consider"? I remember entertaining the possibility of God's existence at a pretty early age -- somewhere between two and four, but infantile amnesia's eaten the specifics -- but always as a hypothetical, a playing-pretend game. It took me quite a while to realize that my peers weren't consciously participating in a pleasant fantasy; as late as age eight or so I remember making decisions that could only have been predicated on the opposite assumption.

For context, I was raised in a pretty obviously Christian cultural milieu -- picture books of Bible stories, a sense that it was normal to go to church on Sundays even if you and your parents didn't -- but most of my very early authority figures didn't make a conspicuous show of belief. "Secular" might be the word, but only implicitly so.

Comment author: Desrtopa 14 December 2010 04:17:42AM 1 point [-]

I also never took the idea of a real interventionist god seriously, and while I've only lived one childhood and so can't compare the effect of this influence to its absence, it might have had to do with the fact that I learned about dead religions at a very early age. By the time my fundamentalist grandmother started proselytizing to me at the age of three, I already had significant exposure to Greek mythology, and I mentally filed "Grandma's beliefs about God" into the same class as "Ancient Greeks' beliefs about gods." It didn't even occur to me until I was about eleven that these were beliefs I was expected to take seriously and have an emotional investment in.

I did experiment with the idea of a non denominational god as a kid, but I never felt the need to make excuses for the hypotheses if they turned up null results. I concluded that if there was a god, it wasn't giving me any reason to worship or believe in it, so I might as well assume it didn't exist.

Comment author: saturn 14 December 2010 07:26:19AM *  6 points [-]

How did you distinguish the Bible from, say, History?

By age 4 I think I had figured out that stories about magical or super-powerful beings always turned out to be made up. I did believe it when adults told me that people had souls though, until I got a book that showed the location of organs in the human body and I noticed it wasn't in there.

Comment author: Raw_Power 14 December 2010 02:38:36PM 0 points [-]

Argh, how I envy you guys. Me, I used to believe All Myths Are True at first, and then I selectively and methodically disbelieved those that I (very gradually) discovered to be inconsistent. I guess I've always had the tendency to completely immerse myself in stories. Even now, I still take stories and fiction way more seriously than I should...

Comment author: Annoyance 03 March 2009 02:48:18PM 19 points [-]

I became an atheist fairly early, but it took me longer to realize there was no Santa Claus. The idea didn't make sense, but the presents appeared under the tree, and my parents denied being responsible, so clearly they'd gotten there somehow. I concluded that I just didn't understand some important part of how the world worked.

One year, we'd just moved into a new house. For the first time, we had a real fireplace, made of brick. I excitedly spoke of how this would make visiting much easier on Santa, but wondered how he could make it down a chimney at all, and began making plans to string a net of dental floss across the opening in an attempt to see how Santa dealt with the obstacle.

I had been leaning on the brickwork, looking up the flue, as I said these things, and as I turned around I intercepted a look my parents were giving each other. Translated into English, it might have said something like "Isn't this precious?"

In that moment, I intuited that there was no Santa Claus, and that my parents had been lying to me because they thought my belief was cute.

I had already learned that not everyone was my friend. I already knew that some people who weren't my friends actively wished to harm me. But that was the first time I really grasped the idea that my parents had goals and preferences of their own that they would choose over my welfare, that I couldn't rely on them not to harm me for their own benefit.

Before that time, I took for granted without thinking about it that people's stances toward things could be easily derived from what they said and did. Enemies were obvious; so were friends. Only afterwards did I really understand not only that appearances were deceiving but that people would actively create false appearances.

Instead of relying on my first impressions, I began to withhold judgment and (although I lacked the words to describe it at the time) actively seek new evidence to test my beliefs.

Comment author: topynate 05 March 2009 06:50:14AM 12 points [-]

When I was 5 or 6, I wanted to be a palaeontologist. I ended up with a small collection of fossils and whatnot, as well as an awareness of both evolution and how old the Earth is. As the infallibility of the Torah was obvious, I assumed that its interpretation, which I wasn't yet old enough to learn, explained how everything could be reconciled. In any case, I had much more serious things to worry about. For instance, the boys and girls I knew showed no inclination to date or marry - therefore the human race would shortly end, unless the Moshiach came. Having tagged 'God exists, Judaism is right' as being obviously true, I simply didn't think about questioning it for a long while. As time went on, I did realise, slowly, that just because I'd decided something was correct, like inexorable human extinction, didn't make it so, and that I was not infinitely smart.

When I was 13, I had my Bar Mitzvah and was surprised that I didn't start observing the strictures of Orthodox Judaism, such as not manipulating electricity on Saturday. Now that I was responsible before God for my actions, I should have been much more compunctious, but I couldn't believe that I would be punished for such things, while non-Jews wouldn't be. I became obsessed with the idea that people like me existed who didn't believe in the infallibility of Judaism. They believed in something else, like the Koran or the New Testament. Why was I Jewish, except that my parents were? I started to think of reasons, but somehow they all depended on the infallibility of the Torah... OK, so suppose for the sake of argument that I don't believe in Judaism; what arguments would convert me to Judaism and not, say, Islam? I realised two things at that moment: first, that I would never have believed the truth of the Torah if I'd learned science first, and second, that Buddhists didn't even believe in God, never mind the Bible. From then on I was provisionally Deist, having no better explanation for the beginning of the universe. I wasn't a very strong Deist, because of what I knew about physics and evolution, but a Creator seemed logically necessary. My idea of looking at my 'deepest beliefs' from a neutral standpoint seemed so much smarter to me than just about every other thought I'd had, that I began to do it all the time. So, at this point I'm a Deist and starting to think rationally a lot more often.

I thought a great deal about God in the next months. When I tried to work out what sort of God could create the universe, I (eventually) realised that the most I could say was that it could create the universe. I'd become very well accustomed to bad logic after a few months of reconversion attempts, so it was obvious that I'd just proven the tautology "If a Creator exists, it exists." My intuition had led me astray: there was no compelling argument for an intelligent Creator on the tip of my tongue, just an unquestioned assumption that the universe had to be caused. That was the end of my Deism.

Comment author: Nominull 14 March 2009 02:45:46AM 7 points [-]

When I was a little kid we would take car trips to visit my grandparents, and my father would borrow books on tape from the library. He borrowed Asimov's "I, Robot", which if you haven't read it is basically "House, M.D." except that instead of people you have robots and instead of Dr. House you have a pair of underpaid robot repairmen. It didn't introduce any concepts of rationality directly, but in the book the heroes won by figuring things out, rather than by being strong or passionate or morally correct. It made figuring things out cool, and it turns out that if you want to figure things out, you use rationality.

Comment author: aluchko 15 March 2009 11:08:07PM *  4 points [-]

I can't really relate to the religious stories, my parents, though not atheists, are pretty secular so I never had the brush with religious indoctrination. In reality I've probably always been an atheist. I think this gave me an early start on rationality, not so much because atheism taught me rationality, but because I never had to abandon a rational line of thought for fear of challenging my religion.

As for consciously trying to be rational though I don't know of any one defining moment though I can recall a slight watershed. During grade 11 I was selected to go with some other students to an economics conference. The conference was run by a strongly right wing institute and myself being left wing, and wanting to signal my intellect by challenging much older and much more knowledgeable people got into (and probably made a fool of myself in) numerous debates.

I recall over the next several months starting to realize that my own views and conclusions might be mistaken. For the first time I started seriously considering how to actually think about and try to find the truth which is probably the same place I'm at today.

Comment author: MBlume 29 March 2009 09:46:40PM *  15 points [-]

I am a scientist. The truth has always held aesthetic value for me. Nonetheless, I was for many years a religionist as well. This was pretty much purely through the force of wishful thinking -- the idea of annihilation after death scared the crap out of me, and so I avoided it. A few particularly excellent posts on that other blog we all read (along with some other helpful nudges) finally broke me of my childhood religion. In February 2008, out of a concern purely for the aesthetic value of truth, I renounced the Dark Side, and all its works.

And so, the Dark Side retaliated by taking from me that which I held most dear.

Would it be ... too petty of me to say that I have sworn vengeance? That I hold a grudge against religion in general for one harm done to me?

I think it's not. If I held a grudge against theme parks in full generality because she ran off with a guy she met working at one, that would be petty. There's no reason to expect theme parks in particular to cause significantly more harm to others along those lines than other working environments. Religion is different.

The Dark Side encourages isolation. A false belief which you feel you must protect means you also have to protect yourself from anyone who can explain to you why it's wrong. It's no accident that the rules of kosher are insanely complicated and difficult to keep. The point is to make it hard for a Jew to break bread with a gentile -- to isolate the religious memes from anything that might challenge them.

And so religion gives us one more reason not to come together. It gives us one more reason not to find the people who could make us happy.

It gives us one more reason to be alone.

And it hardly needs pointing out that the way we are currently wired, we need reasons to be alone like we need holes in our heads.

So, this is what I fight, and why. I don't know how, but I wish to see the end of religion's sway over this world.

Comment author: Raw_Power 13 December 2010 09:05:21PM *  3 points [-]

the idea of annihilation after death scared the crap out of me, and so I avoided it.

That was one of the main things that held me (and, I guess, may others) back. That, and the promise of Hell (at least for Christians and Muslims).

No, really, Cessation Of Existence still scares the crap out of mem though I have accepted is as very very probable (barring the Singularity happening very soon). What about you guys?

Comment author: Kingreaper 14 December 2010 02:09:00AM *  -1 points [-]

The cessation of existence holds very little fear for me. Existence really isn't all that great, so it ending wouldn't be all that bad.

The one thing I fear about it is that it should happen before I manage to make my net impact on the world positive. I don't want to be one of the >50% of the population that the world would have been better off without.

I fear failure, rather than death.

Comment author: MoreOn 14 December 2010 02:37:04AM 2 points [-]

I understand your fear. In fact, I have the same fear.

I don't agree that the world would be better off without 50% of it. If anything, it's underpopulated.

There's a reason why only way of doing worse than doing nothing is to be causing mass murders.

Comment author: Kingreaper 14 December 2010 03:16:30AM 3 points [-]

I don't agree that the world would be better off without 50% of it. If anything, it's underpopulated.

I would be interested in hearing your reasoning for this position.

As such I precommit to upvoting an explanatory post, no matter how much I disagree with its content.

Comment author: wedrifid 14 December 2010 04:50:02AM 0 points [-]

As such I precommit to upvoting an explanatory post, no matter how much I disagree with its content.

And I commit to at least leaving it neutral even if I disagree with its content. And I will disagree. :)

Comment author: MoreOn 14 December 2010 05:48:45AM *  2 points [-]

I posted it into discussion, because it's a long explanation.

Probably unnecessarily long. Do tell.

And I will disagree. :)

I don't even claim to try to be rational (I'm not), so I'm not the one to judge, but at least try to keep an open mind?

Of course, I'd appreciate your feedback even if you do disagree.

The problem with mass murders is not the effect on population.

True. Also, depends on how massive.

Comment author: wedrifid 14 December 2010 04:53:47AM 1 point [-]

There's a reason why only way of doing worse than doing nothing is to be causing mass murders.

The problem with mass murders is not the effect on population.

Comment author: Pavitra 14 December 2010 05:58:34AM 1 point [-]

I'm guessing you think the problem with mass murder is the effect on society of knowing that crazy people might kill you for doing things they don't like, so that murder tends to be not simply a removal of human life, but a political act, a lynching.

Do you consider murdering a thousand people you don't like to be better or worse than letting ten thousand randomly-selected people die because you can't be arsed to do anything about it?

Comment author: ata 14 December 2010 06:11:27AM *  4 points [-]

I'm guessing you think the problem with mass murder is the effect on society of knowing that crazy people might kill you for doing things they don't like

Is that the only alternative to "The problem with mass murder is its effect on human population size" that you can think of? I always thought that the problem with mass murder was about the same as the problem with normal murder except multipled by a thousand or eleven million or however many victims there are.

Comment author: Kingreaper 14 December 2010 12:39:05PM 0 points [-]

I always thought that the problem with mass murder was about the same as the problem with normal murder except multipled by a thousand or eleven million or however many victims there are.

For a strict utilitarian, the main problem with non-torture murder can be seen as the fear it produces in the population.

Strict utilitarianism is quite common here, so guessing that wedrifid is one isn't that much of a reach.

Comment author: ata 14 December 2010 07:43:37PM 0 points [-]

I don't think "strict utilitarianism" refers to a specific, well-defined moral system, but my point still stands if you're referring to the general class of moral systems and methods of moral reasoning that are popular here; involuntary death is bad, whether torturous or not, so killing ten million people is at least as bad as the sum of the individual badness of killing each of them. The "at least" part is to take into account any further negative effects of mass murder, such as the one that you mentioned, but compared to millions of people dying involuntarily, I really doubt that's the dominating factor.

Comment author: Raw_Power 17 December 2010 11:29:01AM 1 point [-]

Well, I for one didn't look at if from a deontological point of view. Unlike other victims of coercion, murdered people tend not to make much of a fuss about having been forced to die. However, their death tends to produce sorrow and anger on those emotionally and economically reliant on them (including their creditors, superiors, subordinates, clients) and causes the loss of a hub of social network and a repository of knowledge and skill accumulated over a lifetime. In other words, murder, for a stable, sedentary, densely structured society, is extremely wasteful and troublesome. And it leads to a shitton of paperwork. That's for just one death.

However, from a Golden Rule/Reciprocal Altruism POV, committing murder is an extremely bad idea because, besides the aforementioned problems with each individual murder, the fact that people can get killed, for whatever reason, may make one fear for one's safety among fellow humans ,raising stress levels to presumably unbearable heights and cause a limitless waste in resources in personal security, . Think of Israel-Palestine, where people constantly live in fear of being killed by some crazy suicide bomber or some trigger-happy teenage soldier. Despite what the actual risk of that happening might be compared to the risk of dying in a traffic accident, much more money ends up being spent on this sort of thing than on road safety. Car accidents, as the Joker would put it, are "all part of the plan". I love how effectively that character uses The Dark Side and The Fallacy Of Grey. Does anyone know any examples of similarly eloquent villains? (Besides Nietzsche that is).

Hence why we are taught to heavily frown upon it.

A Mongol from Genghis Khan's Golden Horde might see things differently, is all I'm saying. There are also countries like Colombia where murder is extremely common, and often absolutely senseless. Society functions, people get used to the fear. Humans can get used to a lot.

Deliberately murdering a mass of people causes the same effect

Comment author: Pavitra 14 December 2010 07:24:00PM 0 points [-]

Is that the only alternative that you can think of?

No, of course not. I just thought it was the most likely to be the one e had in mind.

Comment author: wedrifid 14 December 2010 07:01:57AM 3 points [-]

Do you consider murdering a thousand people you don't like to be better or worse than letting ten thousand randomly-selected people die because you can't be arsed to do anything about it?

I should not answer that question. But will(1). ;)

The murdering of 1,000 people is far better. Especially if done one at a time in novel and humiliating ways. That will serve to lower the status of the group with negative value and so alter the behaviour of the rest of the population. Of course this requires 'liking' to be closely related to the consequentialist value of people whose identities fit that archetype.

That said I still wouldn't murder people. Partly due to an irrational sense of morality and partly due to an ethical injunction.

(1) This message will self destruct upon the first disingenuous quotation by a future social aggressor. Unless this pre-emptive expression of contempt for said moraliser is sufficient for me to be satisfied with leaving the results.

Comment author: Desrtopa 14 December 2010 07:08:07AM 0 points [-]

I don't think that would make sense unless you could somehow accomplish it, not only without people knowing you were responsible for the murders, but that the deaths were murders at all. Otherwise rather than lowering the status of the group, you would probably make the public view them as noble victims.

Comment author: shokwave 14 December 2010 07:13:06AM 0 points [-]

Fictional evidence, but the victims in the SAW movies weren't seen as noble.

Comment author: Desrtopa 14 December 2010 07:18:33AM 0 points [-]

I haven't seen them, but point taken. Am I right in assuming though, that they were deliberately built up as unsympathetic prior to being gruesomely killed? If you want to lower the group's status, it's that build up, where their characters are given a systematically negative portrayal, that you want to aim for, not the gruesome comeuppance.

Comment author: wedrifid 14 December 2010 07:56:48AM *  2 points [-]

I don't think that would make sense unless you could somehow accomplish it, not only without people knowing you were responsible for the murders, but that the deaths were murders at all. Otherwise rather than lowering the status of the group, you would probably make the public view them as noble victims.

Here we disagree on a matter of fact and expectation. Historically in cases where specific groups were the target of lynchings the resulting lowering of group status has been rapid. Even members of said groups lower their perceptions of their own status such that they avoid sending high status signals (acting as equal to the persecutors) and so making themselves the next target.

The same phenomenon can be observed in workplaces and other tribes within our culture, with respect to acts of humiliation, not death. The others in the tribe may view them as noble victims but victims are pitied, not respected. People, particularly ambitious people, will avoid doing things that affiliate them with the victim class. Status goes into free-fall.

I did mention 'one at a time' and 'in humiliating ways' so as to minimise any potential martyrdom bonuses. Something terrible happening once is an exception, a tragedy. Something happening a thousand times is a norm, the status quoe. In a certain instinctive sense it becomes legitimate.

The presence of humilitation and even the fact that it is a murder, not a valiant death in battle is also important. If the victims are raped, castrated and stoned then they just don't look as cool as if they charge into battle screaming "you may take my life but you will never take my freedom!" People at times have even placed a lot of stock in whether they are killed by the sword or by hanging - and for good status relevant reason.

Comment author: Desrtopa 14 December 2010 08:05:03AM 0 points [-]

Here we disagree on a matter of fact and expectation. Historically in cases where specific groups were the target of lynchings the resulting lowering of group status has been rapid. Even members of said groups lower their perceptions of their own status such that they avoid sending high status signals (acting as equal to the persecutors) and so making themselves the next target.

Can you provide any examples? I can't think of any cases where groups were targeted for lynchings where it's clear that their status fell as a result rather than their low status causing the lynchings.

You do have two tendencies working at odds here; the just world fallacy could cause their status to decrease, but being victimized for one's affiliation can also be a positive status symbol, hence why Christians will often frame themselves as being persecuted for beliefs in cases where it's clearly not accurate. If you have someone clearly going around victimizing the group to an extreme extent with the purpose of humiliating them, I expect the martyrdom effect would win out.

Comment author: shokwave 14 December 2010 07:12:01AM 0 points [-]

Do you consider murdering a thousand people you don't like to be better or worse than letting ten thousand randomly-selected people die because you can't be arsed to do anything about it?

It ought to be better. None of the factors of either option (murder, don't like, allow to die, randomly-selected, death due to apathy) are worth more than one human life. Thus, it is a simple question of scale. All the possible consequences - such as 'now people will be afraid if I don't like them', 'well, I can't be held socially or legally responsible for their deaths' - just do not outweigh 9,000 human lives.

That said, if I ever encountered this situation in real life, I would be immediately convinced that I had made a mistake in my reasoning, and would spend as much time as I possibly could looking for the alternative where nobody dies.

Comment author: Costanza 14 December 2010 01:54:37PM 0 points [-]

On the other hand, there's the consolation that if and when you do cease to exist, you will no longer be bothered by fear of failure or anything else. You will have no regrets, no regrets at all.

Comment author: MoreOn 14 December 2010 03:55:28PM 3 points [-]

I prefer to exist with regret and be bothered by the fear of failure than non-exist.

And besides, the universe isn't me-centric. If I invented the cure to all human diseases, solved poverty and prevented the world from blowing up by nukes, I wouldn't "die happy knowing what a positive impact I've had." In the scope of things, there would be that person who's me who did all that, and then ceased to exist.

Comment author: MartinB 14 December 2010 06:01:47AM 0 points [-]

Existence really isn't all that great, so it ending wouldn't be all that bad.

You can do something about that. At least for your own bubble.

Comment author: shokwave 14 December 2010 06:37:00AM 1 point [-]

Hmm. If you are currently below net neutral impact, then continued existence is at least as important as improving your impact on the world. If you are currently above net neutral impact, you should probably end your existence as soon as feasible to ensure you don't accidentally cause or contribute to some event that brings your net impact way down to negatives.

Comment author: Kingreaper 14 December 2010 12:08:25PM 0 points [-]

I don't aim solely to have a net positive impact. I aim to have as large a net positive impact as possible. My fear is not the only contributing factor to my utility function.

So, if I prove capable of pulling out of the significant pit of negative impact I have produced during childhood and adolescence, I will hopefully not commit suicide until senility, when there is good reason to expect my impact to go negative again.*

*(I also have a couple of mental blocks that make me committing suicide unlikely. I haven't attempted it since producing them, although their purpose was unrelated.)

Comment author: TheOtherDave 14 December 2010 02:18:54PM 0 points [-]

Isn't this just the Sunk Cost fallacy applied in reverse?

Comment author: wedrifid 14 December 2010 02:28:58PM 1 point [-]

Not this time. According to the specified value system the approach is rational. (The sunk cost fallacy is fallacious due to the way it interacts with sane human values not 'fear net negative' craziness.)

Comment author: TheOtherDave 14 December 2010 03:39:50PM 2 points [-]

Ah, right. I should have attended more carefully to context.

Comment author: NancyLebovitz 14 December 2010 12:27:34PM 1 point [-]

Why do you think >50% of people are net losses?

Comment author: Kingreaper 14 December 2010 12:47:05PM 0 points [-]

Well, to start off, the reason I picked 50% is the belief that most people, had they not been born, would have been replaced by someone else. Slightly <50% of the world could expect, on average, to be replaced by someone better. (specifically, 0.5*[the proportion that would be replaced])

The reason I chose >50% is that I believe that the population at present is larger than the optimum population. I'm not sure by how much, but I suspect the optimum for our current technology level would be less than 1/3rd of our current population.

Would you like me to explain why I believe the population is above optimum?

Comment author: Costanza 14 December 2010 03:59:47PM *  1 point [-]

I would. Is it just the number, or is it the composition, or maybe the geographical distribution?

Comment author: DanielLC 14 December 2010 07:38:36PM 0 points [-]

Why does the net impact = zero part matter? Certainly the only thing that matters is how much total good there is, not how much was done by you. Even if it is, wouldn't +1 QALY be just as much better than 0 as 0 is from -1 QALY?

Comment author: Vaniver 14 December 2010 06:50:48AM 0 points [-]

No, really, Cessation Of Existence still scares the crap out of mem though I have accepted is as very very probable (barring the Singularity happening very soon). What about you guys?

To the best of my knowledge, it is well with my soul. I enjoy living and seek to continue doing so- but when it comes to lifespan, I start at the present and count up rather than starting at infinity and counting down.

Comment author: NihilCredo 17 December 2010 12:31:34PM 5 points [-]

In the mid- or late-morning, when I'm full of energy and eager to tackle the challenges and entertainments of the day, death looks like a terrible loss, a fun-stopper to be escaped at any cost.

Late at night, when my brain is exhausted and wavering, the bed is so warm and the silence blissful, never waking up again sounds like a fantastic deal.

I hope to die at night.

Comment author: MBlume 14 December 2010 01:57:09AM 14 points [-]

cringes just a bit

In the scope of things, this all seems a bit silly to worry over now =/

Comment author: NihilCredo 17 December 2010 12:24:52PM 1 point [-]

This is very good to hear.

Comment author: Tesseract 29 December 2010 10:59:39AM 1 point [-]

Not to dispute your main point here (that emotionally-protected false beliefs discourage contact with reality), but do you really think that many religious practices were developed consciously and explicitly for the purpose of preventing contact with outside ideas? It seems to me that something like kosher law was more likely the combination of traditional practice and the desire to forge a sense of social identity than a structure explicitly designed to stop interactions. Group differences hinder interaction between groups, but that doesn't mean that the purpose of group differences is to do so.

I don't disagree with you on the point that religion often explicitly discourages contact with nonbelievers, either, but that seems to me to be more easily explained by honest belief than Dark Side practices. If you believe something is true (and important to know the truth of) but that someone can be easily persuaded otherwise by sophistic arguments, then it's reasonable to try to prevent them from hearing them. If someone believes in global warming but doesn't have a firm grasp on the science, then you shouldn't let them wander into a skeptics' convention if you value valid beliefs.

Comment author: orthonormal 05 April 2009 05:16:26AM *  12 points [-]

It was akrasia, Dostoyevsky, and the sacrament of confession that turned me into a rationalist. Seriously.

I became very religious as a teenager (for social reasons, as I'd later realize), and drifted more and more traditional and conservative (since I could see that liberal Christianity is generally logically incoherent). This drew me into theology (thus philosophy), so that I'd been exposed in college to all the arguments I needed to reject Christianity; I just refused to apply them, generally taking them one at a time and playing One Argument Against an Army.

What changed in grad school had to do with the internalization of the virtue of honesty. Because I had to confess my sins frequently, I became more and more aware of my rationalizations and self-deception (in areas of discipline and akrasia, not of course rationality). I took to heart what Dostoyevsky wrote in "The Brothers Karamazov":

Above all, do not lie to yourself. A man who lies to himself and listens to his own lie comes to a point where he does not discern any truth either in himself or anywhere around him, and thus falls into disrespect towards himself and others.

Before long, though, the practice of listening for the signs of self-deception and rationalization had an unexpected consequence: my doubts of the faith, which I'd battled as a sin again and again, were growing worse as I recognized the bad arguments I was letting myself be satisfied with. It finally came to the point of recognizing that I was striving to rid myself of doubt when I thought I was striving to investigate it.

From there, it was a comparatively short leap to atheism and to a more consequentialist and physicalist reevaluation of my interpretation of the world. Nietzsche helped greatly, which is why it saddens me when he's dismissed for the wrong reasons (as invariably happens with people who've only heard of him, or only read short bits). But enough about that.

(I later got hooked on OB because the early posts rang very true to what I'd gone through, though I'd never expressed it as clearly as what I saw there.)

My point is that my birth as a rationalist isn't identical with my fall from religion; it merely caused it as a side effect. My real rationalist beginning was learning to doubt beliefs that felt like they needed no argument, because I'd realized that feelings of certainty arise for reasons besides entanglement with truth.

Comment author: Simulacra 17 April 2009 12:59:43AM 1 point [-]

For me it began as a bored student picking up a book on probability (specifically Randomness by Deborah Bennet) and discovering my understanding of probability was seriously wrong. Following that discovery and armed with my improved understanding I began to look at what other ideas and beliefs might be flawed. I started with those beliefs that were most likely to be based on probabilities and found that nearly everything I thought was true was affected by a single inaccuracy. My mind has burned with a single question ever since: "What else is polluting my mind?"

As for how I found OB; if I recall correctly I was reading up on AI and happened upon one of Eli's posts. Fascinated, I jumped from post to post and found myself deep in rationalist territory. I found home.

Comment author: jsalvatier 13 December 2010 10:56:36PM 0 points [-]

what was the one inaccuracy?

Comment author: Aleric 17 April 2009 11:00:36PM *  24 points [-]

I grew up in the Northeast United States. I didn't care for school most of my life and was exposed to a mainline Protestant church. Due to socialization from the media and educational systems, I was pretty much a de facto liberal until the age of 22. When I say I was a "liberal" I mean it in the American Leftest variety and not the classical Liberalism of the enlightenment.

I joined the military at 22 in the attempt to bring some excitement to my life. After the Bush administration raised my pay by 15% I figured I must be a "Conservative?" In March of 2003 I led an Infantry team during the invasion of Iraq.

After I returned from the war--still believing I was a Conservative--I started reading pop-Conservative books. I took up many of the positions of the Right and believed "the liberals were the problem."

After being honorably discharged I moved home with an intense desire to learn and change the world. I started school and majored in political science. I also picked up an opiate addiction in an attempt to numb the physical and psychological effects of the war. It was during this time of substance abuse that I first started challenging everything I thought I "believed" in. While I don't recommend it, being under the influence of opiates allowed me to question many of the beliefs that I had an emotional attachment to.

After a couple years of abuse I got clean. Looking back at this time I now realize it was critical in changing me from a "believer" to what people at this site appear to call a "rationalist." Also important in my transformation was the study of statistics, probability, logic, economics, and Western Philosophy.

This site looked like a good place to learn more?

Comment author: Raw_Power 13 December 2010 10:30:01PM 6 points [-]

That's... definitely an unusual story over here. Would you care to write a top-level post about the details of this? Or are you especially uncomfortable with talking about your PTSD and the causes and consequences thereof, as well as the experience of opiates consumption? Sorry for being so insensitive, but you really have piqued my curiosity here.

Comment author: jsalvatier 13 December 2010 10:54:14PM *  4 points [-]

I second that notion. It's just too bad we discovered this thread a year and a half after it was posted.

Comment author: Raw_Power 16 December 2010 09:53:00PM 5 points [-]

I cast Raise Thread.

Comment author: [deleted] 16 December 2010 10:15:05PM *  3 points [-]

I am afraid the spell you actually need is Resurrection; this Aleric fellow has not posted in the same span of time. In fact, his only post was this story.

Comment author: Vaniver 16 December 2010 10:42:45PM -1 points [-]

I am afraid the spell you actually need is Resurrection;

You went for SRD correctness over a pun? You are getting both a downvote and a frowny face. :( Don't make me break out the really frowny one.

Comment author: [deleted] 16 December 2010 10:55:25PM 1 point [-]

Not a pun; I was continuing the joke of spellcasting in a way which pointed out that the problem was not only with getting new activity in the thread, but also getting new activity from the poster.

Also, just in case you are wondering, I did not downvote you.

Comment author: Vaniver 16 December 2010 11:00:51PM 3 points [-]

Also, just in case you are wondering, I did not downvote you.

Even if you had, there would have been no hard feelings. That comes with the territory of enjoying puns.

Comment author: Jonii 15 July 2009 12:22:31PM 5 points [-]

When I was around 12, I figured that since adults think I'm smart, and to some degree people of my own age agreed, there must be something I can do to avoid being so clumsy, awkward and stuff. I tried to use best methods I could find to improve my goals and methods to gain those, using every single way I could find. I tried to improve on board game called "Go" to do that, I studied mathematics, read about game theory, and overall tried to gain perspective by learning about the world, and made effort to find suitable role models from fiction(Sherlock Holmes, House, Jedi knights, whatever). I tested myself against those whose beliefs I found stupid(creationists, ghost hunters and stuff), and tried to understand the nature of being wrong or right. To support that, I also read a lot about human psychology and overall epistemology and philosophy of consciousness. All uncoordinated and pretty ineffective, but then I found a website dedicated to "refine the art of human rationality".

So, the key event for me could maybe be posting this comment. I'm expecting a lot.

Comment author: Wei_Dai 15 September 2009 02:53:19AM 12 points [-]

I was born in China, and moved to the US at the age of 10. My parents were both educated in Communist China and therefore atheists. I do not recall any anti-religious education in school, but do have a fairly vivid memory of watching a state-produced television program on the evils of 迷信 (superstition), which somehow left a deep impression.

After moving to the US, I remember watching Star Trek (reruns) as a teenager and admiring the Spock character. But I don't think I ever had a strong interest in learning how to be more rational, and instead just had an intellectual curiosity in topics that happen to be related to rationality, like economics, game theory, cooperation, the nature of probabilities and anthropic reasoning, the future, the Singularity, moral philosophy, etc., which led me to OvercomingBias and then LessWrong. Even now I think I'm driven more by a desire to satisfy my curiosities than to accomplish any larger goals.

I think my experience may be a counterexample to Something to Protect and Try Harder, but I don't really see how to generalize it.

Comment author: [deleted] 02 March 2010 06:13:12AM *  6 points [-]

Most of the math and explicit rationality came later, after I learned to program, but my first step down this path was probably when I was around six. I was suspicious of the whole idea of the tooth fairy, so one night after losing a tooth I did a little experiment: I put it under my pillow without telling anyone. The next morning, I showed my parents, and they actually came clean (obviously they couldn't keep things going with santa claus or anything else like that). I think I still kept a vague sort of religion for a few years after that, though.

Comment author: Strange7 12 March 2010 01:04:40AM 16 points [-]

When I was in second grade, about seven years old, it was my turn to do a show-and-tell project, so I decided to bring a game I'd learned from a book that purported to be about geometry or math or something but seemed to mostly involve silly arguments between a talking turtle and a greek athlete. I assumed my fellow students would enjoy it, since the rules were relatively few and simple (compared to, say, spelling homework) and the victory conditions utterly unambiguous (compared to the bitter disputes of scoring in various playground activities). It seemed to relate to what we were learning, so the teacher might even approve further study.

I could hardly have been more wrong.

The rest of the class just stared blankly, and even the teacher didn't seem to get it. "But," she said, "You've got 'mu' right there at the start. Why don't you just cross out the rest?" I protested that such a move would be against the rules, but was unable to convey the underlying significance before show-and-tell time was determined to be over.

The book was Goedel, Escher, Bach by Douglas Hofstader. I figured that if the teacher couldn't begin make sense of it, none of the other kids were interested, and even my dad was baffled by some parts, I would have to press on alone and figure it out myself.

Of course, I was way out of my depth, and there's still quite a bit about recursion, intelligence, axiomatic systems and so on that I'm not sure I've got a good handle on. It's that basic attitude, 'the only thing I know is that I want to know everything,' and some other stuff derived from it, that keeps me honest.

Comment author: beriukay 12 August 2010 03:47:15PM 4 points [-]

I can't really say what defining moments could be considered my rationalist origin story. However, I can speak of my brief foray into the world of woo, and how the first virtue both endangered me and gave me a savings throw.

Back in high school, I was on the tail end of being a theist, having grown quite bored with Confirmation Classes. I saw little value in memorizing the order of the books of the bible, and was desperate to hear something more than the half-dozen stories they told week after week. In those days, I also felt like a budding renaissance scientist, since I had an unquenchable thirst for science and had gotten quite good at guessing the teacher's password. I thought that was real knowledge at the time. Consequently, it wasn't a big leap to go from absorbing authoritative claims in Popular Science Magazine to reading about how the Grey Aliens are most certainly kidnapping defenseless farmers and experimenting on them. From reading biographies of Abe Lincoln or 60s books on black holes to reading about people's auras and ghost hauntings.

I quickly absorbed as much information about those mystical subjects as I had learned about science (we aren't talking quality of data, just number of bits), and it soon felt like I had a master's level grasp of the topics. And yet I could not see auras, just afterimages. I could not contact or gain any knowledge of ghosts. I imitated my mother's tarot reading with a deck of playing cards, and crucially, I noted all the claims that turned out false (almost all) along with the ones that turned out true (not many). Even when I guessed rightly in a seemingly spectacular way, it still just felt like guessing. And so my first step away from the brink of madness came as my curiosity drifted away from these now boring matters and back to science and mathematics, which were surprisingly good at holding surprises no matter how much I learned about them. One could say that my curiosity stopped being interested in curiosity stoppers.

I have since worried many times about how different my life might have been if I stayed in lala land, or if the pendulum reversed course and I went back to it. I now think that this concern is a waste of effort, since mysticism holds no mystery like reality does. Even if all that mystery is just map-territory confusion.

Comment author: mayonesa 18 August 2010 08:55:53PM 2 points [-]

When I was a child, I read the classics of literature and philosophy and quickly became a realist.

I don't say I'm a rationalist because rationalism implies a universal quality to human judgment, when empirical evidence convinces me no such thing exists.

Since then, I've left behind liberalism (pure emotion, defensiveness) and become a conservative realist, monarchist, conservationist and idealist (in the Kant/Schopenhauer sense).

Comment author: UnholySmoke 19 August 2010 02:59:53PM 7 points [-]

Apologies for coming to this party a bit late. Particularly as I find my own answer really, really frustrating. While I wouldn't say it was an origin per se, getting into reading Overcoming Bias daily a few years back was what crystallised it for me. I'd find myself constantly somewhere between "well, yeah, of course" and "ohhhhhhhhhhhhhhh!" Guess the human brain doesn't tend to do Damascene revelations. We need overwhelming evidence, over a long period of time, to even begin chipping away at our craziest beliefs, and even then it's a step-by-step process.

The analogy I sometimes go over is something most people find fairly obvious like egalitarianism. You don't find many people who would attest to being pro-inequality. But all the same, you find very few people who have genuinely thought through what it means to be in favour of equality and really try to fit that into everyday life. The first step to becoming a rationalist is to admit how irrational everyone is without monumental efforts to the contrary.

BTW, I am totally on the road to de-Catholicising my mother. This is on the order of converting Dubya to Islam, so if I can manage that I'm awarding myself an honorary brown belt.

Comment author: jsalvatier 13 December 2010 10:45:32PM 0 points [-]

I would be surprised if egalitarianism is a very good analogy. Politics is rarely a good example of anything.

Comment author: Raw_Power 14 December 2010 12:31:20AM 0 points [-]

I was going to make a quip about how converting Dubya to reactionary Islam isn't that hard: they have a lot in common, but that's a really offtopic slippery slope.

It has never occured to me to try and deislamize my parents. Or anyone else. I became a rationalist because of my innate character traits (especially curiosity and a healthy disrespect of authority), like almost everyone here, apparently. I have learned that some people just aren't suited for this mindset.

Comment author: ShiroiTora 28 August 2010 09:21:03AM 1 point [-]

I wish I had a great story to tell...I do not. I am a very simple man...with a simple mind. My memory is terrible....for me to remember things...I must understand concepts. There never was a time that I have thought differently...I have never been religious...I am an Atheist. I operate on basic country common sense. I am neither highly educated nor am I especially intelligent.

I argue essential points for its pragmatic value. If an argument is purely an academic one....one in which the answer holds no value to true application in life...I do not value it.

My understanding of Rationalism:

Rationalism is simply the way of understanding, in what is, the simplest, most effective and efficient manner. To know what is...what was...what will be...and to correct wrong by giving the what should be. In short...the scientific method.

If I am wrong....please tell me...I am the above...whatever name has been given it.

Comment author: Will_Newsome 19 September 2010 08:45:39AM *  7 points [-]

I bet my experience is pretty typical: it's just been one really long of string of oops, as far back as I can remember. I realized I was wrong, I updated. I started with nothing... no beliefs, just professions that I think I realized were transient. Slowly but surely I converged on agnostic Buddhist Epicureanism with a little Sagan, then atheist scientific liberal majoritarianism at RationalWiki with a little Dawkins, then neorationality here with Yvain and Eliezer, then hyperrationality at SIAI with a whole bunch of really strong thinkers, and now I just keep on working at it. Lately I've been reading a lot of source materials (Tooby/Cosmides, Dawkins, Jaynes, Buddha) and asking a lot of "Why do I believe what I believe?"s which have both been rather useful at sharpening my thinking. I'm not sure where to go from here; keep learning math, I guess? Read more source materials? I think I'm getting diminishing marginal returns and might soon start having to really paint my own art. That said, at this point it seems the true field of battle will be on the front of instrumental rationality.

Comment author: MartinB 21 September 2010 01:05:15AM 0 points [-]

If you read this far you might actually want to read my story: Borrowed one of these 'popular misconception' books from my grandfather who was slightly into conspiracy stuff and revisionism, esp. in regards to Russian/German WW2 plans. Was super surprised that some really basic ideas of the book completely failed to be understood by anyone I talked to about. Had the same with some minor content of my first lecture on Economy. Read a lot, got weird hobbies, did PR work for some, got surprised by disinterest and/or hostility toward them. Systematized, that its not a property of topic X, but of the person I talk to and my presentation. Got a somewhat reasonable opinion on many many many topics, found out that libertarianism leads to many of those by easier reasoning. Became an atheist. Read the common know Feynman books somewhat before. (actually had those recommended to me by a physicist, who is a member of a little known religion from the 1844s). Discussed with atheists, learned some rationality stuff. Found OB, read OB. Got a rationalist girlfriend that pointed out the flaws in OB/LW writings, learned to some degree to understand that. Had my brain hacked by someone who claims rationality, and shares many many ideas with me, but got important things very wrong. Left that group, left libertarianism and basically ran out of political labels. Read Harry potter and laughed a lot.

Not all in this order.

The hook point on OB was 'that alien message' which I found over reddit, and tried to understand by reading it three times over a few days. Then I went all awwww and since then I basically read stuff and try to implement it.

The first hookpoint into reasoned thinking seems to have been the lexicon. (They became quite popular here. Its a bit like myth busters without the stunts, and in writing.) But I was already really curious before. Being the youngest of three brothers with a age gap of 6,7 might have created a runaway optimization pressure, because for years I was always the one knowing least. That has changed by now. Same for having bright older friends. What also helped was doing different things with/in different groups of people, and having a inhomogeneous circle of friends. Both age and occupation wise. Its odd how many people seem to know only folks their own age, doing basically the same thing. Sadly no one I learned from took anything from me. And also there was no one to recommend GEB to me at any point. The book is 2 years older than me! My curiosity to understand things lead me pretty far, and I value it much. But there is still a long way to go to WIN

Comment author: Perplexed 21 September 2010 01:19:22AM -1 points [-]

... a member of a little known religion from the 1844s ...

This is a pretty well-informed crowd. You don't need to explain what a libertarian is, you don't need to explain who Feynman was, and most people will know what you are talking about if you mention Bahai. And those who don't know how to use wikipedia.

Comment author: MartinB 21 September 2010 01:29:38AM 1 point [-]

I do not think I explained things, did I? The Feynman books influenced me at a time, when they were new to me, thats why they play a part in my story. If I only heard about them here, then the effect would be far less.

The reason for not mentioning Bahai is because I do not want to spread the name everywhere I go.

Comment author: Mass_Driver 25 November 2010 10:05:53AM 6 points [-]

The first time I explicitly saw myself as someone who cared more about rationality than the people around me was on the playground, in third grade. Like other kids my age, I was fond of playing kickball at recess. We often had arguments over whether a baserunner had been successfully tagged out.

The odd thing was that, even though most people in the group didn't like watching arguing for more than a minute or so (you could tell because people started yelling things like "Shut up" and "Just play" with big scowls on their faces), nobody could resist the temptation to take sides in the argument long enough to end the argument. Yes, people thought that it didn't much matter whether Eddie was out at second, but they also couldn't help but point out that Eddie was obviously safe/out, inevitably prompting a renewed outburst of cries that Eddie was obviously out/safe. Sometimes we argued about whose fault it was that we were arguing so much instead of playing.

I never took sides. At some level, I already cared more about my goal (having fun playing kickball) than I did about tribal politics.

The kickball thing quietly but powerfully framed the way I looked at friendships, dating, school, and pretty much everything else in my little world -- I knew that people could do flabbergastingly pointless things, over and over again, even though there were worthwhile things to be doing.

Various classes were useful eye-openers for me -- 10th grade European history put me in touch with the idea that irrationality had consequences on the global stage, and not just on the playground; freshman college statistics showed me how little of what passes for institutional "science" is actually based on sound empiricism AND sound logic.

It is only within the last year or so that I started identifying primarily as a rationalist. I used to have other prominent identities, but various acts of stupidity have slowly been stripping them away. Four years ago, a respected scholar of modern Jewish ecclesiastical law confidently explained to me that the basis of Jewish law was itself -- he apparently believes, without doubt or regret, that although the system has no external justification whatsoever, Jewish law should still dictate one's morals, habits, priorities, and attitudes. Matching his actions to his philosophy, he managed to delay the advance of gay rights in the Jewish community by about 15 years, and he similarly retards progressive thinking about end-of-life care. Although I really enjoy participating in a wide variety of Jewish activities, I find it hard to share a religion with people like him, and I believe that all religions are well-stocked with similar characters -- after meeting him, I tend to be more concerened with whether people take a rational approach to religion than with whether they have any theological beliefs in common with me.

More recently, a junior at Harvard College attempted to explain to me that the world was only 6,000 years old, and that fossils were planted in the ground by Satan to tempt us. I attempted to explain what carbon-dating was, but had to stop for 20 minutes to teach the kid about the difference between the concept of an element and the concept of an isotope. He brought his evangelist friend over, another Harvard student, because they both thought this "isotope" thing was kind of a cool new idea. So I don't have much faith in higher education these days either...I think it's more important to learn how to assess probabilities, correct biases, and evaluate claims than it is to get a "good education," whatever a vague term like that is supposed to mean.

Comment author: Raw_Power 13 December 2010 05:33:58PM 33 points [-]

This was going to be a Discussion article where I panicked about becoming a Yudowksy fanboy, but I thought it might fit better here. Maybe.

I am extremely embarrassed by what I am going to write, but is has been weighting on my mind, and I was wondering if other Lesswrongers were feeling similarly.

See, the more sequences I read, the more amazed I am by the man's work. I mean, back at the beginning, I used to grudgingly respect the guy. Then, the deeper I delved into it, the more sucked-in I was. It was like finding a goldmine. We had the same "basic wavelength", for lack of a better term. There wasn't the dissonance I usually felt when reading other philosophers or writers. He viewed the world from a perspective very similar to mine, and derived his ethics and morality in much the same way I would. Except... we clearly aren't equals. The sheer volume of his work is staggering. The depth of his insights, and, more importantly, how diverse they are, all the fields he covers... He talks about nearly everything that I have ever thought to be relevant or interesting. And he keeps pouring them out. One article a day, isn't it? And then he has his fanfiction. And his day job on top of all that. Where does he find the energy? Despite the evident flaws that seem to be there to remind us that this is a human being rather than some... supernatural creature, after a while my attitude changed from "hey, this guy is pretty cool" to "[speechless]". I feel this is dangerous. "Admiration is the feeling that is furthest from understanding". But that's exactly it. I feel I cannot comprehend, cannot classify and make a model of Eliezer Yudkowsky in the same way I can make it of most humans. It's just too big. Even supposing a large chunk of his massive periodic output of Deep Thoughts is second hand, it makes me wonder where he had the time to read all that, process it and build something new out of it.

This distresses me. It distresses me that I am starting to unconsciously adopt a heuristic that, by default, I should trust his opinion. On a couple of occasions, he deliberately and declaredly left a flaw in his articles. Which I have been unable to find. It distresses me that he is the first author I read that can truly and completely fool me without me noticing something fishy. It distresses me to have found a Living Philosopher and only be one of the Disciples, like the kids in Plato's Academy and Aristotle's Lyceum. If he keeps this pace up, I don't think I'll be able to formulate anything original in my life: the weight of his work is just too huge even to translate.

There is the relief I felt when I finally discovered something wothwile to read. I had despaired of philosophers, and litterate scinetists, and journalists, and social commentarists. I desaired of revolutions and dreams of the future, and I beleived we would be lucky as a species if we could avoid the major ecological catastrophe that's coming upon us. Everywhere I only saw lofty old people thinking they were the be-all and end-all, postmoderns endlessly talking out of their asses (excuse my Klatchian) and people intellectually walking in circles, pacing without a horizon or a compass. Then I found this guy and the shapes behind the darkness were brought out. The insanity behind most people's decisions was classified, labeled. My own self-delusions were painfully taken apart. Thoughts I had never dared to think, but were nibbling at the back of my mind, were gloriously developed to their ultimate conclusions. Pains I felt when looking at the world (including myslef) for which I had no name were sorted and tamed.

So. I can confidently say that I was a "proto-rationalist" ever since I had memory. That I always asked the difficult questions. Always went for the most complete point of view, analyzing a situation from all angles and perspectives I could think of. Which is the reason I could never believe my enemies were "evil mutants". But I was alone. Utterly alone. By the time I was seventeen, I thought I was the Only Sane Man alive. It was terrifying. I couldn't trust anyone. I could never relax my critical senses. My bullshit-detector was so sensitive most works from the media that weren't fiction were thoroughly unenjoyable.

Then I stumbled upon this place. While now I can detect bullshit much more easily, it affects me a lot less. Because now I know how normal it is. I know why people are like that. This has brought me such a peace of mind.

Another thing that has brought me much peace was the abandonment of the Quest For God. At last I knew why no one, regardless of political leanings or actual observance, seemed to take religion seriously and be consistent with it. And doing away with that pain, with the moral anguish of believing in a god that seemed to have values so different to yours, that was so incomprehensible if you took Him at face value, but so, oh so simple when you treated Him as a piece of fiction meant to hold a group together... Suddenly, I was alone. But the world was vast. Where to begin now, I asked myslef?

Then I found out that we guys could become a community. Join forces against evil. Problem being, most of you guys live in the USA. This is kind of inconvenient. The other problem is that, if I become a militant rationalist, I am certain to have a Sword of Damocles upon my head in Divine Right Absolute Monarchy of a home country. Should I exile myslelf, when there is so much I could do there to raise the sanity waterline?

I am now faced with interesting choices. "May you live Interesting Times" indeed:

Comment author: wallowinmaya 02 June 2011 10:43:09AM 5 points [-]

Brilliant! It's seldom that I can relate to every single line of a comment.

Comment author: gwern 15 December 2010 04:00:22AM 5 points [-]

My story isn't very interesting, sadly.

As a very young child*, at Sunday School I was told that prayer was supposed to be a conversation and not a monologue by just me. After a year or two with no one talking back and no other religious experiences to speak of, I began to wonder if there really was someone at the other end.

A year or two later still, I decided that if there was, I would have heard something by now, and became a full-blown atheist. (Although to avoid jeopardizing Christmas and Communion and Easter, and because it'd probably annoy my family, I told no one.)

Everything else - the labels like 'atheist' or 'theist', discovering science fiction, learning logic, reading tons of scriptures and theology and philosophy and occultism - everything else came later.

* I think around age 4 or 5. Surely not after 7.

Comment author: waveman 17 January 2011 12:18:06AM *  1 point [-]

On one account, our rational brains exist to provide convincing rationalizations for our actions for the benefit of other people. Often the stories we tell ourselves are a lot of cobblers.

E.g. We invaded Iraq to the Iraqui people can be free, or to get rid of the weapons of mass destruction (not because of their oil!).

I will try to tell the true story of my conversion from religion.

I was about 12 years old. My parents were forcing me to be 'confirmed'. As part of this I had to make various affirmations. At that age my brain, incited by various hormones, was waking up from the slumber of childhood and beginning to feel the need for autonomy. My reaction was simple: my parents had the power, through threats and violence, to force me to do what they wanted, but they could not control what I believed. I still remember the moment of 'confirmation' - I said the words but I did not believe them.

From that time on, I thought of myself as an atheist, but I retained a fascination for religion. Some of my best friends are religious to the point of having theology degrees.

It was only when I read Nietzsche that I realized that, like most people who thought of themselves as atheists, I had not really shaken off Christianity. One thing about Christianity that proved hard to shake off was the notion that feelings can be sinful/evil.

A year reading pre- and non- Christian writings has helped to remedy that somewhat. Read Homer and see what a different world we live in post-Christianity.

Comment author: Tripitaka 21 March 2011 02:49:03PM *  1 point [-]

Having been born/brought up in germany, where religion is almost a nontopic, I always read Science Fiction/Fantasy and always felt inclined to rational decisions. In my 12/13th year of school I had an exceptional good philosophy teacher, and found myself to find Utilitarism on some level logical. Again some years later (some before the time of the comment) I finally updated my mind/made the rational conclusion:

I should choose the most efficient path to reduce suffering in the world. I saw only two conclusions, getting really rich or becoming a successful uncorrupted politican. Since I was to lazy, felt not being able to assign relevant probability to reach either of these goals, and did not want to overthrow my other ethical views (dont become a power-hungry-politician or bad capitalist) I did not pursue it further. I started to study mechanical engineering, it gives like, A LOT of money and will enable me to further suffering-reducing technology.

Then I stumbled upon Eliezer Yudkowskis argument: most bang for the buck/euro by accelerating FAI. A better writer than myself wrote:

" I felt my entire ethical system restructuring over the course of about five seconds - a very peculiar feeling, let me tell you."-and lost focus again due to having a completely broken motivation system and psychological problems- I am running on even faultier hardware than most. I am working on both topics now. Around nine months later I discovered HP-MOR via TV-Tropes-recommended FanFics and voila- here I am. Right now I am taking my time to decide wether or not I really assign FAI à la Yudkowski any relevant probability or its just a lazy excuse, and wether its cultish salvatory-aspects do worry me or thats just some kind of bias. Updating ones mind is hard!

Comment author: Nick_Roy 12 July 2011 11:09:10PM 1 point [-]

I resolved my typical adolescent existential crisis (for the time being) in a somewhat atypical fashion, concluding after much deliberation that I ought to pause the crisis until I know what's True and what's not, which might mean pausing it forever.

How can I resolve an existential crisis without knowing what meaning, purpose, value, etc. Truly are? Rationality makes the most persuasive claim to the distillation of Truth, so I am an aspiring rationalist.