I agree with Eliezer here, but Robin also has a point. I think we should distinguish between the transition away from one position and the transition towards another. Because falsification is relatively easier than confirmation, once the right evidence falls into place, a rationalist should expect to quickly abandon prior beliefs. The problem arises if something else quickly fills the void without being thoroughly tested. I saw a couple high school friends fall into the trap of thinking the opposite of stupidity is intelligence after leaving religion behind.
Beware a slow transition away from old beliefs as much as a sharp transition to new ones.
To break up the awkward silence at the start of a recent Overcoming Bias meetup, I asked everyone present to tell their rationalist origin story - a key event or fact that played a role in their first beginning to aspire to rationality. This worked surprisingly well (and I would recommend it for future meetups).
I think I've already told enough of my own origin story on Overcoming Bias: how I was digging in my parents' yard as a kid and found a tarnished silver amulet inscribed with Bayes's Theorem, and how I wore it to bed that night and dreamed of a woman in white, holding an ancient leather-bound book called Judgment Under Uncertainty: Heuristics and Biases (eds. D. Kahneman, P. Slovic, and A. Tversky, 1982)... but there's no need to go into that again.
So, seriously... how did you originally go down that road?
Added: For some odd reason, many of the commenters here seem to have had a single experience in common - namely, at some point, encountering Overcoming Bias... But I'm especially interested in what it takes to get the transition started - crossing the first divide. This would be very valuable knowledge if it can be generalized. If that did happen at OB, please try to specify what was the crucial "Aha!" insight (down to the specific post if possible).