This is a place to talk about hobbies that teach rationality lessons. I'll start with a few:
Programming - Lets you practice math and logic, and gain an intuitive understanding of computation. Also teaches that sometimes you can't argue with reality, but you can fix it. (Also suggested recently by ciphergoth.)
Cryptography - That is, designing/breaking cryptosystems and security protocols. Lets you practice math, logic, and probability theory. Also teaches that almost all human ideas are wrong. After doing this for a while, whenever you encounter a new idea (including your own), you'll instinctively think "If I can't find anything wrong with this, it's probably because I'm not smart or knowledgeable enough or haven't tried hard enough."
Science fiction - Reduces status quo bias and gives interesting insights. Also teaches that the way a society is organized depends a lot on the set of technologies it has access to, so if you don't like how your society works, one lever you have is to change that set.
Video games - Teaches that conventional "success" in life is not much less arbitrary than "winning" in a video game. They're both fine for a diversion, but there are more interesting goals to pursue.
A couple others I've seen suggested in recent comments:
Chess - According to JGWeissman, it "teaches you to carefully consider the consequences of your available actions and choose the action with the best consequences". (I've only played a few games of Chinese Chess, and for me, the lesson was that I don't like competition, and I should look for things to do that nobody else is doing.)
Poker - Lets you practice statistics and overcoming emotional biases.
Yes, and game design also provides some very good examples where people not thinking broadly enough can lead to serious problems. One good example of this is Dungeons and Dragons 3.0, where the play testing occurred with characters all playing as certain archetypes (the fighters hit, the wizards throw fireballs, the clerics healed in combat). As a result, no one noticed that minimal amounts of tactical sense could make the wizards and clerics massively outshine the other classes.