Consider trying to design a game that teaches probabilistic reasoning...

Yes, this is very much in line with my own thinking, and the kind of game idea you outlined is something I am strongly considering for my next game.

consider the ways you might mislead someone into learning a caricature of a rationality skill

Very good point. This is where play testing comes in.

I did not understand your "second thoughts" paragraph. Can you provide a specific example.