his is very different from following wherever someone would have their feelings hurt if you didn't go.

What did you have in mind specifically?

Of course, rationality also involves the use of priors, evidence, and accumulated information over your entire lifetime.

Rationality also involves paradigm shifts, revolutions and inversions. "Use priors" is not, should not be, a call for fundamental conservatism.

You are not merely allowed but required to assign a very low prior, in the range of "bloody ridiculous", to propositions which contradict all your available information, or require some massively complex rationalization to be compatible with all your available information.

One person's complex rationalisation is another's paradigm shift.

Evolution, relativity and quantum physics are paradigm shifts. Some people still aren't aboard with some of them, finding them against "logic", "reason", "common sense", etc. The self-professed rationalist Ayn Rand rejected all three: do you want to be another Ayn Rand?

The conservative incremental paradigm, applied retroactivley, would lead lwrationalists to reject good science. So they kind of don't believe in it as the only paradigm. But they also kind of do, since it is the only paradigm they use when discussing theology., or other things they don't like.