Considering this kind of arbitrary self-consistency is often undesirable, it might be worth it to train yourself to deliberately and publicly reneg on snap judgements. Think of it as a security patch. You may also find that your social status does not take the hit you think it will, even if you leave a long time before announcing you've changed your mind.