It seems that it would be easier to keep one's identity small the less one deviates from the norms.

Not least because identity isn't just under one's own control — it's also imposed from without by other people. So if person X is unusual in some salient way, other people are likely to end up impressing that fact upon person X, even if person X wants to discount that aspect of their identity.