That's the society we live in already, Alicorn. Almost all behaviors that could potentially annoy others are unconstrained. You can't call the police to complain that your neighbor's fashion choices disturb you, you can't force the people around you to paint their homes the colors you'd prefer, and you can't force people with accents to be silent in public.

How exactly do you imagine we could make a society in which no one could be annoyed by the behavior of others? We'd have to imprison everyone in a VR world specially tailored for them - and then how would we deal with the people who would be annoyed by being so imprisoned?

"Making the universe be what I want" is not a valid goal for a politics.