I never thought of it this way, but you are a counter-example - your values diverge from mine far more than those of liberals, conservatives and libertarians will, yet you still don't get downvoted to oblivion.

However, this is mitigated by the fact that I don't think everybody here believes you sincerely want to maximize the number of paperclips (sorry for breaking this difficult truth to you).