Not really. I usually see it used more as "I think you're an idiot, but don't want to bother explaining why, so let's talk about / do something else instead."

I believe the most appropriate corresponding expression is that the disagreement is "swept under the rug".

Yes, but understanding that makes it harder to get annoyed at people.