And as well as the reduction of social abuse via the reduced time spent with jackasses it can be a whole lot easier to tolerate social aggression if it comes from outside what you identify as the most local social hierarchy. If a Hufflepuff is insulted by Draco it may be a minor nuisance but if it was a high status Hufflepuff like Neville bullying them it would probably seriously damage their mental health over time.