Abused children fear being abandoned. Would they fear swapping? I suspect the potential-wall would be lower, at the very least. Also, abusers divide into some that want a child to abuse, and others that abuse an unwanted child. The latter would just disconnect, and I think they make up the vast majority of bad parents.

Yes children could make mistakes (under pressure or otherwise), but they could also recover from mistakes.