Yes, entropy considerations make recombining comparatively rare. Much like it's more likely for an egg to break than to recombine perfectly. Physical interactions being reversible in principle doesn't mean we should expect to see things reverse themselves all that often. I doubt that we have a substantial disagreement (at least, we don't if I take your reference to be representative of your position.)