I would suspect it is the latter combined with a third factor: your points, so far as I can determine, are (a) models only predict reality if their assumptions are valid, and (b) it's easy to think that your model is good even with the assumptions aren't valid.

Point (a) would be interesting if it weren't trivial.

Point (b) would be interesting if you showed it convincingly.

The ideal post to make these points would, instead of continuing from "If this concept doesn't make perfect sense [...]", demonstrate this phenomenon in several examples detailed enough to eliminate other reasonable hypotheses.