I've never got a fully satisfactory answer to this. Basically the natural numbers are (informally) a minimal model of peano arithmetic - you can never have any model "smaller" than them.
And it may be possible to fomarlise this. Take the second order peano axioms. Their model is entirely dependent on the model of set theory.
Let M be a model of set theory. Then I wonder whether there can be models M' and N of set theory, such that: there exists a function mapping every set of M to set in M' that preserves the set theoretic properties. This function is an object in N.
Then the (unique) model of the second order peano axioms in M' must be contained inside the image of model in M. This allows us to give an inclusion relationship between second order peano models in different models of set theory. Then it might be that the standard natural numbers are the unique minimal element in this inclusion relationship. If that's the case, then we can isolate them.
Then it might be that the standard natural numbers are the unique minimal element in this inclusion relationship.
Why would we care about the smallest model? Then, we'd end up doing weird things like rejecting the axiom of choice in order to end up with fewer sets. Set theorists often actually do the opposite.
Building on the very bad Gödel anti-AI argument (computers's are formal and can't prove their own Gödel sentence, hence no AI), it occurred to me that you could make a strong case that humans could never recognise a human Gödel sentence. The argument goes like this:
Now, the more usual way of dealing with human Gödel sentences is to say that humans are inconsistent, but that the inconsistency doesn't blow up our reasoning system because we use something akin to relevance logic.
But, if we do assume humans are consistent (or can become consistent), then it does seem we will never knowingly encounter our own Gödel sentences. As to where this G could hide and we could never find it? My guess would be somewhere in the larger ordinals, up where our understanding starts to get flaky.