It's an ok hack for someone in the "flawed but honest" crowd, individually. But note that it really doesn't scale to allowing you to deal with corruption (which was one of the problems I assumed in the post you replied to).

Extended to an entire field, this means that you may end up with N papers, all about the same data set, all proposing a different hypothesis that produces a good match on the set, and all of them claiming that their hypothesis was formulated using this procedure. IOW, you end up with unverifiable "trust us, we didn't cheat" claims for each of those hypotheses. Which is not a good basis for arriving at a consensus in the field.

Re AI design, assuming you actually understand what you implemented (as opposed to just blindly copying algorithms from the human brain without understanding what they do), the reason this method would work is that you've successfully extracted the human built-in simplicity prior (and I don't know how good that one is exactly, but it has to be a halfway workable approximation; otherwise humans couldn't model reality at all).