Okay, that would mean you can't just run the physics backward, but that shouldn't stop the Bayesian method (come up with a prior over histories of Earthlike worlds or some similar class, update on memories, records, etc.) or computationally feasible approximations thereof.