If you take all the branches and run them backward, their branches will cohere instead of decohering, cancel out in most places, and miraculously produce only the larger, more coherent blobs of amplitude they started from.

And the beings in them will only have memories of further-cohered (further "pastward") events, just as if you didn't run anything backwards.