the idea that during sleep my mind declines enough to merge into other experiences and I awake into a world I would consider alien, with perfectly consistent memories.

An entity with self-consistent memories is astronomically more likely to be found in a world which matches those memories, than in some mismatched world. The latter has a complexity penalty equal to all the extra mismatched complexity.