Thank you for sharing this. I've long used the image (or metaphor) of the swirl of cream in a cup of coffee for this purpose, but have never expressed the idea as well.
This is a tangent but:
willing to metaphorically drop anvils on our heads
That might be a mistake people make (if not in that particular way*) but, I don't think we have any reason to believe AIXI would do such a thing.
AIXI doesn't do things 'just to find out what would happen'. It's an attempt at a utility maximizer. (Without a reason to believe there's a benefit in doing so, why would it do so? Wireheading might make sense - but anvils? Really? Why?)
*See below.
**Fail to prevent it from falling on it - maybe.
This post is mostly to share this quote that presents a metaphor describing the dance between map and territory (and the key insight of embeddedness) that was new to me, so let me share it first:
This is from chapter 40, "Ice Forming in Fire", of Buddhism Is Not What You Think: Finding Freedom Beyond Beliefs by Steve Hagen. The title of the chapter is from a perhaps less easily relatable metaphor from Dogen that Hagen liberally translates as "What is Reality? An icicle forming in fire".
I like the whirlpool metaphor because it makes clear how it is our minds bringing things into existence by finding useful patterns in the soup of reality and reifying those patterns into more persistent-seeming forms. Our minds readily trick us into thinking our maps, models, and ideas of what reality is like are more solid than they actually are. It's a quick and easy jump from observation to reification and then from reification to detachment of the map from the territory, paying more attention to our beliefs about what reality is than reality itself. And then we're quickly off behaving not much better than AIXI, willing to metaphorically drop anvils on our heads because we fail to realize how we're embedded in reality.