Which powerful entity simulated by whom are you referring to?
basic idea is that one should ask, at each point in time: What would I do if the reprogrammable parts of my brain were reprogrammed by a superintelligent Master Programmer with the goal of supplying me with a program that would maximize my utility averaged over possible worlds?
If you knew how this entity would program you, don't you already know the correct thing to do?
Surprisingly, Ben Goertzel's (2010) Counterfactual Reprogramming Decision Theory (CRDT) has not been discussed even once on Less Wrong, so I present this discussion post as an opportunity to do so.
Here is Goertzel's abstract:
His first footnote acknowledges some debt to Less Wrong and to Wei Dai in particular:
He also discusses Vladimir Nesov's counterfactual mugging scenario, and attempts to work toward a formalization of CRDT by making use of AIXI and some other stuff.
Thoughts?