That is either profound, or it is absurd. I will have to consider it.

I've always assumed that the whole point of decision theory is to give normative guidance to decision makers. But in this case, I guess we have two decision makers to consider - robot and robot designer - operating at different levels of reduction and at different times. To say nothing of any decisions that may or may not be being made by this Omega fellow.

My head aches. Up to now, I have thought that we don't need to think about "meta-decision theory". Now I am not sure.

Mostly we want well-behaved robots - so the moral seems to be to get the robot maker to build a better robot that has a good reputation and can make credible commitments.