The original specification of Newcomb's problem had the alien empty box B if he predicted I would use a random number generator. I'm not sure why Eliezer removed that restriction, but he did and that is a big part of what I writing about.
If you already believe that a PHYSICAL random number generator can be built based no quantum processes, and that such a generator can be interfaced with a computer and therefore called by, controlled by, with results read by a computer, then you don't need to bother with the details in the next paragraph. The purpose of the next paragraph is to outline the design of such a quantum random number generator.
Get a beta radiation detector with computer interface. Computer must have appropriate two way interface and appropriate library to control and read the radiation detector. Computer must be set up with radiation detector and a beta radiation source (commercially available.)
First part of computer program runs and reads out average rate at which beta particles are being detected. Beta source is moved far away from detector, and it is verified that detector detects at less than once per 10 seconds, on average. Source is moved slowly towards detector until average detector rate is once per 2 seconds or higher. Source can be moved under computer control to make this all a pre=specified program. I would test this program before hardcoding numbers like 10 s and 2 s and the distance ranges the sample was moved, the point would be to get something where the pulses are slow compared to the computer time resolution, but fast compared to any "background" detection rate from this detector.
Now my program freezes the source in place, and runs a 20 s counter. When the 20 s counter is up, the program records the time of the very next beta particle it sees to whatever resolution the computer offers, but at least 1 ms resolution. The computer looks at the tenths-of-second digit in a decimal representation of the time using any onboard clock you care about. Perhaps it is time since the computer program was turned on in order to make it spedifiably simple. If that tenths of a second digit is even, computer chooses two boxes. If that tenths of a second digit is odd, computer chooses only box B.
I believe for this Alien to predict "my" choice, (my computer programs choice) it must be able to predict details of beta decay of my beta emitting sample. Beta decay is a fairly simple atomic decay process which is well characterized by relatively simple quantum mechanics, but which has as best physicists know, an unpredictable actual time that each beta decay will occur.
Now I don't know why Eliezer eliminated the "Alien empties box if you choose box randomly" but my point here is I can with asymptotically certain probability break the "winning" streak of the alien at predicting what humans will do, as I am able to get other humans to employ this technique. Either that or 1) QM as we know it is wrong or 2) the Alien is cheating, i.e., not doing what EY says he is doing.
Assuming EY got rid of "you lose if you go random" from the Alien's response for a reason, I think he is doing the equivalent of assuming pi = 22/7 exactly or that a square has only 3 sides, or SOME such thing where we are no longer in our universe when considering the problem.
That EY might be coming up with a decision theory that applies only to universes other than our own is not what I think he intends.
Seconding jimrandomh: you seem to be talking about issues that don't matter to decision theory very much. Let me reframe.
My own interest in the topic was sparked by Eliezer's remark about "AIs that know each other's source code". As far as I understand, his interest in decision theory isn't purely academic, it's supposed to be applied to building an AI. So the simplest possible approach is to try "solving decision theory" for deterministic programs that are dropped into various weird setups. It's not even necessary to explicitly disallo...
I have not seen any place to discuss Eliezer Yudkowsky's new paper, titled Timeless Decision Theory, so I decided to create a discussion post. (Have I missed an already existing post or discussion?)