aaronde comments on A solvable Newcomb-like problem - part 1 of 3 - Less Wrong

1 Post author: Douglas_Reay 03 December 2012 09:26AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (11)

You are viewing a single comment's thread.

Comment author: aaronde 03 December 2012 07:11:38PM 0 points [-]

If Omega gets it right more than 99% of the time, then why would Alpha take 10-to-1 odds against Omega messing up?

Comment author: Kindly 04 December 2012 02:36:37PM 0 points [-]

Would the problem be different if we changed the Alpha-Omega betting odds so that if Alpha wins 1 in 10000 times (which is still plausible given the data) then Alpha would make a profit?

Comment author: Luke_A_Somers 20 June 2013 09:09:11PM 0 points [-]

Alpha would be running away with it based on the flippers who one-boxed.

Comment author: Douglas_Reay 04 December 2012 09:20:12AM *  0 points [-]

It is a convenient way of representing reputation gain.

Think of Alpha as being the AI society at large, or a reporter detailed to watch and report on Omega, on behalf of the AI society.

So they're not actually doing an explicit bet. Rather it is Omega wanting to improve Omega's reputation at human-prediction within the AI society by doing the experiment. The more Omega does the experiment and makes correct predictions, the higher the others in AI society will rate Omega's expertise. Presumably it is valuable to Omega in some way to have a high reputation for doing this; maybe he wants to sell an algorithm or database, maybe he wants his advice about a human-related problem taken seriously without disclosing his actual source code and evidence - the reason isn't relevant.

From Fred's perspective, when it comes to understanding and planning for Omega's actions, the dynamics of the situation are close enough that, to a first approximation, it is as though Omega had made a bet with some Alpha.

What the odds of that bet are a variable input to the problem, which I shall talk about in part 3, but note for now that this isn't an arbitrage situation where someone else can step in and improve Omega's reputation for him in order to chisel a corner off the odds. The odds for Omega, from the perspective of Omega's knowledge of the situation, will be in Omega's favour of improving Omega's net reputation, else he wouldn't be running the experiment.