timtyler comments on Where do selfish values come from? - Less Wrong

27 Post author: Wei_Dai 18 November 2011 11:52PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (57)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 19 November 2011 07:50:28PM 0 points [-]

I don't think multiverse theory works like that. In one universe it will be the 1001th digit, in another it will be the 1002th digit. There is no multiverse theory where some agent is presented with a problem involving the quadrillionth digit of pi in all the universes.

Comment author: endoself 19 November 2011 08:13:09PM *  1 point [-]

Once AIXI is told that the coin flip will be over the quadrillionth digit of pi, all other scenarios contradict its observations, so they are ruled out and the utility conditional on them stops being taken into account.

Comment author: timtyler 20 November 2011 12:34:22AM 0 points [-]

Possibly. If that turns out to be a flaw, then AIXI may need more "adjustment" than just expanding its environment and utility function to include the mulltiverse.

Comment author: endoself 20 November 2011 01:50:02AM 0 points [-]

Possibly.

I'm not sure what you mean. Are you saying that you still ascribe significant probability to AIXI paying the mugger?

Comment author: timtyler 20 November 2011 12:38:55PM 3 points [-]

Uncomputable AIXI being "out-thought" by uncomputable Omega now seems like a fairly hypothetical situation in the first place. I don't pretend to know what would happen - or even if the question is really meaningful.

Comment author: XiXiDu 20 November 2011 01:29:22PM -1 points [-]

Uncomputable AIXI being "out-thought" by uncomputable Omega now seems like a fairly hypothetical situation...

Priceless :-)