Stuart_Armstrong comments on AIXI and Existential Despair - Less Wrong

13 Post author: paulfchristiano 08 December 2011 08:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 09 December 2011 10:48:50AM 2 points [-]

A true AIXI can't model itself at all. A real AIXI variant (such as AIXItl) will not be able to model itself except in the rarest circumstances. Therefore its model of the universe as containing A is not going to be a simple one, because it can't model A's outputs. Therefore it seems that it will always be unable (as you said in another comment) to "recompute its inputs from the environment".

Comment author: paulfchristiano 09 December 2011 05:17:24PM 1 point [-]

I can't model myself (or other humans) at all either, and yet I can still learn a model in which human behavior results from physical law, and make predictions on the basis of that model.