Eliezer_Yudkowsky comments on Tiling Agents for Self-Modifying AI (OPFAI #2) - Less Wrong

55 Post author: Eliezer_Yudkowsky 06 June 2013 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (260)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 03 July 2013 04:50:50PM 3 points [-]

I second Wei's question. I can imagine doing logical proofs about how your successor's algorithms operate to try to maximize a utility function relative to a lawfully updated epistemic state, and would consider my current struggle to be how to expand this to a notion of a lawfully approximately updated epistemic state. If you say 'martingale' I have no idea where to enter the problem at all, or where the base statistical guarantees that form part of the martingale would come from. It can't be statistical testing unless the problem is i.i.d. because otherwise every context shift breaks the guarantee.

Comment author: jsteinhardt 04 July 2013 04:14:00AM 2 points [-]

I'm not sure how to parse your last sentence about statistical testing, but does Benja's post and my response help to clarify?

You are aware that not all statistical tests require i.i.d. assumptions, right?