JoshuaZ comments on Tiling Agents for Self-Modifying AI (OPFAI #2) - Less Wrong

55 Post author: Eliezer_Yudkowsky 06 June 2013 08:24PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (260)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaZ 08 June 2013 02:17:29AM 1 point [-]

I don't think this can't happen, since A has proven Con(B), then it can now reason using system B for consistency purposes and get from the fact that B proves Con(A) to get A proving Con(A), which is bad.

Comment author: jsteinhardt 08 June 2013 03:34:03AM 1 point [-]

Thanks for pointing this out. My mathematical logic is rusty.