Nisan comments on Controlling Constant Programs - Less Wrong

25 Post author: Vladimir_Nesov 05 September 2010 01:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Sawin 05 September 2010 08:38:54PM 2 points [-]

In fact, one is not able to deduce agent()==1 from that. Doing so would create a contradiction because we would prove

~agent()==2 agent()==2 => world()=100000000000000000000000000 agent()==2

This agent cannot PROVE its own action, except possibly at the maximum proof length, as it would create a contradiction. The algorithm is too unpredictable for that.

An external agent with more understanding COULD prove agent()'s action from this.

Comment author: Nisan 07 September 2010 03:53:08AM 0 points [-]

Oh, I see. I thought proving things about agent() and deciding what to do could be the same thing, but I was wrong.