Nisan comments on Controlling Constant Programs - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (33)
In fact, one is not able to deduce agent()==1 from that. Doing so would create a contradiction because we would prove
~agent()==2 agent()==2 => world()=100000000000000000000000000 agent()==2
This agent cannot PROVE its own action, except possibly at the maximum proof length, as it would create a contradiction. The algorithm is too unpredictable for that.
An external agent with more understanding COULD prove agent()'s action from this.
Oh, I see. I thought proving things about agent() and deciding what to do could be the same thing, but I was wrong.