Thank you so much for your comments, Michaël! The post has been updated on most of them. Here are some more specific replies.
1. I don't understand what you mean by "state" in "Suppose, however, that the AI lacked any capacity to press its shutdown button, or to indirectly control its state". Do you include its utility function in its state? Or just the observations he receives from the environment? What context/framework are you using?
Reply: "State" refers to the state of the button, i.e., whether it is in an on state or ... (read more)
This is very clear. Communication link made me understand that it didn't have a direct physical effect on the agent. It you want to make it even more intuitive you could do a diagram, but this explanation is already great!
Thanks for updating the rest of the post and trying to make it more clear!
Thank you so much for your comments, Michaël! The post has been updated on most of them. Here are some more specific replies.
1. I don't understand what you mean by "state" in "Suppose, however, that the AI lacked any capacity to press its shutdown button, or to indirectly control its state". Do you include its utility function in its state? Or just the observations he receives from the environment? What context/framework are you using?
Reply: "State" refers to the state of the button, i.e., whether it is in an on state or ... (read more)