timtyler comments on Decision theory: Why we need to reduce “could”, “would”, “should” - Less Wrong

19 Post author: AnnaSalamon 02 September 2009 09:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 03 September 2009 08:58:39AM 2 points [-]

I think real agents act as though they believe they have free will.

That means that they rate their own decisions to act as determining their actions, and advice from others about how they think they are going to act as being attempts to manipulate them. Another agent encouraging you to behave in a particular way isn't usually evidence you should update on, it's a manipulation attempt - and agents are smart enough to know the difference.

Are there circumstances under which you should update on such evidence? Yes, if the agent is judged to be both knowledgeable and trustworthy - but that is equally true if you employ practically any sensible decision process.

Re: if an agent takes the action that it predicts it will take, it's predictions are true by definition, so any action suffices.

Agents do take the actions they predict they will take - it seems like a matter of fact to me. However, that's not the criteria they use as the basis for making their predictions in the first place. I didn't ever claim it was - such a claim would be very silly.

Comment author: Matt_Simpson 04 September 2009 12:18:47AM 0 points [-]

Agents do take the actions they predict they will take - it seems like a matter of fact to me. However, that's not the criteria they use as the basis for making their predictions in the first place. I didn't ever claim it was - such a claim would be very silly.

Indeed. You originally wrote:

The agent doesn't know what action it is going to take. If it did, it would just take the action - not spend time calculating the consequences of its various possible actions.

You language is somewhat vague here, which is why EY clarified.