D_Alex comments on Satisficers want to become maximisers - Less Wrong

21 Post author: Stuart_Armstrong 21 October 2011 04:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (67)

You are viewing a single comment's thread. Show more comments above.

Comment author: D_Alex 24 October 2011 08:56:23AM 1 point [-]

Cool example! But your argument relies on certain vagueness in the definitions of "satisficer" and "maximiser", that between:

  • A: an agent "content when it reaches a certain level expected utility"; and
  • B: "simply a maximiser with a bounded utility function"

(These definitions are from the OP).

Looking at the situation you presented: "A" would recognise the situation as having an expected utility as 9, and be content with it (until she loses the coin toss...). "B" would not distinguish between the utility of 9 and the utility of 10. Neither agent would see a need to self-modify.

Your argument treats Sally as (seeing itself) morphing from "A" before the coin toss to "B" after - this, IMO, invalidates your example.