Sweet, there's another Bloggingheads episode with Eliezer.
Bloggingheads: Robert Wright and Eliezer Yudkowsky: Science Saturday: Purposes and Futures
it applies equally well to the "brain" of a washing machine.
That diagram also applies equally well to a thermostat, as I mentioned in a great-great-grandparent comment above.
Sweet, there's another Bloggingheads episode with Eliezer.
Bloggingheads: Robert Wright and Eliezer Yudkowsky: Science Saturday: Purposes and Futures