Matt_Simpson comments on Why the beliefs/values dichotomy? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (153)
One possible response here: We could consider simple optimizers like amoeba or Roomba vacuum cleaners as falling into the category: "mind without a clear belief/values distinction"; they definitely do a lot of signal processing and feature extraction and control theory, but they don't really have values. The Roomba would happily sit with wheels lifted off the ground thinking that it was cleaning a nonexistent room.
Isn't this just a case of the values the Roomba was designed to maximize being different from the values it actually maximizes? Consider the following:
i.e. Roombas are program executers, not cleanliness maximizers.
I suppose the counter is that humans don't have a clear belief/values distinction.