Stuart_Armstrong comments on Friendly AI ideas needed: how would you ban porn? - Less Wrong

6 Post author: Stuart_Armstrong 17 March 2014 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 31 March 2014 02:32:15PM 3 points [-]

Humans are not ideal rational optimizers of their respective utility functions.

Then why claim that they have one? If humans have intransitive preferences (A>B>C>A), as I often do, then why claim that actually their preferences are secretly transitive but they fail to act on them properly? Nothing we know about the brain points to there being a hidden box with a pristine and pure utility function, that we then implement poorly.