My local rationality group assigned this post as reading for our meetup this week, and it generated an interesting discussion.
I'm not an AI or decision theory expert. My only goal here is to argue that some of these claims are poor descriptions of actual human behavior. In particular, I don't think humans have consistent preferences about rare and negative events. I argue this by working backwards from the examples in the discussion on the Axiom of Continuity. I still think this post is valuable in other ways.
Let's look at an example: If you prefer $50 in your pocket to $40, the axiom says that there must be some small such that you
My local rationality group assigned this post as reading for our meetup this week, and it generated an interesting discussion.
I'm not an AI or decision theory expert. My only goal here is to argue that some of these claims are poor descriptions of actual human behavior. In particular, I don't think humans have consistent preferences about rare and negative events. I argue this by working backwards from the examples in the discussion on the Axiom of Continuity. I still think this post is valuable in other ways.
... (read 513 more words →)