Creutzer comments on The Empty White Room: Surreal Utilities - Less Wrong

11 Post author: linkhyrule5 23 July 2013 08:37AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (124)

You are viewing a single comment's thread.

Comment author: Creutzer 23 July 2013 12:57:46PM 3 points [-]

I liked this post. The white room doesn't really seem to work so well as an intuition pump, but it's good that someone has brought up the idea of using surreal utilities.

Since they lead to these tears, within which tradeoff happens normally, but across which you don't trade, it would be interesting to see if we actually find that. We might want to trade n lives for n+1 lives, but what other sacred values do humans have, and how do they behave?

Comment author: linkhyrule5 23 July 2013 07:09:50PM 0 points [-]

Religion seems to be one, if the Crusades are any indication. Legal liberty, equality... basically anything that someone's sacrificed their life for, that's not itself a means to save lives, is a sacred value by definition.

Comment author: Creutzer 23 July 2013 07:54:37PM 0 points [-]

I feel that sacrificing your own life doesn't really count. If anything, it has to be something that you kill or sacrifice someone else's life for; but the other person's life has to count as a sacred value. It's not clear that outgroup people's lives count as sacred. On the other hand, maybe sending people to war counts as trading the sacred value of life - for what exactly, though?

Legal liberty and equality are a bit hard to actually trade; to the extent that equality is traded, though, it is very routinely exchanged for what one should think are lowest-tier goods, no?

On the other hand, I'm not sure were this leaves. Maybe this mess is just the usual humans not having a proper utility function and has nothing to do with tiers of increasing sacredness in particular.