You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Open thread, Oct. 19 - Oct. 25, 2015 - Less Wrong Discussion

3 Post author: MrMind 19 October 2015 06:59AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (198)

You are viewing a single comment's thread. Show more comments above.

Comment author: Houshalter 30 October 2015 05:55:45AM -1 points [-]

Well see my edit to my first comment. I'll paste it here:

After giving it some more thought, I'm not sure voting systems are actually desirable. The whole point of voting is that people can't be trusted to just specify their utility functions. The perfect voting system would be for each person to give a number to each candidate based on how much utility they'd get from them being elected. But that's extremely susceptible to tactical voting.

However with FAI, it's possible we could come up with some way of keeping people honest, or peering into their brains and getting their true value function. That adds a great deal of complexity though. And it requires trusting the AI to do a complex, arbitrary, and subjective task. Which means you must have already solved FAI.

Do you agree that the fairest system would be to combine everyone's utility functions and maximize them? Of course somehow giving everyone equal weight to avoid utility monsters and other issues. I think these issues can be worked out.

If so, do you agree that voting systems are the best compromise when you can't just read people's utility functions? And need to worry about tactical voting? Because that is basically what I was getting at.

If you don't agree to the above, then I don't understand your objection. CEV is about somehow finding the best compromise of all humans' utility functions. About combining them all. All I'm talking about is more concrete methods of doing that.

Comment author: Lumifer 30 October 2015 02:35:35PM 0 points [-]

Do you agree that the fairest system would be to combine everyone's utility functions and maximize them?

No, I do not. I do not think that humans have coherent utility functions. I don't think utilities of different people can be meaningfully combined, too.

I think these issues can be worked out.

Ah, yes, the famous business plan of the underpants gnomes...

If so, do you agree that voting systems are the best compromise when you can't just read people's utility functions?

No, I do not. They might be best given some definitions of "best" and given some conditionals, but they are not always best regardless of anything.

CEV is about somehow finding the best compromise of all humans' utility functions. About combining them all.

What makes you think it is possible?