Vladimir_Nesov comments on The Social Coprocessor Model - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (570)
I think it's unresolved in general. I brought up scope insensitivity as a counter-example to the "Godshatter" argument, or at least a strong form of it which says we should keep all of the values that evolution has handed down to us. It seems likely that we shouldn't, but exactly where to draw the line is unclear to me. Still, to me, desire for high status in some small group seems to be the same kind of "crazy" value as scope insensitivity.
I wasn't talking about CEV, I was mainly talking about what you or I should value, now, as individuals. I'm not sure that positive-sum/zero-sum has much to do with that.
Deciding which psychological drives to keep, and which to abandon, is the same as figuring out full formal preference (assuming you have more expressive power than just keeping/abandoning), so there is no heuristic for doing that simpler than full formal preference. This problem isn't just unresolved, it's almost FAI-complete (preference theory, as opposed to efficient implementation).