Wei_Dai comments on What's wrong with simplicity of value? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (37)
I think it would be reasonable if Eliezer thinks his own reflective equilibrium involves people leading such "good" lives, but not if he thinks everyone has similar reflective equilibria. I know he draws heavily on the notion of psychological unity of humankind, but it seems insufficient to ensure that people share the same "reflective equilibrium value" as opposed to "evolved motivation", given that people start off with different moral intuitions and the process of reflecting on those intuitions seems more divergent than convergent. Again, for people who already have a strong intuition that morality or their values should be simple, it seems quite plausible that they would end up with "reflective equilibrium value" that is quite simple compared to "Godshatter".
Such an intuition may not survive 1) a better intuitive understanding of how human psychology can make some things seem simple even when they are not, and 2) a better intuitive understanding of how all the usual arguments for Occam's razor apply to facts but not to values.
Why do you believe this? What sorts of examples do you have in mind?
See http://lesswrong.com/r/discussion/lw/49j/why_do_we_engage_in_moral_simplification/