Yvain comments on Ego syntonic thoughts and values - Less Wrong

53 Post author: Yvain 17 July 2011 08:43PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (53)

You are viewing a single comment's thread. Show more comments above.

Comment author: Yvain 14 July 2011 09:03:25PM *  6 points [-]

I think this is a case where I knew what I meant and so I wrote something that activated the appropriate ideas in my head but was misleading and unable to communicate the appropriate ideas. I've fixed it by changing "guilt" to "social stigma".

Comment author: Wei_Dai 16 July 2011 12:23:36AM *  3 points [-]

Thanks for the clarification. I think I agree with Nesov that conscious goals are not necessarily those that are socially acceptable. It may be that the conscious/subconscious distinction originally had much to do with signalling socially acceptable values, but I think since then our actual consciously held values have been the result of a memetic evolution where fitness is determined by many factors besides just "social acceptability". Otherwise it seems hard to explain why some people endorse utilitarianism, others endorse egoism, still others endorse Christian deontology, and so on, even when they live in the same society.

ETA: One example of such a memetic fitness "factor" is how well the values prescribed by the meme fits with our existing intuitions about what an ethical system ought to look like, which might in turn come from thinking about something that's not necessarily related, such as math. See my Why Do We Engage in Moral Simplification? for a more detailed example of this.