Wei_Dai comments on Open Thread: December 2009 - Less Wrong

3 Post author: CannibalSmith 01 December 2009 04:25PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (263)

You are viewing a single comment's thread. Show more comments above.

Comment author: EStokes 18 December 2009 02:43:54PM 3 points [-]

I think it's kinda like inclusive genetic fitness: It's the reason you do things, but you're (usually) not conciously striving for an increased amount of it. So I don't think it could be called a terminal value, as such...

Comment author: Wei_Dai 20 December 2009 08:49:13AM 3 points [-]

I had thought of that, but, if you consider a typical human mind as a whole instead of just the conscious part, it seems clear that it is striving for increased status. The same cannot be said for inclusive fitness, or at least the number of people who do not care about having higher status seems much lower than the number of people who do not care about having more offspring.

I think one of Robin's ideas is that unconscious preferences, not just conscious ones, should matter in ethical considerations. Even if you disagrees with that, how do you tell an FAI how to distinguish between conscious preferences and unconscious ones?