If it's worth saying, but not worth its own post, then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should start on Monday, and end on Sunday.
4. Unflag the two options "Notify me of new top level comments on this article" and "
How is a AGI supposed to optimize for values that aren't consistent?
Does that mean that the AGI should start doing genetic manipulation that prevents people from being gay? Is that what the person who made the claim means?
I am not saying this is a trivial problem, but it is a separate problem from 'the hidden complexity of wishes' problem.
Well, if the CEV of the anti-gay, pro-genetic manipulation people exceeds the CEV of the pro-gay/anti-genetic manipulation people then I suppose it would, although I'm not sure whether your question means genetic manipulation with or without consent (also, if a g... (read more)