As per a recent comment this thread is meant to voice contrarian opinions, that is anything this community tends not to agree with. Thus I ask you to post your contrarian views and upvote anything you do not agree with based on personal beliefs. Spam and trolling still needs to be downvoted.
Coherent Extapolated Volition is a bad way of approaching friendliness.
CEV assumes that things can be made coherent. This ignores on how tendensies of pulling in opposite directions play out in practise. This might be a feature and not a bug. The extra polation part is like predicting growth without actual growing. It will lead to another place than natural growth would result with. It also assumes that humans will on the whole cooperate. How should the AI approach conflicts of interest against the constituents? If there is another cold war style scenario does it mean most of the AI power is wasted on being neutral? Or does t... (read more)