Do you have a precise definition of "ethical" in mind? Where by "precise" I mean something roughly equivalent to a math paper.
Without such a definition, how will you know the person in question is ethical? With such a definition, how will you guarantee that the person in question meets it, will continue to meet it, etc.? How certain are you such a person exists?
Do you have a precise definition of "ethical" in mind?
No. Don't need one either.
Where by "precise" I mean something roughly equivalent to a math paper.Without such a definition, how will you know the person in question is ethical?
By ordinary standards.. Eg, Einstein was more ethical than von Neuman.
With such a definition, how will you guarantee that the person in question meets it, will continue to meet it, etc.?
Since when did functional duplicates start diverging unaccountably?
How certain are you such a person exists?
I...
The reasoning of most of the people on this site and at MIRI is that to prevent an AI taking over the world and killing us all; we must first create an AI that will take over the world but act according to the wishes of humanity; a benevolent god, for want of a better term. I think this line of thinking is both unlikely to work and ultimately cruel to the FAI in question, for the reasons this article explains:
http://hplusmagazine.com/2012/01/16/my-hostility-towards-the-concept-of-friendly-ai/