Just a minor thought connected with the orthogonalitythesis: if you claim that any superintelligence will inevitably converge to some true code of morality, then you are also claiming that no measures can be taken by its creators to prevent this convergence. In other words, the superintelligence will be uncontrollable.
Well, yea. Probably a bunch of more complicated techniques it could still use in that case thou. Have some specific ideas, but debating over technicalities of irrelevant counterfactuals is not my idea of fun so I wont mention them.
Just a minor thought connected with the orthogonality thesis: if you claim that any superintelligence will inevitably converge to some true code of morality, then you are also claiming that no measures can be taken by its creators to prevent this convergence. In other words, the superintelligence will be uncontrollable.