So you think that true moral behavior excludes choice? (More generally, once someone chooses their morality, no more choices remain to be made?)
So you think that true moral behavior excludes choice? (More generally, once someone chooses their morality, no more choices remain to be made?)
I think so. What choice is there in the field mathematics? I don't see that mathematicians ever had any choice but to eventually converge at the same answer given the same conjecture. Why would that be different given an objective morality?
I thought that is what the Aumann's agreement theorem states and the core insight of TDT, that rational agents will eventually arrive at the same conclusions and act according...
Just a minor thought connected with the orthogonality thesis: if you claim that any superintelligence will inevitably converge to some true code of morality, then you are also claiming that no measures can be taken by its creators to prevent this convergence. In other words, the superintelligence will be uncontrollable.