Are there ‘categorical’ oughts that do not depend on an “If you want X” clause? Naturalists tend to deny this possibility, but perhaps categorical epistemic or moral oughts can be derived from the mathematics of game theory and decision theory, as naturalist Gary Drescher suggests in Good and Real. If so, it may be wise to make sure they are included in friendliness content theory, so that an AI can respect them.

The phrasing "it may be wise to make sure they are included in friendliness content theory" makes it sound wrong to my ear, as if you are brewing some kind of informal eclectic theoretical soup.