This would all be a lot clearer if, in these sorts of discussions, we avoided using the dangling "should".

In other words, don't just say that "X should do Y", say that "X should do Y, in order for some specifiable condition to be fulfilled". That condition could be their preferences, your preferences, CEV's preferences if you believe in such a thing, or whatever. Oh yeah, and "...in order to be moral" is ambiguous and thus doesn't count.