I don't think I was having any trouble distinguishing between "would", "should", and "prefer". Your analysis of my statement is spot on - it's exactly what I was intending to say.

If morality is (rather simplistically) defined as what we "should" do, I ought to be concerned when what I would do and what I should do doesn't line up, if I want to be a moral person.