Would you kill babies if it was intrinsically the right thing to do?

Probably not.

If not, under what other circumstances would you not do the right thing to do?

Obviously whenever the force of morality on my volition is overcome by the force of other non-moral preferences that go in an opposite direction. (a mere aesthetic preference against baby-killing might suffice, likewise not wanting to go to jail or executed)