I'm somewhat skeptical of the idea that there isn't a universal morality that even a paperclip maximizer would converge to

You mean you're somewhat convinced that there is a universal morality (that even a paperclip maximizer would converge to)? That sounds like a much less tenable position. I mean,

There's goal system zero / God's utility function / Universal Instrumental Values.

A statement like this needs some support.