I hate when unpopular comments get deleted, and all the replies lose their context. One alternative: a "Retract" button that marks your comment as retracted (maybe changes the text to a lighter color), stops the karma loss, automatically contracts the comment and its replies (like a comment below score threshold does), but doesn't delete the content for those who are curious?

I can think of problems with this proposal, so I'm open to other suggestions as well.