In practice it doesn't happen all that often and there is a trivial workaround -- start a new (sub)thread quoting the downvoted post and indicate you want to continue talking...

Avoiding the karma toll is a recipe for being downvoted, and doing it enough to attract moderator attention is unwise.