After a comment is retracted, it can be deleted. The "delete" button appears after you reload the page with a retracted comment. "Retraction", by blocking the downvoting, exists to incentivise retaining of the original text where there's already discussion that references it.