Irrespective of this particular comment, as a rule of thumb outright removing comments that were probably submitted in good faith is harmful from a community standpoint. Among other things, it discourages judicious self-policing among the users, makes approval/disapproval seem more capricious and arbitrary, and is less scalable.

Assuming the goal is a user community-driven site, removal by administrative fiat should be reserved for blatantly disruptive comments: content-free trolling, flooding, &c. If, in your judgement, this comment crossed that line that's fine; but I encourage you to be cautious about policy here and to err on the side of non-intervention.