"don't think about it too much" as in "don't think about things you cannot affect". Unless you want to go and convince Eliezer to remove downvoting and leave only upvote and report links like on Hacker News.

This will leave more garbage in the comments of course, I think it's smaller problem than "downvote to disagree", but I have no strong evidence about it.