I've noticed in general that later replies to comments get less votes; it's possibly because fewer people are still reading. Support for this is that your comment on the other thread already has 7 points, and all of this should go to Toby Ord.

Also, in Exhibit B, James Andrix gave an example attacking religion, which likely got him some votes (for attacking the Great Enemy), and since Toby Ord didn't support his argument, this probably stopped him from getting votes, since by so doing, he defended the Enemy, which is treason.