I'm having trouble understanding it, could you perhaps just stay away from metaphors and explain your moral reasoning here?

Okay,

• "complaining about a person's vote" can mean two things: Either that I believe "they should have voted differently" or that I believe "they should not have voted at all.".

• Therefore to have the moral right to honestly complain about their vote, I must either believe "everyone should have voted differently" or I must believe "everyone should not have voted at all."

• Since I don't believe society would be better if nobody voted, then the only option I have if I want this moral right to complain is "they should have voted differently".

• And therefore it would be hypocrisy if I likewise hadn't myself gone to vote differently.

Now, the thing you're not getting is that I'm not really judging you. My first comment was about how it bought me the moral right to complain. Someone who really thinks the world would be better if nobody voted is exempt from this particular line of reasoning. Because as you said, non-voting can be a political act too.