In general I think it's better to assign x percent of your money to charity and then spend that money optimally rather than compare literally every thing you do to optimal charity.

I was recently worrying about this argument (the one in the OP) independently, and this (the argument I've quoted from you) seems like the best response. In fact you may have just tipped me towards "have kids."