I would not be surprised if the army had some sort of physical standards that the destitute were unlikely to meet.

If this were true it would mostly explain my confusion, although I would still expect that fear of future starvation would push many parents to get their healthy sons to enlist.