You may be on to something with the "putting things into your body" theory, though I think another piece is that fat% has a fairly clear effect on appearance, while people can be quite athletic without showing it.

People who are fat and sedentary don't look quite like that (e.g. worse posture).