I'd hazard a guess it comes down to vitamin D deficiency. Without vitamin D supplementation, which few people do seriously, a society which revolves around staying indoors most of the time would be most problematic for people whose skin is evolved for a significantly higher degree of sunlight, as opposed to white people, whose skin evolved for relatively little and to maximize vitamin D production on what little they do get.