Once you specify where I am, who I am with, what kind of body language the man is using, how big he is, and what he is wearing, further specifying what race he is wouldn't matter that much.

Is that true? Depending on the "where I am" part?

There's only so much you can tell about someone from "what kind of body language the man is using, how big he is, and what he is wearing", after all. In the right racially-segregated society, could it provide valuable additional data?