phenotypic differences in IQ between groups are not caused by direct genetic effects on IQ ('direct' because of indirect effects like genetic effects on skin color which elicits discrimination, etc).

This in itself does not use the mal-formed concept of "race". I have no problem with assessing genetic influences on intelligence.

Famously anti-racist psychologists like James Flynn and Richard Nisbett disagree, and make claims about race and intelligence fairly frequently ... Are they misusing words?

No, they're privileging the hypothesis