I think we are in rough agreement, though I think you stated this backwards:

However, intergroup variability is higher than intragroup variability

Actually, and empirically, variability within a group is relatively high and variation between groups rather low. (More technically, group membership explains only a small fraction of the total variance.) And you seem to understand this below, with your estimate that three out of four genes bearing on intelligence will not be closely correlated with race.