Now I want to know why the US is polarized by geography.

Part of this is historical reasons, that is true of nearly all countries (there's a great map that overlays German election results with both the Thirty Years War truce line and the line between East and West Germany).

Also there are reports that this is becoming self-reinforcing, i.e., people moving to regions of the country with similar beliefs to theirs.