Local minima. Dependencies between genes, other genes, and environment.
It's better to be smarter "other things being equal". But most things involve tradeoffs. The region of genetic/environmental state space where increased encephalization helps, and is likely to occur, may be very small.
"The Planet-of-the-Apes Hypothesis" Revisited --Will Intelligence be a Constant in the Universe?