I'd probably say that "growing older" implies accumulating experience. How well you convert that experience into wisdom (= "getting smarter") very much depends on the person (and in particular, on IQ). Some people do an excellent job out of it, others not so much.