This occurred to me too, but on second reflection this seems like a special case of the "Selfish Memes" scenario. The meme being "the costs of (marginal) children are not worth the benefits".

For what its worth, I also think wealth-induced population stability is a real possibility.