The fact is we as large complex mammals are already locked into a low rate of reproduction, sure given the right evolutionary pressures we could end up like shrews again, but that would take an asteroid strike or nuclear war, the scenario you're thinking of assumes long term evolution within a very long lasting stable society essentially like ours. In those circumstances genes for successful reproduction will spread through the population, but that's largely meaningless - if I have the gene for super attractiveness and manage to have 100 kids with 100 women we're still below replacement rate. The way women maximize their reproduction is by having male kids who are alpha males but in these circumstances an alpha is someone who is good at seduction rather than the old style coercion and multiple wives ownership of old times.

tl;dr the bottleneck for overpopulation is individual women's fertility, and the way women maximize their reproduction is by having high quality sons rather than popping out babies nonstop. So you can still have high reproductive strategies without actual overpopulation.

In any case it's hard to think in these terms, the feeling I have is memetics will always overshadow any purely instinctual drives.