Even without total utilitarianism, increasing the population may be desirable as long as average quality of life isn't lowered. For instance, increasing the amount of R&D can make progress faster, which can benefit everyone. Of course one can also think of dangers and problems that scale with population size, so it's not a trivial question.