If we all hold back, wouldn't it be better for all of us?

No. Doing the mating dance well is fun for all concerned. Mutual self sabotage of social skills would leave us all 'settling' for mediocre, ineptly handled relationships.

But knowledge of the outcome should not change our decision (cf. Good and Real - ethics chapter).

I don't think this applies.