Even in this case, you could have a minority of men who have sex with 100 women very quickly, then die, surrounded by other men who have sex with either 0 or one woman but live for a long time. Women in this scenario all live a long time. Then the average for men will be lower than the average for women.
a minority of men who have sex with 100 women very quickly, then die
Actually, this seems to fit some subset of criminals: make some bold crimes, have a lot of money, be attractive (courageous and rich), have as much sex as possible, and die young (during the next crime, or killed by competition).
From The New York Times:
So how sketchy is the research on human sexual behavior, anyway?