Some men will react badly to being turned down for a date. Some women too, but probably more men, so I'll make this gendered. And also because dealing with someone who won't take "no" for an answer is a scarier experience with the asker is a man and the person saying "no" is a woman.

So the man is the person accepting the "no".