Well, quite a lot aren't aware of the existence of polyamory at all. If they think that a person who's in a sexual relationship with someone would necessarily feel betrayed if they knew that person was also having sex with someone else, they would be likely to consider it immoral even without a religious basis.

Numerically, though, I have no idea.