It's socially influenced, but you're being a bit too status-deterministic about it. Take the example of Steelers quarterback Ben Roethlisberger's (probably true but not prosecuted) rape allegation. Beforehand, he was as high-status as a man can get in the United States, and a vast majority of American women who knew who he was would have found him attractive. Afterward, he seems to have regained much of his status among male Steeler fans, but he has the unmistakable tag of "creepy" (to say the least) among women who follow football.