I don't really know. I'm attracted to women and if I look back most cases of confusing one person for another are cases where a dance Salsa with a woman for 10 minutes and then months later I see the same woman again.

I also use gait patterns for recognition and have sometimes a hard time deciding whether a photo is of a person that I have seen in person if I haven't interacted that much with the person..

As far as attraction goes it's also worth noting that I sometimes do feel emotions that come from having interacted with a person beforehand but it takes me some time to puzzle together where I did meet the person before. The emotional part gets handled by different parts of the brain.