Here's a thought: A human who found other humans super-cute would be extremely vulnerable to cuckoldry (broadly defined). So that there might have been some selection pressure in the opposite direction.

Put another way, one can expect familiarity to breed a certain amount of contempt.