Harry isn't stupid, he has to realize that getting Hermione and Draco out of the way obviously benefits the defense professor. And Quirrell would know this, and not want to make Harry think he's someone who would ruin an innocent 12-year-old girl's life. Their next conversation is going to be interesting.