That's true, and in this context it doesn't seem like Harry was being entirely fair. I liked that line better the first time around, when Harry applied it to how Quirrell used him. He was wrong, but I thought it was interesting that he chose to view it in that light.