Harry doesn't know whether whoever framed Hermione knew her closely or not. He knew that her mind was probably tampered with on several different occasions, but that doesn't necessarily mean that the criminal interacted with her on a regular basis, or enough to empathize with her. Otherwise I think he would have considered Quirell as a lead suspect early on.