Hermione obviously has that problem (cf. her speech about House Ravenclaw in ch. 34), but I would have expected Harry to avoid falling into such an obvious trap.

Hermione is less passionate about Ravenclaw than Harry is -- e.g. Hermione in January thinks that she should have gone to Gryffindor. Harry is very clear about wanting to go to Ravenclaw, and belonging to Ravenclaw.

Either way it's clear that it's marked how many points each student gets -- Dumbledore in Hermione's trial mentions she has earned 103 points for Ravenclaw so far, and even in canon it seems to be known who cost them/won them points (e.g. in Harry Potter & the Philosopher's stone, the protagonists are ostracized at some point for costing Gryffindor 50 points each)