This could get messy quickly though, I could generate infinite karma by giving everyone who upvotes this 5 karma. We probably need a lot of rules.

As it stands, we should assume that nobody's trying to maliciously game karma. Sockpuppetry is already an option for that, so unless we start limiting upvotes somehow there's no reason to fix that problem.