But if someone says we shouldn't paint someone's house purple without their permission, how do we know which abstract principle to induce?

Here's a humorous illustration of the difficulty of selecting the correct abstract principle.