Now that I think about it, you're right; most fictional magic does act on things that are fundamental concepts in people's minds, rather than on things that are actually fundamental.

I didn't just have fictional magic in mind; concepts like sympathetic magic are widespread, maybe even universal in human culture. Humans seem to have strong innate intuitions about the working of magic.