Fair enough, I'd like to believe that my libertarian sympathies are based on a lot more than that as well.

I'm sure you've read a lot of Robin Hanson, do you feel he focuses a lot on a deontological justification for libertarian ideas? I also recommend http://www.marginalrevolution.com for learning to see the world through the eyes of thoughtful libertarian economists. Both of these sources are more libertarian than I am, but I find reading them very worthwhile and often convincing. In important respects, even Paul Krugman is more libertarian than most Americans.

I think we'd probably do well to discuss individual policies, which can be done more precisely than overarching political philosophies.