And it's not a hard problem at all. It is in fact very simple: when people like something for ideological reasons, they will use the libertarian argument to support its legality, and when they dislike something ideologically, they will invent rationalizations for why the libertarian argument doesn't apply in this particular case.

I would like to point out that the above reads just as well with both instances of the word "libertarian" removed.