The point (and I apologize for not being more explicit about it) is that this binary classification is unsatisfactory not only for prostitution but also for tyranny, which is what the joke was here being used as an analogy to, and that I find Jiro's argument unconvincing for (inter alia) the same reason as I think the man in the joke is incorrect (albeit funny).