this is probably because philosophy is hard and skill at philosophy isn't uniformly correlated with skill at writing.

I would have said it is because philosophy as commonly practised is a relatively simple skill that serves primarily as a carrier signal for social politics and only incidentally to generate insight into the nature of things. (Having exposed myself to altogether too much of the Australian Association of Philosophy conference in the last week may well have contributed to this cynicism.)