Ahem:

So the (physical) conditions of the facility may be almost beside the point (despite the fact that this is what it is most socially acceptable to focus on).

...not to mention the fact that the behavior of persons is arguably not within the scope of "the (physical) conditions of the facility".

In short, the comment contained more than enough hedging to preclude such a retort.