So the premise, then, is that the institution of Ethics would come tumbling down if it were not the case that ethicists seemed to have special knowledge that the rest of the populace did not?

Yes.

applies equally well to any academic discipline

Other academic disciplines are tested against reality because they make "is" statements. Philosophy is in a middle ground, I suppose.