Lucius Malfoy claimed to be Imperiused during his time as a Death Eater. That claim needs to have been credible enough that his allies in the Wizengamot could use it to justify voting not to send him to Azkaban. That doesn't mean it has to be very credible, of course. But it had better not have been common knowledge that Imperius only works on weaklings.