I think if you look at the original source for that phrase it reflects the double-edged sword concerns raised by this comment:

Fiat justitia ruat caelum is a Latin legal phrase, meaning "May justice be done though the heavens fall." The maxim signifies the belief that justice must be realized regardless of consequences.

...

In De Ira (On Anger), Book I, Chapter XVIII, Seneca tells of Gnaeus Piso, a Roman governor and lawmaker, when he was angry, ordering the execution of a soldier who had returned from leave of absence without his comrade, on the ground that if the man did not produce his companion, he had killed him. As the condemned man was presenting his neck to the executioner's sword, there suddenly appeared the very comrade who was supposed to have been murdered. The centurion in charge of the execution halted the proceedings and led the condemned man back to Piso, expecting a reprieve. But Piso mounted the tribunal in a rage, and ordered three soldiers to be led to execution. He ordered the death of the man who was to have been executed, because the sentence had already been passed; he also ordered the death of the centurion who was charged with the original execution, for failing to perform his duty; finally, he ordered the death of the man who had been supposed to have been murdered, because he had been the cause of death of two innocent men.

In subsequent retellings of this legend, this principle became known as “Piso’s justice”, which is when sentences made or carried out of retaliation intentions are technically correct, but morally wrong, as could be a negative interpretation of the meaning for Fiat justitita ruat caelum.