On that, I'm pretty sure that the SI would not rush that way. Consider the parable of the dragon. This isn't the story of someone who's willing to cut corners, but of someone who accepts that delays for checking, even delays that cause people to die, are necessary.

Plus, if they develop a clear enough architecture, so one can query what the AI is thinking, then one would be able to see potential future failures while still in testing, without having to have those contingencies actually occur. That will be one of the keys, I think. Make the AI's reasons something that we can follow, even if we couldn't generate those arguments on a reasonable time-frame.