A halfway territory between automated tests and blind hope is to generate routinely produced summaries that can be evaluated easily by a human for correct-feeling.

Agreed. This is especially important for very human-oriented software (graphical programs) and pieces of software (user interfaces), because those are hard to test without an actual human involved.