But IAWYC -- there should be some measure of ‘complexity I care about’ by which music would rank higher than both silence (zero information-theoretical complexity) and white noise (maximum complexity).

How about the measures 'sophistication' or 'logical depth'? Alternately, you could take a Schmidhuber tack and define interestingness as the derivative of compression rate.