Anecdata in the form of observations that people working in finance don't seem to lead horrible lives.

Of course there is selection bias present: there are certain narrow career tracks in finance which require high-motivation full-effort workaholic overachievers. People self-select into these career tracks so it's no wonder that they work a lot of hours and don't spend much time sitting on the couch in front of a TV. I wouldn't call their quality of life "low", though, because they chose to do it and because there are side benefits like being able to fly to the Caribbean for a weekend if they feel like it.

Plus finance is a large industry. If you start as a teller and grow to be, say, a bank branch manager, your worklife will probably be quite placid and uneventful.