In fact, when I was a kid, I would sometimes experience a lot of distress because I felt unable to relegate my breathing to autonomous control once I'd noticed it.

I had a similar experience. Not distress, but a sense of oppression at having to keep on doing this every moment of every day for my whole life. Of course, my attention would eventually leave my breath, but wanting it to would just prolong it.