I've played various musical instruments for nearly 40 years now, but some simple things remain beyond my grasp. Most frustrating is sight reading while playing piano. Though I've tried for years, I can't read bass and treble clef at the same time. To sight-read piano music, when you see this:
you need your right hand to read it as C D E F, but your left hand to read it as E F G A. To this day, I can't do it, and I can only learn piano music by learning the treble and bass clef parts separately to the point where I don't rely on the score for more than reminders, then playing them together.
Transposing is also approximately impossible for me. The musical scale is drawn as a linear scale, but it isn't linear. There are missing steps between B and C and between E and F; B# = C and E# = F [1]. So C D E F, transposed into the key of B, becomes B C# D# E [2]. Transposing music that uses notes outside the scale is significantly worse. The only way I can transpose (badly) is to not look at the music and not think about the names of the notes.
I've blamed myself for lacking some ability that would enable me to do these things. But my conversations with (a few) people who can do these things have been peculiar. They don't have any suggestions for my problem, because they never saw them as problems in the first place. When I talked about the inconsistency of trying to use separate notations for the left and right hand, they stared at me uncomprehendingly. The idea that notations should be consistent seemed never to have occurred to them.
So I've decided to blame them instead. The problem is that my mind is too highly trained.
No, seriously. I realize this is probably an unhelpful, self-defeating attitude. But is it correct?
It seems to me that if you're in the habit of working with things on linear scales, that's going to be a hindrance when you try to transpose music. Your brain latches onto the notes marked on the score and automatically constructs an internal representation that is wrong. Likewise, if you're in the habit of looking for consistent interpretations of data and compressing what you observe, your mind will keep trying to reduce the two clef notations down to one.
The system of sharps and flats is efficient in some ways; you just have to remember the order they always occur in, plus one number per scale (the number of sharps and flats), to construct that scale. You organize the music into concepts like "scale" and "chord", and map those into new keys. It's great if you're playing scales and simple chords, and if your music sticks to a few basic keys plus their minors. But it sucks when you move beyond that.
The notations developed for music work best if you don't aggressively systematize data, so that you can instead learn an orders-of-magnitude-less-efficient mechanism for memorizing note-to-note mappings for every note and every pair of keys [3], and so that your brain doesn't try to let your left know what your right hand is doing.
(A) If you can transpose music on the fly, have you got the note-to-note mappings memorized? Can you say without thinking what B flat is when transposed from the key of F to the key of C? Of A flat?
(B) Do you think this is plausible--that a very general ability or learned skill can make it more difficult to learn some things, either in this particular example, or in general?
(C) If so, are there any natural systems (not notations devised by humans) which are harder to work with for people with more mental talent or training? Idiot savants come to mind.
(D) Is part of the perceived gulf between art and science due to artists developing notations, theories, and conventions that make art more difficult for scientists?
[1] Yes, I know they're not really equal in most historical intonations, blah blah etc.
[2] Yes, I know you musicians think that's easy. That's because you're saying "scale" and "key of B" and constructing a new scale in that key, which is a pretty efficient representation for scales and simple chords, but gets messy for music going beyond that.
[3] Or mapping the pattern being played into some scale or chord or other construct, translating that into the new key, and recreating it in that key. That seems unlikely, or to require forming concepts for most of the 220+495 possible 3 and 4-note "chords", since even with simple church music musicians often can't say what chord is being played. (komponisto has an explanation for that, saying that what is being played is not chords, but temporal sequences moving between chords. But most musicians don't think of harmony that way.)
Good post and I'll chime in if you don't mind. I teach this stuff for a living and even highly skilled musicians struggle with it in various ways (myself emphatically included).
The main thing I want to say is that there's a reason why essentially all music education consists of many years of rote learning. Obviously, that rote learning works better if it's guided in appropriate directions, but I really don't know of any alternative to what you describe when you say "an orders-of-magnitude-less-efficient mechanism for memorizing note-to-note mappings for every note and every pair of keys." I hate to say it, but ... yep. [EDIT: eh, let me qualify that a bit. See point (A) below.]
Sight-transposition (i.e. sight-reading plus on-the-fly transposition) is a ninja-level skill. Some instrumentalists (usually those who play non-concert-pitch instruments) can do it reasonably well for at least some transposition intervals, and a few people like professional vocal accompanists and church organists need to be able to do it fluently as an expected part of their job. But outside of those folks, even professional musicians rarely have that facility.
Here's something that directly supports your point at (D). As you know, pitch intervals in tonal theory are given names that break arithmetic—a second plus a fourth is a fifth, even though 2+4≠5. A certain well-known music theorist often expresses the view that this blatantly illogical convention is almost entirely responsible for the popular perception that music theory is a really, really difficult subject. I think this exaggerates things, but he's got a point. However, most musicians know those interval names really well and have never thought much about how stupid they are, and so then high-level music theory becomes opaque to skilled musicians because we start by renaming intervals correctly (i.e. a second is diatonic interval 1, and you can add them like normal numbers).
In the case of the frustrating conventions of staff notation, there are historical reasons going back a millennium why we write pitches like that. Various reforms have been proposed, but path-dependency basically makes it impossible that any of them would ever be adopted. Far more likely (and well underway for decades now) is that musicians will stop using notation altogether.
Just to briefly answer your other questions with my personal views:
(A) Personally yes, I have all the note-to-note mappings memorized. I do this completely via thinking in scale degrees. I can name any scale degree in any key, so questions like the one you mentioned just revolve around thinking "B-flat is scale-degree 4 in F major. What's scale-degree 4 in C or A-flat?"
(B) Yes, I do think this is plausible, and underappreciated in the specific case of music, since most musicians don't think much about the ways in which notation isn't an optimized system.
(C) Maybe this is too glib, but ... social interaction? "Overthinking it" isn't a path to doing well in social settings. For that matter, natural language might be another. In many respects it's best learned by rote (along with some theory—just like music) but I've certainly had classmates in language courses who get too hung up on the illogic of grammar to progress well in basic skills like speaking and listening comprehension.
I know very little about this, but I have noticed guitar tabs, ocarina fingering guides, mouth harp tabs with simple numbers exist.