which is more than you could say about e.g. symbolic logic; human minds don't run on logic at all

This seems an odd thing to say. I would say that representation learning (the thing that neural nets do) and compositionality (the thing that symbolic logic does) are likely both part of the puzzle?