scroll to 4:40 I like his one argument: if we have finite neurons and thus cannot construct an infinite set in our "map" what makes you think that you can make it correspond to a (hypothetical) infinity in the territory?

I don't really see what this argument comes to. The map-territory metaphor is a metaphor; neural structures do not have to literally resemble the structures they have beliefs about. In fact, if they did, then the objection would work for any finite structure that had more members than there are synapses (or whatever) in the brain.