What is wrong with learning logic, set theory, and number theory before (or in the context of high school, instead of) calculus?

The thing that's wrong is exactly that it would indeed have to be instead of calculus. And then students would not pass the nationally mandated matriculation exams or university entry exams, which test knowledge of calculus. One part of the system can't change independently from the others. I agree that if you're going to teach just one field of math, then calculus is not the optimal choice.

I do believe that for every field that's taught in highschool, the most important theories and results should be taught: evolution, genetics, cell structure and anatomy in biology; Newtonian mechanics, electromagnetism and relativity in physics (QM probably requires too much math for any high-school program); etc.

There won't be time to prove and fully explain everything that's being shown, because time is limited, and it's better that all the people in our society know about classical mechanics and EM and relativity, than that they know about just one of them but have studied and reproduced enough experiments to demonstrate that that one theory is true compared to all alternatives of similar complexity.

And similarly, I think it would be better if everyone knew about the fundamental results of all the important fields of math, than being able to prove a lot of theorems in a couple of fields on highschool exams but not getting to hear a lot of other fields.