As in we can't develop models of possible worlds in which mathematics works differently.

Or we can't develop models of mathematically possible worlds where maths works differently. Or maybe we can, since we can image the AoC being either true or false Actually, it is easier for realists to imagine maths being different in different possible worlds, since, for realists, the existence of numbers makes an epistemic difference. For them, some maths that is formally valid (deducable from axioms) might be transcendentally incorrect (eg, the AoC was assumed but is actually false in Plato's Heaven).