The concept of switching in itself violates all kinds of fundamental assumptions in physics, so trying to think about it mostly results in nonsense. That's if the switch doesn't actually involve moving A to B and B to A by some path, though; if it does, you naturally pay the relevant costs to maintain conservation laws while switching.