don't tell me that Voldemort couldn't have found indirect ways to inflict a variety of magical effect on Harry the moment he realized his magic couldn't touch him directly.

Experimenting with different ways to use magic indirectly carries a risk, that it's not indirect enough for the effect to trigger. Voldemort might not want to take that risk.