My 2 year old would rather be on a leash than be forced to hold hands.

For older child who can unbuckle their leash, try putting the leash on backwards.