I've always felt similarly, and found myself thinking about how plastic we are with our own body sense - we seem to be very capable of remapping our motor functions into completely new devices, cars, video game characters, etc, and gaining a sense of body with them. This seem to be supported by how tied driving is to which part of your body performs the control - for me, going from a hand clutch on a motorcycle to a foot clutch completely failed to translate the skill. I have no idea if this is neurologically correct.