Compare to driving vs. being a passenger in a car driving on a twisty road. I often find the former fun, and the latter decidedly uncomfortable, because the first is a tightly coupled feedback loop and the second is highly varying inputs without much in the way of predictability or control.
"Head-eye" coordination is a thing; the neck muscles and the eye muscles communicate closely, and one would expect that the visual cortex might have access to some of that information as well. Breaking that link will violate expectations on a perceptual level.
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.