I actually agree that fighting the hypothetical is annoying, and that it's easy (both in presenting and in reacting to a hypothetical) to get into a bad discussion state. Here are two reasons it can be difficult to usefully respond to hypotheticals.
1) It's perfectly reasonable to claim that a hypothetical is so divorced from reality, or so incompletely specified that it's not worth the effort to analyze. A physics analogy would be "imagine you could go back in time. how much energy would it take to get to 1983?". Just not complete or useful enough to discuss.
Many moral-intuition hypotheticals, IMO, are of this form: imagine some surface features of a situation. Now, based on the deep structure behind those features (which would take days or years to identify), how would you react?
2) Many hypotheticals are trotted out in a way that feels like (or is) a trap. It's not that you're exploring the world with your conversational partner, it's that you're trying to win an argument by getting them to admit to a contradiction. That's no fun if your partner/adversary isn't into it.
A physics analogy would be "imagine you could go back in time. how much energy would it take to get to 1983?". Just not complete or useful enough to discuss.
The minimum energy required is ~1,000*(Your mass in kilograms + the mass in kilograms of everything coming with you) petajoules, assuming you want to get to 1983 in about three months of subjective time, with a gross of assumptions about the way time works. A minimum of 200 joules per kilogram will get you a subjective arrival time of 1.2 million years. [ETA: Forgot about deceleration. 400 joules for the 1.2 million year mark.]
Hypotheticals are a powerful tool for testing intuitions. However, many people believe that it is problematic a hypothetical does not represent a realistic situation. On the contrary, it is only problematic if it is represented as being realistic when it is not realistic. Realism isn’t required if the aim is simply to show that there is *some* situation where the proposed principle breaks. We may still choose to utilise an imperfect principle, but when we know about the potential for breakage, we are much less likely to be tripped up if we find a situation where the principle is invalid.
It is instructive to look at physics. In physics, we model balls by perfect spherical objects. Nobody believes that a perfectly spherical object exists in real life. However, they provide a baseline theory from which further ideas can be explored. Bumps or ellipticity can be added later. Indeed, they probably *should* be added later. Unless a budding physicist can demonstrate their competence with the simple case, they probably should not be trusted with dealing with the much more complicated real world situation.
If you are doubting a hypothetical, then you haven’t accepted the hypothetical. You can doubt that a hypothetical will have any relevance from outside the hypothetical, but once you step inside the hypothetical you cannot doubt the hypothetical or you never stepped inside in the first place.
This topic has been discussed previously on LessWrong, but a single explanation won't prove compelling to everyone, so it is useful to have different explanations that explain the same topic in a different way.
TimS states similar thoughts in Please Don’t Fight the Hypothetical:
In, The Least Convenient World, Yvain recommends limiting your responses as follows:
You may also want to check out A note on hypotheticals by PhilGoetz