One problem I have with the way such thought experiments are phrased is that they often ask "what would you do?" rather than "what's the best thing to do?", which muddles this notion of being more interested in my moral intuitions about the latter than my predictions about the former.

But I realize that people and cultures vary widely in how they interpret phrases like that.