This is easily turned into a counterexample to basing moral on God. Say that for what ever reason somebody just hasn't have access to bible/christian teachings. Then the harassers visit this guy. It would still be "If it happened to them, they probably would say, ‘Something about this just ain’t right’". Proposedly later the bible and christian teaching were offered to this guy and he later realises that what the guys did was really really wrong. This is really implausible, it is way earlier that he would suspect that this isn't right and would probably act to stop it. Humans are not that morally clueless without gods. We do not NEED to offload moral judgement to the heavens, we don't turn into such psychopaths for not having access to a bible.
But given the guy would propably "discover" their ethical nature in feeling justified to take action against such attacks and we don''t naturallly come up with good theorethical justifications how things might work out so that something can be bad.
Then the harassers visit this guy. It would still be "If it happened to them, they probably would say, ‘Something about this just ain’t right’".
The claim is that they would not be able to say what.
Link to Blog Post: "Extremism in Thought Experiments is No Vice"
_____
_____
This is a LW discussion post for Yvain's blog posts at Slate Star Codex, as per tog's suggestion:
Scott/Yvain's permission to repost on LW was granted (from facebook):