My impression was that Eliezer went much farther than that, and claimed that in order to do counterfactual modeling at all, we'd have to create an entire counterfactual world, or else our models won't make sense. This is different from saying, "our brains don't work right, so we've got to watch out for that".