This is quibbling over semantics, but I would count "don't let the AI get to the point of existing and having an Internet-connected computer" as a valid defense. Additional defenses after that are likely to be underwhelming, but defense-in-depth is certainly desirable.