As an aside, the ones who walk away are also moral failures from the pro-specks standpoint. They should be fomenting revolution, not shrugging and leaving.

Absolutely. Unless you're the last person left, your choosing to opt out of the benefits of living in Omelas doesn't actually accomplish anything. The problem lies, therefore, in getting everyone to leave, which is as classic a collective action problem as any, I suppose...