Quoting from Wikipedia because I have no real expertise on decision theory:

Note that a superrational player playing against a game-theoretic rational player will defect, since the strategy only assumes that the superrational players will agree. A superrational player playing against a player of uncertain superrationality will sometimes defect and sometimes cooperate.

How exactly does superrationality differ from membership in the Club Of Always Colluding With Each Other?