The Unabomber manifesto is an incredibly dense piece of prose. I found it hard to get through, but you are correct. Ted lived in mortal fear of the Intelligentsia being in control because he thought that they were all as psychopathic as he. I would fear a bunch of emotionless robots who hated humanity in charge even if they did run everything in as rational a fashion as possible.

It is likely that the educated and intelligent elite will one day in fact control most of the wealth in the world, and by de facto the actual running of the world under nearly impotent governmental cover. I think that this may well be a side-effect of the Singularity, and if a Friendly AI is indeed developed, it may wind up being very much like The Forbin Project (Except that the AI will not need to threaten us, as it will probably be fantastically capable of just manipulating the masses into the behavior it wishes).

As long as basic freedoms are preserved, I could care less if we were governed by a mindless mob, a group of super-geniuses, or ducks pecking at a light board to play tic-tac-toe to cast legislation.