Not really, although I imagine his humour would appeal to the same kind of people. He's less confrontational and more whimsical than Kaufman though - most of the reference points I could use would be lost on an American, unfortunately (not intended as an insult), but Herring and his former double-act partner Stewart Lee (who does the same kind of thing but is more cerebral and to my mind more obvious, though still great) are part of a long tradition in British comedy - Peter Cook and Dudley Moore, the Goodies, I'm Sorry I Haven't A Clue, the Palin/Jones team within the Monty Python group...
(I'm rambling now. I'll shut up).
.
.