"I figure that anyone who wants to paint me as a lunatic already has more than enough source material to misquote. Let them paint and be damned!"

The problem isn't individual nutcases wanting to paint you as a lunatic; their cause would be better served by SitS or other Singularity-related material. It's that people who haven't heard your ideas before- the largest audience numerically, if you publish this in book form- might classify you as a lunatic and then ignore the rest of your work. Einstein, when writing about SR, did not go on about how the classical physicists were making a bunch of stupid mistakes and how his methods were superior to anything Newton ever developed. You have, of course, made far more extreme statements elsewhere (by mainstream standards), but the overall proportion of such material should scale polynomially with the number of readers who reject you as a crackpot.