The problem is that the suspicions don't necessarily need to be refuted... only explained. A super-intelligent AI is a bit of a god to human eyes, or at least a demi-god. I've said before that half the point of SIAI is to make sure that we create a god we like, and I wasn't really joking (I'm pretty sure I was quoting someone else as well). Likewise, I'm signed up for cryonics specifically because I don't like death, and would prefer to escape it if possible.
So I couldn't honestly refute either accusation, only admit to them and then either brush it off with "it's my crazy thing, we all have our pet crazy thing, right?" if I don't believe getting into the topic will be fruitful with that particular person, or to explain how this is different from superstition and try to reduce the inferential gap.
I've been having a bit of a back-and-forth with a friend about what appears to be a charisma problem with the SIAI, and was hoping you lovely folks had thoughts on the matter. My friend was going through the Eliezer Q&A videos, specifically Question #7, "What's your advice for Less Wrong readers who want to help save the human race?" He typed up a transcript for Eliezer's answer, and went on to say:
He went on to mention that he really likes Eliezer's writings, and that his issue rests with the verbal skills of SIAI's leadership, not with the quality of their works.
I replied:
I also suggested a couple possible (though rather outlandish) ways to make an organization wildly popular. Specifically, to hire a marketing researcher like Frank Luntz to figure out what talking points would win the hearts and minds of the greatest number of people, or alternately to get major brand loyalties by having a cult figure like Steve Jobs representing the SIAI. Of course, I am stating this much more eloquently than I did in the email.
His reply deserves full posting here (with his permission, of course):
The question is now open. Does SIAI have a PR problem? If so, is it due to finances, lack of talent, or something else? Is there an Eternal September issue with watering down the brand (would you support the SIAI if they started investing heavily in advertising campaigns, or would you get a bit suspicious?)? Should they pay Frank Luntz to figure out what transhumanism terms work best with your average family? My friend and I are dying to know.