I think this is mostly a function of the subculture to which you belong and, specifically, which things you find interesting, exciting, important, etc. IQ, of course, is a major underlying factor, but it's not just IQ.

Each subculture also has its own social rituals and implicit communication methods so when you cross over to a different one you are very likely to have conversation difficulties -- unless your social skills are highly developed and you have some idea about how that subculture works.