I haven't yet encountered a sufficiently precise definition of qualia (or consciousness, for that matter) to be able to say what exactly the confusion is, much less where it's coming from or how it can be destroyed. The hard problem of consciousness is a wrong question, and I suspect that for any given untangling of it, the answer will be trivial.