You'll notice that the next few sentences of my post address this same idea for fully functional members of different species. But it doesn't technically refute the claim for qualia, only that we're not all equally responsive to the same stimuli.
It is, for example, technically possible (in the broadest sense) that color-blind people experience the same qualia we do, but they are unable to act on them, much in the same way that a friend with ADD might experience the same auditory stimuli I do, but then is too distracted to actually notice or make sense of it.
I note, however, that the physical differences in color-blindness (or different species' eyes) are enough reason to lend little credibility to this idea.
[Cross-posted.]
1. Defining the problem: The inverted spectrum
A. Attempted solutions to the inverted spectrum.
B. The “substitution bias” of solving the “easy problem of consciousness” instead of the “hard problem.”
2. The false intuition of direct awareness
A. Our sense that the existence of raw experience is self-evident doesn’t show that it is true.
B. Experience can’t reveal the error in the intuition that raw experience exists.
C. We can’t capture the ineffable core of raw experience with language because there’s really nothing there.
D. We believe raw experience exists without detecting it.
3. The conceptual economy of qualia nihilism pays off in philosophical progress
4. Relying on the brute force of an intuition is rationally specious.
Against these considerations, the only argument for retaining raw experience in our ontology is the sheer strength of everyone’s belief in its existence. How much weight should we attach to a strong belief whose validity we can't check? None. Beliefs ordinarily earn a presumption of truth from the absence of empirical challenge, but when empirical challenge is impossible in principle, the belief deserves no confidence.