A general principle: if you find that a certain premise is just so obvious that you can't reduce it any further, and yet other smart people, exposed to the same background sources, don't agree that it's obvious (or think that it's false)... that's a signal that you haven't yet reduced the premise well enough to rely on it in practical matters.

Qualia are very confusing for people to talk and think about, and so using your intuitions about them as a knock-down argument for any other conclusion is probably ill-advised.