Thinking that your brain 'should' identify the same RGB values as the same 'colors' in a different context reflects a confusion about what invariant properties of the world the visual system represents as 'color'. ... If there is any 'failure' captured by this illusion it is a failure to understand what a good job the brain does of extracting useful information from the complex pattern of light that falls onto our retinas rather than a failure of the visual system.

Beautiful. Well said.