Only insofar as the definition of physical is limited to things you can find in books. I wholly reject such a definition.

@ Orthonormal. The conclusion seems to me to come very naturally from the thought experiment, if you allow for its assumptions. But that is what I think is silly, its assumptions. The thought experiment tries to define "all knowledge" in two different and contradictory ways.

If Mary has all knowledge, then there is nothing left for her to learn about red. If upon seeing red she learns something new, then she did not have all knowledge prior to seeing red.

It is their definition of knowledge, which is inconsistent, that leads to the entire thought experiment being silly.