Does GPT-2 Understand Anything?
Some people have expressed that “GPT-2 doesn’t understand anything about language or reality. It’s just huge statistics.” In at least two senses, this is true. First, GPT-2 has no sensory organs. So when it talks about how things look or sound or feel and gets it right, it is just...
Jan 2, 202037