I think this essay is spot on. Most sadly to me, we see this same confusion between the well-understood method of LLM training and the still-incomprehensible method of LLM execution in the Chomsky op-ed in the NYTimes https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html last year. You'd like to believe Chomsky would think harder about this.
Another amusing way to think about this is as follows: On at least two occasions that I know about we've created "time capsules" with a collection of clues about human culture -- "... (read more)
I think this essay is spot on. Most sadly to me, we see this same confusion between the well-understood method of LLM training and the still-incomprehensible method of LLM execution in the Chomsky op-ed in the NYTimes https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html last year. You'd like to believe Chomsky would think harder about this.
Another amusing way to think about this is as follows: On at least two occasions that I know about we've created "time capsules" with a collection of clues about human culture -- "... (read more)