I'm a (very old) programmer with a non technical interest in AI, so I'm not sure how much i can contribute, but I do have some thoughts on some of this. It seems to me that the underlying units of intelligence are concepts. How do i define concepts - it has to be in terms of other related concepts. They are the nodes in a connected graph of concepts. Concepts are ultimately 'grounded' on some pattern of sensory input. Abstract concepts are only different in the sense that they do not depend directly on sensory input It seems to me that gaining 'underst... (read more)
"Concepts are ultimately 'grounded' on some pattern of sensory input." – I call that adhesion. Your graph of related concepts gives us relationality. LLMs work off of relationality.
My views on this are based on work I did on computational semantics back in the ancient days. That work was based on cognitive or semantic networks, which was a very common approach at the time.
I'm a (very old) programmer with a non technical interest in AI,
so I'm not sure how much i can contribute,
but I do have some thoughts on some of this.
It seems to me that the underlying units of intelligence are concepts.
How do i define concepts - it has to be in terms of other related concepts.
They are the nodes in a connected graph of concepts.
Concepts are ultimately 'grounded' on some pattern of sensory input.
Abstract concepts are only different in the sense that they do not depend directly on sensory input
It seems to me that gaining 'underst... (read more)