1000% agree with Sutton here. Having worked in AI for over a decade (pre-LLMs), it's clear we need...
1000% agree with Sutton here.
Having worked in AI for over a decade (pre-LLMs), it's clear we need smarter methods for intelligence to truly compound in the way some of us envision it.
To me, Transformers just scratched the surface.
This arc is coming to an end; a new algorithmic paradigm is about to begin. The folks working on it are already quietly building. You just don't hear enough about them today.
Some companies that heavily optimized for this arc will find out the hard way why that was a mistake.
When I hear all the insane claims and AI fear-mongering driving most of the conversation around AI today, I constantly remind myself and others to go back to the science of AI: the algorithms, the foundations, the scientific rigor around measuring intelligence, etc.
If you track research in this space, you already know the science is far from finished. Let's keep building.
Having worked in AI for over a decade (pre-LLMs), it's clear we need smarter methods for intelligence to truly compound in the way some of us envision it.
To me, Transformers just scratched the surface.
This arc is coming to an end; a new algorithmic paradigm is about to begin. The folks working on it are already quietly building. You just don't hear enough about them today.
Some companies that heavily optimized for this arc will find out the hard way why that was a mistake.
When I hear all the insane claims and AI fear-mongering driving most of the conversation around AI today, I constantly remind myself and others to go back to the science of AI: the algorithms, the foundations, the scientific rigor around measuring intelligence, etc.
If you track research in this space, you already know the science is far from finished. Let's keep building.
Richard Sutton@RichardSSutton
Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
💬10🔄1❤️39👀3662📊11