A worthwhile article by Gary Marcus for people interested in LLMs and the limitations of LLMs.
Open the article and search for 'Hanoi'.
The well-known Tower of Hanoi is a puzzle that can be solved by junior programmers, but above 7 floors (disks), LLMs simply crumble under the complexity.
As Marcus says: "AI is not hitting a wall. But LLMs probably are."
https://garymarcus.substack.com/p/a-knockout-blow-for-llms
#LLM #AI #Puzzle #TowerOfHanoi #GaryMarcus