shakedown.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A community for live music fans with roots in the jam scene. Shakedown Social is run by a team of volunteers (led by @clifff and @sethadam1) and funded by donations.

Administered by:

Server stats:

244
active users

#garymarcus

1 post1 participant0 posts today
Replied in thread

A worthwhile article by Gary Marcus for people interested in LLMs and the limitations of LLMs.

Open the article and search for 'Hanoi'.

The well-known Tower of Hanoi is a puzzle that can be solved by junior programmers, but above 7 floors (disks), LLMs simply crumble under the complexity.

As Marcus says: "AI is not hitting a wall. But LLMs probably are."

@jeridansky

garymarcus.substack.com/p/a-kn
#LLM #AI #Puzzle #TowerOfHanoi #GaryMarcus

Ofcourse @garymarcus was right when he predicted that the top foundation models would encounter diminishing returns and could be in some ways in a dead-end street on the road to "AGI". However current models with current capabilities will still cause a big revolution/disruption. NotebookLM is a good example, that works on basis of Gemini 1.5, not the best model, still the implementation/application made the difference.
#AI #garymarcus #LLM #GoogleGemini #NotebookLM #OpenAI

In 2023, #AI firms collectively spent $50 billion on #Nvidia chips alone. They brought in only $3 billion in revenue.

AI researcher and cognitive scientist #GaryMarcus has said that the industry is dealing with a simple, core problem: #hallucinations make models unreliable; that unreliability makes them non-viable for #corporate use-cases, #AIBubble #GenerativeAI

Here's how investors should navigate the bubble of the #AIBoom
thestreet.com/technology/heres

According to AI expert Gary Marcus, generative AI - the technology that can create realistic content from text, images, or audio - is facing a swift end. Marcus argues that it is based on flawed assumptions and lacks common sense, creativity, and generalization. He warns that it is a dead end that will not lead to human-like intelligence or solve real-world problems.

#GenerativeAI #GaryMarcus #AIcriticism

dezeen.com/2023/08/21/generati

Continued thread

On the other side is a discussion in a recent podcast episode of Ezra Klein's podcast titled "A Skeptical Take on the AI Revolution" where he and "AI expert" Gary Marcus discuss these accuracy and reliability challenges in more detail. I'm still listening to the podcast episode so I haven't heard the whole discussion just yet.

You can find the episode on Pocket Casts here: pca.st/m2vc0n12

You can also find the podcast behind the New York Times paywall here: nytimes.com/2023/01/06/opinion

Pocket CastsA Skeptical Take on the A.I. Revolution - The Ezra Klein ShowThe year 2022 was jam-packed with advances in artificial intelligence, from the release of image generators like DALL-E 2 and text generators like Cicero to a flurry of developments in the self-driving car industry. And then, on November 30, OpenAI released ChatGPT, arguably the smartest, funniest, most humanlike chatbot to date. In the weeks since, ChatGPT has become an internet sensation. If you’ve spent any time on social media recently, you’ve probably seen screenshots of it describing Karl Marx’s theory of surplus value in the style of a Taylor Swift song or explaining how to remove a sandwich from a VCR in the style of the King James Bible. There are hundreds of examples like that. But amid all the hype, I wanted to give voice to skepticism: What is ChatGPT actually doing? Is this system really as “intelligent” as it can sometimes appear? And what are the implications of unleashing this kind of technology at scale? Gary Marcus is an emeritus professor of psychology and neural science at N.Y.U. wh