meta_pixel
Tapesearch Logo
Log in
TechCheck

TechCheck+ Are AI advancements already slowing down? 12/11/24

TechCheck

CNBC

Management, Cnbc, Tech, Faang, Investing, Business, Disruptors, Technology

4.566 Ratings

🗓️ 11 December 2024

⏱️ 13 minutes

🧾️ Download transcript

Summary

Generative AI has developed so quickly in the past two years, massive breakthroughs seemed more a question of “when” rather than “if.” But in recent weeks, Silicon Valley has become increasingly concerned that advancements are slowing. One early indication is the lack of progress between models released by the biggest players in the space. OpenAI is reportedly facing a significantly smaller increase in quality for its next model GPT-5, while Anthropic has delayed the release of its most powerful model Opus, according to wording that was removed from its website. Even at tech giant Google, its upcoming version of Gemini is reportedly not living up to internal expectations. If progress is plateauing, it would call into question a core assumption that Silicon Valley has treated as religion: scaling laws. The idea is that adding more computing power and more data guarantees better models to an infinite degree. But those recent developments suggest they may be more theory than law. The key problem could be that AI companies are running out of data to train models on, hitting what experts call the “data wall.” Instead, they’re turning to synthetic data, or AI-generated data. CNBC’s Deirdre Bosa explores whether AI progress is slowing, and what it means for the industry. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

Transcript

Click on a timestamp to play from that location

0:00.0

AI breakthroughs have been a question of when, not if.

0:03.2

Google unveiling long-awaited new details about its large language model, Gemini.

0:08.8

Claude 3, it is arguably now one of the most powerful AI models out there, if not the most powerful.

0:15.4

Preview, if you will, for us, chat GPT 5.

0:18.4

I expect it to be a significant leap forward.

0:21.4

But what if that core assumption that models can only keep getting bigger and better is now fizzling?

0:27.7

Is there really a slowing in progress because that wasn't expected?

0:33.1

It could spell cracks in the Nvidia Bull story.

0:35.0

We're increasing GPUs at the same rate, but we're not getting the intelligence improvements

0:40.9

out of it.

0:41.8

Calling into question, the gigantic ramp in spending from Amazon, Google, Microsoft.

0:47.0

A rush for tangible use cases and a killer app.

0:50.7

I'm Deirda Drabosa with a tech check take.

0:53.3

Has AI progress peaked?

0:55.0

Call it performance

1:08.0

The growing concern in Silicon Valley that AI's rapid progression is losing steam.

1:13.6

We've really slowed down in terms of the amount of improvement.

1:16.6

Reached a ceiling and is now slowing down.

1:19.6

In the pure model competition, the question is when do we start seeing an asymptote to scale?

1:26.6

Hitting walls that even the biggest players from Open AI to Google can't seem to overcome.

1:32.3

Progress didn't come cheap, billions of dollars invested to keep pace banking on the idea

1:37.3

that returns they would be outsized too. But no gold rush is guaranteed to last and early

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from CNBC, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of CNBC and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.