meta_pixel
Tapesearch Logo
Log in
Better Offline

Yep, We're At Peak AI

Better Offline

Cool Zone Media and iHeartPodcasts

Technology

4.6687 Ratings

🗓️ 4 December 2024

⏱️ 20 minutes

🧾️ Download transcript

Summary

In this episode, Ed Zitron discusses big tech's discovery of the diminishing returns in training generative AI models - and how we may have finally have reached peak AI.

---

LINKS: https://www.tinyurl.com/betterofflinelinks

Newsletter: https://www.wheresyoured.at/

Reddit: https://www.reddit.com/r/BetterOffline/ 

Discord: chat.wheresyoured.at

Ed's Socials:

https://twitter.com/edzitron

https://www.instagram.com/edzitron

https://bsky.app/profile/edzitron.com

https://www.threads.net/@edzitron

See omnystudio.com/listener for privacy information.

Transcript

Click on a timestamp to play from that location

0:00.0

This is an I-Heart podcast.

0:02.5

Guaranteed Human

0:03.5

Quarzo Media

0:07.9

Hello and welcome to Better Offline.

0:11.4

I'm your surly yet lovable host, Ed Zittron.

0:31.3

Better Offline. Today I'm on a kick off by reading something I wrote in March 24 and talked about on the episode PKK.

0:36.5

What if what we're seeing today isn't a glimpse of the future, but the new terms of the present?

0:37.9

What if artificial intelligence isn't actually capable of doing much more than what we're seeing today isn't a glimpse of the future, but the new terms of the present? What if artificial intelligence isn't actually capable of doing much more than what we're seeing today? And what if

0:42.6

there's no clear timeline when it will be able to do more? What if this entire hype cycle has been

0:47.0

built on hot air, ghost by a compliant media, ready and willing to take career embellishes at

0:51.6

their word? Reading that back, well, I think I might have been right. And that's kind of what I'm going to get at today. I don't want to scream mustard. I'm not going to get smug about it. But this is what we're getting into today and in the next episode that will come out on Friday. Now I'll be linking to some articles, so check the episode notes if you want to read them, but I'm going to get a lot into the spoken word.

1:28.9

So I warned you in February that Generative AI has no killer apps and had no way of justifying its valuations. I also warned you in March that Generative AI had already peaked, and I pleaded with the tech industry in April to consider an eventuality where the jump between GPD 4, which is the most current model,

1:34.7

well, GPT-4-0, to GPD 5 was not significant, in part due to a lack of training data,

1:36.2

one of the more obvious things.

1:41.6

I shared more concerns in July that the transformer-based architecture underpinning generative AI,

1:45.1

things like Chad GPT, was a dead end, and that there were really not many ways we'd progressed past the products we'd already seen back then, in part due to the

1:49.7

limits of training data, like I mentioned, and the limits of the models that use said training data.

1:54.5

In August, I summarised the pale horses of the AI apocalypse, events, many that have now come to

1:59.9

past, I'm afraid, that would signify the end,

2:02.6

well, being nigh, though it's not quite here yet and it's not obvious when it will be,

2:07.7

but this can't last forever. But I also added that GPT5 would not change the game enough to matter,

2:13.1

let alone add a new architecture to build future and more capable models or products of any

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Cool Zone Media and iHeartPodcasts, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Cool Zone Media and iHeartPodcasts and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.