This is an I-Heart podcast.

Guaranteed human.

Hello and welcome to Better Offline.

I'm your host and chief romance officer Ed Zittron.

Better Offline. in the last episode in the last episode i dug into the fundamental weaknesses in open ai the supposed leader in

the genital of a i boom and today i'm going to get into a much larger more systemic more

terminal problem and the signs that things

are really, really falling apart. And as ever, I will have links to everything I'm talking about

in the episode notes, so you know I'm not making it up, which one person suggested I did once,

and it bothered me a great deal. But back to the actual stuff. The problems that Open AI is

facing are those faced by the entire

generative AI industry, one's born of their sole focused on the transformer-based architecture

underlying large language models like ChatGPT. Open AI's issues, besides the fact that they're in a

terrible business as discussed in the last episode, is that generative AI, and by extension the model

GPT and the product chat GPT, doesn't really solve complex problems that would justify the

massive cost behind it.

It is these massive intractable challenges that are a result of these models being probabilistic,

meaning that they don't know anything, they're just generating an answer based on maths

and training data, something

that model developers are running out of at an incredible pace. Hallucinations, which occur when

models authoritatively state something that isn't true, or in the case of an image or a video

make something that just looks. Wrong? Well, they're impossible to resolve without new branches

...