Hello everyone and welcome to the Mindscape podcast. I'm your host Sean Carroll. You know that artificial intelligence is in the news.

We've talked about AI in various different ways here on the podcast, especially over the last couple years, where chat gPT and other large

language models have really become an enormous study of interest to many people

for financial reasons for intellectual

reasons they're becoming everywhere right Google has put them on the first

page of its search results lots of people are using large language models to write texts. You can write

programs using large language models. You can write the syllabus for your college course,

etc. It's clear that this technology is going to have an enormous impact

on how humans behave and live going forward. But there are subtleties. One of the things that I've talked about is the idea that large language models are amazing

because they are able to mimic human speech and behavior, right? They are able to sound enormously human without actually thinking in the same way that human beings do.

Large language models in some sense memorize lots of things. They know a lot of facts about

the world and they're super good at interpolating between things that they know. That includes interpolating different kinds of things that have never

been interpolated before, so they can seem creative. They can do things that have never

been done based on the training data of things that have been done before.

They're less good at going outside of the range of that training data, and one can argue that

the processes by which they come up with their outputs are very different

than what a human being does in actually thinking reasoning about the problem presented to it.

And many people, especially people who are experts in AI,

understand this attitude perfectly well. It's certainly not new with me. It's well known to many people,

but it is denied by other people who are much more

impressed with the progress in large language models and think that we're close to

AGI artificial general intelligence.

...