BBC Sounds, Music, Radio, podcasts.

Hello and welcome to NewsAug for the BBC World Service. We're coming to you live from London.

I'm James Menendez. And we're going to begin today talking about artificial intelligence,

the potential of this technology and its potential

pitfalls. In a few minutes, we'll hear how AI is helping scientists develop a completely new type

of vaccine that may offer protection against entire families of viruses. But we're going to begin

with a warning about the perils of AI from one of the

industry's biggest players, Anthropic. The company, which is poised to list on the US stock

market with a value of a trillion dollars, is calling for the whole industry to consider

slowing down the pace of development while society weighs up the implications of the technology.

Anthropics says its AI models are now writing their own computer code to a level of about 80%.

And if that reaches 100%, well, then humans will lose any oversight of the process.

Jack Clark is one of the firm's co-founders. He's been speaking

exclusively to our business editor, Faisal Islam. Right now, it's like the AI industry has a gas

pedal, but it doesn't have a brake pedal in the car. And what we're saying is we want to do some

of the work required to build that brake pedal, so we in the world have an option. It's not obvious today that

you want to do that, but absolutely, as you say, at some point in the future, you might say,

let's get all of the benefits we can for, say, biology and medical research. And let's take a

pause or take a moment on AI research where we can absorb the societal changes implied by this.

A number of Silicon Valley AI companies are raising tens of billions of dollars,

including yourself, valuations of a trillion dollar plus.

And some argue that these are sort of great narratives that help you sell your kit to the world's biggest companies and walk away with these epic valuations.

...