As artificial intelligence increasingly becomes part of daily life, both its benefits and its

pitfalls are becoming apparent. Take medical centers. Many of them use an AI-powered tool called

whisper to transcribe patients' interactions with their doctors. But researchers have found that it

sometimes invents text. It's what's known in the industry as hallucinations.

That raises the possibility of errors like misdiagnosis.

Garantz Burke is an Associated Press Global Investigative reporter who's been looking into this.

I first want to give folks an example of what researchers found.

Here's what a speaker said. And after she got the telephone, he began to pray. Simple sentence. But here's what was transcribed.

Then he would, in addition to make sure I didn't catch a cold, he would help me get my shirt, kill me, and I was, he began to pray.

What sorts of other hallucinations have been found?

Yeah, so in talking with more than a dozen engineers and academic researchers,

my co-reporter Hilke Shalman and I found that this particular AI-powered transcription

tool makes things up that can include racial commentary, sometimes even violent rhetoric. And, of course, what we're talking about here, you know, incorrect words regarding medical diagnoses. So that office leads to a lot of

concerns about its use, particularly in really sensitive settings like in hospitals.

We asked OpenAI about this, and here's what they told us. They said, we take this issue

seriously and are continually working to improve the

accuracy of our models, including reducing hallucinations. For Whisper, our usage policies

prohibit use in certain high-stakes decision-making contexts, and our model card for open-source use

includes recommendations against use in high-risk domains. Given those warnings,

why does so many medical centers use this? You know, I think we're at a time when a lot of

healthcare systems are looking to AI and AI agents to do things that human beings do more efficiently

and at scale. There's a lot of talk about the promise

...