meta_pixel
Tapesearch Logo
Log in
Marketplace Tech

Don’t be surprised by AI chatbots creating fake citations

Marketplace Tech

Marketplace

News, Technology

4.51.3K Ratings

🗓️ 13 April 2023

⏱️ 6 minutes

🧾️ Download transcript

Summary

By now a lot of us are familiar with chatbot “hallucinations” — the tendency of artificial intelligence language models to make stuff up. And lately we’ve been seeing reports of these tools getting creative with bibliography. For instance, last week The Washington Post reported on the case of a law professor whose name showed up in a list of legal scholars accused of sexual harassment. The list was generated by ChatGPT as part of a research project, and the chatbot cited as its source a March 2018 Washington Post article that doesn’t exist. People have taken to calling these fantasy references “hallucitations.” Marketplace’s Meghan McCarty Carino recently spoke with Bethany Edmunds, a teaching professor at Northeastern University, about why this is happening. Edmunds says this kind of result is to be expected.

Transcript

Click on a timestamp to play from that location

0:00.0

Alright, here's another one for your AI vocabulary, hallucitation.

0:07.5

From American Public Media, this is Marketplace Tech, I'm Megan McCarty-Karino.

0:21.4

By now, a lot of us are familiar with chatbot hallucinations, the tendency of these artificial

0:27.5

intelligence language models to make stuff up.

0:31.1

And lately we've been seeing reports of these tools getting creative with bibliography.

0:37.8

For instance, last week, the Washington Post reported on the case of a law professor

0:42.7

whose name showed up in a list of legal scholars accused of sexual harassment that was generated

0:48.8

by chat GPT as part of a research project.

0:53.1

The chatbot cited, as the source of this information, a March 2018 Washington Post article

0:58.9

that doesn't actually exist.

1:01.9

People have taken to calling these fantasy references, hallucitations, and according

1:07.2

to Bethany Edmonds, a teaching professor at Northeastern University, they're kind of

1:11.8

par for the course.

1:12.8

Well, I think the thing to keep in mind is that they were created to generate new text.

1:18.5

And so that is the goal there.

1:19.8

It is not to answer questions, it is not to be factually correct, it is to replicate

1:26.0

language.

1:27.0

And they're doing that really, really well.

1:29.1

But as humans, we actually not just speak, we actually look up information, recall information,

1:34.0

we deduce things from our experiences.

1:37.0

And so that's actually a different concept, right, to be able to go and answer a question.

1:42.1

And so we've used their engines for a long time to actually answer questions, and they

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Marketplace, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Marketplace and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.