meta_pixel
Tapesearch Logo
Log in
The Lawfare Podcast

Lawfare Daily: Elliot Jones on the Importance and Current Limitations of AI Testing

The Lawfare Podcast

The Lawfare Institute

History, Military, International Relations, Government, Constitutional Law, News, International Law, Current Events, Politics, Rule Of Law, Law, Foreign Policy, Diplomacy, National Security, Intelligence, Terrorism

4.76.4K Ratings

🗓️ 30 August 2024

⏱️ 41 minutes

🧾️ Download transcript

Summary

Elliot Jones, a Senior Researcher at the Ada Lovelace Institute, joins Kevin Frazier, Assistant Professor at St. Thomas University College of Law and a Tarbell Fellow at Lawfare, to discuss a report he co-authored on the current state of efforts to test AI systems. The pair break down why evaluations, audits, and related assessments have become a key part of AI regulation. They also analyze why it may take some time for those assessments to be as robust as hoped. 

To receive ad-free podcasts, become a Lawfare Material Supporter at www.patreon.com/lawfare. You can also support Lawfare by making a one-time donation at https://givebutter.com/c/trumptrials.

Support this show http://supporter.acast.com/lawfare.


Hosted on Acast. See acast.com/privacy for more information.

Transcript

Click on a timestamp to play from that location

0:00.0

The following podcast contains advertising.

0:04.0

To access an ad-free version of the Lawfair Podcast,

0:08.0

become a material supporter of Lawfair at Patreon.com slash Lawfair. That's Patreon.com

0:16.4

slash Lawfair. Also check out Lawfair's other podcast offerings, rational security, chatter, lawfare no bull, and the aftermath.

0:30.0

You've stopped someone carrying a large amount of drugs. He's just a teenager. He's

0:39.2

exhausted, scared, not giving you his name, where he's from or where he's going.

0:46.2

He's broken the law, but maybe he really needs your help.

0:50.9

So how'd you get him talking?

0:56.0

If you think you could be a regular or volunteer police constable, such Met careers.

0:58.0

Change needs empathy.

1:00.0

Change needs you.

1:05.0

you. A daring CIA operation threatens chaos in the Kremlin,

1:09.0

but can langly trust the Russian in its center?

1:12.0

Hi, I'm David McClosky, former CIA analyst and the best-selling author of the Times

1:16.4

Thriller of the Year, Damascus Station.

1:18.8

My new novel, Moscow X, is a story about love, loyalty, betrayal, and vengeance amid the shadow war between Washington and Moscow.

1:26.0

Available now in Paperback, e-book, and audio. On one level there's just a generalization problem or a kind of external validity problem of all the tests can do what they need to do.

1:42.2

It can tell you does the system have

1:43.9

stored that knowledge? But translating that's whether the system has stored knowledge or not

1:48.3

into can someone take that knowledge? Can they apply it? Can they use that to create a mass

1:51.9

casualty event?

1:52.8

I just don't think we have that knowledge at all.

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from The Lawfare Institute, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of The Lawfare Institute and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.