#521: Red Teaming LLMs and GenAI with PyRIT

Talk Python To Me

Michael Kennedy

Technology

4.8 • 642 Ratings

🗓️ 29 September 2025

⏱️ 63 minutes

🔗️ Recording | iTunes | RSS

🧾️ Download transcript

Summary

English is now an API. Our apps read untrusted text; they follow instructions hidden in plain sight, and sometimes they turn that text into action. If you connect a model to tools or let it read documents from the wild, you have created a brand new attack surface. In this episode, we will make that concrete. We will talk about the attacks teams are seeing in 2025, the defenses that actually work, and how to test those defenses the same way we test code. Our guides are Tori Westerhoff and Roman Lutz from Microsoft. They help lead AI red teaming and build PyRIT, a Python framework the Microsoft AI Red Team uses to pressure test real products. By the end of this hour you will know where the biggest risks live, what you can ship this quarter to reduce them, and how PyRIT can turn security from a one time audit into an everyday engineering practice.

Transcript

Click on a timestamp to play from that location

0:00.0	English is now an API. Our apps read untrusted text. They follow instructions hidden in plain sight,
0:07.3	and sometimes they turn that text into action. If you connect a model to tools and let it read
0:12.7	documents from the wild, you have created a brand new attack surface. In this episode, we will
0:18.0	make that concrete. We'll talk about the attacks teams are seeing in 2025,
0:22.8	the defenses that actually work, and how to test those defenses the same way that we test code.
0:27.8	Our guides are Tori Westerhoff and Roman Lutz from Microsoft.
0:31.5	They help lead AI red teaming and build pirate, a Python framework from the Microsoft AI
0:36.2	Red team. By the end of this hour, you will know where the biggest risks live, what you can ship
0:41.7	this quarter to reduce them, and how pirate can turn security from a one-time audit into
0:47.0	an everyday engineering practice.
0:49.3	This is Talk Python to Me, episode 521, recorded August 27, 2025. Talk Python, Me. Episode 521 recorded August 27th, 2025.
0:55.2	Talk Python to me, yeah, we ready to roll. Upgrading the code. No fear of getting old.
1:02.6	They sink in the air. New frameworks in sight, geeky rap on deck. Quark crew, it's time to
1:08.0	unite. We started in pyramid. Cruise and O'SQaeda. Welcomeathodon, a weekly podcast on Python. This is your host, Michael Kennedy.
1:15.9	Follow me on Massadon, where I'm at M. Kennedy, and follow the podcast using at Talk Python,
1:21.1	both accounts over at Fostodon.org. And keep up with the show and listen to over nine years of
1:26.9	episodes at TalkPython.fm. If you want to be part of our live episodes, you can find the live streams over on YouTube, subscribe to our YouTube channel over at TalkPython.fm slash YouTube, and get notified about upcoming shows. This episode is brought to you by Century. Don't let those errors go and notice. Use Century like we do here at Talk Python.
1:45.9	Sign up at TalkPython.fm slash Sentry.
1:49.1	And it's brought to you by Agency.
1:51.7	Discover Agentic AI with Agency.
1:53.9	Their layer lets agents find, connect, and work together, any stack, anywhere.
1:58.7	Start building the Internet of Agents at Talk at talk python.fm slash agency,
	...

Please login to see the full transcript.

Previous episode | Next episode

Disclaimer: The podcast and artwork embedded on this page are from Michael Kennedy, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Michael Kennedy and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.