This podcast is sponsored by Google.

Hey folks, I'm Amar, product and design lead at Google DeepMind.

Have you ever wanted to build an app for yourself, your friends,

or finally launched that side project you've been dreaming about?

Now you can bring any idea to life, no coding background required,

with Gemini 3 in Google AI Studio.

It's called vibe coding and we're making it dead simple.

Just describe your app and Gemini will wire up the right models for you so you can

focus on your creative vision.

Head to AI.studio slash build to create your first app.

Today on the AI Daily Brief, why AI Advantage compounds.

Before that in the headlines, AI benchmarks for the real world. The AI Daily Brief is a

daily podcast and video about the most important news and discussions in AI. All right, friends,

quick announcements before we dive in. First of all, thank you to today's sponsors, Gemini, KPMG,

Blitzy, Rovo, and Robots, and

pencils. To get an ad-free version of the show, which is just $3 a month, go to patreon.com slash AI Daily Brief, or you can subscribe directly on Apple Podcasts. If you are interested in sponsoring the show, send us a note at sponsors at AIDailyBief.ai, and newly returned for a test run. Heading into 2026, I want to do some version of an AI newsletter, but I don't want to just repeat what everyone else is doing. So we're experimenting for the next couple of weeks with an evening edition. We're calling Nightdesk. If you go to AIdailybrief.ai, you can click on newsletter to subscribe to updates. But with all that out of the way, let's dive in.

Welcome back to the AI Daily Brief Headlines edition,

all the daily AI news you need in around five minutes.

Regular listeners will know I'm not a super fan of benchmarks,

specifically the way that we use them around new model releases,

for all the reasons that other people complain about benchmarks as well.

Many of them are saturated, meaning the gradations between different models are incredibly small. Many of them can be gamed. Mostly, though, they just don't really exist and operate in the real world that we're using these models in, and so they don't tell us all that much about how those models work in the real world. Lately, however, there has been an effort to try to build evals and benchmarks that are the province of the real world, and one of them, which was introduced by

...