Why Machine Learning Sucks for Predicting Ad Success & What Big Media Layoffs Mean for Marketing
Marketing School - Digital Marketing and Online Marketing Tips
Eric Siu and Neil Patel
4.6 • 1.4K Ratings
🗓️ 12 January 2024
⏱️ 20 minutes
🧾️ Download transcript
Summary
Transcript
Click on a timestamp to play from that location
| 0:00.0 | All right, so we're going to kick this episode off by talking about how and why machine |
| 0:06.5 | learning isn't what you might think it might be in terms of predicting ad campaign |
| 0:12.0 | success. |
| 0:13.0 | So let me explain what that means first and we're going to go through a paper here and |
| 0:15.9 | then Neil now we're going to jump through a couple of different ideas that we have for today's |
| 0:19.1 | topics but basically let's say your Facebook or meta okay let's say your Facebook or Meta, okay, let's say your Google, you have a huge corpus of data and you see a lot of people running billions of ads out there, right? So you haven't a sense for what tends to work and what doesn't. |
| 0:34.0 | Now you would assume that these machine learning algorithms would have, would do a good job of predicting the next campaign success, right? |
| 0:41.0 | And like I would assume the same thing too, |
| 0:44.0 | because you work off of data. |
| 0:45.6 | But here's an interesting thing. |
| 0:47.0 | This paper, and I read part of this paper, |
| 0:49.8 | I won't say I read the whole thing here, |
| 0:51.3 | but Neil, can you see my screen? |
| 0:55.1 | Okay so here's what it says over here for those of you that haven't |
| 0:58.5 | subscribed on YouTube go subscribe on YouTube because we're just gonna get better |
| 1:01.1 | and better there but this this tweet says, fascinating paper, |
| 1:04.8 | it finds that even with access to rich data sets of user level features, |
| 1:09.1 | sophisticated ad engagement, propensity scoring techniques fail failed to approximate the causal lift results of |
| 1:15.3 | RCTs. RCTs just call a test, right? So RCT just means like a test. That's all it means at the end of |
| 1:21.1 | day. Just think of it as an experiment. And in some cases, |
| 1:24.0 | dramatically overestimate them. So this graph over here that those, those of you that are watching right now, |
| 1:30.9 | this just shows like in the RCTs in red so that's the original test right |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from Eric Siu and Neil Patel, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of Eric Siu and Neil Patel and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.

