AI is eating up the world's computing memory
Marketplace Tech
Marketplace
4.5 • 1.3K Ratings
🗓️ 13 January 2026
⏱️ 8 minutes
🧾️ Download transcript
Summary
Much like graphics processing units, high bandwidth memory is essential for training and running AI. It's paired with all those NVIDIA chips that have been selling like hotcakes and only a small handful companies in the world make it. Now the surge in demand from data centers has created a global shortage for everything else — the PCs and smartphones and other consumer electronics that also use memory chips. Marketplace’s Meghan McCarty Carino spoke with Tom Mainelli, vice president of device and consumer research at IDC, about how long this shortage could last.
Transcript
Click on a timestamp to play from that location
| 0:00.0 | AI is sucking up all the world's memory. |
| 0:05.0 | From American Public Media, this is Marketplace Tech. |
| 0:08.0 | I'm Megan McCarty Carrino. |
| 0:10.0 | No, I don't mean memory in a metaphysical sense, though that could also be argued. |
| 0:24.4 | I'm talking RAM and other kinds of memory hardware. |
| 0:28.0 | Much like graphics processing units, high bandwidth memory is essential for training and running AI. |
| 0:34.4 | It's paired with all those Nvidia chips that have been selling like hotcakes, |
| 0:38.9 | and only a small handful of companies in the world make it. Now, the surge in demand from data |
| 0:44.5 | centers has created a global shortage for everything else, the PCs and smartphones and other |
| 0:50.7 | consumer electronics that also use memory chips. We spoke with Tom Monelli, |
| 0:55.6 | vice president of device and consumer research at IDC, International Data Corporation. I asked him how |
| 1:02.7 | long this shortage could last. I think one thing that's really important to note is the memory |
| 1:09.1 | industry historically has been kind of a boom and bust |
| 1:12.2 | industry. The memory vendors, they build more capacity. They get into an oversupply situation. |
| 1:19.8 | The industry ramps up to leverage more memory. And then eventually they get in the supply |
| 1:25.2 | constraint. And then they start the whole process again. |
| 1:28.4 | With the AI boom, it's basically a whole new area that is requiring memory. |
| 1:34.3 | And so our best estimate is that this is going to continue to be a problem throughout 2026 and could easily slide into 27, the memory vendors are going to eventually |
| 1:47.9 | build out their capacity. But if you're a memory vendor, this is a very good time to be a memory |
| 1:52.6 | vendor to sell your product for the most money that they can get. And so, you know, the other thing |
| 1:59.3 | that I think is important to note is, |
| 2:01.7 | you know, there's a lot of talk about the AI buildout. There's a lot of talk about whether |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from Marketplace, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of Marketplace and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.

