meta_pixel
Tapesearch Logo
Log in
Forbes Daily Briefing

Sometimes You Don’t Want A GPU: Groq Cofounder Explains Whirlwind Deal With Nvidia

Forbes Daily Briefing

Forbes

Business, Tech News, News

4.418 Ratings

🗓️ 14 May 2026

⏱️ 7 minutes

🧾️ Download transcript

Summary

Last winter, Groq cofounder and CEO Jonathan Ross walked into a meeting with Nvidia CEO Jensen Huang with a pitch for the companies’ tech to work together. He now describes the synergy with a logistics analogy: stop building AI data centers as if every workload wants the same hardware. Training is bulk hauling; inference is last-mile delivery. GPUs can do both, but using the 18-wheeler even when you just need a van can be a lot slower. So: Nvidia’s general-purpose GPUs are the big trucks. Groq’s specialized chips—LPUs, or language processing units, designed to run models fast—are the smaller vans. “If you were building out a logistics network for the entire United States, and I told you your two options were all 18-wheelers or just delivery vans, which one would you pick?” Ross said. “The best answer is both.”  Ross wasn’t just pitching a worldview. He wanted Nvidia’s permission to buy around 100,000 Blackwell chips, likely worth billions. Huang grilled him on the technical details, and then the meeting ended.  When Huang called back three days later, Ross expected a discussion about his GPU purchase order. Instead, the Nvidia CEO cut to the chase. “We should probably move really fast,” Ross recalled him saying. Learn more about your ad choices. Visit megaphone.fm/adchoices

Transcript

Click on a timestamp to play from that location

0:00.0

Changes in sexual performance are more common than most people realize, and support doesn't

0:04.0

need to feel awkward.

0:05.9

With MedExpress, everything happens privately online.

0:09.4

Start by completing a short consultation reviewed by UK registered clinicians.

0:13.4

If eligible, treatment is delivered discreetly to your home, with ongoing support whenever

0:17.8

you need it.

0:18.8

You're not alone in this.

0:20.4

Visit Medexpress.com.

0:21.8

dot UK slash podcast to learn more. Security program on spreadsheets, new regulations piling up,

0:28.0

an audit dread. It's time for Vanta. Vanta automate security and compliance, brings evidence

0:34.0

into one place and cuts audit prep by 82%.

0:37.5

Less manual work, clear a visibility, faster deals, zero chaos.

0:42.8

Call it compliance or call it calm clients.

0:46.0

Get it.

0:46.8

Join the 15,000 companies using Vanta to prove trust.

0:50.8

Get started at vanta.com slash calm.

0:54.4

Today on Forbes, sometimes you don't want a GPU.

0:59.1

GROC's co-founder explains whirlwind deal with NVIDIA.

1:03.3

Last winter, GROC co-founder and CEO Jonathan Ross walked into a meeting with

1:09.0

NVIDIA's CEO Jensen Wong with a pitch to stop building

1:13.1

AI data centers as if every workload needs the same hardware. Training is bulk hauling. Inference is

1:20.5

last mile delivery. Inference is essentially the process of using AI rather than training it. GPUs can do both, but using the 18-wheeler

...

Transcript will be available on the free plan in 5 days. Upgrade to see the full transcript now.

Disclaimer: The podcast and artwork embedded on this page are from Forbes, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Forbes and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.