meta_pixel
Tapesearch Logo
Log in
Software Engineering Daily

Production-Grade AI Systems with Fred Roma

Software Engineering Daily

Software Engineering Daily

News, Technology, Tech News

4.4662 Ratings

🗓️ 27 January 2026

⏱️ 52 minutes

🧾️ Download transcript

Summary

Engineering teams around the world are building AI-focused applications or integrating AI features into existing products. The AI development ecosystem is maturing, which is accelerating how quickly these applications can be prototyped. However, taking AI applications to production remains a notoriously complex process. Modern AI stacks demand LLMs, embeddings, vector search, observability, new caching layers,

Transcript

Click on a timestamp to play from that location

0:00.0

Engineering teams around the world are building AI-focused applications or integrating AI features into existing products.

0:08.0

The AI development ecosystem is maturing, which is accelerating how quickly these applications can be prototyped.

0:15.0

However, taking AI applications to production remains in a notoriously complex process. Modern AI stacks demand

0:23.2

LLMs, embeddings, vector search, observability, new caching layers, and a constant adaptation

0:29.8

as the landscape shifts week to week. Increasingly, the data layer has become both the foundation

0:36.4

and the bottleneck to AI app productionization.

0:40.3

MongoDB has been expanding beyond its core document database into a full AI-ready database

0:46.3

platform with integrated capabilities for operational data, search, real-time analytics, and AI-powered data retrieval.

0:54.8

The company also recently acquired Voyage AI to provide accurate and cost-effective embedding models

1:01.1

and re-rankers to its users.

1:03.7

Fred Roma is a veteran engineer and is currently the SVPF product and engineering at MongoDB.

1:10.7

He joins the show with Kevin Ball to talk about

1:13.0

the state of AI application development, the role of vector search and re-ranking, schema evolution

1:19.2

and the LLM era, the Voyage AI acquisition, how data platforms must evolve to keep up with AI's

1:26.7

breakneck pace, and more.

1:29.8

Kevin Ball, or K-Ball, is the vice president of engineering at Mento and an independent

1:34.7

coach for engineers and engineering leaders. He co-founded and served as CTO for two companies,

1:40.3

founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through

1:45.4

latent space. Check out the show notes to follow KBall on Twitter or LinkedIn or visit his website,

1:50.8

kball.l. LLC.

2:05.7

Fred! Fred! Fred, welcome to the show.

2:06.9

Hey, Keevina.

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Software Engineering Daily, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Software Engineering Daily and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.