Data meshes: a distributed domain-oriented data platform
Thoughtworks Technology Podcast
Thoughtworks
4.5 • 58 Ratings
🗓️ 18 October 2019
⏱️ 32 minutes
🧾️ Download transcript
Summary
Over the years, there have been numerous approaches to data management: from data warehouses and data marts to data lakes — collating data in a central place. Today, we see many failure modes when it comes to building big data platforms, with organizations stuck in building data architectures such as data lakes that never deliver business value.
In our latest episode, we explore the ideas of data meshes, an alternative approach to serve and surface data organizationally. Our regular co-hosts Mike Mason and Neal Ford talk to Ken Collier, Head of Data Science and Engineering at ThoughtWorks, and Zhamak Dehghani, one of our regular co-hosts and also a Principal Consultant, with a focus on distributed systems architecture.
Transcript
Click on a timestamp to play from that location
| 0:00.0 | Hello, everyone, and welcome to the ThoughtWorks podcast. |
| 0:10.0 | My name is Mike Mason. |
| 0:11.5 | And I'm another of your regular host, Neil Ford. |
| 0:14.6 | And we're joined today by two of our colleagues. |
| 0:17.3 | I'll let them introduce themselves. |
| 0:19.1 | I'm Ken Collier. |
| 0:20.2 | I'm the head of data science and data engineering at ThoughtWorks. Hi introduce themselves. I'm Ken Collier. I'm the head of data science |
| 0:21.4 | and data engineering at ThoughtWorks. Hi, everyone. I'm Jamek DeHanee, and I'm a technical principal |
| 0:27.1 | at ThoughtWorks from San Francisco. And of course, you might recognize Shemak as one of the hosts |
| 0:32.6 | of the podcast, but in fact, today we have her as a guest, so we're going to be picking her brains. |
| 0:38.7 | That's right. We're into one of her areas of domain expertise, and so we're going to be talking |
| 0:42.8 | today about data and data architecture, and in particular, the ideas around what's the next |
| 0:49.0 | generation architecture beyond the data lake. So many of you may be familiar with the concept of |
| 0:54.0 | data lake that Martin Fowler writes be familiar with the concept of data lake that |
| 0:54.8 | Martin Fowler writes about in his website, but we've been doing some thinking about what goes |
| 0:59.6 | beyond that, and that's what Ken and Jemacher here to talk about. Thank you for having us. |
| 1:06.4 | So what's the problem we're trying to address here? Well, so data, I'll jump in a little bit because I'm an old guy who goes way back in data. |
| 1:17.0 | Data management and data architectures have largely been a centralized focus. |
| 1:22.6 | So from enterprise data warehousing to even data marts and and Kimball style architectures. |
| 1:31.0 | We've continued to focus on centralizing data. |
| 1:35.3 | In about 2009, James Dixon introduced the concept of Data Lake, which captured everyone's |
| 1:42.5 | attention and got everybody's imagination working, |
... |
Please login to see the full transcript.
Disclaimer: The podcast and artwork embedded on this page are from Thoughtworks, and are the property of its owner and not affiliated with or endorsed by Tapesearch.
Generated transcripts are the property of Thoughtworks and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.
Copyright © Tapesearch 2026.
