meta_pixel
Tapesearch Logo
Log in
Talk Python To Me

#207: Parallelizing computation with Dask

Talk Python To Me

Michael Kennedy

Technology

4.8635 Ratings

🗓️ 14 April 2019

⏱️ 58 minutes

🧾️ Download transcript

Summary

What if you could write standard numpy and pandas code but have it run on a distributed computing grid for incredible parallel processing right from Python? How about just splitting it across multiprocessing to escape the limitations of the GIL on your local machine? That's what Dask was built to do.

Transcript

Click on a timestamp to play from that location

0:00.0

What if you could write standard numpy and pandas code, but have it run on a distributed computing

0:04.5

grid for incredible parallel processing right from Python?

0:08.0

How about just splitting the work across multi-processing to escape the limitations of the

0:11.7

gill right on your local machine?

0:13.5

That's what Dask was built to do.

0:15.3

On this episode, you'll meet Matthew Rockland to talk about its origins, use cases, and a whole

0:19.7

bunch of other interesting topics.

0:21.6

This is Talk Python to Me, episode 207, recorded February 20th, 2019.

0:55.2

Welcome to Talk Python to Me, a weekly podcast on Python, the language, the libraries, the ecosystem, and the personalities. This is your host, Michael Kennedy. Follow me on Twitter where I'm at M Kennedy. Keep up with a show and listen to past episodes at TalkPython.fm, and follow the show on Twitter via at Talk Python. Hey folks, a quick announcement before we get to our conversation with Matthew.

1:01.1

People have been enjoying the courses over at Talk Python training for years now. But one

1:05.6

shortcoming we've been looking to address is to give you offline access to your content

1:09.9

while you're traveling or if you're

1:11.5

just in a location with spotty internet speeds. We also want to make taking our courses on your

1:15.6

mobile devices the best they can be. That's why I'm thrilled to tell you about our new apps,

1:20.6

which solve both of these problems at once. Just visit training.tokpython.fm slash apps and download

1:26.0

the Android version right now.

1:27.9

The iOS version is just around the corner. Should be out in a week or so. You'll have access to all

1:32.6

of your existing courses. But we've also added a single tap feature to allow you to join our two

1:38.2

free courses, the Responder Web Framework mini course and the MongoDB quick start course. So log in,

1:45.1

tap the free course,

1:48.9

and you'll be right in there. Please check out the apps and try one of the free courses today.

1:55.1

Now, let's talk Dask with Matthew. Matthew, welcome to talk Python to me. Thanks, Michael. I've listened to the show a lot. It's really an honor to be here. Thank you for having me. It's an honor to have

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Michael Kennedy, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Michael Kennedy and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2025.