meta_pixel
Tapesearch Logo
Log in
Invest Like the Best with Patrick O'Shaughnessy

Jeremiah Lowin – Machine Learning in Investing – [Invest Like the Best, EP.105]

Invest Like the Best with Patrick O'Shaughnessy

Colossus

Technology, Business, Investing

4.72.5K Ratings

🗓️ 25 September 2018

⏱️ 59 minutes

🧾️ Download transcript

Summary

My guest this week is one of my best and oldest friends, Jeremiah Lowin. Jeremiah has had a fascinating career, starting with advanced work in statistics before moving into the risk management field in the hedge fund world. Through his career he has studied data, risk, statistics, and machine learning—the last of which is the topic of our conversation today.  He has now left the world of finance to found a company called Prefect, which is a framework for building data infrastructure. Prefect was inspired by observing frictions between data scientists and data engineers, and solves these problems with a functional API for defining and executing data workflows. These problems, while wonky, are ones I can relate to working in quantitative investing—and others that suffer from them out there will be nodding their heads. In full and fair disclosure, both me and my family are investors in Jeremiah’s business. You won’t have to worry about that potential conflict of interest in today’s conversation, though, because our focus is on the deployment of machine learning technologies in the realm of investing. What I love about talking to Jeremiah is that he is an optimist and a skeptic. He loves working with new statistical learning technologies, but often thinks they are overhyped or entirely unsuited to the tasks they are being used for. We get into some deep detail on how tests are set up, the importance of data, and how the minimization of error is a guiding light in machine learning and perhaps all of human learning, too. Let’s dive in. For more episodes go to InvestorFieldGuide.com/podcast. Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag Show Notes 2:06 - (First Question) – What do people need to think about when considering using machine learning tools 3:19 – Types of problems that AI is perfect for 6:09 – Walking through an actual test and understanding the terminology 11:52 – Data in training: training set, test set, validation set 13:55 – The difference between machine learning and classical academic finance modelling 16:09 – What will the future of investing look like using these technologies 19:53 – The concept of stationarity 21:31 – Why you shouldn’t take for granted label formation in tests 24:12 – Ability for a model to shrug 26:13 – Hyper parameter tuning 28:16 – Categories of types of models 30:49 – Idea of a nearest neighbor or K-Means Algorithm 34:48 – Trees as the ultimate utility player in this landscape 38:00 – Features and data sets as the driver of edge in Machine Learning 40:12 – Key considerations when working through time series 42:05 – Pitfalls he has seen when folks try to build predictive market investing models 44:36 – Getting started 46:29 – Looking back at his career, what are some of the frontier vs settled applications of machine learning he has implemented 49:49 – Does intereptability matter in all of this 52:31 – How gradient decent fits into this whole picture     Learn More For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag

Transcript

Click on a timestamp to play from that location

0:00.0

Hello and welcome everyone, I'm Patrick O'Shaughnessy and this is Invest Like The Best.

0:08.6

This show is an open-ended exploration of markets, ideas, methods, stories, and of strategies

0:13.9

that will help you better invest both your time and your money.

0:17.2

You can learn more and stay up to date at InvestorFieldGuide.com.

0:24.6

Patrick O'Shaughnessy is the CEO of O'Shaughnessy Asset Management.

0:28.5

All opinions expressed by Patrick and podcast guests are solely their own opinions and do

0:32.9

not reflect the opinion of O'Shaughnessy Asset Management.

0:36.3

This podcast is for informational purposes only and should not be relied upon as a basis

0:40.6

for investment decisions.

0:42.4

Clients of O'Shaughnessy Asset Management may maintain positions and the securities discussed

0:46.2

in this podcast.

0:49.6

My guess this week is one of my best and oldest friends, Jeremiah Lohan.

0:53.0

Jeremiah has had a fascinating career starting with advanced work and statistics before moving

0:56.9

into risk management in the hedge fund world.

0:59.6

Through his career he has studied data, risk, stats, and machine learning, the last of

1:03.7

which is the topic of our conversation today.

1:06.2

He has now left the world of finance to found a company called Prefect, which is a framework

1:10.0

for building data infrastructure.

1:12.0

Prefect was inspired by observing frictions between data scientists and data engineers

1:15.8

and solves these problems with a functional API for defining and executing data workflows.

1:20.5

These problems while wonky are ones I can relate to working in the quantitative investing

1:24.3

world and others that suffer from them out there will be nodding their heads right now.

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Colossus, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Colossus and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.