meta_pixel
Tapesearch Logo
Log in
Patrick Boyle On Finance

What Is The Replication Crisis?

Patrick Boyle On Finance

Patrick Boyle

Investing, Business

4.9320 Ratings

🗓️ 25 November 2021

⏱️ 14 minutes

🧾️ Download transcript

Summary

Send us a textIn 2005, Stanford medical professor John Ioannidis published a bombshell essay titled “Why Most Published Research Findings Are False”, which noted that the results of many medical research papers could not be replicated by other researchers. Subsequently, several other fields have turned a harsh eye on themselves and come to similar conclusions. The heart of the issue is a phenomenon that researchers call “p-hacking”. Campbell Harvey, a professor of finance at Duke univer...

Transcript

Click on a timestamp to play from that location

0:00.0

Hello and welcome. You are listening to Patrick Boyle on Finance, a podcast exploring ideas from quantitative finance, examining events occurring in markets right now and financial history to see what lessons can be taken away, including interviews with some of the most interesting people in the world of finance. To learn more about the podcast, visit onfinance.org.

0:26.9

In 2005, a Stanford medical professor, John Unidis, published an essay titled, Why Most Published

0:34.8

Research Findings Are False, where he showed that the results of many medical

0:39.5

research studies could not be replicated by other researchers. This is obviously a problem. A subsequent

0:47.6

survey by the Science Journal, Nature, showed that more than 70% of researchers have tried and

0:54.0

failed to reproduce another scientist's

0:56.4

experiments. Not only that, but more than half admit to having failed to reproduce their own

1:02.5

experiments. During a decade as Head of Global Cancer Research at Amgen, C. Glenn Begley identified

1:10.4

53 landmark publications, papers in top journals

1:15.1

from reputable labs for his team to reproduce. He sought to double-check the findings before

1:21.5

trying to build on them for drug development. He found that 47 of the 53 could not be replicated, causing huge problems for

1:31.1

those trying to produce new medicines based upon the findings. So what might be causing this problem?

1:37.8

Well, partway through his project to reproduce these landmark cancer studies,

1:43.0

Begley met with the lead scientist of one of the

1:45.6

problematic studies. He told the scientist that he had gone through the paper line by line,

1:51.6

figure by figure, and redid the experiment 50 times and never got the published result. The

1:58.6

scientist told him that they'd done the experiment six times, got the published result. The scientists told him that they'd done the experiment six times,

2:02.9

got the published result once, and put it in the paper because it made the best story. Such

2:09.7

selective publication is just one reason that the scientific literature is peppered with incorrect

2:15.8

results. Many blame the hyper-competitive academic

2:19.8

environment as research compete for diminishing funding. The surest ticket to getting a grant

2:26.2

or a good job is getting published in a high-profile journal, and this can lead a scientist

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Patrick Boyle, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Patrick Boyle and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.