What are Open Science Practices and Why do they Matter? Inside JABA 21

The Behavioral Observations Podcast with Matt Cicoria

Matt Cicoria

Science, Mental Health, Skinner, Behaviorism, Behaviorconsultant, Aba, Behavioralpsychology, Health & Fitness, Appliedbehavioranalysis, Autism, Acceptanceandcommitmenttherapy, Fba, Social Sciences, Verbalbehavior, Bcba, Functionalassessment, Discretetrial

4.8 • 648 Ratings

🗓️ 16 November 2024

⏱️ 64 minutes

🔗️ Recording | iTunes | RSS

🧾️ Download transcript

Summary

Dr. Matt Tincani joins Dr. John Borrero and me for the 21st (can you believe it!?!?) installment of the Inside JABA Series on Behavioral Observations.

From a research perspective, this Inside JABA episode is by far our most wonkiest one to date. By that I mean we take a deep dive into the area of Open Science Practices.

If you're not familiar with the Open Science movement, Matt walks us through the basics. In doing so, we review the lead paper in the fall 2024 issue of JABA that he co-wrote with Drs. Shawn Gilroy and Art Dowdy (see Tincani, Gilroy, and Dowdy, 2024).

Of the several Open Science Practices, this paper - and by extension, this episode - focuses on Preregistration. According to Tincani and colleagues, "preregistration entails outlining a research protocol and specifying the study methods and plans for analysis, which are then archived publicly in a repository before conducting the study" (see p. 4).

The point of doing this, amongst others, is to increase transparency and reduce criticisms of questionable research practices in Behavior-Analytic research, such as the file drawer effect, dropping participants from analyses, and so on.

While these aims sound laudable, when reading this paper, my inner skeptic began formulating a handful of objections to preregistration, such as increasing barriers to conducting research by adding additional steps, "boxing in" the work of researchers to the point if inflexibility, and so on. Both in the paper and on this podcast, Matt walks through these common objections, so if you too are skeptical, give this episode a listen and see if Matt's treatment of these resonate with you.

Here are a few resources mentioned in the episode:

Tincani, Gilroy, and Dowdy (2024). Extensions of open science for applied behavior analysis: Preregistration for single-case experimental designs.
Tincani and Travers (2019). Replication Research, Publication Bias, and Applied Behavior Analysis.
Subscribe to JABA here.
Open Science Collaboration (2015). Estimating the reproducibility of psychological science.
Retraction Watch.
Rick Kubina, Session 39.
Kubina et al. (2017). A Critical Review of Line Graphs in Behavior Analytic Journals.

Transcript

Click on a timestamp to play from that location

0:00.0	Welcome to the behavioral observations podcast, stimulating talk for today's behavior
0:14.0	analysts.
0:15.4	Now here's your host, Matt Sequoria.
0:20.0	Doctors.
0:20.8	Matt Tinkani and John Barrero, welcome again to the Matt Secoria. Doctors.
0:28.2	Matt Tinkani and John Barrero, welcome again to the, you know, John, I'm losing count which one this is.
0:30.0	We're in the 20s, I know.
0:31.4	Are we already?
0:32.9	Yeah, yeah.
0:41.6	The Inside Java series on behavioral observations, I really, really enjoy these sessions with you,
0:45.9	John, and with all these fantastic Java authors that we get to bring on and talk about,
0:57.5	really cool papers. And this one's definitely in that category. So Matt Tinkani, thank you for joining me to talk about this paper.
1:03.9	The paper is extensions of open science for applied behavior analysis, pre-registration for single case experimental designs. And that's a paper that you co-wrote with Sean Gilroy and Art Dowdy.
1:10.3	So before we get into the paper itself, I'd like you to have the opportunity to tell listeners a little bit about yourself, you know, how you got into this field and then kind of bring us up the speed to what you're doing these days.
1:25.0	Yeah, sure. And thank you, Matt, and thank you, John, for inviting me on. Thank you,
1:31.3	John, for suggesting it. I was really, really excited to talk about open science practices and
1:36.6	pre-registration. I hope this is helpful for folks. If they are learning about open science
1:43.5	practices or they're considering pre-registration,
1:46.2	hopefully this can help them through that process.
1:50.8	So I've been in the field now for it's hard to believe for a little over 30 years.
1:56.2	I got my start in ABA in 1993 when I was in college and I took a course called
2:03.0	behavior modification. That was actually an applied behavior analysis course.
	...

Please login to see the full transcript.

Previous episode | Next episode

Disclaimer: The podcast and artwork embedded on this page are from Matt Cicoria, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Matt Cicoria and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.