The Replication Crisis in Academic Studies - Gurwinder

The replication crisis (also called the replicability crisis and the reproducibility crisis) is an ongoing methodological crisis in which the results of many scientific studies are difficult or impossible to reproduce. Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially call into question substantial parts of scientific knowledge.

The replication crisis is frequently discussed in relation to psychology and medicine, where considerable efforts have been undertaken to reinvestigate classic results, to determine whether they are reliable, and if they turn out not to be, the reasons for the failure. Data strongly indicate that other natural and social sciences are affected as well.

The phrase replication crisis was coined in the early 2010s as part of a growing awareness of the problem. Considerations of causes and remedies have given rise to a new scientific discipline, metascience, which uses methods of empirical research to examine empirical research practice.

[gregsmith]

There have been a few brave souls that have been sounding the alarm for years now.

[williambillycraig]

This problem cuts across many disciplines

[darraghomeara]

As someone who has been through a postgraduate research program, I can tell you this is absolutely true but another massive problem is an unwillingness for researchers and their institutions to try to replicate research.

Replication studies are a key step in rigorously testing a hypothesis but everyone searches for and is encouraged to search for their own niche and to stray away from "what is known" it's non-scientific nonsense.

[francispitts]

I’ve been saying this for years now. I’m not even an academic either. Sure I have a degree but it’s been years since I’ve been on a campus. It was long before computers. But I’ve kept up with reading actual studies on topics that I’m interested in. I could see it was complete garbage and nonsense that has no foundation or relevant facts.

[garfius]

Most interesting podcast in waaay long time...

[thomasowenmazzetti]

same thing happening in earth sciences. i got a phd in atmospheric science and it felt like the only thing driving investigation in a given subject was either r&d or advertising for some way to make money or raise the gdp.

[mercurialshift]

You should mention that the social sciences are different than other sciences because of so many variables that come with being human. It’s not like studying animal behavior or that which obeys direct scientific laws. So depending on the topic and the field, you’re never going to get the exact same result. You look for patterns.

As for systematic racism, it’s not just about the hiring process of whether or not hiring is based on meritocracy. From the get go, certain minorities have been treated like second class citizens and were purposely set back or unable to access the same resources and education. Then their children grow up poor and lack the funding or guidance to get the education to compete. They may grow up being targeted more by police or poverty may cause them to try to make money in illegal ways. Which then, with a criminal record marks them for the rest of their lives.

Being aware of social issues and the evolution and change surrounding them and affecting society over time, is essential to overcoming these barriers. Nobody is telling someone that they can’t achieve anything and so shouldn’t even try. I feel like that’s a cop out. At the same time, people can become overly fixated on some aspect of their identity and make too many assumptions about how they are treated by others. Like anything, we need a balanced approach to these issues. I think most academics who work in the social sciences are wanting to see some positive change and are passionate about their work and their field. It’s not all superficial.

It seems this guest isn’t a fan of transgenderism and so may be overemphasizing the affect gender studies has had in academia. We all have our biases but for some people, they can only see things through the lens of their political ideology or affiliation. Not to say there aren’t issues within academia but right now, there is an anti academic climate in the conservative community.

At the same time academia can have a bit of a superiority complex that can turn off ordinary people. There is this disconnect that sometimes occurs between the academic world and the masses. At times, I want to defend academia and expertise. On other occasions, I understand how uppity that world can be and how snobby and disengaged academia is from the world of ordinary people.

Anyway, just some thoughts…I was arguing with some asshole racist on twitter today and we were discussing social sciences and certain studies regarding racism. I was basically telling him studies indicate racist people are dumb. Which yes is an over generalization but there is some truth to it for sure. So some of these topics were fresh in my mind. 😂

[Lee-hqtf]

Much of psychology is indistinguishable from quackery.

[psikeyhackr]

Where is there a physical model of the North Tower collapse? Wouldn't the model have to have the same mass distribution as the North Tower? Where have any experts discussed wanting or needing accurate data on the distribution of steel down the Twin Towers?

Why is the Eiffel 🗼 Tower shaped like that?

[LindaMcification]

If the country is not systemically racist, why is there profiling. I disagree with this Dr.'s opinion. I see it with the rise of neonazism.

[haraldurkarlsson]

It could also be that study is underpowered and the results are a fluke.