Skip to content
Studies / Telepathy / Bias in the evaluation of psychology stu…

Parapsychology: Is Science Biased?

Bethany ButzerEXPLORE, 2019 Peer-Reviewed
On this page
✦ Imagine …

Do scientists judge studies differently based on the field?

Imagine you're a scientist reviewing two identical psychology studies — same methodology, same statistical results, same quality. The only difference? One investigates brain activity during meditation, the other explores telepathy between twins. Would you rate them equally? Researcher Bethany Butzer suspected the answer was no, so she designed an experiment to test whether the topic alone influences how we judge scientific work. What she discovered challenges our assumptions about objectivity in science itself.

Researchers may evaluate identical methods differently when labeled parapsychology versus neuroscience.

Scientific peer review is supposed to be objective, but what if the field label influences how researchers judge a study's quality? A 2019 investigation examined whether psychology researchers apply different standards when evaluating parapsychology versus neuroscience research.

💡

The data show that identical research methods receive significantly different evaluations depending on whether they investigate conventional neuroscience or controversial parapsychology topics.

🔍

Key Findings

  • The study revealed systematic differences in how researchers evaluated studies depending on whether they were presented as parapsychology or neuroscience research.
  • This suggests that field labels can create evaluation biases that go beyond the actual methodology and results.

What Is This About?

The researcher surveyed psychology professionals to see how they evaluated research studies. The key twist: some participants reviewed studies labeled as parapsychology research, while others reviewed identical or similar studies labeled as neuroscience research. This allowed comparison of whether the field label itself influenced how harshly or favorably the research was judged.

Methodology

Survey study comparing how psychology researchers evaluate studies from parapsychology versus neuroscience fields.

Outcomes

Found differences in how researchers assess the quality and validity of studies depending on whether they come from parapsychology or neuroscience.

How Good Is the Evidence?

Anecdotal15/100
AnecdotalPreliminarySolidStrongOverwhelming

Supporters argue this demonstrates unfair bias against parapsychology research, suggesting good studies are dismissed due to field prejudice rather than methodological flaws. Skeptics might counter that heightened scrutiny of extraordinary claims is appropriate, and that parapsychology research often does have genuine methodological issues that warrant closer examination.

↔ Interpretation Spectrum

Mainstream: Field labels shouldn't influence evaluation, but some bias is understandable given parapsychology's controversial claims. Moderate: This reveals problematic bias in scientific review that undermines fair assessment of research quality. Frontier: This demonstrates systematic prejudice that prevents legitimate parapsychological research from receiving fair consideration.

Common Misconception

Many people assume scientific peer review is purely objective, but this study shows that field labels and preconceptions can influence how researchers evaluate methodology and results.

Convincing Checklist
2 of 5 criteria met
Met2/5
Large sample (N>100)
Peer-reviewed journal
Replicated
Significant effect
DOI available

To establish evaluation bias conclusively, we'd need large-scale studies with identical research papers randomly labeled as different fields, multiple reviewer populations, and pre-registered analysis plans. This study provides initial evidence but would need replication across different institutions and countries.

The study identifies evaluation bias differences between parapsychology and neuroscience research assessment.

Stance: Mixed

What Does It Mean?

The fascinating twist is that science — our gold standard for objectivity — might be more influenced by human psychology than we'd like to admit. This study essentially used scientific methods to examine science itself, revealing how our preconceptions can shape what we consider 'good research.'

It's like how the same wine might be rated differently if served in an expensive bottle versus a cheap one - the label influences perception even when the content is identical.

If these findings hold up in larger studies, they could reshape how we think about scientific objectivity and peer review. It might lead to blinded review processes where evaluators don't know the research topic, or new training for reviewers about unconscious bias. The debate about what constitutes legitimate scientific inquiry could become more nuanced and self-reflective.

Wonder Score
3/5
Fascinating
🎓
Science Literacy Tip

This study demonstrates how label bias can affect scientific evaluation - a reminder that even trained researchers can be influenced by preconceptions rather than focusing purely on methodology and data.

Understanding Terms

📖
Evaluation Bias
When researchers judge identical work differently based on irrelevant factors like field labels rather than actual quality
📖
Peer Review
The process where scientists evaluate each other's research before publication to ensure quality and validity

What This Study Claims

Findings

Methodological and evaluative disparities exist between parapsychology and neuroscience fields

moderate

Evaluation bias exists when assessing parapsychology versus neuroscience research

moderate

Interpretations

Research assessment practices may be influenced by field-specific biases

moderate

This summary is for general information about current research. It does not constitute medical advice. The scientific interpretation of these results is debated among researchers. If personally affected, please consult qualified professionals.