Skip to content
Think For Yourself

When Sources Disagree: How to Evaluate Conflicting Evidence

Ages 12–16 25 min read Advanced

What happens when two credible sources say opposite things? One study says coffee is good for you. Another says it's harmful. One expert says the economy is improving. Another says it's declining.

Welcome to reality — where evidence is messy and certainty is rare.

Why Sources Disagree

1. Different Data

Two studies on coffee might use different populations (young vs old), different amounts (1 cup vs 5), and different time periods. Their results can legitimately differ because they're measuring different things.

2. Different Methods

A survey asking people about their health produces different results from a controlled lab experiment. Neither is wrong — they're different approaches with different strengths.

3. Different Funding

Research funded by the sugar industry tends to find that sugar isn't harmful. Research funded by health organisations tends to find the opposite. A 2016 investigation revealed that the sugar industry paid Harvard researchers in the 1960s to downplay sugar's role in heart disease and blame fat instead (Kearns et al., JAMA Internal Medicine).

Always check who funded the research.

4. Different Interpretations

The same data can be interpreted differently. "Unemployment fell from 5% to 4.5%." Optimist: "The economy is improving!" Pessimist: "But underemployment rose to 8%!" Both are using real data.

How to Navigate Disagreement

  1. Look for consensus. When 97% of scientists agree on climate change and 3% disagree, go with the 97%. When it's 55% vs 45%, genuine uncertainty exists.
  2. Check the evidence hierarchy. A meta-analysis trumps a single study. A controlled trial trumps an anecdote.
  3. Follow the funding. Who paid? What might they want the results to show?
  4. Look for replication. Has the finding been confirmed by other independent researchers?
  5. Be comfortable with uncertainty. "The evidence suggests..." is more honest than "The science proves..."

Tonight's Question

"Is there a topic where you've seen experts disagree? How did you decide what to believe? Did you look at the evidence, or go with the expert you liked more?"

The Coffee Debate

  1. Search "Is coffee good for you?" online.
  2. Find one article saying yes and one saying no.
  3. For each article: What evidence do they cite? Who wrote it? What's the original study?
  4. Compare: are they actually measuring the same thing? (Amount, age group, health outcome?)
  5. Write a balanced conclusion based on both sources.

Go Further

  • Research: The sugar industry scandal — how corporate funding corrupted nutrition science for decades.
  • Book: Merchants of Doubt by Naomi Oreskes & Erik Conway (2010) — how industry creates fake scientific controversy.
  • Tool: Cochrane Reviews (cochranelibrary.com) — the gold standard for synthesising medical evidence.
  • Question: Should research funded by the industry it's studying be treated differently?

What We Simplified

  • Industry-funded research isn't automatically wrong. Many legitimate studies are industry-funded. The issue is when funding creates pressure to reach certain conclusions.
  • Consensus can be wrong. The scientific consensus on stomach ulcers (caused by stress) was overturned by Barry Marshall, who proved they're caused by bacteria. But this is rare — most consensus reflects robust evidence.
  • Uncertainty is normal in science. Science advances by updating conclusions as new evidence appears. This isn't weakness — it's the system working.

Sources

  • Kearns, C.E. et al. (2016). "Sugar Industry and Coronary Heart Disease Research." JAMA Internal Medicine, 176(11), 1680-1685.
  • Oreskes, N. & Conway, E.M. (2010). Merchants of Doubt. Bloomsbury.
  • Cochrane Collaboration. cochrane.org

Want to track progress and save lessons?

Create a free family account. No credit card, no catch — just a place to keep track of what your family is learning.

Create Free Account