Lesson 5 of 10
Discernment II: Evidence You Can Trust
What you will learn
- 1Explain what peer review is, what it does well, and where it falls short.
- 2Tell a primary source from a secondary one and rank common sources by reliability.
- 3Read the abstract of a scientific paper and say what it does and does not claim.
Dr. Dalton's talk
Reading
How Science Checks Itself
You have found your thing and looked at your own reactions. Now you need facts. Where does it live? How is it doing? What threatens it? What helps? The quality of your stewardship will depend on the quality of your answers. A letter built on a false number gets ignored. A post that repeats a myth spreads the myth. Caring is not enough. You have to be right, or at least as right as the evidence allows.
What peer review is
When scientists finish a study, they write it up and send it to a journal. The editor sends the paper to other experts in the same field, usually two or three, who had no part in the work. These reviewers check the methods, the numbers and the reasoning. They can recommend that the journal publish it, ask for changes, or reject it. Often the reviewers' names are kept from the authors so they can be frank. Only after this process is the paper published. That is peer review.
Peer review is a filter. It catches many errors, weak methods and unsupported claims before they reach the public. It is the main reason a journal article deserves more trust than a blog post.
What peer review is not
Peer review is not a guarantee of truth. Reviewers are human, busy and unpaid. They usually do not repeat the experiment. Mistakes slip through, and now and then so does fraud. Papers are sometimes retracted, which means withdrawn after publication. Some so-called predatory journals will publish nearly anything for a fee while claiming to be peer reviewed. And a preprint, a paper posted online before review, has not been through the filter at all.
So a single study, even a good one, is a piece of evidence and not a verdict. What scientists trust most is a finding that many independent teams have reached by different methods. That agreement is called scientific consensus. It is not a vote or an opinion poll. It is what remains standing after years of people trying to knock it down.
A ladder of sources
Not all sources are equal. This ladder is a rough guide, strongest at the top.
| Rung | Source | Why it ranks here |
|---|---|---|
| 1 | Review articles and assessments that combine many studies | They weigh the whole body of evidence. |
| 2 | Individual peer-reviewed studies | Checked by experts, but only one piece of the picture. |
| 3 | Government science agencies, universities, museums, major conservation science groups | Usually summarize peer-reviewed work and name their sources. |
| 4 | Quality journalism that links to the original studies | Useful, but one step removed, and headlines can overstate. |
| 5 | Advocacy pages, company pages, personal blogs | May be accurate, but they have a goal. Check their sources. |
| 6 | Social media posts, memes, unsourced videos | Treat as a tip to investigate, never as evidence. |
A primary source is the original: the study itself, the dataset, the agency report. A secondary source describes or interprets a primary one, as a news story does. When something matters, trace it back to the primary source. You will be surprised how often the original says something more careful than the headline.
How to read a paper without a science degree
A scientific article has standard parts. The abstract is a one-paragraph summary at the top. The introduction says what question was asked and why. The methods section says what the researchers did. The results section says what they found. The discussion says what they think it means and, if they are honest, what the study could not show.
You do not need to follow every statistic. Read the abstract, then the first and last paragraphs of the discussion. Then ask five questions.
- Who did this, and who published it? Is it a real journal? Are the authors at a university or research institute?
- What exactly was studied? One pond or a continent? Fifty animals or fifty thousand? A lab or the wild?
- What did they actually find? State it in one sentence, using their words where you can.
- How sure are they? Look for words like "suggests," "is associated with," and "may." Scientists choose these carefully.
- Who paid for it? Funding does not prove bias, but it is worth knowing.
Two cautions come up constantly. First, correlation is not causation. Two things rising together does not prove one caused the other. Second, sample size matters. A finding from a handful of cases is a hint. A finding from thousands is stronger.
Uncertainty is honesty
People sometimes distrust science because scientists say "we are not sure" or change their conclusions. That reaction has it backwards. Stating uncertainty is a sign of honesty, and changing your mind when better evidence arrives is the method working. Be more suspicious of any source that is certain about everything.
Jung understood both sides of this. He wrote that he was powerfully drawn to science for its truths based on facts, yet in science alone he missed the factor of meaning. This course asks you to hold both. Awe gives you the meaning. Evidence keeps you honest. A steward needs each one to check the other.
Remember your own lens
Lesson 4 applies here. The mind has a well-documented habit called confirmation bias: we notice and believe evidence that agrees with what we already think, and we doubt or skip the rest. The cure is simple to state and hard to do. Go looking for the best evidence against your view. If your belief survives, you can hold it with more confidence. If it does not, you have just learned something.
Where to look
- Google Scholar (scholar.google.com) searches scholarly articles. Many have free versions.
- Your school or public library. Librarians are trained for exactly this, and libraries pay for access to journals.
- Agency and university pages. Wildlife agencies, natural history museums and university extension offices publish reliable plain-language summaries.
- The reference list. Any good article about your thing will cite its sources. Follow them.
Teaching this as a facilitator
You are not expected to be a scientist. You are expected to model three habits: ask "how do we know?", name your source every time you state a fact, and say "I don't know, let's find out" without embarrassment. Those three habits are worth more than any amount of memorized information.
Key terms
- Peer review: evaluation of a study by independent experts before publication.
- Primary source: the original study, data or report.
- Scientific consensus: agreement reached by many independent lines of evidence.
- Confirmation bias: favoring evidence that fits what we already believe.
- Preprint: a paper shared before peer review.
Recommended reading
- The Demon-Haunted World: Science as a Candle in the Dark, by Carl Sagan (1995). A warm, readable defense of careful thinking, including his well-known "baloney detection kit."
- Factfulness: Ten Reasons We're Wrong About the World, and Why Things Are Better Than You Think, by Hans Rosling, with Ola Rosling and Anna Rosling Rönnlund (2018). How instinct distorts our picture of the world, and how data corrects it. A natural partner to eco-optimism.
Practice this week
Find one peer-reviewed article or one agency or university page about your thing. Write down three facts and where each came from.
Ready to test your understanding?
10 questions — you need 8 or more correct to pass.