Evidence and Research Literacy
Reading studies critically: the evidence ladder, reproducibility, sample size, statistical significance, sponsor funding, negative studies, and investigational status.
Overview
Evidence is the structure that holds a scientific claim together. The same molecule can appear in a biochemical assay, a cell line, a rodent model, a non-human primate, and a controlled human trial. Each setting produces a different kind of information, and each comes with different constraints on interpretation.
The evidence ladder is a useful framing. In vitro experiments demonstrate that an interaction is biochemically possible. Animal models demonstrate that the interaction can occur within an organism and indicate where it occurs. Human studies, particularly randomized controlled trials with prespecified endpoints, demonstrate whether the effect is reliable in people under defined conditions. Mechanistic plausibility is not human efficacy. A receptor binding study does not establish a clinical outcome.
Reproducibility is not optional. A single positive study, especially with a small sample, an unblinded design, or industry funding, is a starting point rather than a conclusion. Independent replication with comparable materials, comparable methods, and comparable endpoints is what converts an observation into evidence.
Statistical reasoning belongs in every read. Effect sizes, confidence intervals, prespecified versus post hoc endpoints, and multiplicity corrections are not technical details for biostatisticians; they are the difference between an inference that holds and one that does not. A p-value below 0.05 is not a license to extrapolate.
This hub teaches the reading. The aim is not to dismiss a literature but to evaluate it with the appropriate skepticism, attention to material identity, and respect for what the study actually measured.