File Drawer Effect

A study with no clear result is far more likely to get hidden away than shared. That quiet suppression makes the published record look more positive than all the research actually done.

This effect is the systematic suppression of null or negative results from the public literature, producing a biased sample of reported findings. The selective non-publication distorts meta-analytic inference and inflates the apparent effect size across a research domain.

A company tests a new painkiller in twelve small trials. Eight show the drug barely works, but four show strong results. Only the four positive trials get published. Doctors reading the literature conclude the drug is highly effective, when most of the actual tests found it unremarkable.

A meta-analyst pooling randomized controlled trials on a cognitive-behavioral intervention for anxiety finds a pooled effect size of 0.65 across 24 published studies. Testing for publication bias reveals an estimated 11 missing studies that never made it into the literature, and correcting for them drops the adjusted effect size to 0.38 — well below the threshold considered clinically meaningful. Comparison against a prospective trial registry shows 19 registered studies that never produced a publication at all, confirming that selective non-publication inflated the apparent effect by roughly 70%.

Researchers prefer sharing studies that look successful, so the null results simply stay unseen. Journals and reviewers reinforce this by favoring striking findings, skewing the published record further.

Selective reporting arises from incentive structures and editorial thresholds that weight novelty and statistical significance far more heavily than a null result. Those structural pressures bias the whole submission-and-acceptance pipeline toward suppressing null-result visibility.

Sharing all study results openly, even the unremarkable ones, is the direct fix. Publishing venues that explicitly accept null results keep them from disappearing from the record.

Registered reports and mandatory data repositories ensure every outcome enters the literature, correcting the bias at its source. Reforming editorial incentives to reward methodological rigor over novelty removes the underlying pressure to suppress null results.

Overestimated effect sizes; Misleading meta-analyses; Wasted replication efforts

A bad actor funding applied research (e.g., pharmaceutical, tobacco, or chemical industries) can deliberately run many small trials, selectively publish only those producing favorable outcomes, and bury null or adverse findings—engineering a literature that systematically overstates efficacy or safety. Regulatory bodies and systematic reviewers relying on published corpora will then draw biased conclusions without ever knowing the suppressed data exists. This mechanism can be further weaponized by controlling who holds the raw data, making independent auditing structurally impossible.

Pre-registration of study hypotheses, methods, and analysis plans before data collection creates an auditable record that exposes non-publication; registries such as ClinicalTrials.gov operationalize this at scale. Registered reports, in which journals commit to publication contingent on methodological quality rather than outcomes, directly sever the incentive link between result valence and visibility. Funnel plot asymmetry tests, trim-and-fill methods, and the Egger test applied during meta-analysis can statistically estimate and partially correct for publication bias when full study registers are unavailable.