Atlas 6,943 concepts
☆ Favorites

Texas Sharpshooter Distortion

Systemic Distortions Cognitive bias Documented
Precedent Application
Detection: high Stability: persistent Level: intermediate
Texas sharpshooter distortion is when someone picks facts that match their story and ignores the rest. It makes a pattern look real even when it happened by chance.
Texas sharpshooter distortion is a cognitive bias where selective attention to confirmatory evidence creates the illusion of a meaningful pattern from random or heterogeneous data. Analysts overfit interpretations by retroactively clustering outcomes to support a preferred hypothesis, undermining objective inference.
A manager notices that three employees in the northwest corner of the office were all promoted last year, and concludes that sitting in that area must boost performance—ignoring the dozens of other employees in that area who were not promoted and the many promotions that happened elsewhere.
A litigator defending a pharmaceutical company conducts a post hoc subgroup analysis of a clinical trial, identifying a subset of patients (e.g., women aged 45–55 with a specific comorbidity profile) in whom the drug shows statistically significant benefit. Without a preregistered hypothesis for this subgroup, the cluster was constructed retroactively around the data—analogous to painting the target around the bullet holes. When presented to a court as a precedent-supporting pattern, this leverages asymmetries in legal analogical reasoning: judges applying case mapping to "similar" prior cases anchor on the manufactured cluster, inflating its perceptual salience within the evidentiary record and suppressing the base-rate reweighting that would reveal the finding as a chance artifact under multiple-comparison correction.
Someone notices matching facts and then focuses only on those facts. That focus makes the chosen facts seem more important than they are.
The mechanism involves selective sampling where observers impose a target region onto a dataset and weight internally coherent observations more heavily, producing a skewed posterior toward the constructed cluster. Constraints on hypothesis testing and asymmetric evidence weighting amplify confirmatory interpretation within precedent_application_frameworks.
Look at all the data before deciding if a pattern is real. Try to test whether the pattern would appear by chance.
Define hypotheses and clustering criteria before inspecting outcomes, and use out-of-sample tests or randomization checks to assess pattern robustness. Employ blind analysis or preregistration to prevent post hoc clustering and confirmatory selection.
False pattern identification; Overconfident conclusions; Ignoring contradictory evidence
An adversarial actor can deliberately mine a large dataset for any subset of cases that superficially support a desired legal precedent or policy conclusion, then present that cherry-picked cluster as representative evidence while suppressing disconfirming records. In litigation or regulatory proceedings, this can manufacture the appearance of a robust evidentiary pattern—e.g., selectively citing only favorable case outcomes to establish a false doctrinal trend. Combined with citation concentration and precedent application asymmetries, this weaponized post hoc clustering can anchor judicial or regulatory reasoning around a manufactured target region that was never prespecified.
Preregistration of hypotheses and clustering criteria before data inspection is the primary structural defense, preventing retroactive target construction. Analysts should demand out-of-sample validation or randomization tests to assess whether an apparent cluster survives contact with held-out or independently drawn data. In legal and evaluative contexts, requiring adversarial parties to disclose the full dataset from which cited precedents were drawn and applying systematic doctrinal congruence audits materially reduce the exploitable surface.