Overprecision In Intervals
Disaster Framing
Definition
Overprecision in intervals is when people give ranges that are too tight around what they expect. They act like they are more certain than they really are and miss the true answer often.
Advanced definition
Overprecision in interval estimates refers to the systematic underestimation of uncertainty when forecasters provide overly narrow confidence ranges around predictions. This bias leads to interval widths that inadequately account for variability, producing calibration errors between stated confidence and observed hit rates.
Example
A friend confidently predicts the drive to the airport will take "exactly 25 to 30 minutes," ignoring the possibility of traffic, construction, or parking delays. Because the range is so tight, they end up missing the flight when the trip takes 50 minutes — an outcome their narrow interval never contemplated.
Advanced example
An equity research analyst forecasting quarterly earnings per share anchors on a DCF-derived point estimate of $2.14 and reports a 90% confidence interval of [$2.05, $2.23]. Empirical back-testing across 200 similar estimates reveals the analyst's stated 90% intervals contain the true outcome only 54% of the time, confirming systematic interval underexpansion. The root cause is an anchoring-centric interval construction process: the central estimate is produced first via model output, then endpoints are set by minimal symmetric adjustment (±~4%) rather than by propagating full parameter uncertainty through the model's variance structure. Applying a calibration correction factor derived from the historical hit-rate shortfall — inflating raw interval width by approximately 1.67× — brings empirical coverage back to the nominal 90% level, consistent with debiasing protocols that enforce variance inflation based on historical error distributions.
Mechanism
People pick a best guess and then shrink the range because they feel sure, so the true answer falls outside. This feeling of certainty causes the interval to be too small.
Advanced mechanism
A central-estimate anchoring mechanism with asymmetric adjustment produces underexpanded intervals, where limited variance weighting and constraint on range endpoints bias width downward. The interval construction uses a focal point and asymmetric weighting of evidence, yielding overprecision.
How to counter it
Ask for wider ranges or higher confidence levels so intervals include more outcomes. Encourage checking past misses to widen future intervals.
Advanced countermove
Implement calibration training that links empirical hit rates to stated confidence levels and require explicitly justified variance margins. Use debiasing protocols that enforce variance inflation based on historical error distributions.
Failure modes
Intervals exclude true outcomes; Overconfident decision making; Poor calibration across cases
Exploitation surface
Adversarial actors can exploit overprecision in intervals by seeding authoritative-seeming narrow forecasts into public discourse, inducing anchoring in downstream analysts who inherit artificially tight confidence ranges as baseline assumptions. In adversarial intelligence or financial contexts, a manipulator can deliberately publish overconfident interval estimates to crowd out wider, more accurate uncertainty representations, causing opponents to under-prepare for tail outcomes. Crisis communicators or lobbyists can weaponize overprecision by presenting narrow scenario bands that systematically exclude inconvenient extreme events, making low-probability high-impact risks appear effectively impossible.
Resistance profile
Calibration training that maps stated confidence levels against empirical hit rates over time builds measurable resistance, as forecasters learn to associate interval width with actual coverage frequency. Requiring explicit variance inflation protocols grounded in historical error distributions — such as multiplying raw interval widths by a domain-specific expansion factor — counteracts the anchoring-centric construction process. Red-team review processes that specifically task a reviewer with identifying plausible scenarios outside a submitted interval force range expansion before estimates are finalized.