Statistics, Politics and Policy
Editor-in-Chief: Wagschal, Uwe
Substantive Importance and the Veil of Statistical Significance
1Department of Political Science, Texas A&M University, 2010 Allen Building, College Station, TX 77843, USA
Citation Information: Statistics, Politics and Policy. Volume 6, Issue 1-2, Pages 77–96, ISSN (Online) 2151-7509, ISSN (Print) 2194-6299, DOI: https://doi.org/10.1515/spp-2015-0001, November 2015
- Published Online:
Political science is gradually moving away from an exclusive focus on statistical significance and toward an emphasis on the magnitude and importance of effects. While we welcome this change, we argue that the current practice of “magnitude-and-significance,” in which researchers only interpret the magnitude of a statistically significant point estimate, barely improves the much-maligned “sign-and-significance” approach, in which researchers focus only on the statistical significance of an estimate. This exclusive focus on the point estimate hides the uncertainty behind a veil of statistical significance. Instead, we encourage researchers to explicitly account for uncertainty by interpreting the range of values contained in the confidence interval. Especially when making judgments about the importance of estimated effects, we advise researchers to make empirical claims if and only if those claims hold for the entire confidence interval.