Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Statistical Applications in Genetics and Molecular Biology

Editor-in-Chief: Sanguinetti, Guido


IMPACT FACTOR 2018: 0.536
5-year IMPACT FACTOR: 0.764

CiteScore 2018: 0.49

SCImago Journal Rank (SJR) 2018: 0.316
Source Normalized Impact per Paper (SNIP) 2018: 0.342

Mathematical Citation Quotient (MCQ) 2018: 0.02

Online
ISSN
1544-6115
See all formats and pricing
More options …
Volume 3, Issue 1

Issues

Volume 10 (2011)

Volume 9 (2010)

Volume 6 (2007)

Volume 5 (2006)

Volume 4 (2005)

Volume 2 (2003)

Volume 1 (2002)

Multiple Testing. Part I. Single-Step Procedures for Control of General Type I Error Rates

Sandrine Dudoit / Mark J. van der Laan / Katherine S. Pollard
Published Online: 2004-06-09 | DOI: https://doi.org/10.2202/1544-6115.1040

The present article proposes general single-step multiple testing procedures for controlling Type I error rates defined as arbitrary parameters of the distribution of the number of Type I errors, such as the generalized family-wise error rate. A key feature of our approach is the test statistics null distribution (rather than data generating null distribution) used to derive cut-offs (i.e., rejection regions) for these test statistics and the resulting adjusted p-values. For general null hypotheses, corresponding to submodels for the data generating distribution, we identify an asymptotic domination condition for a null distribution under which single-step common-quantile and common-cut-off procedures asymptotically control the Type I error rate, for arbitrary data generating distributions, without the need for conditions such as subset pivotality. Inspired by this general characterization of a null distribution, we then propose as an explicit null distribution the asymptotic distribution of the vector of null value shifted and scaled test statistics. In the special case of family-wise error rate (FWER) control, our method yields the single-step minP and maxT procedures, based on minima of unadjusted p-values and maxima of test statistics, respectively, with the important distinction in the choice of null distribution. Single-step procedures based on consistent estimators of the null distribution are shown to also provide asymptotic control of the Type I error rate. A general bootstrap algorithm is supplied to conveniently obtain consistent estimators of the null distribution. The special cases of t- and F-statistics are discussed in detail. The companion articles focus on step-down multiple testing procedures for control of the FWER (van der Laan et al., 2004b) and on augmentations of FWER-controlling methods to control error rates such as tail probabilities for the number of false positives and for the proportion of false positives among the rejected hypotheses (van der Laan et al., 2004a). The proposed bootstrap multiple testing procedures are evaluated by a simulation study and applied to genomic data in the fourth article of the series (Pollard et al., 2004).

Keywords: Adjusted p-value; asymptotic control; bootstrap; consistency; cut-off; F-statistic; generalized family-wise error rate; multiple testing; null distribution; null hypothesis; quantile; single-step; test statistic; t-statistic; Type I error rate

About the article

Published Online: 2004-06-09


Citation Information: Statistical Applications in Genetics and Molecular Biology, Volume 3, Issue 1, Pages 1–69, ISSN (Online) 1544-6115, DOI: https://doi.org/10.2202/1544-6115.1040.

Export Citation

©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston.Get Permission

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

[1]
Christelle Reynès, Guilhem Kister, Marine Rohmer, Tristan Bouschet, Annie Varrault, Emeric Dubois, Stéphanie Rialle, Laurent Journot, Robert Sabatier, and Janet Kelso
Bioinformatics, 2019
[2]
Minnkyong Lee, Kendra A. Williams, Ying Hu, Jonathan Andreas, Shashank J. Patel, Suiyuan Zhang, and Nigel P. S. Crawford
Clinical & Experimental Metastasis, 2015, Volume 32, Number 8, Page 769
[3]
Alexa J Resler, Kathleen E Malone, Lisa G Johnson, Mari Malkki, Effie W Petersdorf, Barbara McKnight, and Margaret M Madeleine
BMC Cancer, 2013, Volume 13, Number 1
[4]
Cizao Ren, Pantel S Vokonas, Helen Suh, Shona Fang, David C Christiani, and Joel Schwartz
Environmental Health, 2010, Volume 9, Number 1
[6]
Frank Emmert-Streib and Matthias Dehmer
Machine Learning and Knowledge Extraction, 2019, Volume 1, Number 2, Page 653
[7]
Katrina M. Waters, Ruimin Tan, Damian C. Genetos, Seema Verma, Clare E. Yellowley, and Norman J. Karin
Bone, 2007, Volume 41, Number 5, Page 833
[8]
Luis F. Miranda-Moreno, Aurélie Labbe, and Liping Fu
Accident Analysis & Prevention, 2007, Volume 39, Number 6, Page 1192
[9]
Alexander Y. Gordon
Journal of Statistical Planning and Inference, 2007, Volume 137, Number 11, Page 3497
[10]
Zoe Moodie, A.J. Rossini, Michael G. Hudgens, Peter B. Gilbert, Steven G. Self, and Nina D. Russell
Contemporary Clinical Trials, 2006, Volume 27, Number 2, Page 147
[11]
Srinka Ghosh, Heather A Hirsch, Edward A Sekinger, Philipp Kapranov, Kevin Struhl, and Thomas R Gingeras
BMC Bioinformatics, 2007, Volume 8, Number 1
[12]
Jonathan Chevrier, Brenda Eskenazi, Asa Bradman, Laura Fenster, and Dana B. Barr
Environmental Health Perspectives, 2007, Volume 115, Number 10, Page 1490
[13]
Matthew S. Forrest, Qing Lan, Alan E. Hubbard, Luoping Zhang, Roel Vermeulen, Xin Zhao, Guilan Li, Yen-Ying Wu, Min Shen, Songnian Yin, Stephen J. Chanock, Nathaniel Rothman, and Martyn T. Smith
Environmental Health Perspectives, 2005, Volume 113, Number 6, Page 801
[14]
Angélica Cibrián-Jaramillo, Jose E. De la Torre-Bárcena, Ernest K. Lee, Manpreet S. Katari, Damon P. Little, Dennis W. Stevenson, Rob Martienssen, Gloria M. Coruzzi, and Rob DeSalle
Genome Biology and Evolution, 2010, Volume 2, Page 225
[15]
Stanley B. Pounds
Briefings in Bioinformatics, 2006, Volume 7, Number 1, Page 25
[16]
Franck Chiappini, Alain Barrier, Raphaël Saffroy, Marie-Charlotte Domart, Nicolas Dagues, Daniel Azoulay, Mylène Sebagh, Brigitte Franc, Stephan Chevalier, Brigitte Debuire, Sandrine Dudoit, and Antoinette Lemoine
Laboratory Investigation, 2006, Volume 86, Number 2, Page 154
[17]
Tapan S. Mehta, Stanislav O. Zakharkin, Gary L. Gadbury, and David B. Allison
Physiological Genomics, 2006, Volume 28, Number 1, Page 24
[18]
Jean-François Chich, Olivier David, Fanny Villers, Brigitte Schaeffer, Didier Lutomski, and Sylvie Huet
Journal of Chromatography B, 2007, Volume 849, Number 1-2, Page 261
[19]
Katrina M. Waters, Jon M. Jacobs, Marina A. Gritsenko, and Norman J. Karin
Bone, 2011, Volume 48, Number 6, Page 1328
[20]
Seung Yeon Baik, Minkyung Jeong, Hyang Sook Kim, and Seung-Hwan Lee
Journal of Affective Disorders, 2017
[21]
Marcus Bantscheff, Markus Schirle, Gavain Sweetman, Jens Rick, and Bernhard Kuster
Analytical and Bioanalytical Chemistry, 2007, Volume 389, Number 4, Page 1017
[22]
Owen A Ross, Alexandra I Soto-Ortolaza, Michael G Heckman, Jan O Aasly, Nadine Abahuni, Grazia Annesi, Justin A Bacon, Soraya Bardien, Maria Bozi, Alexis Brice, Laura Brighina, Christine Van Broeckhoven, Jonathan Carr, Marie-Christine Chartier-Harlin, Efthimios Dardiotis, Dennis W Dickson, Nancy N Diehl, Alexis Elbaz, Carlo Ferrarese, Alessandro Ferraris, Brian Fiske, J Mark Gibson, Rachel Gibson, Georgios M Hadjigeorgiou, Nobutaka Hattori, John PA Ioannidis, Barbara Jasinska-Myga, Beom S Jeon, Yun Joong Kim, Christine Klein, Rejko Kruger, Elli Kyratzi, Suzanne Lesage, Chin-Hsien Lin, Timothy Lynch, Demetrius M Maraganore, George D Mellick, Eugénie Mutez, Christer Nilsson, Grzegorz Opala, Sung Sup Park, Andreas Puschmann, Aldo Quattrone, Manu Sharma, Peter A Silburn, Young Ho Sohn, Leonidas Stefanis, Vera Tadic, Jessie Theuns, Hiroyuki Tomiyama, Ryan J Uitti, Enza Maria Valente, Simone van de Loo, Demetrios K Vassilatis, Carles Vilariño-Güell, Linda R White, Karin Wirdefeldt, Zbigniew K Wszolek, Ruey-Meei Wu, and Matthew J Farrer
The Lancet Neurology, 2011, Volume 10, Number 10, Page 898
[23]
Owen A. Ross, Alexandra I. Soto-Ortolaza, Michael G. Heckman, Christophe Verbeeck, Daniel J. Serie, Sruti Rayaprolu, Stephen S. Rich, Michael A. Nalls, Andrew Singleton, Rita Guerreiro, Emma Kinsella, Zbigniew K. Wszolek, Thomas G. Brott, Robert D. Brown, Bradford B. Worrall, James F. Meschia, and Christian Wider
PLoS ONE, 2013, Volume 8, Number 9, Page e75035
[24]
Paolo Miotto, Francesca Forti, Alessandro Ambrosi, Danilo Pellin, Diogo F. Veiga, Gabor Balazsi, Maria L. Gennaro, Clelia Di Serio, Daniela Ghisotti, Daniela M. Cirillo, and Delia Goletti
PLoS ONE, 2012, Volume 7, Number 12, Page e51950
[25]
Yongchao Ge, Stuart C Sealfon, and Terence P Speed
Statistical Methods in Medical Research, 2009, Volume 18, Number 6, Page 543
[26]
Alessio Farcomeni
Statistical Methods in Medical Research, 2008, Volume 17, Number 4, Page 347
[27]
Sunil Mathur and Samuel Dolo
Statistical Methods in Medical Research, 2008, Volume 17, Number 4, Page 405
[28]
Sergey V. Malov, Alexey Antonik, Minzhong Tang, Alexandre Berred, Yi Zeng, and Stephen J. O'Brien
Biometrical Journal, 2017, Volume 59, Number 1, Page 126
[29]
Tai-Qin Huang, Min Su Lee, Eunha Oh, Byoung-Tak Zhang, Jeong-Sun Seo, and Woong-Yang Park
International Journal of Radiation Biology, 2008, Volume 84, Number 9, Page 734
[30]
Christina C. Bartenschlager and Michael Krapp
AStA Wirtschafts- und Sozialstatistisches Archiv, 2015, Volume 9, Number 2, Page 107
[31]
ALESSIO FARCOMENI
Scandinavian Journal of Statistics, 2007, Volume 34, Number 2, Page 275
[32]
Tsu-Hsin Howe, Ching-Fan Sheu, Tien-Ni Wang, and Yung-Wen Hsu
Research in Developmental Disabilities, 2014, Volume 35, Number 7, Page 1748
[34]
Yoshiyuki Ninomiya and Hironori Fujisawa
Biometrics, 2007, Volume 63, Number 4, Page 1135
[36]
Jeffrey C. Miecznikowski, David Gold, Lori Shepherd, and Song Liu
Statistics & Probability Letters, 2011, Volume 81, Number 11, Page 1695
[37]
David Shilane, Jarno Martikainen, Sandrine Dudoit, and Seppo J. Ovaska
Information Sciences, 2008, Volume 178, Number 14, Page 2870
[38]
Xinping Cui, Haibing Zhao, and Jason Wilson
Journal of Biopharmaceutical Statistics, 2010, Volume 20, Number 2, Page 223
[39]
Aurélie Labbe and Mary E. Thompson
Canadian Journal of Statistics, 2007, Volume 35, Number 1, Page 51

Comments (0)

Please log in or register to comment.
Log in