Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter June 22, 2019

The Modern Randomized Clinical Trial: Is it Time to Sharpen a Blunt Instrument?

  • Janet Turk Wittes ORCID logo EMAIL logo


In spite of the obvious differences in the diseases under study, designs of trials of prevention of HIV and cardiovascular disease share some common features. A trial of prevention should identify a population at risk for the disease; it should have a clearly defined, clinically important, outcome; it should be large enough to have sufficient power to detect an effect of public health importance; and participants should be followed long enough for the effect of the intervention to become manifest (but the trial should not take so long as to render the intervention no longer of interest). Many cardiovascular prevention studies have been large, simple, randomized trials leading to easily interpretable results. This paper urges that designers of trials of HIV prevention should consider mimicking the strategies used in cardiovascular disease prevention trials: focus on a clear inferential path to the question being asked while limiting unnecessary data collection, auditing, and complexity. Finally, showing benefit in a trial is only the first step in reducing the burden of disease: aggressive, effective efforts at educating the population at risk so they will implement the intervention is essential to improvement in public health.


This paper is based on a talk given at the 2018 symposium, HIV Prevention Efficacy Trial Designs of the Future. I am grateful to Holly E. Janes, PhD, for inviting me to present at that meeting and for her very helpful suggestions as I was preparing the talk. Thanks also to Ms Alexandra Kindahl for her assistance in reviewing the literature on cardiovascular prevention trials and to Frank Bretz, PhD, for his careful reading of an earlier version of this paper and his incisive comments.


Berry, D. A. 2011. “Adaptive Clinical Trials in Oncology.” Nature Reviews Clinical Oncology 9 (4): 199–207.10.1038/nrclinonc.2011.165Search in Google Scholar PubMed

Bretz, F., P. Gallo, and W. Maurer. 2017. “Adaptive Designs: The Swiss Army Knife among Clinical Trial Designs?” Clinical Trials 14 (5): 417–24.10.1177/1740774517699406Search in Google Scholar PubMed

Bretz, F., F. Koenig, W. Brannath, E. Glimm, and M. Posch. 2009. “Adaptive Designs for Confirmatory Clinical Trials.” Statistics in Medicine 28 (8): 1181–217.10.1002/sim.3538Search in Google Scholar PubMed

Chen, Y. H., D. L. DeMets, and K. K. Lan. 2004. “Increasing the Sample Size When the Unblinded Interim Result Is Promising.” Statistics in Medicine 23 (7): 1023–38.10.1002/sim.1688Search in Google Scholar PubMed

Chen, Y. H., C. Li, and K. K. G. Lan. 2005. “Sample Size Adjustment Based on Promising Interim Results and Its Application in Confirmatory Clinical Trials.” Clinical Trials 12 (6): 584–95.10.1177/1740774515594378Search in Google Scholar PubMed

Chowdhury, B. A., S. M. Seymour, T. M. Michele, A. G. Durmowicz, D. Liu, and C. J. Rosebraugh. 2011. “The Risks and Benefits of Indacaterol — The FDA’s Review.” The New England Journal of Medicine 365 (24): 2247–49.10.1056/NEJMp1109621Search in Google Scholar PubMed

Cui, L., H. M. J. Hung, and S. J. Wang. 1999. “Modification of Sample Size in Group Sequential Clinical Trials.” Biometrics 55 (3): 863–857.10.1111/j.0006-341X.1999.00853.xSearch in Google Scholar

Dawber, T. 1980. The Framingham Study: The Epidemiology of Atherosclerotic Disease. Cambridge: Harvard University Press.10.4159/harvard.9780674492097Search in Google Scholar

Downs, M., K. Tucker, H. Christ-Schmidt, and J. Wittes. 2010. “Some Practical Problems in Implementing Randomization.” Clinical Trials 7 (3): 235–45.10.1177/1740774510368300Search in Google Scholar PubMed

Dunnett, C. W. 1955. “A Multiple Comparison Procedure for Comparing Several Treatments with A Control.” Journal of the American Statistical Association 50 (272): 1096–121.10.1080/01621459.1955.10501294Search in Google Scholar

Ellenberg, S. S. 2001. “Safety Considerations for New Vaccine Development.” Pharmacoepidemiology and Drug Safety 10 (5): 411–15.10.1002/pds.616Search in Google Scholar PubMed

Ford, E. S., U. A. Ajani, J. B. Croft, J. A. Critchley, D. R. Labarthe, T. E. Kottke, W.H. Giles, and S. Capewell. 2007. “Explaining the Decrease in U.S. Deaths from Coronary Disease, 1980–2000.” The New England Journal of Medicine 356 (23): 2388–98. .10.1056/NEJMsa053935Search in Google Scholar PubMed

Hennekens, C. H., J. E. Buring, J. E. Manson, M. Stampfer, B. Rosner, N. R. Cook, C. Belanger, et al. 1996. “Lack of Effect on Long-Term Supplementation with Beta Carotene on the Incidence of Malignant Neoplasms and Cardiovascular Disease.” The New England Journal of Medicine 334 (18): 1145–49. .10.1056/NEJM199605023341801Search in Google Scholar PubMed

Hochberg, Y. 1988. “A Sharper Bonferroni Procedure for Multiple Tests of Significance.” Biometrika 75 (4): 800–02.10.1093/biomet/75.4.800Search in Google Scholar

Institute of Medicine. 2013. Large Simple Trials and Knowledge Generation in a Learning Health System: Workshop Summary. Washington, D.C.: National Academies Press.Search in Google Scholar

International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. 1996. “ICH Harmonized Tripartite Guideline for Good Clinical Practice E6(R1). Step 4 Version (Including the Post Step 4 Corrections).”Search in Google Scholar

Ivanova, A., B. Qaqish, and D. A. Schoenfeld. 2011. “Optimality, Sample Size, and Power Calculations for the Sequential Parallel Comparison Design.” Statistics in Medicine 30 (23): 2767–866.10.1002/sim.4292Search in Google Scholar

Jamal, A., E. Phillips, A. S. Gentzke, D. M. Homa, S. D. Babb, B. A. King, and L. J. Neff. 2018. “Current Cigarette Smoking Among Adults—United States, 2016.” Morbidity and Mortality Weekly Report 67 (2): 53–59.10.15585/mmwr.mm6702a1Search in Google Scholar

Lawrence, D., F. Bretz, and S. Pocock. 2014. “INHANCE: An Adaptive Confirmatory Study with Dose Selection at Interim,” in Indacaterol, edited by A. Trifilieff, 77–92. Basel, Switzerland: Springer10.1007/978-3-0348-0709-8_5Search in Google Scholar

Lehmacher, W., and G. Wassmer. 1999. “Adaptive Sample Size Calculations in Group Sequential Trials.” Biometrics 55 (4): 1286–90.10.1111/j.0006-341X.1999.01286.xSearch in Google Scholar PubMed

Mandrola, J. 2017. “Ten Quick Thoughts on FOURIER.” in Google Scholar

Mehta, C. R., and S. J. Pocock. 2011. “Adaptive Increase in Sample Size When Interim Results are Promising: A Practical Guide with Examples.” Statistics in Medicine 30 (28): 3267–84.10.1002/sim.4102Search in Google Scholar PubMed

Peto, R. 1997. “The Trials of Dr Bernard Fisher: A European Perspective on an American Episode.” Controlled Clinical Trials 18 (1): 1–13.10.1016/S0197-2456(96)00225-5Search in Google Scholar

Pfeffer, M., B. Claggett, S. F. Assman, R. Boineau, I. S. Anand, , N. Clausell, A.S. Desai, et al. 2015. “Regional Variation in Patients and Outcomes in the Treatment of Preserved Cardiac Function Heart Failure with an Aldosterone Antagonist (TOPCAT) Trial.” Circulation 131 (1): 34–42. .10.1161/CIRCULATIONAHA.114.013255Search in Google Scholar PubMed

Reith, C., M. Landray, P. J. Devereaux, J. Bosch, C. B. Granger, C. Baigent, R.M. Califf, et al. 2013. “Randomized Clinical Trials - Removing Unnecessary Obstacles.” The New England Journal of Medicine 369 (11): 1061–65. .10.1056/NEJMsb1300760Search in Google Scholar PubMed

Rosenberger, W. F., D. Uschner, and Y. Wang. 2019. “Randomization: The Forgotten Component of the Randomized Clinical Trial (With Commentary).” Statistics in Medicine 38 (1): 1–12.10.1002/sim.7901Search in Google Scholar

Sabatine, M. S., R. P. Giugliano, A. C. Keech, N. Honarpour, S. D. Wiviott, S. A. Murphy, J.F. Kuder, et al. 2017. “Evolocumab and Clinical Outcomes in Patients with Cardiovascular Disease.” The New England Journal of Medicine 376 (18): 1713–22. .10.1056/NEJMoa1615664Search in Google Scholar PubMed

Sprosen, T. 2018. “What Errors Matter When Doing a Randomised Trial?” Accessed May 5, 2019. in Google Scholar

Sprosen, T. 2019. “Major Funders Establish Initiative to Develop New Trial Guidelints.” Accessed May 26, 2019. in Google Scholar

Steering Committee of the Physicians’ Health Study Research Group. 1989. “Final Report on the Aspirin Component of the Ongoing Physicians’ Health Study.” The New England Journal of Medicine 321 (3): 129–35.10.1056/NEJM198907203210301Search in Google Scholar PubMed

Stewart, J. 1964. concurring, Jacobellis v. Ohio, 378 U.S. 184.Search in Google Scholar

U. S. Department of Health, Education, and Welfare, Public Health Service. 1964. “Smoking and Health.” Report of the Advisory Committee to the Surgeon General. Washington, D.C.: U.S. Government Printing Office.Search in Google Scholar

U.S. Department of Health and Human Services. 2014. “The Health Consequences of Smoking: 50 Years of Progress. A Report of the Surgeon General.” Atlanta: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health. in Google Scholar

U.S. Department of Health and Human Services, National Center for Health Statistics. 2017. “Age-Adjusted Death Rates for Selected Causes of Death, by Sex, Race, and Hispanic Origin: United States, Selected Years 1950–2016.” In Health, United States, 2017 with Special Feature on Mortality. Hyattsville: National Center for Health Statistics.Search in Google Scholar

Wittes, J. 2002. “On Changing a Long‐Term Clinical Trial Midstream.” Statistics in Medicine 21 (19): 2789–95.10.1002/sim.1282Search in Google Scholar PubMed

Wittes, J., and E. Brittain. 1990. “The Role of Internal Pilot Studies in Increasing the Efficiency of Clinical Trials.” Statistics in Medicine 9 (1–2): 65–72.10.1002/sim.4780090113Search in Google Scholar PubMed

Yusuf, S., R. Collins, and R. Peto. 1984. “Why Do We Need Some Large, Simple Randomized Trials?” Statistics in Medicine 3 (4): 409–20.10.1002/sim.4780030421Search in Google Scholar PubMed

Zucker, D., J. Wittes, O. Schabenberger, and E. Brittain. 1999. “Internal Pilot Studies II: Comparison of Various Procedures.” Statistics in Medicine 18 (24): 3493–509.10.1002/(SICI)1097-0258(19991230)18:24<3493::AID-SIM302>3.0.CO;2-2Search in Google Scholar PubMed

Received: 2019-02-10
Revised: 2019-05-26
Accepted: 2019-05-28
Published Online: 2019-06-22

© 2019 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 7.6.2023 from
Scroll to top button