Abstract
Background
Statistical analyses are used to help understand the practical significance of the findings in a clinical study. Many clinical researchers appear to have limited knowledge onhowto perform appropriate statistical analysis as well as understanding what the results in fact mean.
Methods
This focal review is based on long experience in supervising clinicians on statistical analysis and advising editors of scientific journals on the quality of statistical analysis applied in scientific reports evaluated for publication.
Results
Basic facts on elementary statistical analyses are presented, and common misunderstandings are elucidated. Efficacy estimates, the effect of sample size, and confidence intervals for effect estimates are reviewed, and the difference between statistical significance and clinical relevance is highlighted. The weaknesses of p-values and misunderstandings in how to interpret them are illustrated with practical examples.
Conclusions and recommendations
Some very important questions need to be answered before initiating a clinical trial. What is the research question? To which patients should the result be generalised? Is the number of patients sufficient to draw a valid conclusion? When data are analysed the number of (preplanned) significance tests should be kept small and post hoc analyses should be avoided. It should also be remembered that the clinical relevance of a finding cannot be assessed by the p-value. Thus effect estimates and corresponding 95% confidence intervals should always be reported.
Conflict of interest
No conflict of interests declared.
References
[1] Mills JL. Data torturing. N EnglJ Med 1993;329:1196–9.10.1056/NEJM199310143291613Search in Google Scholar
[2] ICH E9. Note for guidance on statistical principles for clinical trials (CPMP/ICH/363/96); 2013. http://www.ema.europa.eu/docs/en_GB/document_ library/Scientific_guideline/2009/09/WC500002928.pdf.Search in Google Scholar
© 2013 Scandiavian Association for the Study of Pain