We describe an approach for analyzing failures in diagnostic processes in a small, enriched cohort of general medicine patients who expired during hospitalization and experienced medical error. Our objective was to delineate a systematic strategy for identifying frequent and significant failures in the diagnostic process to inform strategies for preventing adverse events due to diagnostic error.
Two clinicians independently reviewed detailed records of purposively sampled cases identified from established institutional case review forums and assessed the likelihood of diagnostic error using the Safer Dx instrument. Each reviewer used the modified Diagnostic Error Evaluation and Research (DEER) taxonomy, revised for acute care (41 possible failure points across six process dimensions), to characterize the frequency of failure points (FPs) and significant FPs in the diagnostic process.
Of 166 cases with medical error, 16 were sampled: 13 (81.3%) had one or more diagnostic error(s), and a total of 113 FPs and 30 significant FPs were identified. A majority of significant FPs (63.3%) occurred in “Diagnostic Information and Patient Follow-up” and “Patient and Provider Encounter and Initial Assessment” process dimensions. Fourteen (87.5%) cases had a significant FP in at least one of these dimensions.
Failures in the diagnostic process occurred across multiple dimensions in our purposively sampled cohort. A systematic analytic approach incorporating the modified DEER taxonomy, revised for acute care, offered critical insights into key failures in the diagnostic process that could serve as potential targets for preventative interventions.
Funding source: Agency for Healthcare Research and Quality
Award Identifier / Grant number: R18HS026613
We would like to thank Drs. Marc Pimentel and Mallika Mendu and Dr. Nina Chalfin for providing cases from the Brigham and Women’s Hospital (BWH) Morbidity and Mortality review process, and Brigham Health’s Hospital Medicine Unit Quality Assurance committee, respectively.
Research funding: This research is funded by AHRQ PSLL Award R18 - HS026613.
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
Competing interests: Dr. Dalal reports consulting fees from MayaMD, which makes AI software for patient engagement and decision support. Dr. Rozenblum reports having an equity in Hospitech Respiration Ltd, which makes Airway Management Solutions. Dr. Bates reports grants and personal fees from EarlySense, personal fees from CDI Negev, equity from ValeraHealth, equity from Clew, equity from MDClone, personal fees and equity from AESOP, and grants from IBM Watson Health, outside the submitted work. Authors otherwise report no conflicts of interest.
Informed consent: Not applicable.
Ethical approval: The local Institutional Review Board provided approval for the conduct of this study.
1. Singh, H, Graber, ML. Improving diagnosis in health care — the next imperative for patient safety. N Engl J Med 2015;373:2493–5. https://doi.org/10.1056/NEJMp1512241.Search in Google Scholar PubMed
2. Medford-Davis, L, Park, E, Shlamovitz, G, Suliburk, J, Meyer, AND, Singh, H. Diagnostic errors related to acute abdominal pain in the emergency department. Emerg Med J 2016;33:253–9. https://doi.org/10.1136/emermed-2015-204754.Search in Google Scholar PubMed
3. Zwaan, L, Schiff, GD, Singh, H. Advancing the research agenda for diagnostic error reduction. BMJ Qual Saf 2013;22(Suppl 2):52–7. https://doi.org/10.1136/bmjqs-2012-001624.Search in Google Scholar PubMed PubMed Central
4. Zwaan, L, Singh, H. Diagnostic error in hospitals : finding forests not just the big trees; 2020. pp. 1–4.10.1136/bmjqs-2020-011099Search in Google Scholar PubMed
5. Newman-Toker, DE, Pronovost, PJ. Diagnostic errors the next Frontier for patient safety. JAMA, J Am Med Assoc 2009;301:1060–2. https://doi.org/10.1001/jama.2009.249.Search in Google Scholar PubMed
6. Itri, JN, Tappouni, RR, Mceachern, RO, Pesch, AJ, Patel, SH. Fundamentals of diagnostic error in imaging. Radiographics 2018;38:1845–65. https://doi.org/10.1148/rg.2018180021.Search in Google Scholar PubMed
7. Voisin, S, Pinto, F, Morin-Ducote, G, Hudson, KB, Tourassi, GD. Predicting diagnostic error in radiology via eye-tracking and image analytics: preliminary investigation in mammography. Med Phys 2013;40:1–10. https://doi.org/10.1118/1.4820536.Search in Google Scholar PubMed
8. Bakradze, E, Liberman, AL. Diagnostic error in stroke—reasons and proposed Solutions. Curr Atherosclerosis Rep 2018;20:1–13. https://doi.org/10.1007/s11883-018-0712-3.Search in Google Scholar PubMed
9. Carberry, AR, Hanson, K, Flannery, A, Fischer, M, Gehlbach, J, Diamond, C, et al.. Diagnostic error in pediatric cancer. Clin Pediatr 2017;57:11–8. https://doi.org/10.1177/0009922816687325.Search in Google Scholar PubMed
10. Davalos, MC, Samuels, K, Meyer, AND, Thammasitboon, S, Sur, M, Roy, K, et al.. Finding diagnostic errors in children admitted to the PICU. Pediatr Crit Care Med 2017;18:265–71. https://doi.org/10.1097/pcc.0000000000001059.Search in Google Scholar
11. Perry, MF, Melvin, JE, Kasick, RT, Kersey, KE, Scherzer, DJ, Kamboj, MK, et al.. The diagnostic error index: a quality improvement initiative to identify and measure diagnostic errors. J Pediatr 2021;232:257–63. https://doi.org/10.1016/j.jpeds.2020.11.065.Search in Google Scholar PubMed
12. Gupta, A, Snyder, A, Kachalia, A, Flanders, S, Saint, S, Chopra, V. Malpractice claims related to diagnostic errors in the hospital. BMJ Qual Saf 2018;27:53–60. https://doi.org/10.1136/bmjqs-2017-006774.Search in Google Scholar PubMed
13. Graber, ML. The incidence of diagnostic error in medicine. BMJ Qual Saf 2013;22(Suppl 2):21–7. https://doi.org/10.1136/bmjqs-2012-001615.Search in Google Scholar PubMed PubMed Central
14. Gunderson, CG, Bilan, VP, Holleck, JL, Nickerson, P, Cherry, BM, Chui, P, et al.. Prevalence of harmful diagnostic errors in hospitalised adults: a systematic review and meta-analysis. BMJ Qual Saf 2020;29:1008–18. https://doi.org/10.1136/bmjqs-2019-010822.Search in Google Scholar PubMed
15. Raffel, KE, Kantor, MA, Barish, P, Esmaili, A, Lim, H, Xue, F, et al.. Prevalence and characterisation of diagnostic error among 7-day all-cause hospital medicine readmissions: a retrospective cohort study. BMJ Qual Saf 2020;29:971–9. https://doi.org/10.1136/bmjqs-2020-010896.Search in Google Scholar PubMed
16. Zwaan, L, Singh, H. The challenges in defining and measuring diagnostic error. Diagnosis 2015;2:97–103. https://doi.org/10.1515/dx-2014-0069.Search in Google Scholar PubMed PubMed Central
17. Shenvi, EC, El-Kareh, R. Clinical criteria to screen for inpatient diagnostic errors: a scoping review. Diagnosis 2014;2:3–19. https://doi.org/10.1515/dx-2014-0047.Search in Google Scholar PubMed PubMed Central
18. Singh, H, Khanna, A, Spitzmueller, C, Meyer, AND. Recommendations for using the Revised Safer Dx Instrument to help measure and improve diagnostic safety. Diagnosis 2019;6:315–23. https://doi.org/10.1515/dx-2019-0012.Search in Google Scholar PubMed
19. Mendu, ML, Lu, Y, Petersen, A, Tellez, MG, Beloff, J, Fiumara, K, et al.. Reflections on implementing a hospital-wide provider-based electronic inpatient mortality review system: lessons learnt. BMJ Qual Saf 2020;29:304–12. https://doi.org/10.1136/bmjqs-2019-009864.Search in Google Scholar PubMed
20. Provenzano, A, Rohan, S, Trevejo, E, Burdick, E, Lipsitz, S, Kachalia, A. Evaluating inpatient mortality: a new electronic review process that gathers information from front-line providers. BMJ Qual Saf 2015;24:31–7. https://doi.org/10.1136/bmjqs-2014-003120.Search in Google Scholar PubMed
21. Lavrakas, P. Encyclopedia of survey research methods. California: Thousand Oaks; 2008.10.4135/9781412963947Search in Google Scholar
22. Al-Mutairi, A, Meyer, AND, Thomas, EJ, Etchegaray, JM, Roy, KM, Davalos, MC, et al.. Accuracy of the safer dx instrument to identify diagnostic errors in primary care. J Gen Intern Med 2016;31:602–8. https://doi.org/10.1007/s11606-016-3601-x.Search in Google Scholar
23. Piniella, N, Malik, M, Bersani, K, Schnock, K, Garabedian, P, Bates, DW, et al.. Developing an electronic chart review tool to identify and assess diagnostic errors in the acute care setting. Washington DC; 2019.Search in Google Scholar
24. Schiff, GD, Hasan, O, Kim, S, Abrams, R, Cosby, K, Lambert, BL, et al.. Diagnostic error in medicine: analysis of 583 physician-reported errors. Arch Intern Med 2009;169:1881–7. https://doi.org/10.1001/archinternmed.2009.333.Search in Google Scholar
25. Schiff, GD, Kim, S, Abrams, R, Cosby, K, Lambert, B, Elstein, AS, et al.. Diagnosing diagnosis errors: lessons from a multi-institutional collaborative project. In: Henriksen, K, Battles, JB, Marks, ES, Lewin, DI, editors. Rockville (MD); 2005.Search in Google Scholar
26. Saber Tehrani, AS, Lee, HW, Mathews, SC, Shore, A, Makary, MA, Pronovost, PJ, et al.. 25-Year summary of US malpractice claims for diagnostic errors 1986-2010: an analysis from the National Practitioner Data Bank. BMJ Qual Saf 2013;22:672–80. https://doi.org/10.1136/bmjqs-2012-001550.Search in Google Scholar
27. Ryan, AM. Paid malpractice claims for adverse events in inpatient and outpatient settings (Journal of the American Medical Association (2011) 305, 23 (2427-2431)). JAMA, J Am Med Assoc 2011;306:384. https://doi.org/10.1001/jama.2011.1046.Search in Google Scholar
28. Schaffer, AC, Jena, AB, Seabury, SA, Singh, H, Chalasani, V, Kachalia, A. Rates and characteristics of paid malpractice claims among US Physicians by Specialty, 1992-2014. JAMA Intern Med 2017;177:710–8. https://doi.org/10.1001/jamainternmed.2017.0311.Search in Google Scholar
29. Singh, H, Sittig, DF. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf 2015;24:103–10. https://doi.org/10.1136/bmjqs-2014-003675.Search in Google Scholar
30. Roy, CL, Rothschild, JM, Dighe, AS, Schiff, GD, Graydon-Baker, E, Lenoci-Edwards, J, et al.. An initiative to improve the management of clinically significant test results in a large health care network. Joint Comm J Qual Patient Saf 2013;39:517–27. https://doi.org/10.1016/s1553-7250(13)39068-0.Search in Google Scholar
31. Garber, A, Wu, L, Malik, M, Carr, K, Bersani, K, Fraser, H, et al.. Design and development OF a diagnostic time-out to address diagnostic errors in acute care. In: Abstract published at hospital medicine 2020, virtual competition abstract 386 journal of hospital medicine; 2021.Search in Google Scholar
32. Kipnis, P, Turk, BJ, Wulf, DA, LaGuardia, JC, Liu, V, Churpek, MM, et al.. Development and validation of an electronic medical record- based alert score for detection of inpatient deterioration outside the ICU. J Biomed Inf 2016;64:10–9. https://doi.org/10.1016/j.jbi.2016.09.013.Search in Google Scholar PubMed PubMed Central
33. Dalal, AK, Schnipper, JL. Care team identification in the electronic health record: a critical first step for patient-centered communication. J Hosp Med 2016;11:381–5. https://doi.org/10.1002/jhm.2542.Search in Google Scholar PubMed
The online version of this article offers supplementary material (https://doi.org/10.1515/dx-2021-0033).
© 2021 Walter de Gruyter GmbH, Berlin/Boston