Diagnostic errors in medicine pose a significant burden to patients, providers, and the overall healthcare system, leading to increased morbidity and mortality and significant financial implications. Diagnostic errors are estimated to occur in at least 5% of patients in the outpatient setting ,  and up to 17% of in-hospital adverse events are attributed to diagnostic error . In Emergency Medicine (EM), the true diagnostic error rate is unknown. Prior studies on the topic estimate this to be anywhere from 0.6% to 35% of cases depending on the chief complaint , , . Diagnostic errors affect patient outcomes and trigger quality assurance (QA), risk management, and medical malpractice actions. Prior work suggests that diagnostic errors result in 40,000–80,000 deaths annually in the Unites States , . They also represent 29–35% of malpractice claims and result in the highest proportion of malpractice payouts , , . Diagnostic error is a significant issue for quality assurance (QA) and patient safety initiatives and is a public health imperative , , .
Diagnostic error is multifactorial with contributions from both systems and cognitive factors , . Common causes include breakdown in the patient-physician encounter and follow-up , , , . Errors (along with resulting malpractice cases) could potentially be reduced through resident education on diagnostic error and strategies to avoid it. The Accreditation Council for Graduate Medical Education (ACGME) common program requirements mandate resident participation in quality improvement and patient safety education . However, the methods and dedicated time training programs use to educate residents on the topics of diagnostic errors, QA and malpractice/risk management are unknown.
The objectives of our study were to identify the current methods used to teach EM residents about diagnostic errors, QA, and malpractice/risk management and to determine the educational time EM training programs dedicate to teaching these topics. As diagnostic error interplays significantly with both malpractice and QA, we focused on the time allotted to these latter specific topics. Additionally, as EM residencies have both 3- and 4-year models, we aimed to determine if there was a difference in educational time dedicated to these topics by program length.
Materials and methods
We conducted a survey study of EM residency directors of ACGME-accredited programs. The medical education team at our institution, which included the residency director and medical student clerkship directors, as well as our quality assurance leadership, developed an 11-item questionnaire (see Supplementary Material, Appendix 1). Respondents were asked to identify the name of their program (to avoid redundancy of responses) and to identify the length of their residency program. Nationwide in the United States, 71% of EM residency programs are 3-year programs, and the remaining are 4-year programs . The survey examined what modalities were used to teach the following topics: diagnostic errors, QA, and malpractice/risk management education. The survey was piloted among the medical education faculty within our department for ease of use, and the authors made minor modifications for clarity based on feedback.
Through the Council of Emergency Medicine Residency Directors (CORD) listserv, we identified 168 ACGME-accredited EM Programs. The survey was emailed to the CORD listserv in September 2015 and a reminder email was sent 2 weeks later. Four weeks after the initial survey request, program directors of residencies who did not complete the survey were contacted individually by email and asked to respond. Responses were recorded in a REDCap database . Duplicate responses from individual programs were removed, with the first response from a program being used. Additionally, as the CORD listserv also included non-ACGME-accredited programs, responses from programs not included in the identified 168 ACGME-accredited programs were removed. Results were de-identified prior to data analysis and stored on a secure server. Differences in the proportions of responses by duration of training program (3 vs. 4 years) were analyzed using chi-squared or Fisher’s exact tests, as appropriate. Analysis was performed using Stata 14.2 (College Station, TX, USA). This study was reviewed by the Institutional Review Board at our institution and determined exempt from further review.
Fifty-four percent (91/168) of the EM programs responded. There was no difference in prevalence of formal education on these topics among 3- and 4-year programs (Table 1). The different educational modalities used by programs are shown in Table 2. The majority of programs (59.5%) offer fewer than 4 h per year of additional QA education beyond morbidity and mortality (M&M) rounds (Table 3); fewer programs (18.8%) offer more than 4 h per year of medical malpractice/risk management education (Table 4).
The results of our study demonstrate that the majority of ACGME-certified EM residency programs who responded to our survey offer formal didactics on diagnostic errors, QA, and medical malpractice/risk management. The modalities of education are varied, and the majority of programs offer fewer than 4 h of dedicated educational time on QA and medical malpractice/risk management.
Resident education on diagnostic error is currently evolving. Several curricular interventions on these topics have been proposed in the literature. Ruedinger et al. described a 6-month longitudinal curriculum incorporating interactive lectures, small group discussions, case analysis, case conference, and an interactive faculty panel over three distinct sessions encompassing 9 h of education time. Residents found the curriculum helpful and had improved awareness of strategies to reduce cognitive error . Likewise, Reilly et al. developed a longitudinal 1-year curriculum on diagnostic errors and cognitive bias comprised of didactics, case-based discussion, small group narratives, and an online module divided into three separate sessions, which improved Internal Medicine residents’ knowledge and awareness of cognitive bias . While EM programs in our study utilized a variety of educational modalities for education on diagnostic errors including simulation and small group discussions, M&M and lecture were the most frequent approaches. EM programs may consider devoting more time to other modalities such as small group discussion, case-based learning, and web-based modules to expand resident education on diagnostic error.
Educational initiatives on diagnostic error in EM should include discussions about the cognitive and systems factors that contribute to diagnostic errors. Croskerry highlights the dual process model of reasoning for clinical decision-making and diagnostic error . He has also extensively described specific cognitive biases, how they lead to errors, and strategies for cognitive de-biasing including metacognition , . Additionally, various strategies have been shown (or suggested) to reduce errors including checklists, structured processes for patient handoffs, and the “diagnostic time-out” , , . An understanding of these cognitive and systems-based mechanisms is imperative for understanding diagnostic errors and should be included in curriculum development efforts.
In addition to new educational curriculum focusing on diagnostic error, several EM curricula focusing on medical malpractice have been proposed. Houry and Shockley developed a formalized 1-week curriculum during which EM residents reviewed malpractice cases and observed settlement discussions with a malpractice insurance company, which resulted in an improved understanding of the medicolegal aspects of EM practice . Schlicher and Ten Eyck utilized a layered simulation session involving a case with an adverse outcome and subsequent simulated deposition. EM residents rated this curriculum highly . In our study, only 10% of 3-year programs and 17% of 4-year programs utilized simulation cases. Further studies are needed to assess the efficacy of traditionally used teaching modalities (i.e. M&M conference, lectures) as well as more novel techniques.
One of the most common teaching modalities utilized by residency programs for all topics was M&M rounds. While M&M rounds can provide valuable clinical education, they may not analyze the intricacies of medical malpractice/risk management , . This can lead to an overall lack of legal knowledge as well as inexperience with malpractice case reviews , . In a recent analysis of over 350,000 open and closed EM malpractice claims, Gurley et al. found that residents were named in 13% of cases and that resident cases were characterized as higher in severity . Given this substantial percentage and the downstream consequences entailed in malpractice claims as well as the significant contribution of diagnostic error to over 25% of malpractice cases and 35% of malpractice payouts , it is imperative that residency programs provide education on these topics early in training.
The lack of dedicated teaching time towards these topics, as demonstrated in our study, is not limited to EM. Ruedinger et al. note that formal education on diagnostic errors is lacking in many graduate medical education programs . In one survey of medicolegal knowledge of Family Medicine residents, respondents noted a lack of knowledge of medicolegal issues . Likewise, over 70% of medical chief residents felt that their training on medicolegal issues was insufficient . Furthermore, the American Academy of Pediatrics states that residents and fellows must be educated on matters relating to medical liability by their training programs . Given these findings and recommendations as well as the paucity of dedicated educational time we found in our survey, a standardized approach for teaching these topics across multiple specialties may be beneficial and allow for interdepartmental collaboration.
Our study serves as a needs assessment for improvement in EM resident education. A new standardized curriculum incorporating high-yield lectures by legal counsel, faculty panels, participation in review of cases and depositions with the residency malpractice insurance provider, layered simulation cases on diagnostic error, and participation in departmental QA review process has the potential to enhance resident comfort and understanding of these important topics.
This study has several limitations. First, given the variability in educational curriculum and the survey methodology, the exact categorization of QA, diagnostic error, risk management/malpractice may differ among programs. The terminology used in the survey, such as “formal required didactics”, may not be interpreted in the same manner by every program and this may have influenced the results. The terminology is slightly different from that used in the EM milestones project and may have been interpreted differently by survey participants. It is unknown if education on risk management/medical malpractice, diagnostic errors, and QA influences the likelihood of making a diagnostic error or being involved in a medical malpractice case.
The majority of EM programs have formal education on diagnostic errors, QA, malpractice/risk management. The modalities for teaching these topics vary across programs and the overall number of educational hours devoted to QA and malpractice/risk management is low. A more formalized curricular structure with increased time allotment in the residency educational curriculum may prove enhance resident knowledge of these patient safety and health care quality issues.
Singh H, Meyer AN, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf 2014;23:727–31. CrossrefWeb of SciencePubMedGoogle Scholar
National Academies of Sciences, Engineering, and Medicine. Improving diagnosis in health care. Washington, DC: National Academies Press, 2015. Google Scholar
Medford-Davis L, Park E, Shlamovitz G, Suliburk J, Meyer AN, Singh H. Diagnostic errors related to acute abdominal pain in the emergency department. Emerg Med J 2016;33:253–9. Web of ScienceCrossrefPubMedGoogle Scholar
Brown TW, McCarthy ML, Kelen GD, Levy F. An epidemiologic study of closed emergency department malpractice claims in a national database of physician malpractice insurers. Acad Emerg Med 2010;17:553–60. Web of ScienceCrossrefGoogle Scholar
Kachalia A, Gandhi TK, Puopolo AL, Yoon C, Thomas EJ, Griffey R, et al. Missed and delayed diagnoses in the emergency department: a study of closed malpractice claims from 4 liability insurers. Ann Emerg Med 2007;49:196–205. PubMedWeb of ScienceCrossrefGoogle Scholar
Hoffman J, editor. 2014 Annual benchmarking report: malpractice risks in the diagnostic process. Cambridge, MA: CRICO strategies, 2014. Google Scholar
Singh H, Giardina TD, Meyer AN, Forjuoh SN, Reis MD, Thomas EJ. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med 2013;173:418–25. PubMedCrossrefWeb of ScienceGoogle Scholar
Accreditation Council for Graduate Medical Education. ACGME Common Program Requirements (Residency). Available at: https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/CPRResidency2019.pdf. Accessed: 24 Jul 2018.
Society for Academic Emergency Medicine. Residency Directory. Available at: http://saem.org/resources/directories/residency-directory. Accessed: 15 Nov 2018.
Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. PubMedCrossrefWeb of ScienceGoogle Scholar
Ruedinger E, Olson M, Yee J, Borman-Shoap E, Olson AP. Education for the next frontier in patient safety: a longitudinal resident curriculum on diagnostic error. Am J Med Qual 2017;32:625–31. CrossrefWeb of SciencePubMedGoogle Scholar
Reilly JB, Ogdie AR, Von Feldt JM, Myers JS. Teaching about how doctors think: a longitudinal curriculum in cognitive bias and diagnostic error for residents. BMJ Qual Saf 2013;22:1044–50. Web of SciencePubMedCrossrefGoogle Scholar
Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove S, et al. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med 2006;355:2725–32. PubMedCrossrefGoogle Scholar
Starmer AJ, Sectish TC, Simon DW, Keohane C, McSweeney ME, Chung EY, et al. Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. J Am Med Assoc 2013;310:2262–70. Web of ScienceCrossrefGoogle Scholar
Houry D, Shockley LW. Evaluation of a residency program’s experience with a one-week emergency medicine resident rotation at a medical liability insurance company. Acad Emerg Med 2001;8:765–7. CrossrefGoogle Scholar
Gurley KL, Grossman SA, Janes M, Yu-Moe CW, Song E, Tibbles CD, et al. Comparison of emergency medicine malpractice cases involving residents to non-resident cases. Acad Emerg Med 2018;25:980–6. CrossrefGoogle Scholar
Committee on Medical Liability and Risk Management, Gonzalez JL. Professional liability insurance and medicolegal education for pediatric residents and fellows. Pediatrics 2011;128:624–9. Web of ScienceCrossrefPubMedGoogle Scholar
The online version of this article offers supplementary material (https://doi.org/10.1515/dx-2018-0079).
About the article
Published Online: 2019-02-28
Published in Print: 2019-06-26
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.