Faculty Bibliography

BACKGROUND: A subset of high-risk procedures present significant safety threats due to their (1) infrequent occurrence, (2) execution under time constraints and (3) immediate necessity for patient survival. A Just-in-Time (JIT) intervention could provide real-time bedside guidance to improve high-risk procedural performance and address procedural deficits associated with skill decay. OBJECTIVE: To evaluate the impact of a novel JIT intervention on transvenous pacemaker (TVP) placement during a simulated patient event. METHODS: This was a prospective, randomised controlled study to determine the effect of a JIT intervention on performance of TVP placement. Subjects included board-certified emergency medicine physicians from two hospitals. The JIT intervention consisted of a portable, bedside computer-based procedural adjunct. The primary outcome was performance during a simulated patient encounter requiring TVP placement, as assessed by trained raters using a technical skills checklist. Secondary outcomes included global performance ratings, time to TVP placement, number of critical omissions and System Usability Scale scores (intervention only). RESULTS: Groups were similar at baseline across all outcomes. Compared with the control group, the intervention group demonstrated statistically significant improvement in the technical checklist score (11.45 vs 23.44, p<0.001, Cohen's d effect size 4.64), the global rating scale (2.27 vs 4.54, p<0.001, Cohen's d effect size 3.76), and a statistically significant reduction in critical omissions (2.23 vs 0.68, p<0.001, Cohen's d effect size -1.86). The difference in time to procedural completion was not statistically significant between conditions (11.15 min vs 12.80 min, p=0.12, Cohen's d effect size 0.65). System Usability Scale scores demonstrated excellent usability. CONCLUSION: A JIT intervention improved procedure perfromance, suggesting a role for JIT interventions in rarely performed procedures.

INTRODUCTION: The WestJEM Blog and Podcast Watch presents high-quality, open-access educational blogs and podcasts in emergency medicine (EM) based on the ongoing Academic Life in EM (ALiEM) Approved Instructional Resources (AIR) and AIR-Professional series. Both series critically appraise resources using an objective scoring rubric. This installment of the Blog and Podcast Watch highlights the topic of procedure emergencies from the AIR Series. METHODS: The AIR Series is a continuously building curriculum that follows the Council of Emergency Medicine Residency Directors' (CORD) annual testing schedule. For each module, relevant content is collected from the top 50 Social Media Index sites published within the previous 12 months, and scored by eight AIR board members using five equally weighted measurement outcomes: Best Evidence in Emergency Medicine (BEEM) score, accuracy, educational utility, evidence based, and references. Resources scoring >/=30 out of 35 available points receive an AIR label. Resources scoring 27-29 receive an "honorable mention" label if the executive board agrees that the post is accurate and educationally valuable. RESULTS: A total of 85 blog posts and podcasts were evaluated in June 2016. This report summarizes key educational pearls from the three AIR posts and the 10 Honorable Mentions. CONCLUSION: The WestJEM Blog and Podcast Watch series is based on the AIR and AIR-Pro series, which attempts to identify high-quality educational content on open-access blogs and podcasts. This series provides an expert-based, post-publication curation of educational social media content for EM clinicians, with this installment focusing on procedure emergencies within the AIR series.

Objective/UNASSIGNED:Burnout is common among emergency medicine (EM) physicians, and it is prevalent even among EM trainees. Recently proposed Accreditation Council for Graduate Medical Education requirements encourage faculty to alert residency leadership when trainees display signs of burnout. It remains uncertain how trainees experiencing burnout can be reliably identified. We examined if EM faculty advisers at one institution can accurately predict burnout in their EM resident advisees. Methods/UNASSIGNED:In this cross-sectional, exploratory study at a single institution, we measured EM trainee burnout using the Maslach Burnout Inventory through a confidential, electronic survey. We subsequently asked EM faculty to predict if their designated advisees were experiencing burnout through a separate confidential, electronic survey. Burnout results were dichotomized from each survey and compared using a 2 × 2 contingency table and Fisher's exact test. Results/UNASSIGNED:Thirty-six of 54 (66.7%) eligible EM trainees completed the burnout assessment. Eleven of 19 (57.9%) eligible faculty advisers completed trainee burnout predictions, resulting in 30 of 54 (55.6%) trainees who completed the burnout assessment and had a faculty burnout prediction. Trainees reported an overall burnout rate of 70.0% (95% confidence interval [CI] = 53.6% to 86.4%). Cumulative faculty predictions of trainee burnout resulted in an overall burnout rate of 16.7% (95% CI = -5.3% to 38.7%). The sensitivity and specificity of faculty predictions of trainee burnout were 19.1% (95% CI = 5.5% to 41.9%) and 88.9% (95% CI = 51.8% to 99.7%), respectively. Faculty prediction of trainee burnout had a positive predictive value of 80.0% (95% CI = 28.4% to 99.5%) and a negative predictive value of 32.0% (95% CI = 15.0% to 53.5). The difference between trainees' reported rate of burnout and faculty predictions of trainee burnout was significant (p < 0.001). Conclusion/UNASSIGNED:Emergency medicine faculty prediction of trainee burnout was poor. Education on recognizing burnout and other methods of identifying trainee burnout may be necessary.

INTRODUCTION: Emergency medicine (EM) residency programs may be 36 or 48 months in length. The Residency Review Committee for EM requires that 48-month programs provide educational justification for the additional 12 months. We developed additional milestones that EM training programs might use to assess outcomes in domains that meet this accreditation requirement. This study aims to assess for content validity of these supplemental milestones using a similar methodology to that of the original EM Milestones validation study. METHODS: A panel of EM program directors (PD) and content experts at two institutions identified domains of additional training not covered by the existing EM Milestones. This led to the development of six novel subcompetencies: "Operations and Administration," "Critical Care," "Leadership and Management," "Research," "Teaching and Learning," and "Career Development." Subject-matter experts at other 48-month EM residency programs refined the milestones for these subcompetencies. PDs of all 48-month EM programs were then asked to order the proposed milestones using the Dreyfus model of skill acquisition for each subcompetency. Data analysis mirrored that used in the original EM Milestones validation study, leading to the final version of our supplemental milestones. RESULTS: Twenty of 33 subjects (58.8%) completed the study. No subcompetency or individual milestone met deletion criteria. Of the 97 proposed milestones, 67 (69.1%) required no further editing and remained at the same level as proposed by the study authors. Thirty milestones underwent level changes: 15 (15.5%) were moved one level up and 13 (13.4%) were moved one level down. One milestone (1.0%) in "Leadership and Management" was moved two levels up, and one milestone in "Operations and Administration" was moved two levels down. One milestone in "Research" was ranked by the survey respondents at one level higher than that proposed by the authors; however, this milestone was kept at its original level assignment. CONCLUSION: Six additional subcompetencies were generated and assessed for content validity using the same methodology as was used to validate the current EM Milestones. These optional milestones may serve as an additional set of assessment tools that will allow EM residency programs to report these additional educational outcomes using a familiar milestone rubric.

BACKGROUND: Reading emergent electrocardiograms (ECGs) is one of the emergency physician's most crucial tasks, yet no well-validated tool exists to measure resident competence in this skill. OBJECTIVES: To assess validity of a novel tool measuring emergency medicine resident competency for interpreting, and responding to, critical ECGs. In addition, we aim to observe trends in this skill for resident physicians at different levels of training. METHODS: This is a multi-center, prospective study of postgraduate year (PGY) 1-4 residents at five emergency medicine (EM) residency programs in the United States. An assessment tool was created that asks the physician to identify either the ECG diagnosis or the best immediate management. RESULTS: One hundred thirteen EM residents from five EM residency programs submitted completed assessment surveys, including 43 PGY-1s, 33 PGY-2s, and 37 PGY-3/4s. PGY-3/4s averaged 74.6% correct (95% confidence interval [CI] 70.9-78.4) and performed significantly better than PGY-1s, who averaged 63.2% correct (95% CI 58.0-68.3). PGY-2s averaged 69.0% (95% CI 62.2-73.7). Year-to-year differences were more pronounced in management than in diagnosis. CONCLUSIONS: Residency training in EM seems to be associated with improved ability to interpret "critical" ECGs as measured by our assessment tool. This lends validity evidence for the tool by correlating with a previously observed association between residency training and improved ECG interpretation. Resident skill in ECG interpretation remains less than ideal. Creation of this sort of tool may allow programs to assess resident performance as well as evaluate interventions designed to improve competency.

BACKGROUND: Team leadership is a critical skill for emergency medicine physicians that directly affects team performance and the quality of patient care. There exists a robust body of team science research supporting team leadership conceptual models and behavioral skill sets. However, to date, this work has not been widely incorporated into health care team leadership education. OBJECTIVE: This narrative review has 3 aims: (1) to synthesize the team science literature and to translate important concepts and models to health care team leadership; (2) to describe how team leadership is currently represented in the health care literature and in the Accreditation Council for Graduate Medical Education Milestones for emergency medicine; and (3) to propose a novel, evidence-based framework for the assessment of team leadership in emergency medicine. METHODS: We conducted a narrative review of the team science and health care literature. We summarized our findings and identified a list of team leadership behaviors that were then used to create a framework for team leadership assessment. RESULTS: Current health care team leadership measurement tools do not incorporate evidence-based models of leadership concepts from other established domains. The emergency medicine milestones include several team leadership behaviors as part of a larger resident evaluation program. However, they do not offer a comprehensive or cohesive representation of the team leadership construct. CONCLUSIONS: Despite the importance of team leadership to patient care, there is no standardized approach to team leadership assessment in emergency medicine. Based on the results of our review, we propose a novel team leadership assessment framework that is supported by the team science literature.

OBJECTIVE: This study sought to define expert opinion on the ideal length of training (LoT) for Accreditation Council of Graduate Medical Education (ACGME)-accredited emergency medicine (EM) residency programs. METHODS: A cross-sectional Web-based survey was sent to program directors (PDs) at all ACGME-accredited EM residency programs during a study period of August to October 2014. The primary outcome of ideal LoT was determined in two ways: 1) subjects provided the ideal total LoT in months and 2) then separately selected the type and number of rotations for an ideal EM residency curriculum by month, the sum of which provided an alternative measurement of their ideal LoT. We did not include vacation time. Descriptive statistics and an analysis of variance are reported. RESULTS: Response rate was 68.0% (108/159) with 72% of respondents (78/108) directing programs in the PGY 1-3 (36-month) format and 28% directing PGY 1-4 (48-month) programs. More than half of subjects (51.9%) have direct personal experience with both formats. When asked about ideal total LoT, PDs averaged 41.5 months (n = 107; SD = 5.5 months, range = 36-60 months). When asked to provide durations of individual clinical experiences for their ideal EM program, the sum total (n = 104) averaged 45.0 months. Results from a factorial analysis of variance revealed statistically significant effects of PDs' past training experiences: participants who trained in a 36-month program had statistically significantly lower LoT (mean = 39.2 months) than participants who trained in a 48-month program (mean = 44.5 months). There was also a statistically significant effect of current program format on ideal LoT: participants who directed a 36-month program had statistically significantly lower LoT (mean = 39.8 months) than participants who directed a 48-month program (mean = 45.8 months). CONCLUSIONS: PD opinion on ideal LoT averages between 36 and 48 months, but is longer when the sum of desired clinical rotations is considered. While half of the respondents reported direct experience with both PGY 1-3 and PGY 1-4 training programs, opinions on ideal LoT through both methods corresponded strongly with the length of the program the PDs trained in and the format of the program they currently direct. PD opinions may be too biased by their own experiences to provide objective input on the ideal LoT for EM residency programs.

Background Emergency medicine (EM) residency programs can provide up to 20% of their planned didactic experiences asynchronously through the Individualized Interactive Instruction (III) initiative. Although blogs and podcasts provide potential material for III content, programs often struggle with identifying quality online content. Objective To develop and implement a process to curate quality EM content on blogs and podcasts for resident education and III credit. Methods We developed the Approved Instructional Resources (AIR) Series on the Academic Life in Emergency Medicine website. Monthly, an editorial board identifies, peer reviews, and writes assessment questions for high-quality blog/podcast content. Eight educators rate each post using a standardized scoring instrument. Posts scoring >/= 30 of 35 points are awarded an AIR badge and featured in the series. Enrolled residents can complete an assessment quiz for III credit. After 12 months of implementation, we report on program feasibility, enrollment rate, web analytics, and resident satisfaction scores. Results As of June 2015, 65 EM residency programs are enrolled in the AIR Series, and 2140 AIR quizzes have been completed. A total of 96% (2064 of 2140) of participants agree or strongly agree that the activity would improve their clinical competency, 98% (2098 of 2140) plan to use the AIR Series for III credit, and 97% (2077 of 2140) plan to use it again in the future. Conclusions The AIR Series is a national asynchronous EM curriculum featuring quality blogs and podcasts. It uses a national expert panel and novel scoring instrument to peer review web-based educational resources.

INTRODUCTION: Burnout is a syndrome of depersonalization, emotional exhaustion and sense of low personal accomplishment. Emergency physicians (EPs) experience the highest levels of burnout among all physicians. Burnout is associated with greater rates of self-reported suboptimal care among surgeons and internists. The association between burnout and suboptimal care among EPs is unknown. The objective of the study was to evaluate burnout rates among attending and resident EPs and examine their relationship with self-reported patient care practices. METHODS: In this cross-sectional study burnout was measured at two university-based emergency medicine residency programs with the Maslach Burnout Inventory. We also measured depression, quality of life (QOL) and career satisfaction using validated questionnaires. Six items assessed suboptimal care and the frequency with which they were performed. RESULTS: We included 77 out of 155 (49.7%) responses. The EP burnout rate was 57.1%, with no difference between attending and resident physicians. Residents were more likely to screen positive for depression (47.8% vs 18.5%, p=0.012) and report lower QOL scores (6.7 vs 7.4 out of 10, p=0.036) than attendings. Attendings and residents reported similar rates of career satisfaction (85.2% vs 87.0%, p=0.744). Burnout was associated with a positive screen for depression (38.6% vs 12.1%, p=0.011) and lower career satisfaction (77.3% vs 97.0%, p=0.02). EPs with high burnout were significantly more likely to report performing all six acts of suboptimal care. CONCLUSION: A majority of EPs demonstrated high burnout. EP burnout was significantly associated with higher frequencies of self-reported suboptimal care. Future efforts to determine if provider burnout is associated with negative changes in actual patient care are necessary.