Faculty Bibliography

Undergraduate medical educators seek to optimize student learning, improve grading transparency and fairness, and provide useful information to residency programs. Recently, the United States Medical Licensing Examination's shift to pass/fail scoring for Step 1 disrupted curricular and assessment operations, and schools' tiered grading practices have been scrutinized. In noting that significant institutional time and energy were being expended in addressing the current levels of student grade appeals, 6 public and private medical schools in the Northeastern United States engaged in an examination of grade appeals via a root cause analysis (RCA). From November 2021 to April 2022, the authors reviewed specific instances of grading challenges that the team of educators encountered previously. From May to June 2022, the authors met for a facilitated discussion of the question, "Why are students challenging grading processes and systems or outcomes?" From July to October 2022, the authors identified root causes by analyzing results from the fishbone diagram (process, equipment, materials, people, and environment) and using the "five whys" technique. Several potential explanations for grade appeals and challenging grading systems across institutions were identified, including variability in the quality or experience of evaluators, lack of clarity about the goals and expectations of clerkships and a lack of transparency about the grading process, having a tiered grading system, technical issues with equipment, and clinical productivity demands of faculty. In proposing solutions to root causes identified in the RCA, factors were mapped to Liaison Committee on Medical Education (LCME) standards to facilitate quality and process improvements in grading. Aiming to support the learning environment and a fair and equivalent assessment process, the authors present a novel RCA and LCME method that can contribute to improving grading systems and has the potential to enhance learning and success.

INTRODUCTION/UNASSIGNED:Over the past decade, the growth of accelerated three-year MD (3YMD) programs has flourished. In 2015, with support from the Josiah Macy Jr. Foundation, the Consortium of Medical Pathway Programs (CAMPP) started with eight North American medical schools. The objective of this paper is to evaluate the current state of the 3YMD programs. MATERIAL AND METHODS/UNASSIGNED:Since 2015, the CAMPP has tracked new and prospective 3YMD programs. An electronic survey collecting curricular and programmatic information about the programs was disseminated to all members of the CAMPP in August 2023. The survey included elements related to year of initiation, number of graduates, and curricular elements. RESULTS/UNASSIGNED:Of the schools with known established three-year MD programs, 29 of 32 programs responded (response rate 90%). There is growth of Accelerated Medical Pathway Programs over time with almost 20% of United States Allopathic Medical Schools having or developing an accelerated program. There have been 817 graduates from these programs from 2013-2023. Most schools include an opportunity for a 'directed pathway' experience for students. A directed pathway is where a student completes the MD degree in three-years and then has a direct placement into an affiliated residency program, provided they meet the goals and objectives of the curriculum. Most of the schools report a mission to reduce medical student debt and build a workforce for a specialty, for a population of patients, or geographical distribution. CONCLUSIONS/UNASSIGNED:Accelerated three-year medical pathway programs have grown significantly over the last decade, consistent with an overall effort to redesign medical curricula, reduce debt and contribute to the workforce.

INTRODUCTION/UNASSIGNED:Addressing systemic bias in medical school assessment is an urgent task for medical education. This paper outlines recommendations on topic areas for further research on systemic bias, developed from a workshop discussion at the 2023 annual meeting of the Society of Directors of Research in Medical Education. MATERIALS AND METHODS/UNASSIGNED:During the workshop, directors engaged in small-group discussions on guidelines to address bias in assessment practices following a proposed categorization of 'Do's,' 'Don'ts,' and 'Don't knows' and listed their insights using anonymous sticky notes, which were shared and discussed with the larger group of participants. The authors performed a content analysis of the notes through deductive and inductive coding. We reviewed and discussed our analysis to reach consensus. RESULTS/UNASSIGNED:The workshop included 31 participants from 28 institutions across the US and Canada, generating 51 unique notes. Participants identified 23 research areas in need of further study. The inductive analysis of proposed research areas revealed four main topics: 1) The role of interventions, including pre-medical academic interventions, medical-education interventions, assessment approaches, and wellness interventions; 2) Professional development, including the definition and assessment of professionalism and professional identity formation; 3) Context, including patient care and systemic influences; and 4) Research approaches. DISCUSSION/UNASSIGNED:While limited to data from a single workshop, the results offered perspectives about areas for further research shared by a group of directors of medical education research units from diverse backgrounds. The workshop produced valuable insights into the need for more evidence-based interventions that promote more equitable assessment practices grounded in real-world situations and that attenuate the effects of bias.

Building on the initial accelerated pathway programs in the 1970s to increase workforce, nearly 30 schools have launched accelerated 3-year pathways (A3YP) during the past decade. The authors based on their educational roles, experiences, and scholarship with A3YP provide this perspective of the argument for A3YP and potential disadvantages for each group-students, schools, residencies, departments, and community. When schools consider innovations, they might consider A3YPs for multiple reasons; this perspective helps provide justification for the program and broadly considers return on investment (ROI). The ROI for students includes decreased debt, reduced costs and stress associated with the fourth-year residency applications, and a directed pathway with facilitated transition into a residency program with accompanying professional identity development. Disadvantages for students include early specialty commitment, risk of deceleration, and condensed curriculum. The ROI for schools includes recruiting and retaining students, who will then transition more easily into residency and stimulating innovation. Residency programs gain residents with known skills, who have been a part of the department for 3 years. In addition, fewer residency slots for interviewing leads to saving recruitment administrative costs and time. Finally, many programs are intended to increase the workforce, since students who come to the region for medical school and transition directly into residency are likely to stay in the region. Disadvantages include increased curricular complexity for the medical school, increased administrative support, and advising resources. Finally, several of the accelerated programs attract matriculants from diverse backgrounds contributing to the diversity of the medical school, residency program, and community workforce.

PURPOSE/UNASSIGNED:Given the significance of the US Medical Licensing Exam (USMLE) Step 1 score moving from a 3-digit value to pass/fail, the authors investigated the impact of the change on students' anxiety, approach to learning, and curiosity. METHOD/UNASSIGNED:) and multiple regression path analysis was performed to determine the factors that significantly impacted learning strategies. RESULTS/UNASSIGNED: < 0.05). CONCLUSIONS/UNASSIGNED:Counter to the stated hypothesis and intentions, the initial impact of the change to pass/fail grading for USMLE Step 1 failed to reduce learner anxiety, and reduced curiosity and deep learning strategies. SUPPLEMENTARY INFORMATION/UNASSIGNED:The online version contains supplementary material available at 10.1007/s40670-023-01878-w.

PURPOSE/UNASSIGNED:With undergraduate medical education shifting to an integrated, student-centered approach, self-regulated learning (SRL) skills are critical for student success. Educational research holds that learning strategy effectiveness is context dependent. Our study aims to explore what strategies medical students use to support SRL when engaged in the specific context of an integrated, student-centered curriculum. APPROACH/UNASSIGNED:This study took place in two medical schools with integrated, student-centered curricula. Semi-structured interviews were conducted with first-year medical students from both schools, asking them to reflect on the learning strategies they used throughout their first year of medical school. Interview data was analyzed first deductively using the SRL framework and then inductively to understand the specific strategies being used. FINDINGS/UNASSIGNED:Students engaged in strategies to support SRL in ways that were unique to the integrated, student-centered context. We found that medical students developed strategies to plan for integration and building connections across material during all three phases of self-regulated learning. INSIGHTS/UNASSIGNED:By identifying specific tasks and behaviors students utilized during their first year of medical school, this study provides a roadmap that students and educators can use to help students become self-regulated learners.

Despite the many clerkship models of medical education, all can be considered a form of experiential learning. Experiential learning is a complex pedagogical approach involving the development of cognitive skills in an environment with a unique culture with multiple stakeholders, which may impact learner motivation, confidence, and other noncognitive drivers of success. Students may delay the transition to the clerkship year for myriad reasons, and the intricate nature of experiential learning suggested this may impact student performance. This retrospective, observational study investigated the impact of clerkship postponement by measuring subsequent clerkship performance. Pre-clerkship and third-year clerkship performance were analyzed for three cohorts of students (classes of 2018, 2019, and 2020, N = 274) where students had the option to delay the start of their clerkship year. A mixed analysis of variance (ANOVA) and paired t-tests were conducted to compare academic performance over time among students who did and did not delay. Across three cohorts of students, 12% delayed the start of the clerkship year (N = 33). Regardless of prior academic performance, these students experienced a significant reduction in clerkship grades compared to their non-delaying peers. Delaying the start of the clerkship year may have negative durable effects on future academic performance. This information should be kept in mind for student advisement.

PROBLEM/UNASSIGNED:Some medical schools have incorporated constructed response short answer questions (CR-SAQs) into their assessment toolkits. Although CR-SAQs carry benefits for medical students and educators, the faculty perception that the amount of time required to create and score CR-SAQs is not feasible and concerns about reliable scoring may impede the use of this assessment type in medical education. INTERVENTION/UNASSIGNED:) was used to evaluate inter-rater reliability. CONTEXT/UNASSIGNED:This research study was implemented at three US medical schools that are nationally dispersed and have been administering CR-SAQ summative exams as part of their programs of assessment for at least five years. The study exam question was included in an end-of-course summative exam during the first year of medical school. IMPACT/UNASSIGNED:=.59-.66, analytic rubric). LESSONS LEARNED/UNASSIGNED:Our findings show that from the faculty perspective it is feasible to include CR-SAQs in summative exams and we provide practical information for medical educators creating and scoring CR-SAQs. We also learned that CR-SAQs can be reliably scored by faculty without content expertise or senior medical students using an analytic rubric, or by senior medical students using a holistic rubric, which provides options to alleviate the faculty burden associated with grading CR-SAQs.

Once medical students attain a certain level of medical knowledge, success in residency often depends on noncognitive attributes, such as conscientiousness, empathy, and grit. These traits are significantly more difficult to assess than cognitive performance, creating a potential gap in measurement. Despite its promise, competency-based medical education (CBME) has yet to bridge this gap, partly due to a lack of well-defined noncognitive observable behaviors that assessors and educators can use in formative and summative assessment. As a result, typical undergraduate to graduate medical education handovers stress standardized test scores, and program directors trust little of the remaining information they receive, sometimes turning to third-party companies to better describe potential residency candidates. The authors have created a list of noncognitive attributes, with associated definitions and noncognitive skills-called observable practice activities (OPAs)-written for learners across the continuum to help educators collect assessment data that can be turned into valuable information. OPAs are discrete work-based assessment elements collected over time and mapped to larger structures, such as milestones, entrustable professional activities, or competencies, to create learning trajectories for formative and summative decisions. Medical schools and graduate medical education programs could adapt these OPAs or determine ways to create new ones specific to their own contexts. Once OPAs are created, programs will have to find effective ways to assess them, interpret the data, determine consequence validity, and communicate information to learners and institutions. The authors discuss the need for culture change surrounding assessment-even for the adoption of behavior-based tools such as OPAs-including grounding the work in a growth mindset and the broad underpinnings of CBME. Ultimately, improving assessment of noncognitive capacity should benefit learners, schools, programs, and most importantly, patients.

INTRODUCTION/UNASSIGNED:The elimination of the USMLE Step 1 three-digit score has created a deficit in standardized performance metrics for undergraduate medical educators and residency program directors. It is likely that there will be greater emphasis on USMLE Step 2 CK, an exam found to be associated with later clinical performance in residents and physicians. Because many previous models relied on Step 1 scores to predict student performance on Step 2 CK, we developed a model using other metrics. MATERIALS AND METHODS/UNASSIGNED:Assessment data for 228 students in three cohorts (classes of 2018, 2019, and 2020) were collected, including the Medical College Admission Test (MCAT), NBME Customized Assessment Service (CAS) exams and NBME Subject exams. A linear regression model was conducted to predict Step 2 CK scores at five time-points: at the end of years one and two and at three trimester intervals in year three. An additional cohort (class of 2021) was used to validate the model. RESULTS/UNASSIGNED:= 0.62). Including Step 1 scores did not significantly improve the final model. Using metrics from the class of 2021, the model predicted Step 2 CK performance within a mean square error (MSE) of 8.3 points (SD = 6.8) at the end of year 1 increasing predictability incrementally to within a mean of 5.4 points (SD = 4.1) by the end of year 3. CONCLUSION/UNASSIGNED:This model is highly generalizable and enables medical educators to predict student performance on Step 2 CK in the absence of Step 1 quantitative data as early as the end of the first year of medical education with increasingly stronger predictions as students progressed through the clerkship year.