Searched for: in-biosketch:yes
person:ak41
Understanding medical student paths to communication skills expertise using latent profile analysis
Altshuler, Lisa; Wilhite, Jeffrey A; Hardowar, Khemraj; Crowe, Ruth; Hanley, Kathleen; Kalet, Adina; Zabar, Sondra; Gillespie, Colleen; Ark, Tavinder
PURPOSE:To describe patterns of clinical communication skills that inform curriculum enhancement and guide coaching of medical students. MATERIALS AND METHODS:Performance data from 1182 consenting third year medical students in 9 cohorts (2011-2019), on a 17-item Clinical Communication Skills Assessment Tool (CCSAT) completed by trained Standardized Patients as part of an eight case high stakes Comprehensive Clinical Skills Exam (CCSE) were analyzed using latent profile analysis (LPA). Assessment domains included: information gathering (6 items), relationship development (5 items), patient education (3 items), and organization/time management (3 items). LPA clustered learners with similar strength/weakness into profiles based on item response patterns across cases. One-way analysis of variance (ANOVA) assessed for significant differences by profile for CCSAT items. RESULTS:Student performance clustered into six profiles in three groups, high performing (HP1 and HP2-Low Patient Education, 15.7%), average performing (AP1 and AP2-Interrupters, 40.9%), and lower performing profiles (LP1-Non-interrupters and LP2, 43.4%) with adequate model fit estimations and similar distribution in each cohort. We identified 3 CCSAT items that discriminated among learner's skill profiles. CONCLUSION:Clinical communication skill performance profiles provide nuanced, benchmarked guidance for curriculum improvement and tailoring of communication skills coaching.
PMID: 36961759
ISSN: 1466-187x
CID: 5708092
Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine
Smirnova, Alina; Chahine, Saad; Milani, Christina; Schuh, Abigail; Sebok-Syer, Stefanie S; Swartz, Jordan; Wilhite, Jeffrey A; Kalet, Adina; Durning, Steven J; Lombarts, Kiki M J M H; van der Vleuten, Cees P M; Schumacher, Daniel J
PURPOSE/OBJECTIVE:Traditional quality metrics do not adequately represent the clinical work done by residents and, thus, cannot be used to link residency training to health care quality. This study aimed to determine whether electronic health record (EHR) data can be used to meaningfully assess residents' clinical performance in pediatric emergency medicine using resident-sensitive quality measures (RSQMs). METHOD/METHODS:EHR data for asthma and bronchiolitis RSQMs from Cincinnati Children's Hospital Medical Center, a quaternary children's hospital, between July 1, 2017, and June 30, 2019, were analyzed by ranking residents based on composite scores calculated using raw, unadjusted, and case-mix adjusted latent score models, with lower percentiles indicating a lower quality of care and performance. Reliability and associations between the scores produced by the 3 scoring models were compared. Resident and patient characteristics associated with performance in the highest and lowest tertiles and changes in residents' rank after case-mix adjustments were also identified. RESULTS:274 residents and 1,963 individual encounters of bronchiolitis patients aged 0-1 as well as 270 residents and 1,752 individual encounters of asthmatic patients aged 2-21 were included in the analysis. The minimum reliability requirement to create a composite score was met for asthma data (α = 0.77), but not bronchiolitis (α = 0.17). The asthma composite scores showed high correlations (r = 0.90-0.99) between raw, latent, and adjusted composite scores. After case-mix adjustments, residents' absolute percentile rank shifted on average 10 percentiles. Residents who dropped by 10 or more percentiles were likely to be more junior, saw fewer patients, cared for less acute and younger patients, or had patients with a longer emergency department stay. CONCLUSIONS:For some clinical areas, it is possible to use EHR data, adjusted for patient complexity, to meaningfully assess residents' clinical performance and identify opportunities for quality improvement.
PMID: 36351056
ISSN: 1938-808x
CID: 5357362
Heartache or Bellyache? Epigastric Pain, Communication Skills, and Implicit Bias: Can We Uncover an Association in the Simulation Lab?
Ark, Tavinder; Fisher, Marla; Milan, Felise; Kalet, Adina L; Marantz, Paul R; Burgess, Diana; Rodriguez, Carlos J; Burd-Orama, Lily; Samuel, Malika; Gonzalez, Cristina M
PMCID:9614548
PMID: 36419761
ISSN: 1938-808x
CID: 5364222
Viewing Readiness-for-Residency through Binoculars: Mapping Competency-Based Assessments to the AAMC's 13 Core Entrustable Professional Activities (EPAs)
Eliasz, Kinga L; Nick, Michael W; Zabar, Sondra; Buckvar-Keltz, Lynn; Ng, Grace M; Riles, Thomas S; Kalet, Adina L
PMID: 35668557
ISSN: 1532-8015
CID: 5283072
Mentoring Underrepresented Minority Physician-Scientists to Success
Kalet, Adina; Libby, Anne M; Jagsi, Reshma; Brady, Kathleen; Chavis-Keeling, Deborah; Pillinger, Michael H; Daumit, Gail L; Drake, Amelia F; Drake, Wonder Puryear; Fraser, Victoria; Ford, Daniel; Hochman, Judith S; Jones, Rochelle D; Mangurian, Christina; Meagher, Emma A; McGuinness, Georgeann; Regensteiner, Judith G; Rubin, Deborah C; Yaffe, Kristine; Ravenell, Joseph E
As the nation seeks to recruit and retain physician-scientists, gaps remain in understanding and addressing mitigatable challenges to the success of faculty from underrepresented minority (URM) backgrounds. The Doris Duke Charitable Foundation Fund to Retain Clinical Scientists program, implemented in 2015 at 10 academic medical centers in the United States, seeks to retain physician-scientists at risk of leaving science because of periods of extraordinary family caregiving needs, hardships that URM faculty-especially those who identify as female-are more likely to experience. At the annual Fund to Retain Clinical Scientists program directors conference in 2018, program directors-21% of whom identify as URM individuals and 13% as male-addressed issues that affect URM physician-scientists in particular. Key issues that threaten the retention of URM physician-scientists were identified through focused literature reviews; institutional environmental scans; and structured small- and large-group discussions with program directors, staff, and participants. These issues include bias and discrimination, personal wealth differential, the minority tax (i.e., service burdens placed on URM faculty who represent URM perspectives on committees and at conferences), lack of mentorship training, intersectionality and isolation, concerns about confirming stereotypes, and institutional-level factors. The authors present recommendations for how to create an environment in which URM physician-scientists can expect equitable opportunities to thrive, as institutions demonstrate proactive allyship and remove structural barriers to success. Recommendations include providing universal training to reduce interpersonal bias and discrimination, addressing the consequences of the personal wealth gap through financial counseling and benefits, measuring the service faculty members provide to the institution as advocates for URM faculty issues and compensating them appropriately, supporting URM faculty who wish to engage in national leadership programs, and sustaining institutional policies that address structural and interpersonal barriers to inclusive excellence.
PMID: 34495889
ISSN: 1938-808x
CID: 5200092
A Preliminary Evaluation of Students' Learning and Performance Outcomes in an Accelerated 3-Year MD Pathway Program
Cangiarella, Joan; Eliasz, Kinga; Kalet, Adina; Cohen, Elisabeth; Abramson, Steven; Gillespie, Colleen
Background/UNASSIGNED:Little outcome data exist on 3-year MD (3YMD) programs to guide residency program directors (PDs) in deciding whether to select these graduates for their programs. Objective/UNASSIGNED:To compare performance outcomes of 3YMD and 4-year MD (4YMD) students at New York University Grossman School of Medicine. Methods/UNASSIGNED:In 2020, using the Kirkpatrick 4-level evaluation model, outcomes from 3 graduating cohorts of 3YMD students (2016-2018) were compared with the 4YMD counterparts. Results/UNASSIGNED:=.03), other metrics and overall intern ratings did not differ by pathway. Conclusions/UNASSIGNED:Exploratory findings from a single institution suggest that 3YMD students performed similarly to 4YMD students in medical school and the first year of residency.
PMCID:8848877
PMID: 35222827
ISSN: 1949-8357
CID: 5174042
HEARTACHE OR BELLYACHE? EPIGASTRIC PAIN, COMMUNICATION SKILLS, AND IMPLICIT BIAS: CAN WE UNCOVER AN ASSOCIATION IN THE SIMULATION LAB? [Meeting Abstract]
Ark, Tavinder K.; Fisher, Marla; Milan, Felise; Kalet, Adina; Marantz, Paul R.; Burgess, Diana J.; Rodriguez, Carlos J.; Burd, Lily; Samuel, Malika; Gonzalez, Cristina M.
ISI:000821782700218
ISSN: 0884-8734
CID: 5364482
"MY NEIGHBOR SAID PERCOCET MIGHT HELP"- ACUTE PAIN, COMMUNICATION SKILLS, AND IMPLICIT BIAS. CAN WE UNCOVER AN ASSOCIATION IN THE SIM LAB? [Meeting Abstract]
Ark, Tavinder K.; Fisher, Marla; Kalet, Adina; Milan, Felise; Marantz, Paul R.; Burgess, Diana J.; Starrels, Joanna L.; Samuel, Malika; Burd, Lily; Gonzalez, Cristina M.
ISI:000821782700184
ISSN: 0884-8734
CID: 5364472
Does a measure of Medical Professional Identity Formation predict communication skills performance?
Kalet, Adina; Ark, Tavinder K; Monson, Verna; Song, Hyuksoon S; Buckvar-Keltz, Lynn; Harnik, Victoria; Yingling, Sandra; Rivera, Rafael; Tewksbury, Linda; Lusk, Penelope; Crowe, Ruth
OBJECTIVE:To validate an approach to measuring professional identity formation (PIF), we explore if the Professional Identity Essay (PIE), a stage score measure of medical professional identity (PI), predicts clinical communication skills. METHODS:Students completed the PIE during medical school orientation and a 3-case Objective Structured Clinical Exam (OSCE) where standardized patients reliably assessed communication skills in 5 domains. Using mediation analyses, relationships between PIE stage scores and communication skills were explored. RESULTS:For the 351 (89%) consenting students, controlling for individual characteristics, there were increases in patient counseling (6.5%, p<0.01), information gathering (4.3%, p = 0.01), organization and management (4.1%, p = 0.02), patient assessment (3.6%, p = 0.04), and relationship development (3.5%, p = 0.03) skills for every half stage increase in PIE score. The communication skills of lower socio-economic status (SES) students are indirectly impacted by their slightly higher PIE stage scores. CONCLUSION/CONCLUSIONS:Higher PIE stage scores are associated with higher communication skills and lower SES. PRACTICE IMPLICATIONS/CONCLUSIONS:PIE predicts critical clinical skills and identifies how SES and other characteristics indirectly impact future clinical performance, providing validity evidence for using PIE as a tool in longitudinal formative academic coaching, program and curriculum evaluation, and research.
PMID: 33896685
ISSN: 1873-5134
CID: 4889222
In Search of Medical Professionalism Research: Preliminary Results from a Review of Widely Read Medical Journals
Isaacson, J Harry; Ziring, Deborah; Hafferty, Fred; Kalet, Adina; Littleton, Dawn; Frankel, Richard M
INTRODUCTION/BACKGROUND:Professionalism is a core concept in medicine. The extent to which knowledge about professionalism is anchored in empirical research is unknown. Understanding the current state of research is necessary to identify significant gaps and create a road map for future professionalism efforts. The authors conducted an exploratory literature review to characterize professionalism research published in widely read medical journals, identify knowledge gaps, and describe the sources of funding for the identified studies. METHODS:The authors focused on Medline's Abridged Index Medicus and 4 core Medline education-oriented journal and developed a search filter using text words found in the article title or abstract addressing professionalism. Articles were further filtered to include those indicating a research focus. RESULTS:The search strategy resulted in 461 professionalism research articles for analysis. Articles were divided into themes of education (n = 212, 45.9%), performance (n = 83, 18%), measurement development (n = 13, 2.8%), remediation (n = 53, 11.5%), and well-being (n = 100, 21.6%). There were 36 studies from 1980 to 2002 (Era 1: before publication of Accreditation Council for Graduate Medical Education competencies) and 425 from 2003 to 17 (Era 2: after Accreditation Council for Graduate Medical Education publication of competencies). Professionalism education was the most common topic area, and most studies were from single institutions with results based on convenience samples. Most studies received no funding or were funded by the authors' own institution. DISCUSSION/CONCLUSIONS:Little empirical research is available on professionalism in widely read medical journals. There has been limited external research funding available to study this topic. CONCLUSION/CONCLUSIONS:More investment in high quality professionalism research is justified and should be encouraged.
PMCID:8817929
PMID: 35348058
ISSN: 1552-5775
CID: 5201002