Faculty Bibliography

High-dimensional multinomial regression models are very useful in practice but have received less research attention than logistic regression models, especially from the perspective of statistical inference. In this work, we analyze the estimation and prediction error of the contrast-based

Ensuring reliability of Large Language Models (LLMs) in clinical tasks is crucial. Our study assesses two state-of-the-art LLMs (ChatGPT and LlaMA-2) for extracting clinical information, focusing on cognitive tests like MMSE and CDR. Our data consisted of 135,307 clinical notes (Jan 12th, 2010 to May 24th, 2023) mentioning MMSE, CDR, or MoCA. After applying inclusion criteria 34,465 notes remained, of which 765 underwent ChatGPT (GPT-4) and LlaMA-2, and 22 experts reviewed the responses. ChatGPT successfully extracted MMSE and CDR instances with dates from 742 notes. We used 20 notes for fine-tuning and training the reviewers. The remaining 722 were assigned to reviewers, with 309 each assigned to two reviewers simultaneously. Inter-rater-agreement (Fleiss' Kappa), precision, recall, true/false negative rates, and accuracy were calculated. Our study follows TRIPOD reporting guidelines for model validation. For MMSE information extraction, ChatGPT (vs. LlaMA-2) achieved accuracy of 83% (vs. 66.4%), sensitivity of 89.7% (vs. 69.9%), true-negative rates of 96% (vs 60.0%), and precision of 82.7% (vs 62.2%). For CDR the results were lower overall, with accuracy of 87.1% (vs. 74.5%), sensitivity of 84.3% (vs. 39.7%), true-negative rates of 99.8% (98.4%), and precision of 48.3% (vs. 16.1%). We qualitatively evaluated the MMSE errors of ChatGPT and LlaMA-2 on double-reviewed notes. LlaMA-2 errors included 27 cases of total hallucination, 19 cases of reporting other scores instead of MMSE, 25 missed scores, and 23 cases of reporting only the wrong date. In comparison, ChatGPT's errors included only 3 cases of total hallucination, 17 cases of wrong test reported instead of MMSE, and 19 cases of reporting a wrong date. In this diagnostic/prognostic study of ChatGPT and LlaMA-2 for extracting cognitive exam dates and scores from clinical notes, ChatGPT exhibited high accuracy, with better performance compared to LlaMA-2. The use of LLMs could benefit dementia research and clinical care, by identifying eligible patients for treatments initialization or clinical trial enrollments. Rigorous evaluation of LLMs is crucial to understanding their capabilities and limitations.

BACKGROUND:The choroid plexus (ChP), a densely vascularized structure, has drawn increasing attention for its involvement in brain homeostasis and waste clearance. While the volumetric changes have been explored in many imaging studies, few studies have investigated the vascular degeneration associated with aging in the ChP. PURPOSE/OBJECTIVE:To investigate the sub-structural characteristics of the ChP, particularly the vascular compartment using high-resolution 7T imaging enhanced with Ferumoxytol, an ultrasmall super-paramagnetic iron oxide, which greatly increase the susceptibility contrast for vessels. STUDY TYPE/METHODS:Prospective. SUBJECTS/METHODS:Forty-nine subjects without neurological disorders (age: 21-80 years; 42 ± 17 years; 20 females). FIELD STRENGTH/SEQUENCE/UNASSIGNED:7-T with 2D and 3D T2* GRE, 3D MPRAGE T1, 2D TSE T2, and 2D FLAIR. ASSESSMENT/RESULTS:ratio) and susceptibility change (Δχ) induced by Ferumoxytol were analyzed on 3D GRE-derived susceptibility-weighted imaging and quantitative susceptibility mapping, respectively. STATISTICAL TESTS/METHODS:Independent t-test, Mann-Whitney U test, and Chi-square test were utilized for group comparisons. The relationship between age and ChP's vascular alterations was examined using Pearson's correlation. Intra-class coefficient was calculated for inter-observer agreement. A P value <0.05 was considered statistically significant. RESULTS:2D GRE images demonstrated superior contrast and accurate delineation of ChP substructures (ICC = 0.86). Older subjects exhibited a significantly smaller vascular density (16.5 ± 4.34%) and lower Δχ (22.10 ± 12.82 ppb) compared to younger subjects (24.85 ± 6.84% and 34.64 ± 12.69 ppb). Vascular density and mean Δχ within the ChP negatively correlated with age (r = -0.48, and r = -0.45). DATA CONCLUSION/CONCLUSIONS:Ferumoxytol-enhanced 7T images can demonstrate ChP alterations in elderly with decreased vascular density and expansion of nonvascular compartment. EVIDENCE LEVEL/METHODS:1 TECHNICAL EFFICACY: Stage 2.

Anxiety is highly prevalent in Alzheimer's disease (AD), correlating with cerebrospinal fluid/positron emission tomography biomarkers and disease progression. Relationships to plasma biomarkers are unclear. Herein, we compare levels of plasma biomarkers in research participants with and without anxiety at cognitively normal, mild cognitive impairment, and AD dementia stages. We observed significantly higher plasma tau/amyloid-β₄₂ ratio in AD participants with anxiety versus those without, but did not observe differences at other stages or plasma biomarkers. No such relationships were evident with depression. These results support a unique pathophysiological relationship between anxiety and AD that can be reflected in plasma biomarkers, suggestive of heightened neurodegeneration.

BACKGROUND/UNASSIGNED:The burden of Alzheimer's disease and related dementias (AD/ADRD) in Costa Rica is expected to become one of the highest in the region. Early detection will help optimize resources and improve primary care interventions. The Montreal Cognitive Assessment (MoCA) has shown good sensitivity for detecting mild cognitive impairment (MCI), but specificity varies depending on the population. This motivated the analysis of different cutoffs to minimize false-positive classifications in a Costa Rican sample for its use in clinical settings. METHODS/UNASSIGNED:Data was analyzed from 516 memory clinic outpatients (148 cognitively normal, 260 MCI, 108 mild AD/ADRD; mean age 66.3 ± 10.8 years) who underwent complete neurological and neuropsychological assessment and were diagnosed by consensus. Optimal MoCA cutoff scores were identified using a multiple cutoff approach. RESULTS/UNASSIGNED:Overall, a cutoff score of ≥ 23 showed better accuracy to distinguish between normal cognition (NC) and MCI (sensitivity 73%, specificity 83%). When analyzed by educational levels, a cutoff score of ≥ 21 showed better accuracy for ≤ 6 years (sensitivity 80%, specificity 76%), ≥23 for 7-12 years (sensitivity 86%, specificity 76%) and ≥ 24 for > 12 years (sensitivity 70%, specificity 85%). For distinguishing MCI from mild AD/ADRD, the optimal overall cutoff score was ≥ 15 (sensitivity 66%, specificity 85%). When stratified by years of education, cutoff scores of ≥ 14 showed better accuracy for ≤ 6 years (sensitivity 70%, specificity 88%), ≥15 for 7-12 years (sensitivity 46%, specificity 95%) and ≥ 17 for > 12 years (sensitivity 67%, specificity 93%). CONCLUSIONS/UNASSIGNED:A MoCA cutoff score of ≥ 23 in the Costa Rican population showed better diagnostic accuracy for detecting MCI and may reduce the false positive rate. Our findings may be helpful for primary care clinical settings and further referral criteria.

Alzheimer's disease (AD) is a devastating, age-associated neurodegenerative disorder and the most common cause of dementia. The clinical continuum of AD spans from preclinical disease to subjective cognitive decline, mild cognitive impairment, and dementia stages (mild, moderate, and severe). Neuropathologically, AD is defined by the accumulation of amyloid β (Aβ) into extracellular plaques in the brain parenchyma and in the cerebral vasculature, and by abnormally phosphorylated tau that accumulates intraneuronally forming neurofibrillary tangles (NFTs). Development of treatment approaches that prevent or even reduce the cognitive decline because of AD has been slow compared to other major causes of death. Recently, the United States Food and Drug Administration gave full approval to 2 different Aβ-targeting monoclonal antibodies. However, this breakthrough disease modifying approach only applies to a limited subset of patients in the AD continuum and there are stringent eligibility criteria. Furthermore, these approaches do not prevent progression of disease, because other AD-related pathologies, such as NFTs, are not directly targeted. A non-mutually exclusive alternative is to address lifestyle interventions that can help reduce the risk of AD and AD-related dementias (ADRD). It is estimated that addressing such modifiable risk factors could potentially delay up to 40% of AD/ADRD cases. In this review, we discuss some of the many modifiable risk factors that may be associated with prevention of AD/ADRD and/or increasing brain resilience, as well as other factors that may interact with these modifiable risk factors to influence AD/ADRD progression. ANN NEUROL 2024.

BACKGROUND:Subjective cognitive decline (SCD), considered a preclinical dementia stage, is less understood in Hispanics, a high-risk group for dementia. We investigated SCD to mild cognitive impairment (MCI) progression risk, as well as baseline and longitudinal features of depressive symptoms, SCD complaints, and objective cognitive performance among Hispanics compared to non-Hispanic Whites (NHW). METHODS:Hispanic (n = 23) and NHW (n = 165) SCD participants were evaluated at baseline and 2-year follow-up. Evaluations assessed function, depressive symptoms, SCD, and objective cognitive performance. RESULTS:Hispanic ethnicity associated with a significantly increased risk of 2-year progression of SCD to MCI compared to NHW. This increased risk associated with increased depressive symptoms, distinctive SCD features, and elevated amnestic and non-amnestic objective cognitive decline. This supports further research to refine the assessment of preclinical dementia in this high-risk group.

Anxiety is highly prevalent in Alzheimer's disease (AD), correlating with CSF/PET biomarkers and disease progression. Relationships to plasma biomarkers are unclear. Herein, we compare levels of plasma biomarkers in research participants with and without anxiety at cognitively normal, mild cognitive impairment, and AD dementia stages. We observed significantly higher plasma tau/Aβ42 ratio in AD participants with anxiety versus those without, but did not observe differences at other stages or plasma biomarkers. No such relationships were evident with depression. These results support a unique pathophysiological relationship between anxiety and AD that can be reflected in plasma biomarkers, suggestive of heightened neurodegeneration.