Searched for: Department/Unit:Neurology
Examining Traditional and Novel Validity Indicators from the Medical Symptom Validity Test Across Levels of Verbal and Visual Memory Impairment
Cerny, Brian M; Resch, Zachary J; Rhoads, Tasha; Jennette, Kyle J; Singh, Palak G; Ovsiew, Gabriel P; Soble, Jason R
OBJECTIVE:This cross-sectional study examined accuracy of traditional Medical Symptom Validity Test (MSVT) validity indicators, including immediate recognition (IR), delayed recognition (DR), and consistency (CNS), as well as a novel indicator derived from the mean performance on IR, DR, and CNS across verbal, visual, and combined learning and memory impairment bands. METHOD/METHODS:A sample of 180 adult outpatients was divided into valid (n = 150) and invalid (n = 30) groups based on results of four independent criterion performance validity tests. Verbal and visual learning and recall were classified as indicative of no impairment, mild impairment, or severe impairment based on performance on the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised, respectively. RESULTS:In general, individual MSVT subtests were able to accurately classify performance as valid or invalid, even in the context of severe learning and memory deficits. However, as verbal and visual memory impairment increased, optimal MSVT cut-scores diverged from manual-specified cutoffs such that DR and CNS required cut-scores to be lowered to maintain adequate specificity. By contrast, the newly proposed scoring algorithm generally showed more robust psychometric properties across the memory impairment bands. CONCLUSIONS:The mean performance index, a novel scoring algorithm using the mean of the three primary MSVT subtests, may be a more robust validity indicator than the individual MSVT subtests in the context of bona fide memory impairment.
PMID: 34050349
ISSN: 1873-5843
CID: 5592882
The impact of visual memory impairment on Victoria Symptom Validity Test performance: A known-groups analysis
Stocks, Jane K; Shields, Allison N; DeBoer, Adam B; Cerny, Brian M; Ogram Buckley, Caitlin M; Ovsiew, Gabriel P; Jennette, Kyle J; Resch, Zachary J; Basurto, Karen S; Song, Woojin; Pliskin, Neil H; Soble, Jason R
OBJECTIVE:We assessed the effect of visual learning and recall impairment on Victoria Symptom Validity Test (VSVT) accuracy and response latency for Easy, Difficult, and Total Items. METHOD/METHODS:A sample of 163 adult patients administered the VSVT and Brief Visuospatial Memory Test-Revised were classified as valid (114/163) or invalid (49/163) groups via independent criterion performance validity tests (PVTs). Classification accuracies for all VSVT indices were examined for the overall sample, and separately for subgroups based on visual memory functioning. RESULTS:In the overall sample, all indices produced acceptable classification accuracy (areas under the curve [AUCs] ≥ 0.79). When stratified by visual learning/recall impairment, accuracy indices yielded acceptable classification for both the unimpaired (AUCs ≥0.79) and impaired subsamples (AUCs ≥0.75). Latency indices had acceptable classification accuracy for the unimpaired subsample (AUCs ≥0.74), but accuracy and sensitivity dropped for the impaired sample (AUCs ≥0.67). CONCLUSIONS:VSVT accuracy and response latency yielded acceptable classification accuracies in the overall sample, and this effect was maintained in those with and without visual learning/recall impairment for the accuracy indices. Findings indicate that the VSVT is a psychometrically robust PVT with largely invariant cut-scores, even in the presence of bona fide visual learning/recall impairment.
PMID: 34985401
ISSN: 2327-9109
CID: 5592642
Black and White individuals differ in dementia prevalence, risk factors, and symptomatic presentation
Lennon, Jack C; Aita, Stephen L; Bene, Victor A Del; Rhoads, Tasha; Resch, Zachary J; Eloi, Janelle M; Walker, Keenan A
INTRODUCTION:Although dementia prevalence differs by race, it remains unclear whether cognition and neuropsychiatric symptom severity differ between Black and White individuals with dementia. METHODS:Using National Alzheimer's Coordinating Center (NACC) data, we evaluated dementia prevalence in non-Hispanic Black and White participants and compared their clinicodemographic characteristics. We examined race differences in cognition, neuropsychiatric symptoms, and functional abilities in participants with dementia using multivariable linear and logistic regression models. RESULTS:We included 5,700 Black and 31,225 White participants across 39 Alzheimer's Disease Research Centers. Of these, 1,528 (27%) Black and 11,267 (36%) White participants had dementia diagnoses. Despite having lower dementia prevalence, risk factors were more prevalent among Black participants. Black participants with dementia showed greater cognitive deficits, neuropsychiatric symptoms/severity, and functional dependence. DISCUSSION:Despite lower dementia prevalence, Black participants with dementia had more dementia risk factors, as well as greater cognitive impairment and neuropsychiatric symptom severity than White participants.
PMCID:9160212
PMID: 34854531
ISSN: 1552-5279
CID: 5592622
Assessing performance validity during attention-deficit/hyperactivity disorder evaluations: Cross-validation of non-memory embedded validity indicators
Ausloos-Lozano, Jenna E; Bing-Canar, Hanaan; Khan, Humza; Singh, Palak G; Wisinger, Amanda M; Rauch, Andrew A; Ogram Buckley, Caitlin M; Petry, Luke G; Jennette, Kyle J; Soble, Jason R; Resch, Zachary J
Embedded performance validity tests (PVTs) are key components of neuropsychological evaluations. However, most are memory-based and may be less useful in the assessment of attention-deficit/hyperactivity disorder (ADHD). Four non-memory-based validity indices derived from processing speed and executive functioning measures commonly included in ADHD evaluations, namely Verbal Fluency (VF) and the Trail Making Test (TMT), were cross-validated using the Rey 15-Item Test (RFIT) Recall and Recall/Recognition as memory-based comparison measures. This consecutive case series included data from 416 demographically-diverse adults who underwent outpatient neuropsychological evaluation for ADHD. Validity classifications were established, with ≤1 PVT failure of five independent criterion PVTs as indicative of valid performance (374 valid performers/42 invalid performers). Among the statistically significant validity indicators, TMT-A and TMT-B T-scores (AUCs = .707-.723) had acceptable classification accuracy ranges and sensitivities ranging from 29%-36% (≥89% specificity). RFIT Recall/Recognition produced similar results as TMT-B T-score with 42% sensitivity/90% specificity, but with lower classification accuracy. In evaluating adult ADHD, VF and TMT embedded PVTs demonstrated comparable sensitivity and specificity values to those found in other clinical populations but necessitated alternate cut-scores. Results also support use of RFIT Recall/Recognition over the standard RFIT Recall as a PVT for adult ADHD evaluations.
PMID: 35787068
ISSN: 1532-6942
CID: 5592702
Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance
Resch, Zachary J; Pham, Amber T; Abramson, Dayna A; White, Daniel J; DeDios-Stern, Samantha; Ovsiew, Gabriel P; Castillo, Liliam R; Soble, Jason R
The California Verbal Learning Test-Second Edition (CVLT-II) Forced Choice Recognition (FC) and Brief Visuospatial Memory Test-Revised (BVMT-R) Recognition Discrimination Index (RD) are embedded performance validity tests (PVTs) assessing material-specific neuropsychological processes (i.e., verbal and visual memory, respectively). Prior research demonstrated the utility of these PVTs independently; however, no study has compared their diagnostic accuracy for identifying invalid performance relative to each other and in combination within a single sample. This cross-sectional study included an adult neuropsychiatric sample who underwent neuropsychological evaluation. Validity groups were determined via independent criterion PVT performance, and consisted of 103 participants with valid and 25 with invalid neurocognitive performance. FC and RD were not significantly correlated (r = .154), yet both differed between validity groups (ηp
PMID: 32202916
ISSN: 2327-9109
CID: 5592692
Concordance between the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and Clinical Assessment of Attention Deficit-Adult (CAT-A) over-reporting validity scales for detecting invalid ADHD symptom reporting
Leib, Sophie I; Schieszler-Ockrassa, Christine; White, Daniel J; Gallagher, Virginia T; Carter, Dustin A; Basurto, Karen S; Ovsiew, Gabriel P; Resch, Zachary J; Jennette, Kyle J; Soble, Jason R
This study investigated the relationship between symptom validity scales on the Clinical Assessment of Attention Deficit-Adult (CAT-A) and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in the context of Attention-Deficit/Hyperactivity Disorder (ADHD) evaluation. The sample comprised 140 consecutive patients referred for a neuropsychological evaluation of ADHD and were administered the CAT-A and the MMPI-2-RF and a battery of performance-based neurocognitive tests. Results indicated CAT-A/MMPI-2-RF symptom validity concordance of 51% between measures, with 38% concordant valid and 13% concordant invalid responses. Among those with discordance symptom validity results, rates of valid CAT-A/invalid MMPI-2-RF responding (41%) were more common than invalid CAT-A/valid MMPI-2-RF responding (8%). Results also indicated higher levels of ADHD symptoms among invalid responding within the CAT-A, whereas the MMPI-2-RF Cognitive Complaints scale did not differ by CAT-A validity status. Finally, symptom validity scales on both the CAT-A and MMPI-2-RF were largely discordant from neuropsychological test validity status per performance validity tests. Findings highlight the need for symptom validity testing when assessing ADHD and indicate that validity indices on broad personality assessments may assess different constructs than embedded validity indices in ADHD-specific measures.
PMID: 33719792
ISSN: 2327-9109
CID: 5592822
Multivariable analysis of the relative utility and additive value of eight embedded performance validity tests for classifying invalid neuropsychological test performance
Jennette, Kyle J; Rhoads, Tasha; Resch, Zachary J; Cerny, Brian M; Leib, Sophie I; Sharp, Dillon W; Ovsiew, Gabriel P; Soble, Jason R
INTRODUCTION:This study investigated a combination of eight embedded performance validity tests (PVTs) derived from commonly administered neuropsychological tests to optimize sensitivity/specificity for detecting invalid neuropsychological test performance. The goal of this study was to evaluate what combination of these common embedded PVTs that have the most robust predictive power for detecting invalid neuropsychological test performance in a single diverse clinical sample. METHOD:Eight previously validated memory- and nonmemory-based embedded PVTs were examined among 231 patients undergoing neuropsychological evaluation. Patients were classified into valid/invalid groups based on four independent criterion PVTs. Embedded PVT accuracy was assessed using standard and stepwise multiple logistic regression models. RESULTS:Three PVTs, the Brief Visuospatial Memory Test-Revised Recognition Discrimination (BVMT-R-RD), Rey Auditory Verbal Learning Test Forced Choice, and WAIS-IV Digit Span Age Corrected Scaled Score, predicted 45.5% of the variance in validity group membership. BVMT-RD independently accounted for 32% of the variance in prediction of independent, criterion-defined validity group membership. CONCLUSIONS:This study demonstrated the incremental predictive power of multiple embedded PVTs derived from common neuropsychological measures in detecting invalid test performance and those measures accounting for the greatest portion of the variance. These results provide guidance for evaluating the most fruitful embedded PVTs and proof of concept to better guide selection of embedded validity indices. Further, this offers clinicians an efficient, empirically derived approach to assessing performance validity when time restraints potentially limit the use of freestanding PVTs.
PMID: 36197342
ISSN: 1744-411x
CID: 5593002
A Known-Groups Validation of the Medical Symptom Validity Test and Analysis of the Genuine Memory Impairment Profile
Resch, Zachary J; Rhoads, Tasha; Ovsiew, Gabriel P; Soble, Jason R
This study cross-validated the Medical Symptom Validity Test (MSVT) in a mixed neuropsychiatric sample and examined its accuracy for identifying invalid neuropsychological performance using a known-groups design. Cross-sectional data from 129 clinical patients who completed the MSVT were examined. Validity groups were established using six, independent criterion performance validity tests, which yielded 98 patients in the valid group and 31 in the invalid group. All MSVT subtest scores were significantly lower in the invalid group (η
PMID: 33371720
ISSN: 1552-3489
CID: 5592772
A comparison of embedded validity indicators from the Stroop Color and Word Test among adults referred for clinical evaluation of suspected or confirmed attention-deficit/hyperactivity disorder
Khan, Humza; Rauch, Andrew A; Obolsky, Maximillian A; Skymba, Haley; Barwegen, Kearston C; Wisinger, Amanda M; Ovsiew, Gabriel P; Jennette, Kyle J; Soble, Jason R; Resch, Zachary J
This study investigated the utility of four Stroop Color and Word Test (SCWT) indices, including the raw score and T score for the word reading (WR) and color naming (CN) trials, as embedded performance validity tests (PVTs) within a sample referred for evaluation of suspected or known attention-deficit/hyperactivity disorder (ADHD). Data were analyzed from a final sample of 317 patients consecutively referred for ADHD evaluation, which was divided into groups with invalid (n = 43; 14%) and valid neuropsychological test performance (n = 274; 86%). A subset of the valid group with confirmed ADHD diagnoses (n = 226; 71%) were also analyzed separately. Classification accuracy for the overall valid sample was in the acceptable range (AUCs = .757-.794), with optimal cut scores of WR raw ≤75 (54% sensitivity/90% specificity), WR T score ≤ 28 (54% sensitivity/88% specificity), CN raw ≤57 (42% sensitivity/90% specificity), and CN T score ≤ 30 (40% sensitivity/90% specificity). Classification accuracy was also in the acceptable range for the ADHD-confirmed subgroup (AUCs = .750-.790), with optimal cut scores of WR Raw ≤ 75 (54% sensitivity/89% specificity), WR T score ≤ 28 (54% sensitivity/87% specificity), CN Raw ≤ 57 (42% sensitivity/90% specificity), and CN T score ≤ 30 (40% sensitivity/90% specificity). These findings indicate that embedded PVTs derived from the SCWT, particularly those derived from the WR trial, are effective measures for determining validity status in samples with suspected or confirmed ADHD. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
PMID: 35357873
ISSN: 1939-134x
CID: 5592982
Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples
Jennette, Kyle J; Williams, Christopher P; Resch, Zachary J; Ovsiew, Gabriel P; Durkin, Nicole M; O'Rourke, Justin J F; Marceaux, Janice C; Critchfield, Edan A; Soble, Jason R
PMID: 33759699
ISSN: 1744-4144
CID: 5592842