Searched for: in-biosketch:true
person:reschz01
Cognitive Performance and Psychiatric Self-Reports Across Adult Cognitive Disengagement Syndrome and ADHD Diagnostic Groups
Cerny, Brian M; Reynolds, Tristan P; Chang, Fini; Scimeca, Lauren M; Phillips, Matthew S; Ogram Buckley, Caitlin M; Leib, Sophie I; Resch, Zachary J; Pliskin, Neil H; Soble, Jason R
OBJECTIVE:Cognitive disengagement syndrome (CDS) is characterized by inattention, under-arousal, and fatigue and frequently co-occurs with attention-deficit/hyperactivity disorder (ADHD). Although CDS is associated with cognitive complaints, its association with objective cognitive performance is less well understood. METHOD: RESULTS:There were no differences in cognitive performance, significant differences in self-reported psychiatric symptoms (greater CDS symptomatology, impulsivity among the high CDS groups; greater inattention among the positive ADHD/high CDS groups; greater hyperactivity among the positive ADHD groups), significant intercorrelations within cognitive and self-report measures, nonsignificant correlations between cognitive measures and self-report measures. CONCLUSION:Findings support prior work demonstrating weak to null associations between ADHD and CDS symptoms and cognitive performance among adults.
PMID: 36354066
ISSN: 1557-1246
CID: 5592742
Comparing behavioral and psychological symptom structures on the Neuropsychiatric Inventory Questionnaire
González, David Andrés; Resch, Zachary J; Obolsky, Maximilian A; Soble, Jason R
The Neuropsychiatric Inventory Questionnaire (NPI-Q) is a collateral-rated measure of behavioral and psychological symptoms commonly found in dementia (BPSD). Several factor structures have been published, but they have not been systematically compared. Furthermore, the possibility of hierarchical models or presence of measurement invariance around cognitive stage or dementia syndrome has not been previously evaluated. This study addressed these gaps with confirmatory factor analyses using a multicenter sample (n = 41,801; M
PMID: 36892877
ISSN: 1939-134x
CID: 5592782
Validation of alternative dot counting test E-score cutoffs based on degree of cognitive impairment in veteran and civilian clinical samples
Hansen, Nicholas D; Rhoads, Tasha; Jennette, Kyle J; Reynolds, Tristan P; Ovsiew, Gabriel P; Resch, Zachary J; Critchfield, Edan A; Marceaux, Janice C; O'Rourke, Justin J F; Soble, Jason R
OBJECTIVE:This study examined Dot Counting Test (DCT) performance among patient populations with no/minimal impairment and mild impairment in an attempt to cross-validate a more parsimonious interpretative strategy and to derive optimal E-Score cutoffs. METHOD: = 183) settings. Patients were separated by validity status (valid/invalid), and subsequently two comparison groups were formed from each sample's valid group. Namely, Group 1 included patients with no to minimal cognitive impairment, and Group 2 included those with mild neurocognitive disorder. Analysis of variance tested for differences between rounded and unrounded DCT E-Scores across both comparison groups and the invalid group. Receiver operating characteristic curve analyses identified optimal validity cut-scores for each sample and stratified by comparison groups. RESULTS:In the VA sample, cut scores of ≥13 (rounded) and ≥12.58 (unrounded) differentiated Group 1 from the invalid performers (87% sensitivity/88% specificity), and cut scores of ≥17 (rounded; 58% sensitivity/90% specificity) and ≥16.49 (unrounded; 61% sensitivity/90% specificity) differentiated Group 2 from the invalid group. Similarly, in the AMC group, a cut score of ≥13 (rounded and unrounded; 75% sensitivity/90% specificity) differentiated Group 1 from the invalid group, whereas cut scores of ≥18 (rounded; 43% sensitivity/94% specificity) and ≥16.94 (unrounded; 46% sensitivity/90% specificity) differentiated Group 2 from the invalid performers. CONCLUSIONS:Different cut scores were indicated based on degree of cognitive impairment, and provide proof-of-concept for a more parsimonious interpretative paradigm than using individual cut scores derived for specific diagnostic groups.
PMID: 35343379
ISSN: 1744-4144
CID: 5593082
A Direct Comparison of 10 WAIS-IV Digit Span Embedded Validity Indicators among a Mixed Neuropsychiatric Sample with Varying Degrees of Cognitive Impairment
Resch, Zachary J; Cerny, Brian M; Ovsiew, Gabriel P; Jennette, Kyle J; Bing-Canar, Hanaan; Rhoads, Tasha; Soble, Jason R
OBJECTIVE:Reliable Digit Span (RDS), RDS-Revised (RDS-R), and age-corrected scaled score (ACSS) have been previously validated as embedded performance validity tests (PVTs) from the Wechsler Adult Intelligence Scale-IV Digit Span subtest (WAIS-IV DS). However, few studies have directly compared the relative utility of these and other proposed WAIS-IV DS validity indicators within a single sample. METHOD/METHODS:This study compared classification accuracies of 10 WAIS-IV DS indices in a mixed neuropsychiatric sample of 227 outpatients who completed a standardized neuropsychological battery. Participants with ≤1 PVT failures of the four, freestanding criterion PVTs constituted the valid group (n = 181), whereas those with ≥2 PVT failures formed the invalid group (n = 46). Among the valid group, 113 met criteria for mild cognitive impairment (MCI). RESULTS:Classification accuracies for all DS indicators were statistically significant across the overall sample and subsamples with and without MCI, apart from indices derived from the Forward trial in the MCI sample. DS Sequencing ACSS, working memory RDS (wmRDS), and DS ACSS emerged as the most effective predictors of validity status, with acceptable to excellent classification accuracy for the overall sample (AUCs = 0.792-0.816; 35%-50% sensitivity/88%-96% specificity). CONCLUSIONS:Although most DS indices demonstrated clinical utility as embedded PVTs, DS Sequencing ACSS, wmRDS, and DS ACSS may be particularly robust to cognitive impairment, minimizing risk of false positive errors while identifying noncredible performance. Moreover, DS indices incorporating data from multiple trials (i.e., wmRDS, DS ACSS) also generally yielded greater classification accuracy than those derived from a single trial.
PMID: 36244241
ISSN: 1873-5843
CID: 5593102
Comprehensive Analysis of MMPI-2-RF Symptom Validity Scales and Performance Validity Test Relationships in a Diverse Mixed Neuropsychiatric Setting
De Boer, Adam B; Phillips, Matthew S; Barwegen, Kearston C; Obolsky, Maximillian A; Rauch, Andrew A; Pesanti, Stephen D; Tse, Phoebe Ka Yin; Ovsiew, Gabriel P; Jennette, Kyle J; Resch, Zachary J; Soble, Jason R
The utility of symptom (SVT) and performance (PVT) validity tests has been independently established in neuropsychological evaluations, yet research on the relationship between these two types of validity indices is limited to circumscribed populations and measures. This study examined the relationship between SVTs on the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and PVTs in a mixed neuropsychiatric setting. This cross-sectional study included data from 181 diagnostically and demographically diverse patients with neuropsychiatric conditions referred for outpatient clinical neuropsychological evaluation at an academic medical center. All patients were administered a uniform neuropsychological battery, including the MMPI-2-RF and five PVTs (i.e., Dot Counting Test; Medical Symptom Validity Test; Reliable Digit Span; Test of Memory Malingering-Trial 1; Word Choice Test). Nonsignificant associations emerged between SVT and PVT performance. Although the Response Bias Scale was most predictive of PVT performance, MMPI-2-RF SVTs generally had low classification accuracy for predicting PVT performance. Neuropsychological test performance was related to MMPI-2-RF SVT status only when overreporting elevations were at extreme scores. The current study further supports that SVTs and PVTs measure unique and dissociable constructs among diverse patients with neuropsychiatric conditions, consistent with literature from other clinical contexts. Therefore, objective evidence of symptom overreporting on MMPI-2-RF SVTs cannot be interpreted as definitively indicating invalid performance on tests of neurocognitive abilities. As such, clinicians should include both SVTs and PVTs as part of a comprehensive neuropsychological evaluation as they provide unique information regarding performance and symptom validity.
PMCID:9633118
PMID: 36348958
ISSN: 1938-971x
CID: 5593122
Do demographic factors influence detection of invalid neuropsychological test performance using common performance validity tests? A multisite investigation
Soble, Jason R; Cerny, Brian M; Rhoads, Tasha; DeBoer, Adam B; Sharp, Dillon W; Ovsiew, Gabriel P; Phillips, Matthew S; Pesanti, Stephen D; Jennette, Kyle J; Resch, Zachary J
OBJECTIVE:This study examined the extent to which demographic variables (i.e., age, education, premorbid IQ, sex, ethnoracial identity, and presence/absence of external incentive) affect performance validity test (PVT) performance. METHOD/METHODS:= 111). All patients completed a battery including five PVTs. Premorbid IQ was assessed using the Test of Premorbid Functioning (TOPF) in the AMC sample. RESULTS:Multiple correlations between demographic variables and individual PVT performance were statistically significant, but accompanying effect sizes were small, except for the relationship of premorbid IQ and reliable digit span (RDS). Regressions showed demographic variables accounted for 7%-11% of the variance in individual PVT scores in the AMC sample, and 6%-26% in the VA sample, premorbid IQ driving results in the AMC sample and compensation-seeking status in the VA sample. Other demographic variables did not correlate with compensation-seeking status. Additionally, premorbid IQ was found to be significantly higher in validly performing individuals compared to those performing invalidly in the AMC sample. CONCLUSION/CONCLUSIONS:Most demographic factors evaluated accounted for relatively little variance in individual PVT performance and did not significantly predict overall validity categorization. Compensation-seeking status correlated with validity classification across both groups, but offers limited diagnostic utility itself compared to objective PVT scores. Premorbid IQ within the AMC group demonstrated influence on particular PVTs (i.e., RDS) reflecting the difficulty of assessing validity within low IQ populations, particularly with PVTs more strongly correlated with IQ. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
PMID: 36355644
ISSN: 1931-1559
CID: 5593142
Performance and symptom validity assessment in attention deficit/hyperactivity disorder: Base rates of invalidity, concordance, and relative impact on cognitive performance
Ovsiew, Gabriel P; Cerny, Brian M; Boer, Adam B De; Petry, Luke G; Resch, Zachary J; Durkin, Nicole M; Soble, Jason R
PMID: 36594201
ISSN: 1744-4144
CID: 5593162
Using the Grooved Pegboard Test as an Embedded Validity Indicator in a Mixed Neuropsychiatric Sample with Varying Cognitive Impairment: Cross-Validation Problems
Chang, Fini; Cerny, Brian M; Tse, Phoebe Ka Yin; Rauch, Andrew A; Khan, Humza; Phillips, Matthew S; Fletcher, Noah B; Resch, Zachary J; Ovsiew, Gabriel P; Jennette, Kyle J; Soble, Jason R
Embedded validity indicators (EVIs) derived from motor tests have received less empirical attention than those derived from tests of other neuropsychological abilities, particularly memory. Preliminary evidence suggests that the Grooved Pegboard Test (GPB) may function as an EVI, but existing studies were largely conducted using simulators and population samples without cognitive impairment. In this study we aimed to evaluate the GPB's classification accuracy as an EVI among a mixed clinical neuropsychiatric sample with and without cognitive impairment. This cross-sectional study comprised 223 patients clinically referred for neuropsychological testing. GPB raw and T-scores for both dominant and nondominant hands were examined as EVIs. A known-groups design, based on ≤1 failure on a battery of validated, independent criterion PVTs, showed that GPB performance differed significantly by validity group. Within the valid group, receiver operating characteristic curve analyses revealed that only the dominant hand raw score displayed acceptable classification accuracy for detecting invalid performance (area under curve [AUC] = .72), with an optimal cut-score of ≥106 seconds (33% sensitivity/88% specificity). All other scores had marginally lower classification accuracy (AUCs = .65-.68) for differentiating valid from invalid performers. Therefore, the GPB demonstrated limited utility as an EVI in a clinical sample containing patients with bona fide cognitive impairment.
PMID: 36634223
ISSN: 1558-688x
CID: 5593172
Multivariate examination of embedded indicators of performance validity for ADHD evaluations: A targeted approach
Finley, John-Christopher A; Brooks, Julia M; Nili, Amanda N; Oh, Alison; VanLandingham, Hannah B; Ovsiew, Gabriel P; Ulrich, Devin M; Resch, Zachary J; Soble, Jason R
This study investigated the individual and combined utility of 10 embedded validity indicators (EVIs) within executive functioning, attention/working memory, and processing speed measures in 585 adults referred for an attention-deficit/hyperactivity disorder (ADHD) evaluation. Participants were categorized into invalid and valid performance groups as determined by scores from empirical performance validity indicators. Analyses revealed that all of the EVIs could meaningfully discriminate invalid from valid performers (AUCs = .69-.78), with high specificity (≥90%) but low sensitivity (19%-51%). However, none of them explained more than 20% of the variance in validity status. Combining any of these 10 EVIs into a multivariate model significantly improved classification accuracy, explaining up to 36% of the variance in validity status. Integrating six EVIs from the Stroop Color and Word Test, Trail Making Test, Verbal Fluency Test, and Wechsler Adult Intelligence Scale-Fourth Edition was as efficacious (AUC = .86) as using all 10 EVIs together. Failing any two of these six EVIs or any three of the 10 EVIs yielded clinically acceptable specificity (≥90%) with moderate sensitivity (60%). Findings support the use of multivariate models to improve the identification of performance invalidity in ADHD evaluations, but chaining multiple EVIs may only be helpful to an extent.
PMID: 37703401
ISSN: 2327-9109
CID: 5592602
A Known-Groups Validation of the Medical Symptom Validity Test and Analysis of the Genuine Memory Impairment Profile
Resch, Zachary J; Rhoads, Tasha; Ovsiew, Gabriel P; Soble, Jason R
This study cross-validated the Medical Symptom Validity Test (MSVT) in a mixed neuropsychiatric sample and examined its accuracy for identifying invalid neuropsychological performance using a known-groups design. Cross-sectional data from 129 clinical patients who completed the MSVT were examined. Validity groups were established using six, independent criterion performance validity tests, which yielded 98 patients in the valid group and 31 in the invalid group. All MSVT subtest scores were significantly lower in the invalid group (η
PMID: 33371720
ISSN: 1552-3489
CID: 5592772