Try a new search

Format these results:

Searched for:

in-biosketch:true

person:reschz01

Total Results:

53


Examining Traditional and Novel Validity Indicators from the Medical Symptom Validity Test Across Levels of Verbal and Visual Memory Impairment

Cerny, Brian M; Resch, Zachary J; Rhoads, Tasha; Jennette, Kyle J; Singh, Palak G; Ovsiew, Gabriel P; Soble, Jason R
OBJECTIVE:This cross-sectional study examined accuracy of traditional Medical Symptom Validity Test (MSVT) validity indicators, including immediate recognition (IR), delayed recognition (DR), and consistency (CNS), as well as a novel indicator derived from the mean performance on IR, DR, and CNS across verbal, visual, and combined learning and memory impairment bands. METHOD/METHODS:A sample of 180 adult outpatients was divided into valid (n = 150) and invalid (n = 30) groups based on results of four independent criterion performance validity tests. Verbal and visual learning and recall were classified as indicative of no impairment, mild impairment, or severe impairment based on performance on the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised, respectively. RESULTS:In general, individual MSVT subtests were able to accurately classify performance as valid or invalid, even in the context of severe learning and memory deficits. However, as verbal and visual memory impairment increased, optimal MSVT cut-scores diverged from manual-specified cutoffs such that DR and CNS required cut-scores to be lowered to maintain adequate specificity. By contrast, the newly proposed scoring algorithm generally showed more robust psychometric properties across the memory impairment bands. CONCLUSIONS:The mean performance index, a novel scoring algorithm using the mean of the three primary MSVT subtests, may be a more robust validity indicator than the individual MSVT subtests in the context of bona fide memory impairment.
PMID: 34050349
ISSN: 1873-5843
CID: 5592882

Forgetting to Remember: The Impact of Post-traumatic Stress Disorder on Prospective and Retrospective Memory Performance

Korinek, Dale; Resch, Zachary J; Soble, Jason R; Aase, Darrin M; Schroth, Christopher; Phan, K Luan
OBJECTIVE:We examined the impact of post-traumatic stress disorder (PTSD) on both prospective (PM) and retrospective (RM) memory performance among a cross-sectional veteran sample. METHOD/METHODS:Data from tests of PM/RM memory and PTSD, anxiety, depression and sleep disturbance symptoms were examined among a prospectively recruited sample of 26 veterans with confirmed PTSD (PTSD+) and 26 well-matched, combat-exposed controls who did not meet criteria for PTSD (PTSD-). RESULTS:Small-to-moderate negative correlations emerged between PTSD symptom severity, visuospatial RM and some aspects of PM; general anxiety correlated more strongly with memory. The PTSD+ group demonstrated significantly worse, but still average visuospatial RM; differences in PM were nonsignificant between groups. Regression analyses implicated generalized anxiety, but not other psychiatric symptomology, as significant contributors to all memory performances. CONCLUSIONS:Minimal memory differences were found between veterans with and without PTSD. PM/RM memory performance was better explained by generalized anxiety rather that PTSD-specific symptoms.
PMID: 34009244
ISSN: 1873-5843
CID: 5592612

The impact of visual memory impairment on Victoria Symptom Validity Test performance: A known-groups analysis

Stocks, Jane K; Shields, Allison N; DeBoer, Adam B; Cerny, Brian M; Ogram Buckley, Caitlin M; Ovsiew, Gabriel P; Jennette, Kyle J; Resch, Zachary J; Basurto, Karen S; Song, Woojin; Pliskin, Neil H; Soble, Jason R
OBJECTIVE:We assessed the effect of visual learning and recall impairment on Victoria Symptom Validity Test (VSVT) accuracy and response latency for Easy, Difficult, and Total Items. METHOD/METHODS:A sample of 163 adult patients administered the VSVT and Brief Visuospatial Memory Test-Revised were classified as valid (114/163) or invalid (49/163) groups via independent criterion performance validity tests (PVTs). Classification accuracies for all VSVT indices were examined for the overall sample, and separately for subgroups based on visual memory functioning. RESULTS:In the overall sample, all indices produced acceptable classification accuracy (areas under the curve [AUCs] ≥ 0.79). When stratified by visual learning/recall impairment, accuracy indices yielded acceptable classification for both the unimpaired (AUCs ≥0.79) and impaired subsamples (AUCs ≥0.75). Latency indices had acceptable classification accuracy for the unimpaired subsample (AUCs ≥0.74), but accuracy and sensitivity dropped for the impaired sample (AUCs ≥0.67). CONCLUSIONS:VSVT accuracy and response latency yielded acceptable classification accuracies in the overall sample, and this effect was maintained in those with and without visual learning/recall impairment for the accuracy indices. Findings indicate that the VSVT is a psychometrically robust PVT with largely invariant cut-scores, even in the presence of bona fide visual learning/recall impairment.
PMID: 34985401
ISSN: 2327-9109
CID: 5592642

The Divergent Roles of Symptom and Performance Validity in the Assessment of ADHD

White, Daniel J; Ovsiew, Gabriel P; Rhoads, Tasha; Resch, Zachary J; Lee, Mary; Oh, Alison J; Soble, Jason R
OBJECTIVE:This study examined concordance between symptom and performance validity among clinically-referred patients undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD). METHOD:Data from 203 patients who completed the WAIS-IV Working Memory Index, the Clinical Assessment of Attention Deficit-Adult (CAT-A), and ≥4 criterion performance validity tests (PVTs) were analyzed. RESULTS: CONCLUSION:Symptom and performance invalidity represent dissociable constructs in patients undergoing neuropsychological evaluation of ADHD and should be evaluated independently.
PMID: 33084457
ISSN: 1557-1246
CID: 5592532

Mean response latency indices on the Victoria Symptom Validity Test do not contribute meaningful predictive value over accuracy scores for detecting invalid performance

Cerny, Brian M; Rhoads, Tasha; Leib, Sophie I; Jennette, Kyle J; Basurto, Karen S; Durkin, Nicole M; Ovsiew, Gabriel P; Resch, Zachary J; Soble, Jason R
The utility of the Victoria Symptom Validity Test (VSVT) as a performance validity test (PVT) has been primarily established using response accuracy scores. However, the degree to which response latency may contribute to accurate classification of performance invalidity over and above accuracy scores remains understudied. Therefore, this study investigated whether combining VSVT accuracy and response latency scores would increase predictive utility beyond use of accuracy scores alone. Data from a mixed clinical sample of 163 patients, who were administered the VSVT as part of a larger neuropsychological battery, were analyzed. At least four independent criterion PVTs were used to establish validity groups (121 valid/42 invalid). Logistic regression models examining each difficulty level revealed that all VSVT measures were useful in classifying validity groups, both independently and when combined. Individual predictor classification accuracy ranged from 77.9 to 81.6%, indicating acceptable to excellent discriminability across the validity indices. The results of this study support the value of both accuracy and latency scores on the VSVT to identify performance invalidity, although the accuracy scores had superior classification statistics compared to response latency, and mean latency indices provided no unique benefit for classification accuracy beyond dimensional accuracy scores alone.
PMID: 33470869
ISSN: 2327-9109
CID: 5592792

Impaired or invalid? Limitations of assessing performance validity using the Boston Naming Test

Abramson, Dayna A; Resch, Zachary J; Ovsiew, Gabriel P; White, Daniel J; Bernstein, Matthew T; Basurto, Karen S; Soble, Jason R
The Boston Naming Test (BNT) has been proposed as an embedded performance validity test (PVT), though replication is needed to provide further empirical support of its simultaneous use as a cognitive ability measure and embedded PVT. This cross-sectional study examined BNT performance in a mixed neuropsychiatric sample of 137 patients with/without cognitive impairment. Four independent criterion PVTs classified 109 (80%) as valid and 28 (20%) as invalid. BNT raw and demographically-corrected T-scores were significantly higher among the valid group with small effect sizes (ηp
PMID: 32538174
ISSN: 2327-9109
CID: 5592492

Concordance between the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and Clinical Assessment of Attention Deficit-Adult (CAT-A) over-reporting validity scales for detecting invalid ADHD symptom reporting

Leib, Sophie I; Schieszler-Ockrassa, Christine; White, Daniel J; Gallagher, Virginia T; Carter, Dustin A; Basurto, Karen S; Ovsiew, Gabriel P; Resch, Zachary J; Jennette, Kyle J; Soble, Jason R
This study investigated the relationship between symptom validity scales on the Clinical Assessment of Attention Deficit-Adult (CAT-A) and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in the context of Attention-Deficit/Hyperactivity Disorder (ADHD) evaluation. The sample comprised 140 consecutive patients referred for a neuropsychological evaluation of ADHD and were administered the CAT-A and the MMPI-2-RF and a battery of performance-based neurocognitive tests. Results indicated CAT-A/MMPI-2-RF symptom validity concordance of 51% between measures, with 38% concordant valid and 13% concordant invalid responses. Among those with discordance symptom validity results, rates of valid CAT-A/invalid MMPI-2-RF responding (41%) were more common than invalid CAT-A/valid MMPI-2-RF responding (8%). Results also indicated higher levels of ADHD symptoms among invalid responding within the CAT-A, whereas the MMPI-2-RF Cognitive Complaints scale did not differ by CAT-A validity status. Finally, symptom validity scales on both the CAT-A and MMPI-2-RF were largely discordant from neuropsychological test validity status per performance validity tests. Findings highlight the need for symptom validity testing when assessing ADHD and indicate that validity indices on broad personality assessments may assess different constructs than embedded validity indices in ADHD-specific measures.
PMID: 33719792
ISSN: 2327-9109
CID: 5592822

Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance

Resch, Zachary J; Pham, Amber T; Abramson, Dayna A; White, Daniel J; DeDios-Stern, Samantha; Ovsiew, Gabriel P; Castillo, Liliam R; Soble, Jason R
The California Verbal Learning Test-Second Edition (CVLT-II) Forced Choice Recognition (FC) and Brief Visuospatial Memory Test-Revised (BVMT-R) Recognition Discrimination Index (RD) are embedded performance validity tests (PVTs) assessing material-specific neuropsychological processes (i.e., verbal and visual memory, respectively). Prior research demonstrated the utility of these PVTs independently; however, no study has compared their diagnostic accuracy for identifying invalid performance relative to each other and in combination within a single sample. This cross-sectional study included an adult neuropsychiatric sample who underwent neuropsychological evaluation. Validity groups were determined via independent criterion PVT performance, and consisted of 103 participants with valid and 25 with invalid neurocognitive performance. FC and RD were not significantly correlated (r = .154), yet both differed between validity groups (ηp
PMID: 32202916
ISSN: 2327-9109
CID: 5592692

Comparing the Psychometric Properties of Eight Embedded Performance Validity Tests in the Rey Auditory Verbal Learning Test, Wechsler Memory Scale Logical Memory, and Brief Visuospatial Memory Test-Revised Recognition Trials for Detecting Invalid Neuropsychological Test Performance

Pliskin, Joshua I; DeDios Stern, Samantha; Resch, Zachary J; Saladino, Kevin F; Ovsiew, Gabriel P; Carter, Dustin A; Soble, Jason R
This cross-sectional study evaluated eight embedded performance validity tests (PVTs) previously derived from the Rey Auditory Verbal Learning Test (RAVLT), Wechsler Memory Scale-IV-Logical Memory (LM), and Brief Visuospatial Memory Test-Revised (BVMT-R) recognition trials among a single mixed clinical sample of 108 neuropsychiatric patients (83 valid/25 invalid) with (n = 54) and without (n = 29) mild neurocognitive disorder. Among the overall sample, all eight recognition PVTs significantly differentiated valid from invalid performance (areas under the curve [AUCs] = .64-.81) with 26% to 44% sensitivity (≥89% specificity) at optimal cut-scores depending on the specific PVT. After subdividing the sample by cognitive impairment status, all eight PVTs continued to reliably identify invalid performance (AUC = .68-.91) with markedly increased sensitivities of 56% to 80% (≥89% specificity) in the unimpaired group. In contrast, among those with mild neurocognitive disorder, RAVLT False Positives and LM became nonsignificant, whereas the other six PVTs remained significant (AUC = .64-.77), albeit with reduced sensitivities of 32% to 44% (≥89% specificity) at optimal cut-scores. Taken together, results cross-validated BVMT-R and most RAVLT recognition indices as effective embedded PVTs for identifying invalid neuropsychological test performance with diverse populations including examinees with and without suspected mild neurocognitive disorder, whereas LM had more limited utility as an embedded PVT, particularly when mild neurocognitive disorder was present.
PMID: 32484371
ISSN: 1552-3489
CID: 5593022

Masking effect of high IQ on the Rey Auditory Verbal Learning Test in an adult sample with attention deficit/hyperactivity disorder

Keezer, Richard D; Leib, Sophie I; Scimeca, Lauren M; Smith, Justin T; Holbrook, Lindsey R; Sharp, Dillon W; Jennette, Kyle J; Ovsiew, Gabriel P; Resch, Zachary J; Soble, Jason R
OBJECTIVE:High intelligence (IQ) adults with attention-deficit/hyperactivity disorder (ADHD) often perform better on neuropsychological tests relative to average IQ adults with ADHD, despite commensurate functional impairment. This study compared adults with ADHD and high versus average IQ on the Rey Auditory Verbal Learning Test (RAVLT) to specifically assess this proposed masking effect of IQ on verbal learning/memory performance among those undergoing neuropsychological evaluation. METHOD/METHODS:RAVLT performance between patients with ADHD and average versus high Test of Premorbid Function-estimated IQ were compared. Latent growth curve modeling (LGCM) evaluated learning acquisition across trials. RESULTS:RAVLT total learning, immediate, and delayed free recall performances were significantly better in the high IQ relative to the average IQ group. LGCM showed similar quadradic growth trajectories for both IQ groups. Both groups reported equivalent symptom severity and functional complaints in childhood and adulthood. CONCLUSIONS:Adults with ADHD and high IQ performed normally on a verbal learning/memory test compared to adults with average IQ, who scored 0.5-1.0 standard deviations below the mean. These results suggest a masking of performance-based memory deficits in the context of higher IQ in adults with ADHD, supporting growing evidence that higher IQ masks neurocognitive deficits during the assessment of adults with ADHD.
PMID: 34623950
ISSN: 2327-9109
CID: 5593062