Faculty Bibliography

BACKGROUND:Multiple symptoms of suicide risk have been assessed based on visual and auditory information, including flattened affect, reduced movement, and slowed speech. Objective quantification of such symptomatology from novel data sources can increase the sensitivity, scalability, and timeliness of suicide risk assessment. OBJECTIVE:We aimed to examine measurements extracted from video interviews using open-source deep learning algorithms to quantify facial, vocal, and movement behaviors in relation to suicide risk severity in recently admitted patients following a suicide attempt. METHODS:We utilized video to quantify facial, vocal, and movement markers associated with mood, emotion, and motor functioning from a structured clinical conversation in 20 patients admitted to a psychiatric hospital following a suicide risk attempt. Measures were calculated using open-source deep learning algorithms for processing facial expressivity, head movement, and vocal characteristics. Derived digital measures of flattened affect, reduced movement, and slowed speech were compared to suicide risk with the Beck Scale for Suicide Ideation controlling for age and sex, using multiple linear regression. RESULTS:=0.32). CONCLUSIONS:Digital measurements of facial affect, movement, and speech prevalence demonstrated strong effect sizes and linear associations with the severity of suicidal ideation.

The necessary requirement of a traumatic event preceding the development of Posttraumatic Stress Disorder, theoretically allows for administering preventive and early interventions in the early aftermath of such events. Machine learning models including biomedical data to forecast PTSD outcome after trauma are highly promising for detection of individuals most in need of such interventions. In the current study, machine learning was applied on biomedical data collected within 48 h post-trauma to forecast individual risk for long-term PTSD, using a multinominal approach including the full spectrum of common PTSD symptom courses within one prognostic model for the first time. N = 417 patients (37.2% females; mean age 46.09 ± 15.88) admitted with (suspected) serious injury to two urban Academic Level-1 Trauma Centers were included. Routinely collected biomedical information (endocrine measures, vital signs, pharmacotherapy, demographics, injury and trauma characteristics) upon ED admission and subsequent 48 h was used. Cross-validated multi-nominal classification of longitudinal self-reported symptom severity (IES-R) over 12 months and bimodal classification of clinician-rated PTSD diagnosis (CAPS-IV) at 12 months post-trauma was performed using extreme Gradient Boosting and evaluated on hold-out sets. SHapley Additive exPlanations (SHAP) values were used to explain the derived models in human-interpretable form. Good prediction of longitudinal PTSD symptom trajectories (multiclass AUC = 0.89) and clinician-rated PTSD at 12 months (AUC = 0.89) was achieved. Most relevant prognostic variables to forecast both multinominal and dichotomous PTSD outcomes included acute endocrine and psychophysiological measures and hospital-prescribed pharmacotherapy. Thus, individual risk for long-term PTSD was accurately forecasted from biomedical information routinely collected within 48 h post-trauma. These results facilitate future targeted preventive interventions by enabling future early risk detection and provide further insights into the complex etiology of PTSD.

Digital health technologies are advancing characterization of mental health and functioning using objective, sensitive, and scalable tools for measurement of disease. These efforts directly address well-documented issues with traditional clinical assessments of psychiatric functioning, which can be burdensome, subjective, and insensitive to change. In this article, we highlight novel approaches for digital phenotyping of mental health. Each approach is categorized by the way biomarker data are collected, focusing on passive monitoring, active assessment, individual self-report, and biological measurement. Common challenges faced by each of these approaches are discussed, including pathways to validation, regulatory approval, and integration into patient care and clinical research. Finally, we present our perspective on the promise of such technology, focusing on how integration of independent digital measurement tools into a common technological infrastructure would allow for highly accurate, multimodal machine learning models for unprecedented objective measurement of mental health.

Introduction/UNASSIGNED:Motor abnormalities have been shown to be a distinct component of schizophrenia symptomatology. However, objective and scalable methods for assessment of motor functioning in schizophrenia are lacking. Advancements in machine learning-based digital tools have allowed for automated and remote "digital phenotyping" of disease symptomatology. Here, we assess the performance of a computer vision-based assessment of motor functioning as a characteristic of schizophrenia using video data collected remotely through smartphones. Methods/UNASSIGNED:Eighteen patients with schizophrenia and 9 healthy controls were asked to remotely participate in smartphone-based assessments daily for 14 days. Video recorded from the smartphone front-facing camera during these assessments was used to quantify the Euclidean distance of head movement between frames through a pretrained computer vision model. The ability of head movement measurements to distinguish between patients and healthy controls as well as their relationship to schizophrenia symptom severity as measured through traditional clinical scores was assessed. Results/UNASSIGNED:= 0.04), primarily with negative symptoms of schizophrenia. Conclusions/UNASSIGNED:Remote, smartphone-based assessments were able to capture meaningful visual behavior for computer vision-based objective measurement of head movement. The measurements of head movement acquired were able to accurately classify schizophrenia diagnosis and quantify symptom severity in patients with schizophrenia.

Background/UNASSIGNED:Alterations in multiple domains of cognition have been observed in individuals who have experienced a traumatic stressor. These domains may provide important insights in identifying underlying neurobiological dysfunction driving an individual's clinical response to trauma. However, such assessments are burdensome, costly, and time-consuming. To overcome barriers, efforts have emerged to measure multiple domains of cognitive functioning through the application of machine learning (ML) models to passive data sources. Methods/UNASSIGNED:We utilized automated computer vision and voice analysis methods to extract facial, movement, and speech characteristics from semi-structured clinical interviews in 81 trauma survivors who additionally completed a cognitive assessment battery. A ML-based regression framework was used to identify variance in visual and auditory measures that relate to multiple cognitive domains. Results/UNASSIGNED:= 0.63), consistent with the high test-retest reliability of traditional cognitive assessments. Face, voice, speech content, and movement have all significantly contributed to explaining the variance in predicting functioning in all cognitive domains. Conclusions/UNASSIGNED:The results demonstrate the feasibility of automated measurement of reliable proxies of cognitive functioning through low-burden passive patient evaluations. This makes it easier to monitor cognitive functions and to intervene earlier and at a lower threshold without requiring a time-consuming neurocognitive assessment by, for instance, a licensed psychologist with specialized training in neuropsychology.

Women are at higher risk for developing posttraumatic stress disorder (PTSD) compared to men, yet little is known about the biological contributors to this sex difference. One possible mechanism is differential immunological and neuroendocrine responses to traumatic stress exposure. In the current prospective study, we aimed to identify whether sex is indirectly associated with the probability of developing nonremitting PTSD through pro-inflammatory markers and whether steroid hormone concentrations influence this effect. Female (n = 179) and male (n = 197) trauma survivors were recruited from an emergency department and completed clinical assessment within 24 h and blood samples within ∼three hours of trauma exposure. Pro-inflammatory cytokines (IL-6, IL-1

Each year, more than 800,000 persons die by suicide, making it a leading cause of death worldwide. Recent innovations in information and communication technology may offer new opportunities in suicide prevention in individuals, hereby potentially reducing this number. In our project, we design digital indices based on both self-reports and passive mobile sensing and test their ability to predict suicidal ideation, a major predictor for suicide, and psychiatric hospital readmission in high-risk individuals: psychiatric patients after discharge who were admitted in the context of suicidal ideation or a suicidal attempt, or expressed suicidal ideations during their intake. Specifically, two smartphone applications -one for self-reports (SIMON-SELF) and one for passive mobile sensing (SIMON-SENSE)- are installed on participants' smartphones. SIMON-SELF uses a text-based chatbot, called Simon, to guide participants along the study protocol and to ask participants questions about suicidal ideation and relevant other psychological variables five times a day. These self-report data are collected for four consecutive weeks after study participants are discharged from the hospital. SIMON-SENSE collects behavioral variables -such as physical activity, location, and social connectedness- parallel to the first application. We aim to include 100 patients over 12 months to test whether (1) implementation of the digital protocol in such a high-risk population is feasible, and (2) if suicidal ideation and psychiatric hospital readmission can be predicted using a combination of psychological indices and passive sensor information. To this end, a predictive algorithm for suicidal ideation and psychiatric hospital readmission using various learning algorithms (e.g., random forest and support vector machines) and multilevel models will be constructed. Data collected on the basis of psychological theory and digital phenotyping may, in the future and based on our results, help reach vulnerable individuals early and provide links to just-in-time and cost-effective interventions or establish prompt mental health service contact. The current effort may thus lead to saving lives and significantly reduce economic impact by decreasing inpatient treatment and days lost to inability.

Medication non-adherence represents a significant barrier to treatment efficacy. Remote, real-time measurement of medication dosing can facilitate dynamic prediction of risk for medication non-adherence, which in-turn allows for proactive clinical intervention to optimize health outcomes. We examine the accuracy of dynamic prediction of non-adherence using data from remote real-time measurements of medication dosing. Participants across a large set of clinical trials (n = 4,182) were observed via a smartphone application that video records patients taking their prescribed medication. The patients' primary diagnosis, demographics, and prior indication of observed adherence/non-adherence were utilized to predict (1) adherence rates ≥ 80% across the clinical trial, (2) adherence ≥ 80% for the subsequent week, and (3) adherence the subsequent day using machine learning-based classification models. Empirically observed adherence was demonstrated to be the strongest predictor of future adherence/non-adherence. Collectively, the classification models accurately predicted adherence across the trial (AUC = 0.83), the subsequent week (AUC = 0.87) and the subsequent day (AUC = 0.87). Real-time measurement of dosing can be utilized to dynamically predict medication adherence with high accuracy.