Faculty Bibliography

Contextual embeddings, derived from deep language models (DLMs), provide a continuous vectorial representation of language. This embedding space differs fundamentally from the symbolic representations posited by traditional psycholinguistics. We hypothesize that language areas in the human brain, similar to DLMs, rely on a continuous embedding space to represent language. To test this hypothesis, we densely record the neural activity patterns in the inferior frontal gyrus (IFG) of three participants using dense intracranial arrays while they listened to a 30-minute podcast. From these fine-grained spatiotemporal neural recordings, we derive a continuous vectorial representation for each word (i.e., a brain embedding) in each patient. Using stringent zero-shot mapping we demonstrate that brain embeddings in the IFG and the DLM contextual embedding space have common geometric patterns. The common geometric patterns allow us to predict the brain embedding in IFG of a given left-out word based solely on its geometrical relationship to other non-overlapping words in the podcast. Furthermore, we show that contextual embeddings capture the geometry of IFG embeddings better than static word embeddings. The continuous brain embedding space exposes a vector-based neural code for natural language processing in the human brain.

OBJECTIVE:This study was undertaken to conduct external validation of previously published epilepsy surgery prediction tools using a large independent multicenter dataset and to assess whether these tools can stratify patients for being operated on and for becoming free of disabling seizures (International League Against Epilepsy stage 1 and 2). METHODS:We analyzed a dataset of 1562 patients, not used for tool development. We applied two scales: Epilepsy Surgery Grading Scale (ESGS) and Seizure Freedom Score (SFS); and two versions of Epilepsy Surgery Nomogram (ESN): the original version and the modified version, which included electroencephalographic data. For the ESNs, we used calibration curves and concordance indexes. We stratified the patients into three tiers for assessing the chances of attaining freedom from disabling seizures after surgery: high (ESGS = 1, SFS = 3-4, ESNs > 70%), moderate (ESGS = 2, SFS = 2, ESNs = 40%-70%), and low (ESGS = 2, SFS = 0-1, ESNs < 40%). We compared the three tiers as stratified by these tools, concerning the proportion of patients who were operated on, and for the proportion of patients who became free of disabling seizures. RESULTS:The concordance indexes for the various versions of the nomograms were between .56 and .69. Both scales (ESGS, SFS) and nomograms accurately stratified the patients for becoming free of disabling seizures, with significant differences among the three tiers (p < .05). In addition, ESGS and the modified ESN accurately stratified the patients for having been offered surgery, with significant difference among the three tiers (p < .05). SIGNIFICANCE/CONCLUSIONS:ESGS and the modified ESN (at thresholds of 40% and 70%) stratify patients undergoing presurgical evaluation into three tiers, with high, moderate, and low chance for favorable outcome, with significant differences between the groups concerning having surgery and becoming free of disabling seizures. Stratifying patients for epilepsy surgery has the potential to help select the optimal candidates in underprivileged areas and better allocate resources in developed countries.

Convolutional neural networks (CNN) show great promise for translating decades of research on structural abnormalities in temporal lobe epilepsy into clinical practice. Three-dimensional CNNs typically outperform two-dimensional CNNs in medical imaging. Here we explore for the first time whether a three-dimensional CNN outperforms a two-dimensional CNN for identifying temporal lobe epilepsy-specific features on MRI. Using 1178 T1-weighted images (589 temporal lobe epilepsy, 589 healthy controls) from 12 surgical centres, we trained 3D and 2D CNNs for temporal lobe epilepsy versus healthy control classification, using feature visualization to identify important regions. The 3D CNN was compared to the 2D model and to a randomized model (comparison to chance). Further, we explored the effect of sample size with subsampling, examined model performance based on single-subject clinical characteristics, and tested the impact of image harmonization on model performance. Across 50 datapoints (10 runs with 5-folds each) the 3D CNN median accuracy was 86.4% (35.3% above chance) and the median F1-score was 86.1% (33.3% above chance). The 3D model yielded higher accuracy compared to the 2D model on 84% of datapoints (median 2D accuracy, 83.0%), a significant outperformance for the 3D model (binomial test: P < 0.001). This advantage of the 3D model was only apparent at the highest sample size. Saliency maps exhibited the importance of medial-ventral temporal, cerebellar, and midline subcortical regions across both models for classification. However, the 3D model had higher salience in the most important regions, the ventral-medial temporal and midline subcortical regions. Importantly, the model achieved high accuracy (82% accuracy) even in patients without MRI-identifiable hippocampal sclerosis. Finally, applying ComBat for harmonization did not improve performance. These findings highlight the value of 3D CNNs for identifying subtle structural abnormalities on MRI, especially in patients without clinically identified temporal lobe epilepsy lesions. Our findings also reveal that the advantage of 3D CNNs relies on large sample sizes for model training.

Cortical regions supporting speech production are commonly established using neuroimaging techniques in both research and clinical settings. However, for neurosurgical purposes, structural function is routinely mapped peri-operatively using direct electrocortical stimulation. While this method is the gold standard for identification of eloquent cortical regions to preserve in neurosurgical patients, there is lack of specificity of the actual underlying cognitive processes being interrupted. To address this, we propose mapping the temporal dynamics of speech arrest across peri-sylvian cortices by quantifying the latency between stimulation and speech deficits. In doing so, we are able to substantiate hypotheses about distinct region-specific functional roles (e.g. planning versus motor execution). In this retrospective observational study, we analysed 20 patients (12 female; age range 14-43) with refractory epilepsy who underwent continuous extra-operative intracranial EEG monitoring of an automatic speech task during clinical bedside language mapping. Latency to speech arrest was calculated as time from stimulation onset to speech arrest onset, controlling for individual speech rate. Most instances of motor-based arrest (87.5% of 96 instances) were in sensorimotor cortex with mid-range latencies to speech arrest with a distributional peak at 0.47 s. Speech arrest occurred in numerous regions, with relatively short latencies in supramarginal gyrus (0.46 s), superior temporal gyrus (0.51 s) and middle temporal gyrus (0.54 s), followed by relatively long latencies in sensorimotor cortex (0.72 s) and especially long latencies in inferior frontal gyrus (0.95 s). Non-parametric testing for speech arrest revealed that region predicted latency; latencies in supramarginal gyrus and in superior temporal gyrus were shorter than in sensorimotor cortex and in inferior frontal gyrus. Sensorimotor cortex is primarily responsible for motor-based arrest. Latencies to speech arrest in supramarginal gyrus and superior temporal gyrus (and to a lesser extent middle temporal gyrus) align with latencies to motor-based arrest in sensorimotor cortex. This pattern of relatively quick cessation of speech suggests that stimulating these regions interferes with the outgoing motor execution. In contrast, the latencies to speech arrest in inferior frontal gyrus and in ventral regions of sensorimotor cortex were significantly longer than those in temporoparietal regions. Longer latencies in the more frontal areas (including inferior frontal gyrus and ventral areas of precentral gyrus and postcentral gyrus) suggest that stimulating these areas interrupts a higher-level speech production process involved in planning. These results implicate the ventral specialization of sensorimotor cortex (including both precentral and postcentral gyri) for speech planning above and beyond motor execution.

PURPOSE/OBJECTIVE:Brain responsive neurostimulation (NeuroPace) treats patients with refractory focal epilepsy and provides chronic electrocorticography (ECoG). We explored how machine learning algorithms applied to interictal ECoG could assess clinical response to changes in neurostimulation parameters. METHODS:We identified five responsive neurostimulation patients each with ≥200 continuous days of stable medication and detection settings (median, 358 days per patient). For each patient, interictal ECoG segments for each month were labeled as "high" or "low" to represent relatively high or low long-episode (i.e., seizure) count compared with the median monthly long-episode count. Power from six conventional frequency bands from four responsive neurostimulation channels were extracted as features. For each patient, five machine learning algorithms were trained on 80% of ECoG, then tested on the remaining 20%. Classifiers were scored by the area-under-the-receiver-operating-characteristic curve. We explored how individual circadian cycles of seizure activity could inform classifier building. RESULTS:Support vector machine or gradient boosting models achieved the best performance, ranging from 0.705 (fair) to 0.892 (excellent) across patients. High gamma power was the most important feature, tending to decrease during low-seizure-frequency epochs. For two subjects, training on ECoG recorded during the circadian ictal peak resulted in comparable model performance, despite less data used. CONCLUSIONS:Machine learning analysis on retrospective background ECoG can classify relative seizure frequency for an individual patient. High gamma power was the most informative, whereas individual circadian patterns of seizure activity can guide model building. Machine learning classifiers built on interictal ECoG may guide stimulation programming.

INTRODUCTION:For drug resistant epilepsy patients who are either not candidates for resective surgery or have already failed resective surgery, neuromodulation is a promising option. Neuromodulatory approaches include responsive neurostimulation (RNS), deep brain stimulation (DBS), and vagal nerve stimulation (VNS). Thalamocortical circuits are involved in both generalized and focal onset seizures. This paper explores the use of RNS in the centromedian nucleus of the thalamus (CMN) and in the anterior thalamic nucleus (ANT) of patients with drug resistant epilepsy. METHODS:This is a retrospective multicenter study from seven different epilepsy centers in the United States. Patients that had unilateral or bilateral thalamic RNS leads implanted in the CMN or ANT for at least 6 months were included. Primary objectives were to describe the implant location and determine changes in the frequency of disabling seizures at 6 months, 1 year, 2 years, and > 2 years. Secondary objectives included documenting seizure free periods, anti-seizure medication regimen changes, stimulation side effects, and serious adverse events. In addition, the global clinical impression scale was completed. RESULTS:Twelve patients had at least one lead placed in the CMN, and 13 had at least one lead placed in the ANT. The median baseline seizure frequency was 15 per month. Overall, the median seizure reduction was 33% at 6 months, 55% at 1 year, 65% at 2 years, and 74% at >2 years. Seizure free intervals of at least 3 months occurred in nine patients. Most patients (60%, 15/25) did not have a change in anti-seizure medications post RNS placement. Two serious adverse events were recorded, one related to RNS implantation. Lastly, overall functioning seemed to improve with 88% showing improvement on the global clinical impression scale. DISCUSSION:Meaningful seizure reduction was observed in patients who suffer from drug resistant epilepsy with unilateral or bilateral RNS in either the ANT or CMN of the thalamus. Most patients remained on their pre-operative anti-seizure medication regimen. The device was well tolerated with few side effects. There were rare serious adverse events. Most patients showed an improvement in global clinical impression scores.

OBJECTIVE:Genetic factors have long been debated as a cause of failure of surgery for mesial temporal lobe epilepsy (MTLE). We investigated whether rare genetic variation influences seizure outcomes of MTLE surgery. METHODS:We performed an international, multicenter, whole exome sequencing study of patients who underwent surgery for drug-resistant, unilateral MTLE with normal magnetic resonance imaging (MRI) or MRI evidence of hippocampal sclerosis and ≥2-year postsurgical follow-up. Patients with either sustained seizure freedom (favorable outcome) or ongoing uncontrolled seizures since surgery (unfavorable outcome) were included. Exomes of controls without epilepsy were also included. Gene set burden analyses were carried out to identify genes with significant enrichment of rare deleterious variants in patients compared to controls. RESULTS:Nine centers from 3 continents contributed 206 patients operated for drug-resistant unilateral MTLE, of whom 196 (149 with favorable outcome and 47 with unfavorable outcome) were included after stringent quality control. Compared to 8,718 controls, MTLE cases carried a higher burden of ultrarare missense variants in constrained genes that are intolerant to loss-of-function (LoF) variants (odds ratio [OR] = 2.6, 95% confidence interval [CI] = 1.9-3.5, p = 1.3E-09) and in genes encoding voltage-gated cation channels (OR = 2.4, 95% CI = 1.4-3.8, p = 2.7E-04). Proportions of subjects with such variants were comparable between patients with favorable outcome and those with unfavorable outcome, with no significant between-group differences. INTERPRETATION/CONCLUSIONS:Rare variation contributes to the genetic architecture of MTLE, but does not appear to have a major role in failure of MTLE surgery. These findings can be incorporated into presurgical decision-making and counseling. ANN NEUROL 2022.

Neural responses to visual stimuli exhibit complex temporal dynamics, including sub-additive temporal summation, response reduction with repeated or sustained stimuli (adaptation), and slower dynamics at low contrast. These phenomena are often studied independently. Here, we demonstrate these phenomena within the same experiment and model the underlying neural computations with a single computational model. We extracted time-varying responses from electrocorticographic (ECoG) recordings from patients presented with stimuli that varied in contrast, duration, and inter-stimulus interval (ISI). Aggregating data across patients from both sexes yielded 98 electrodes with robust visual responses, covering both earlier (V1-V3) and higher-order (V3a/b, LO, TO, IPS) retinotopic maps. In all regions, the temporal dynamics of neural responses exhibit several non-linear features: peak response amplitude saturates with high contrast and longer stimulus durations; the response to a second stimulus is suppressed for short ISIs and recovers for longer ISIs; response latency decreases with increasing contrast. These features are accurately captured by a computational model comprised of a small set of canonical neuronal operations: linear filtering, rectification, exponentiation, and a delayed divisive normalization. We find that an increased normalization term captures both contrast- and adaptation-related response reductions, suggesting potentially shared underlying mechanisms. We additionally demonstrate both changes and invariance in temporal response dynamics between earlier and higher-order visual areas. Together, our results reveal the presence of a wide range of temporal and contrast-dependent neuronal dynamics in the human visual cortex, and demonstrate that a simple model captures these dynamics at millisecond resolution.SIGNIFICANCE STATEMENTSensory inputs and neural responses change continuously over time. It is especially challenging to understand a system that has both dynamic inputs and outputs. Here we use a computational modeling approach that specifies computations to convert a time-varying input stimulus to a neural response time course, and use this to predict neural activity measured in the human visual cortex. We show that this computational model predicts a wide variety of complex neural response shapes that we induced experimentally by manipulating the duration, repetition and contrast of visual stimuli. By comparing data and model predictions, we uncover systematic properties of temporal dynamics of neural signals, allowing us to better understand how the brain processes dynamic sensory information.

In analyzing the neural correlates of naturalistic and unstructured behaviors, features of neural activity that are ignored in a trial-based experimental paradigm can be more fully studied and investigated. Here, we analyze neural activity from two patients using electrocorticography (ECoG) and stereo-electroencephalography (sEEG) recordings, and reveal that multiple neural signal characteristics exist that discriminate between unstructured and naturalistic behavioral states such as "engaging in dialogue" and "using electronics". Using the high gamma amplitude as an estimate of neuronal firing rate, we demonstrate that behavioral states in a naturalistic setting are discriminable based on long-term mean shifts, variance shifts, and differences in the specific neural activity's covariance structure. Both the rapid and slow changes in high gamma band activity separate unstructured behavioral states. We also use Gaussian process factor analysis (GPFA) to show the existence of salient spatiotemporal features with variable smoothness in time. Further, we demonstrate that both temporally smooth and stochastic spatiotemporal activity can be used to differentiate unstructured behavioral states. This is the first attempt to elucidate how different neural signal features contain information about behavioral states collected outside the conventional experimental paradigm.

OBJECTIVES/OBJECTIVE:As part of the COVID-19 and Epilepsy (COV-E) global study, we aimed to understand the impact of COVID-19 on the medical care and well-being of people with epilepsy (PWE) in the United States, based on their perspectives and those of their caregivers. METHODS:Separate surveys designed for PWE and their caregivers were circulated from April 2020 to July 2021; modifications in March 2021 included a question about COVID-19 vaccination status. RESULTS:We received 788 responses, 71% from PWE (n = 559) and 29% (n=229) from caregivers of persons with epilepsy. A third (n = 308) of respondents reported a change in their health or in the health of the person they care for. Twenty-seven percent (n = 210) reported issues related to worsening mental health. Of respondents taking ASMs (n = 769), 10% (n= 78) reported difficulty taking medications on time, mostly due to stress causing forgetfulness. Less than half of respondents received counseling on mental health and stress. Less than half of the PWE reported having discussions with their healthcare providers about sleep, ASMs and potential side effects, while a larger proportion of caregivers (81%) reported having had discussions with their healthcare providers on the same topics. More PWE and caregivers reported that COVID-19 related measures caused adverse impact on their health in the post-vaccine period than during the pre-vaccine period, citing mental health issues as the primary reason. SIGNIFICANCE/CONCLUSIONS:Our findings indicate that the impact of the COVID-19 pandemic in the US on PWE is multifaceted. Apart from the increased risk of poor COVID-19 outcomes, the pandemic has also had negative effects on mental health and self-management. Healthcare providers must be vigilant for increased emotional distress in PWE during the pandemic and consider the importance of effective counseling to diminish risks related to exacerbated treatment gaps.