Faculty Bibliography

Naturalistic electrocorticography (ECoG) data are a rare but essential resource for studying the brain's linguistic capabilities. ECoG offers high temporal resolution suitable for investigating processes at multiple temporal timescales and frequency bands. It also provides broad spatial coverage, often along critical language areas. Here, we share a dataset of nine ECoG participants with 1,330 electrodes listening to a 30-minute audio podcast. The richness of this naturalistic stimulus can be used for various research questions, from auditory perception to narrative integration. In addition to the neural data, we extracted linguistic features of the stimulus ranging from phonetic information to large language model word embeddings. We use these linguistic features in encoding models that relate stimulus properties to neural activity. Finally, we provide detailed tutorials for preprocessing raw data, extracting stimulus features, and running encoding analyses that can serve as a pedagogical resource or a springboard for new research.

OBJECTIVE:Reduced-channel wearable electroencephalography (EEG) may overcome the accessibility and patient comfort limitations of traditional ambulatory electrographic seizure monitoring during extended-duration use. Automated algorithms are necessary for review of extended-duration reduced-channel EEG, yet current clinical support software is designed only for full-montage recordings. METHODS:The performance of a novel automated seizure detection algorithm for reduced-channel EEG (Epitel) was evaluated in a clinical validation study involving 50 participants (31 with seizures) with diverse demographic and seizure representation. RESULTS:The algorithm demonstrated an event-level sensitivity of 86.2% (95% confidence interval [CI] = 79.5%-93.2%) and a false detection rate of .162 per hour (95% CI = .116-.221), which is comparable to the performance of current clinical software for full-montage EEG. Performance varied by electrographic seizure type, with 91.4% sensitivity for focal evolving to generalized seizures, 86.7% for generalized seizures, and 77.3% for focal seizures. The algorithm maintained robust performance in both pediatric participants aged 6-21 years (83% sensitivity) and adults aged 22+ years (90% sensitivity), as well as in ambulatory (80%) and epilepsy monitoring unit (EMU) monitoring environments (87.5%). The false detection rate in ambulatory monitoring environments (.290 false positive [FP] detections/h), all of which involved pediatric participants, was notably higher than in the EMU (.136 FP/h), indicating an area with clear need for improvement for unrestricted at-home monitoring. The algorithm's supplemental Confidence metric, designed to engender trust in the algorithm, showed a strong correlation with detection precision. SIGNIFICANCE/CONCLUSIONS:These results suggest that this algorithm can provide crucial support for review of extended-duration reduced-channel wearable EEG, enabling electrographic seizure monitoring with no restrictions on a person's daily life.

Neuronal oscillations at about 10 Hz, called alpha oscillations, are often thought to arise from synchronous activity across the occipital cortex and are usually largest when the cortex is inactive. However, recent studies measuring visual receptive fields have reported that local alpha power increases when cortex is excited by visual stimulation. This contrasts with the expectation that alpha oscillations are associated with cortical inactivity. Here, we used intracranial electrodes in human patients to measure alpha oscillations in response to visual stimuli whose location varied systematically across the visual field. We hypothesized that stimulus-driven local increases in alpha power result from a mixture of two effects: a reduction in alpha oscillatory power and a simultaneous increase in broadband power. To test this, we implemented a model to separate these components. The two components were then independently fit by population receptive field (pRF) models. We find that the alpha pRFs have similar center locations to pRFs estimated from broadband power but are several times larger and exhibit the opposite effect: alpha oscillatory power decreases in response to stimuli within the receptive field, reinforcing the link between alpha oscillations and cortical inactivity, whereas broadband power increases. The results demonstrate that alpha suppression in the human visual cortex can be precisely tuned, but that to measure these effects, it is essential to separate the oscillatory signal from broadband power changes. Finally, we show how the large size and the negative valence of alpha pRFs can explain key features of exogenous visual attention.

Sentence production is the uniquely human ability to transform complex thoughts into strings of words. Despite the importance of this process, language production research has primarily focused on single words. It remains a largely untested assumption that the principles of word production generalize to more naturalistic utterances like sentences. Here, we investigate this using high-resolution neurosurgical recordings (ECoG) and an overt production experiment where ten patients produced six words in isolation (picture naming) and in sentences (scene description). We trained machine learning classifiers to identify the unique brain activity patterns for each word during picture naming, and used these patterns to decode which words patients were processing while they produced sentences. Our findings confirm that words share cortical representations across tasks, but reveal a division of labor within the language network. In sensorimotor cortex, words were consistently activated in the order in which they were said in the sentence. However, in prefrontal cortex, the order in which words were processed depended on the syntactic structure of the sentence. In non-canonical sentences (passives), we further observed a spatial code for syntactic roles, with subjects selectively encoded in inferior frontal gyrus (IFG) and objects selectively encoded in middle frontal gyrus (MFG). We suggest that these complex dynamics of prefrontal cortex may impose a subtle pressure on language evolution, potentially explaining why nearly all the world's languages position subjects before objects.

We introduce an intracranial EEG (iEEG) dataset collected as part of an adversarial collaboration between proponents of two theories of consciousness: Global Neuronal Workspace Theory and Integrated Information Theory. The data were recorded from 38 patients undergoing intracranial monitoring of epileptic seizures across three research centers using the same experimental protocol. Participants were presented with suprathreshold visual stimuli belonging to four different categories (faces, objects, letters, false fonts) in three orientations (front, left, right view), and for three durations (0.5, 1.0, 1.5 s). Participants engaged in a non-speeded Go/No-Go target detection task to identify infrequent targets with some stimuli becoming task-relevant and others task-irrelevant. Participants also engaged in a motor localizer task. The data were checked for its quality and converted to Brain Imaging Data Structure (BIDS). The de-identified dataset contains demographics, clinical information, electrode reconstruction, behavioral performance, and eye-tracking data. We also provide code to preprocess and analyze the data. This dataset holds promise for reuse in consciousness science and vision neuroscience to answer questions related to stimulus processing, target detection, and task-relevance, among many others.

The ability to connect the form and meaning of a concept, known as word retrieval, is fundamental to human communication. While various input modalities could lead to identical word retrieval, the exact neural dynamics supporting this process relevant to daily auditory discourse remain poorly understood. Here, we recorded neurosurgical electrocorticography (ECoG) data from 48 patients and dissociated two key language networks that highly overlap in time and space, critical for word retrieval. Using unsupervised temporal clustering techniques, we found a semantic processing network located in the middle and inferior frontal gyri. This network was distinct from an articulatory planning network in the inferior frontal and precentral gyri, which was invariant to input modalities. Functionally, we confirmed that the semantic processing network encodes word surprisal during sentence perception. These findings elucidate neurophysiological mechanisms underlying the processing of semantic auditory inputs ranging from passive language comprehension to conversational speech.

This study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain. We used electrocorticography to record neural signals across 100 h of speech production and comprehension as participants engaged in open-ended real-life conversations. We extracted low-level acoustic, mid-level speech and contextual word embeddings from a multimodal speech-to-text model (Whisper). We developed encoding models that linearly map these embeddings onto brain activity during speech production and comprehension. Remarkably, this model accurately predicts neural activity at each level of the language processing hierarchy across hours of new conversations not used in training the model. The internal processing hierarchy in the model is aligned with the cortical hierarchy for speech and language processing, where sensory and motor regions better align with the model's speech embeddings, and higher-level language areas better align with the model's language embeddings. The Whisper model captures the temporal sequence of language-to-speech encoding before word articulation (speech production) and speech-to-language encoding post articulation (speech comprehension). The embeddings learned by this model outperform symbolic models in capturing neural activity supporting natural speech and language. These findings support a paradigm shift towards unified computational models that capture the entire processing hierarchy for speech comprehension and production in real-world conversations.

The ability to connect the form and meaning of a concept, known as word retrieval, is fundamental to human communication. While various input modalities could lead to identical word retrieval, the exact neural dynamics supporting this convergence relevant to daily auditory discourse remain poorly understood. Here, we leveraged neurosurgical electrocorticographic (ECoG) recordings from 48 patients and dissociated two key language networks that highly overlap in time and space integral to word retrieval. Using unsupervised temporal clustering techniques, we found a semantic processing network located in the middle and inferior frontal gyri. This network was distinct from an articulatory planning network in the inferior frontal and precentral gyri, which was agnostic to input modalities. Functionally, we confirmed that the semantic processing network encodes word surprisal during sentence perception. Our findings characterize how humans integrate ongoing auditory semantic information over time, a critical linguistic function from passive comprehension to daily discourse.

OBJECTIVE:This study aimed to externally validate the Memory Assessment Clinics Scale for Epilepsy (MAC-E), a brief self-report measure of subjective memory complaints in adults with epilepsy. METHODS:A cross-sectional study was conducted including adults with focal pharmacoresistant epilepsy from three Level 4 epilepsy centers in the U.S., who completed the MAC-E as part of a clinical neuropsychological evaluation. Confirmatory factor analysis was conducted, and goodness-of-fit criteria were calculated to assess model fit: comparative fit index (CFI), root mean square error of approximation (RMSEA), and standardized root mean residual (SRMR). Item response theory models were constructed, and Mokken analysis was used to assess discrimination and unidimensionality. Internal consistency was evaluated with McDonald's Omega. RESULTS:values for each of the 5 factors (0.58-0.91 and 0.34-0.82, respectively). MAC-E items demonstrated high levels of discrimination as well as the ability to evaluate across the entirety of each latent trait. Score responses were uniformly distributed across latent traits, and unidimensionality was established by factor (all H coefficients > 0.4). Internal consistency was high across factors (omega range: 0.77-0.88). CONCLUSIONS:Results of this study demonstrate good external validation of the MAC-E in an independent, multicenter cohort of adults with epilepsy. These findings provide further support that the MAC-E is a psychometrically valid, self-report instrument to assess every-day memory abilities in adults with epilepsy in both clinical and research settings.