Faculty Bibliography

Sensory input arrives in continuous sequences that humans experience as segmented units, e.g., words and events. The brain's ability to discover regularities is called statistical learning. Structure can be represented at multiple levels, including transitional probabilities, ordinal position, and identity of units. To investigate sequence encoding in cortex and hippocampus, we recorded from intracranial electrodes in human subjects as they were exposed to auditory and visual sequences containing temporal regularities. We find neural tracking of regularities within minutes, with characteristic profiles across brain areas. Early processing tracked lower-level features (e.g., syllables) and learned units (e.g., words), while later processing tracked only learned units. Learning rapidly shaped neural representations, with a gradient of complexity from early brain areas encoding transitional probability, to associative regions and hippocampus encoding ordinal position and identity of units. These findings indicate the existence of multiple, parallel computational systems for sequence learning across hierarchically organized cortico-hippocampal circuits.

OBJECTIVE:The combined spatiotemporal dynamics underlying sign language production remains largely unknown. To investigate these dynamics as compared to speech production we utilized intracranial electrocorticography during a battery of language tasks. METHODS:We report a unique case of direct cortical surface recordings obtained from a neurosurgical patient with intact hearing and bilingual in English and American Sign Language. We designed a battery of cognitive tasks to capture multiple modalities of language processing and production. RESULTS:We identified two spatially distinct cortical networks: ventral for speech and dorsal for sign production. Sign production recruited peri-rolandic, parietal and posterior temporal regions, while speech production recruited frontal, peri-sylvian and peri-rolandic regions. Electrical cortical stimulation confirmed this spatial segregation, identifying mouth areas for speech production and limb areas for sign production. The temporal dynamics revealed superior parietal cortex activity immediately before sign production, suggesting its role in planning and producing sign language. CONCLUSIONS:Our findings reveal a distinct network for sign language and detail the temporal propagation supporting sign production.

Cognitive functions, for example speech processing, are distributed asymmetrically in the two hemispheres that mostly have homologous anatomical structures. Dichotic listening is a well-established paradigm to investigate hemispherical lateralization of speech. However, the mixed results of dichotic listening, especially when using tonal languages as stimuli, complicates the investigation of functional lateralization. We hypothesized that the inconsistent results in dichotic listening are due to an interaction in processing a mixture of acoustic and linguistic attributes that are differentially processed over the two hemispheres. In this study, a within-subject dichotic listening paradigm was designed, in which different levels of speech and linguistic information was incrementally included in different conditions that required the same tone identification task. A left ear advantage (LEA), in contrast with the commonly found right ear advantage (REA) in dichotic listening, was observed in the hummed tones condition, where only the slow frequency modulation of tones was included. However, when phonemic and lexical information was added in simple vowel tone conditions, the LEA became unstable. Furthermore, ear preference became balanced when phonological and lexical-semantic attributes were included in the consonant-vowel (CV), pseudo-word, and word conditions. Compared with the existing REA results that use complex vowel word tones, a complete pattern emerged gradually shifting from LEA to REA. These results support the hypothesis that an acoustic analysis of suprasegmental information of tones is preferably processed in the right hemisphere, but is influenced by phonological and lexical semantic processes residing in the left hemisphere. The ear preference in dichotic listening depends on the levels of speech and linguistic analysis and preferentially lateralizes across the different hemispheres. That is, the manifestation of functional lateralization depends on the integration of information across the two hemispheres.

Slow-oscillations and spindle activity during non-REM sleep have been implicated in memory consolidation. Closed-loop acoustic stimulation has previously been shown to enhance slow oscillations and spindle activity during sleep and improve verbal associative memory. We assessed the effect of closed-loop acoustic stimulation during a daytime nap on a virtual reality spatial navigation task in 12 healthy human subjects in a randomized within-subject crossover design. We show robust enhancement of slow-spindle activity during sleep. However, no effects on behavioral performance were observed when comparing real versus sham stimulation. To explore whether memory enhancement effects were task-specific and dependent on nocturnal sleep, in a second experiment with 19 healthy subjects, we aimed to replicate a previous study which used closed-loop acoustic stimulation to enhance memory for word pairs. Methods were as close as possible to the original study, except we used a double-blind protocol, in which both subject and experimenter were unaware of the test condition. Again, we successfully enhanced slow-spindle power, but again did not strengthen associative memory performance with stimulation. We conclude that enhancement of slow-spindle oscillations may be insufficient to enhance memory performance in spatial navigation or verbal association tasks, and provide possible explanations for lack of behavioral replication.SIGNIFICANCE STATEMENT Prior studies have demonstrated that a closed-loop acoustic pulse paradigm during sleep can enhance verbal memory performance. This technique has widespread scientific and clinical appeal due to its non-invasive nature and ease of application. We tested with a rigorous double-blind design whether this technique could enhance key sleep rhythms associated sleep-dependent memory performance. We discovered that we could reliably enhance slow and spindle rhythms, but did not improve memory performance in the stimulation condition compared to sham condition. Our findings suggest that enhancing slow-spindle rhythms is insufficient to enhance sleep-dependent learning.

Dynamic interactions between remote but functionally specialized brain regions enable complex information processing. This intercortical communication is disrupted in the neural networks of patients with focal epilepsy, and epileptic activity can exert widespread effects within the brain. Using large-scale human intracranial electroencephalography recordings, we show that interictal epileptiform discharges (IEDs) are significantly coupled with spindles in discrete, individualized brain regions outside of the epileptic network. We found that a substantial proportion of these localized spindles travel across the cortical surface. Brain regions that participate in this IED-driven oscillatory coupling express spindles that have a broader spatial extent and higher tendency to propagate than spindles occurring in uncoupled regions. These altered spatiotemporal oscillatory properties identify areas that are shaped by epileptic activity independent of IED or seizure detection. Our findings suggest that IED-spindle coupling may be an important mechanism of interictal global network dysfunction that could be targeted to prevent disruption of normal neural activity.

The principles underlying functional asymmetries in cortex remain debated. For example, it is accepted that speech is processed bilaterally in auditory cortex, but a left hemisphere dominance emerges when the input is interpreted linguistically. The mechanisms, however, are contested, such as what sound features or processing principles underlie laterality. Recent findings across species (humans, canines and bats) provide converging evidence that spectrotemporal sound features drive asymmetrical responses. Typically, accounts invoke models wherein the hemispheres differ in time-frequency resolution or integration window size. We develop a framework that builds on and unifies prevailing models, using spectrotemporal modulation space. Using signal processing techniques motivated by neural responses, we test this approach, employing behavioural and neurophysiological measures. We show how psychophysical judgements align with spectrotemporal modulations and then characterize the neural sensitivities to temporal and spectral modulations. We demonstrate differential contributions from both hemispheres, with a left lateralization for temporal modulations and a weaker right lateralization for spectral modulations. We argue that representations in the modulation domain provide a more mechanistic basis to account for lateralization in auditory cortex.