Faculty Bibliography

Slow-oscillations and spindle activity during non-REM sleep have been implicated in memory consolidation. Closed-loop acoustic stimulation has previously been shown to enhance slow oscillations and spindle activity during sleep and improve verbal associative memory. We assessed the effect of closed-loop acoustic stimulation during a daytime nap on a virtual reality spatial navigation task in 12 healthy human subjects in a randomized within-subject crossover design. We show robust enhancement of slow-spindle activity during sleep. However, no effects on behavioral performance were observed when comparing real versus sham stimulation. To explore whether memory enhancement effects were task-specific and dependent on nocturnal sleep, in a second experiment with 19 healthy subjects, we aimed to replicate a previous study which used closed-loop acoustic stimulation to enhance memory for word pairs. Methods were as close as possible to the original study, except we used a double-blind protocol, in which both subject and experimenter were unaware of the test condition. Again, we successfully enhanced slow-spindle power, but again did not strengthen associative memory performance with stimulation. We conclude that enhancement of slow-spindle oscillations may be insufficient to enhance memory performance in spatial navigation or verbal association tasks, and provide possible explanations for lack of behavioral replication.SIGNIFICANCE STATEMENT Prior studies have demonstrated that a closed-loop acoustic pulse paradigm during sleep can enhance verbal memory performance. This technique has widespread scientific and clinical appeal due to its non-invasive nature and ease of application. We tested with a rigorous double-blind design whether this technique could enhance key sleep rhythms associated sleep-dependent memory performance. We discovered that we could reliably enhance slow and spindle rhythms, but did not improve memory performance in the stimulation condition compared to sham condition. Our findings suggest that enhancing slow-spindle rhythms is insufficient to enhance sleep-dependent learning.

Noninvasive brain stimulation techniques are used in experimental and clinical fields for their potential effects on brain network dynamics and behavior. Transcranial electrical stimulation (TES), including transcranial direct current stimulation (tDCS) and transcranial alternating current stimulation (tACS), has gained popularity because of its convenience and potential as a chronic therapy. However, a mechanistic understanding of TES has lagged behind its widespread adoption. Here, we review data and modelling on the immediate neurophysiological effects of TES in vitro as well as in vivo in both humans and other animals. While it remains unclear how typical TES protocols affect neural activity, we propose that validated models of current flow should inform study design and artifacts should be carefully excluded during signal recording and analysis. Potential indirect effects of TES (e.g., peripheral stimulation) should be investigated in more detail and further explored in experimental designs. We also consider how novel technologies may stimulate the next generation of TES experiments and devices, thus enhancing validity, specificity, and reproducibility.

Employing predictions based on environmental regularities is fundamental for adaptive behaviour. While it is widely accepted that predictions across different stimulus attributes (e.g., time and content) facilitate sensory processing, it is unknown whether predictions across these attributes rely on the same neural mechanism. Here, to elucidate the neural mechanisms of predictions, we combine invasive electrophysiological recordings (human electrocorticography in 4 females and 2 males) with computational modelling while manipulating predictions about content ('what') and time ('when'). We found that 'when' predictions increased evoked activity over motor and prefrontal regions both at early (∼180 ms) and late (430-450 ms) latencies. 'What' predictability, however, increased evoked activity only over prefrontal areas late in time (420-460 ms). Beyond these dissociable influences, we found that 'what' and 'when' predictability interactively modulated the amplitude of early (165 ms) evoked responses in the superior temporal gyrus. We modelled the observed neural responses using biophysically realistic neural mass models, to better understand whether 'what' and 'when' predictions tap into similar or different neurophysiological mechanisms. Our modelling results suggest that 'what' and 'when' predictability rely on complementary neural processes: 'what' predictions increased short-term plasticity in auditory areas, while 'when' predictability increased synaptic gain in motor areas. Thus, content and temporal predictions engage complementary neural mechanisms in different regions, suggesting domain-specific prediction signalling along the cortical hierarchy. Encoding predictions through different mechanisms may endow the brain with the flexibility to efficiently signal different sources of predictions, weight them by their reliability, and allow for their encoding without mutual interference.SIGNIFICANCE STATEMENTPredictions of different stimulus features facilitate sensory processing. However, it is unclear whether predictions of different attributes rely on similar or different neural mechanisms. By combining invasive electrophysiological recordings of cortical activity with experimental manipulations of participants' predictions about content and time of acoustic events, we found that the two types of predictions had dissociable influences on cortical activity, both in terms of the regions involved and the timing of the observed effects. Further, our biophysical modelling analysis suggests that predictability of content and time rely on complementary neural processes: short-term plasticity in auditory areas and synaptic gain in motor areas, respectively. This suggests that predictions of different features are encoded with complementary neural mechanisms in different brain regions.

Our visual environment constantly changes, yet we experience the world as a stable, unified whole. How is this stability achieved? It has been proposed that the brain preserves an implicit perceptual memory in sensory cortices [1] which stabilizes perception towards previously experienced states [2,3]. The role of higher-order areas, especially prefrontal cortex (PFC), in perceptual memory is less explored. Because PFC exhibits long neural time constants, invariance properties, and large receptive fields which may stabilize perception against time-varying inputs, it seems particularly suited to implement perceptual memory [4]. Support for this idea comes from a neuroimaging study reporting that dorsomedial PFC (dmPFC) correlates with perceptual memory [5]. But dmPFC also participates in decision making [6], so its contribution to perceptual memory could arise on a post-perceptual, decisional level [7]. To determine which role, if any, PFC plays in perceptual memory, we obtained direct intracranial recordings in six epilepsy patients while they performed sequential orientation judgements on ambiguous stimuli known to elicit perceptual memory [8]. We found that dmPFC activity in the high gamma frequency band (HGB, 70-150 Hz) correlates with perceptual memory. This effect is anatomically specific to dmPFC and functionally specific for memories of preceding percepts. Further, dmPFC appears to play a causal role, as a patient with a lesion in this area showed impaired perceptual memory. Thus, dmPFC integrates current sensory information with prior percepts, stabilizing visual experience against the perpetual variability of our surroundings.

It has come to our attention that we did not specify whether the stimulation magnitudes we report in this Article are peak amplitudes or peak-to-peak. All references to intensity given in mA in the manuscript refer to peak-to-peak amplitudes, except in Fig. 2, where the model is calibrated to 1 mA peak amplitude, as stated. In the original version of the paper we incorrectly calibrated the computational models to 1 mA peak-to-peak, rather than 1 mA peak amplitude. This means that we divided by a value twice as large as we should have. The correct estimated fields are therefore twice as large as shown in the original Fig. 2 and Supplementary Figure 11. The corrected figures are now properly calibrated to 1 mA peak amplitude. Furthermore, the sentence in the first paragraph of the Results section 'Intensity ranged from 0.5 to 2.5 mA (current density 0.125-0.625 mA mA/cm²), which is stronger than in previous reports', should have read 'Intensity ranged from 0.5 to 2.5 mA peak to peak (peak current density 0.0625-0.3125 mA/cm²), which is stronger than in previous reports.' These errors do not affect any of the Article's conclusions.

Reliable posture labels in hospital environments can augment research studies on neural correlates to natural behaviors and clinical applications that monitor patient activity. However, many existing pose estimation frameworks are not calibrated for these unpredictable settings. In this paper, we propose a semi-automated approach for improving upper-body pose estimation in noisy clinical environments, whereby we adapt and build around an existing joint tracking framework to improve its robustness to environmental uncertainties. The proposed framework uses subject-specific convolutional neural network models trained on a subset of a patient's RGB video recording chosen to maximize the feature variance of each joint. Furthermore, by compensating for scene lighting changes and by refining the predicted joint trajectories through a Kalman filter with fitted noise parameters, the extended system yields more consistent and accurate posture annotations when compared with the two state-of-the-art generalized pose tracking algorithms for three hospital patients recorded in two research clinics.

Transcranial electrical stimulation has widespread clinical and research applications, yet its effect on ongoing neural activity in humans is not well established. Previous reports argue that transcranial alternating current stimulation (tACS) can entrain and enhance neural rhythms related to memory, but the evidence from non-invasive recordings has remained inconclusive. Here, we measure endogenous spindle and theta activity intracranially in humans during low-frequency tACS and find no stable entrainment of spindle power during non-REM sleep, nor of theta power during resting wakefulness. As positive controls, we find robust entrainment of spindle activity to endogenous slow-wave activity in 66% of electrodes as well as entrainment to rhythmic noise-burst acoustic stimulation in 14% of electrodes. We conclude that low-frequency tACS at common stimulation intensities neither acutely modulates spindle activity during sleep nor theta activity during waking rest, likely because of the attenuated electrical fields reaching the cortical surface.

A key hallmark of visual perceptual awareness is robustness to instabilities arising from unnoticeable eye and eyelid movements. In previous human intracranial (iEEG) work (Golan et al., 2016) we found that excitatory broadband high-frequency activity transients, driven by eye blinks, are suppressed in higher-level but not early visual cortex. Here, we utilized the broad anatomical coverage of iEEG recordings in 12 eye-tracked neurosurgical patients to test whether a similar stabilizing mechanism operates following small saccades. We compared saccades (1.3 degrees -3.7 degrees ) initiated during inspection of large individual visual objects with similarly-sized external stimulus displacements. Early visual cortex sites responded with positive transients to both conditions. In contrast, in both dorsal and ventral higher-level sites the response to saccades (but not to external displacements) was suppressed. These findings indicate that early visual cortex is highly unstable compared to higher-level visual regions which apparently constitute the main target of stabilizing extra-retinal oculomotor influences.

Verbal working memory (vWM) involves storing and manipulating information in phonological sensory input. An influential theory of vWM proposes that manipulation is carried out by a central executive while storage is performed by two interacting systems: a phonological input buffer that captures sound-based information and an articulatory rehearsal system that controls speech motor output. Whether, when and how neural activity in the brain encodes these components remains unknown. Here we read out the contents of vWM from neural activity in human subjects as they manipulated stored speech sounds. As predicted, we identified storage systems that contained both phonological sensory and articulatory motor representations. Unexpectedly, however, we found that manipulation did not involve a single central executive but rather involved two systems with distinct contributions to successful manipulation. We propose, therefore, that multiple subsystems comprise the central executive needed to manipulate stored phonological input for articulatory motor output in vWM.