Faculty Bibliography

Rapid advances in generative artificial intelligence (AI) and deep representation learning have revolutionized numerous engineering applications in signal processing, computer vision, speech recognition and translation, and natural language processing due to amazingly powerful representation power (e.g., [1,2]). Generative AI-empowered tools, such as ChatGPT and Sora, have fundamentally changed the landscape of human-computer communications research. One emerging application along this line is to link the brain to the computer (i.e., brain-computer interface or BCI) and to develop paradigm-shift brain-to-content technologies. This BCI system upgrade (i.e., BCI 2.0) is empowered by generative AI and deep learning ("new engine") and large amounts of data ("gas"). In this article, we will revisit the old song sung in a new tune, highlight some state-of-the-art progresses, and briefly discuss the future outlook.

Advances in closed-loop neural interfaces and neuromodulation have offered a potentially effective and non-addictive treatment for chronic pain. These interfaces link neural sensors with device outputs to provide temporally precise stimulation. We discuss challenges and trends of state-of-the-art neural interfaces for treating pain in animal models and human pilot trials.

Distributed hypothalamic-midbrain neural circuits help orchestrate complex behavioral responses during social interactions. Given rapid advances in optical imaging, it is a fundamental question how population-averaged neural activity measured by multi-fiber photometry (MFP) for calcium fluorescence signals correlates with social behaviors is a fundamental question. This paper aims to investigate the correspondence between MFP data and social behaviors. 
Approach: We propose a state-space analysis framework to characterize mouse MFP data based on dynamic latent variable models, which include a continuous-state linear dynamical system (LDS) and a discrete-state hidden semi-Markov model (HSMM). We validate these models on extensive MFP recordings during aggressive and mating behaviors in male-male and male-female interactions, respectively. 
Main Results: Our results show that these models are capable of capturing both temporal behavioral structure and associated neural states, and produce interpretable latent states. Our approach is also validated in computer simulations in the presence of known ground truth.
Significance: Overall, these analysis approaches provide a state-space framework to examine neural dynamics underlying social behaviors and reveals mechanistic insights into the relevant networks. 
&#xD.

High-speed wide-field fluorescence microscopy has the potential to capture biological processes with exceptional spatiotemporal resolution. However, conventional cameras suffer from low signal-to-noise ratio at high frame rates, limiting their ability to detect faint fluorescent events. Here, we introduce an image sensor where each pixel has individually programmable sampling speed and phase, so that pixels can be arranged to simultaneously sample at high speed with a high signal-to-noise ratio. In high-speed voltage imaging experiments, our image sensor significantly increases the output signal-to-noise ratio compared to a low-noise scientific CMOS camera (~2-3 folds). This signal-to-noise ratio gain enables the detection of weak neuronal action potentials and subthreshold activities missed by the standard scientific CMOS cameras. Our camera with flexible pixel exposure configurations offers versatile sampling strategies to improve signal quality in various experimental conditions.

High-speed wide-field fluorescence microscopy has the potential to capture biological processes with exceptional spatiotemporal resolution. However, conventional cameras suffer from low signal-to-noise ratio at high frame rates, limiting their ability to detect faint fluorescent events. Here, we introduce an image sensor where each pixel has individually programmable sampling speed and phase, so that pixels can be arranged to simultaneously sample at high speed with a high signal-to-noise ratio. In high-speed voltage imaging experiments, our image sensor significantly increases the output signal-to-noise ratio compared to a low-noise scientific CMOS camera (~2-3 folds). This signal-to-noise ratio gain enables the detection of weak neuronal action potentials and subthreshold activities missed by the standard scientific CMOS cameras. Our camera with flexible pixel exposure configurations offers versatile sampling strategies to improve signal quality in various experimental conditions.

Identifying directed information flow or Granger causality between multivariate time series is important for a wide range of applications in science and engineering. However, traditional data-driven approaches are insufficient to assess Granger causality between multimodal data with distinct temporal resolution. Here we propose a new analysis approach to address this challenge and present quantitative characterizations and statistical assessment on frequency-dependent directed information flow ("generalized spectral causality"). We validate our approach with intensive computer simulations on bivariate and trivariate systems for various conditions.

Distributed hypothalamic-midbrain neural circuits orchestrate complex behavioral responses during social interactions. How population-averaged neural activity measured by multi-fiber photometry (MFP) for calcium fluorescence signals correlates with social behaviors is a fundamental question. We propose a state-space analysis framework to characterize mouse MFP data based on dynamic latent variable models, which include continuous-state linear dynamical system (LDS) and discrete-state hidden semi-Markov model (HSMM). We validate these models on extensive MFP recordings during aggressive and mating behaviors in male-male and male-female interactions, respectively. Our results show that these models are capable of capturing both temporal behavioral structure and associated neural states. Overall, these analysis approaches provide an unbiased strategy to examine neural dynamics underlying social behaviors and reveals mechanistic insights into the relevant networks.

BACKGROUND:The striatal-pallidal pathway plays an important role in cognitive control and modulation of behaviors. Globus pallidus interna (GPi), as a primary output structure, is crucial in modulating excitation and inhibition. Studies of GPi in psychiatric illnesses are lacking given the technical challenges of examining this small and functionally diverse subcortical structure. METHODS:71 medication-naïve first episode schizophrenia (FES) participants and 73 healthy controls (HC) were recruited at the Shanghai Mental Health Center. Clinical symptoms and imaging data were collected at baseline and, in a subset of patients, 8 weeks after initiating treatment. Resting-state functional connectivity of sub-regions of the GP were assessed using a novel mask that combines two atlases to create 8 ROIs in the GP. RESULTS: = 0.486, p < 0.001). CONCLUSIONS:Our results implicate striatal-pallidal-thalamic pathways in antipsychotic efficacy. If replicated, these findings may reflect failure of neurodevelopmental processes in adolescence and early adulthood that decrease functional connectivity as an index of failure of the limbic/associative GPi to appropriately inhibit irrelevant signals in psychosis.

Sexual and aggressive behaviors are vital for species survival and individual reproductive success. Although many limbic regions have been found relevant to these behaviors, how social cues are represented across regions and how the network activity generates each behavior remains elusive. To answer these questions, we utilize multi-fiber photometry (MFP) to simultaneously record Ca²⁺ signals of estrogen receptor alpha (Esr1)-expressing cells from 13 limbic regions in male mice during mating and fighting. We find that conspecific sensory information and social action signals are widely distributed in the limbic system and can be decoded from the network activity. Cross-region correlation analysis reveals striking increases in the network functional connectivity during the social action initiation phase, whereas late copulation is accompanied by a "dissociated" network state. Based on the response patterns, we propose a mating-biased network (MBN) and an aggression-biased network (ABN) for mediating male sexual and aggressive behaviors, respectively.