Arrow Research search

Author name cluster

Jianfeng Feng

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

31 papers
2 author rows

Possible papers

31

NeurIPS Conference 2025 Conference Paper

Stochastic Forward-Forward Learning through Representational Dimensionality Compression

  • Zhichao Zhu
  • Yang Qi
  • Hengyuan Ma
  • Wenlian Lu
  • Jianfeng Feng

The Forward-Forward (FF) learning algorithm provides a bottom-up alternative to backpropagation (BP) for training neural networks, relying on a layer-wise "goodness" function with well-designed negative samples for contrastive learning. Existing goodness functions are typically defined as the sum of squared postsynaptic activations, neglecting correlated variability between neurons. In this work, we propose a novel goodness function termed dimensionality compression that uses the effective dimensionality (ED) of fluctuating neural responses to incorporate second-order statistical structure. Our objective minimizes ED for noisy copies of individual inputs while maximizing it across the sample distribution, promoting structured representations without the need to prepare negative samples. We demonstrate that this formulation achieves competitive performance compared to other non-BP methods. Moreover, we show that noise plays a constructive role that can enhance generalization and improve inference when predictions are derived from the mean of squared output, which is equivalent to making predictions based on an energy term. Our findings contribute to the development of more biologically plausible learning algorithms and suggest a natural fit for neuromorphic computing, where stochasticity is a computational resource rather than a nuisance. The code is available at https: //github. com/ZhichaoZhu/StochasticForwardForward.

NeurIPS Conference 2024 Conference Paper

DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimization

  • Yueming Xu
  • Haochen Jiang
  • Zhongyang Xiao
  • Jianfeng Feng
  • Li Zhang

Achieving robust and precise pose estimation in dynamic scenes is a significant research challenge in Visual Simultaneous Localization and Mapping (SLAM). Recent advancements integrating Gaussian Splatting into SLAM systems have proven effective in creating high-quality renderings using explicit 3D Gaussian models, significantly improving environmental reconstruction fidelity. However, these approaches depend on a static environment assumption and face challenges in dynamic environments due to inconsistent observations of geometry and photometry. To address this problem, we propose DG-SLAM, the first robust dynamic visual SLAM system grounded in 3D Gaussians, which provides precise camera pose estimation alongside high-fidelity reconstructions. Specifically, we propose effective strategies, including motion mask generation, adaptive Gaussian point management, and a hybrid camera tracking algorithm to improve the accuracy and robustness of pose estimation. Extensive experiments demonstrate that DG-SLAM delivers state-of-the-art performance in camera pose estimation, map reconstruction, and novel-view synthesis in dynamic scenes, outperforming existing methods meanwhile preserving real-time rendering ability.

NeurIPS Conference 2024 Conference Paper

Efficient Combinatorial Optimization via Heat Diffusion

  • Hengyuan Ma
  • Wenlian Lu
  • Jianfeng Feng

Combinatorial optimization problems are widespread but inherently challenging due to their discrete nature. The primary limitation of existing methods is that they can only access a small fraction of the solution space at each iteration, resulting in limited efficiency for searching the global optimal. To overcome this challenge, diverging from conventional efforts of expanding the solver's search scope, we focus on enabling information to actively propagate to the solver through heat diffusion. By transforming the target function while preserving its optima, heat diffusion facilitates information flow from distant regions to the solver, providing more efficient navigation. Utilizing heat diffusion, we propose a framework for solving general combinatorial optimization problems. The proposed methodology demonstrates superior performance across a range of the most challenging and widely encountered combinatorial optimizations. Echoing recent advancements in harnessing thermodynamics for generative artificial intelligence, our study further reveals its significant potential in advancing combinatorial optimization.

TMLR Journal 2024 Journal Article

LEA: Learning Latent Embedding Alignment Model for fMRI Decoding and Encoding

  • Xuelin Qian
  • Yikai Wang
  • Xinwei Sun
  • Yanwei Fu
  • Xiangyang Xue
  • Jianfeng Feng

The connection between brain activity and visual stimuli is crucial to understanding the human brain. Although deep generative models have shown advances in recovering brain recordings by generating images conditioned on fMRI signals, it is still challenging to generate consistent semantics. Moreover, predicting fMRI signals from visual stimuli remains a hard problem. In this paper, we introduce a unified framework that addresses both fMRI decoding and encoding. We train two latent spaces to represent and reconstruct fMRI signals and visual images, respectively. By aligning these two latent spaces, we seamlessly transform between the fMRI signal and visual stimuli. Our model, called Latent Embedding Alignment (LEA), can recover visual stimuli from fMRI signals and predict brain activity from images. LEA outperforms existing methods on multiple fMRI decoding and encoding benchmarks. It offers a comprehensive solution for modeling the relationship between fMRI signals and visual stimuli. The codes are available at \url{https://github.com/naiq/LEA}.

IROS Conference 2024 Conference Paper

OpenOcc: Open Vocabulary 3D Scene Reconstruction via Occupancy Representation

  • Haochen Jiang
  • Yueming Xu
  • Yihan Zeng
  • Hang Xu 0004
  • Wei Zhang 0196
  • Jianfeng Feng
  • Li Zhang 0040

3D reconstruction has been widely used in autonomous navigation fields of mobile robotics. However, the former research can only provide the basic geometry structure without the capability of open-world scene understanding, limiting advanced tasks like human interaction and visual navigation. Moreover, traditional 3D scene understanding approaches rely on expensive labeled 3D datasets to train a model for a single task with supervision. Thus, geometric reconstruction with zero-shot scene understanding i. e. Open vocabulary 3D Understanding and Reconstruction, is crucial for the future development of mobile robots. In this paper, we propose OpenOcc, a novel framework unifying the 3D scene reconstruction and open vocabulary understanding with neural radiance fields. We model the geometric structure of the scene with occupancy representation and distill the pre-trained open vocabulary model into a 3D language field via volume rendering for zero-shot inference. Furthermore, a novel semantic-aware confidence propagation (SCP) method has been proposed to relieve the issue of language field representation degeneracy caused by inconsistent measurements in distilled features. Experimental results show that our approach achieves competitive performance in 3D scene understanding tasks, especially for small and long-tail objects.

YNICL Journal 2023 Journal Article

Age-level bias correction in brain age prediction

  • Biao Zhang
  • Shuqin Zhang
  • Jianfeng Feng
  • Shihua Zhang

The predicted age difference (PAD) between an individual's predicted brain age and chronological age has been commonly viewed as a meaningful phenotype relating to aging and brain diseases. However, the systematic bias appears in the PAD achieved using machine learning methods. Recent studies have designed diverse bias correction methods to eliminate it for further downstream studies. Strikingly, here we demonstrate that bias still exists in the PAD of samples with the same age even after kind of correction. Therefore, current PAD may not be taken as a reliable phenotype and more investigations are needed to solve this fundamental defect. To this end, we propose an age-level bias correction method and demonstrate its efficacy in numerical experiments.

YNIMG Journal 2023 Journal Article

Fractionation of neural reward processing into independent components by novel decoding principle

  • Shitong Xiang
  • Tianye Jia
  • Chao Xie
  • Zhichao Zhu
  • Wei Cheng
  • Gunter Schumann
  • Trevor W. Robbins
  • Jianfeng Feng

How to retrieve latent neurobehavioural processes from complex neurobiological signals is an important yet unresolved challenge. Here, we develop a novel approach, orthogonal-Decoding multi-Cognitive Processes (DeCoP), to reveal underlying latent neurobehavioural processing and show that its performance is superior to traditional non-orthogonal decoding in terms of both false inference and robustness. Processing value and salience information are two fundamental but mutually confounded pathways of reward reinforcement essential for decision making. During reward/punishment anticipation, we applied DeCoP to decode brain-wide responses into spatially overlapping, yet functionally independent, evaluation and readiness processes, which are modulated differentially by meso‑limbic vs nigro-striatal dopamine systems. Using DeCoP, we further demonstrated that most brain regions only encoded abstract information but not the exact input, except for dorsal anterior cingulate cortex and insula. Furthermore, we anticipate our novel analytical principle to be applied generally in decoding multiple latent neurobehavioral processes and thus advance both the design and hypothesis testing for cognitive tasks.

YNIMG Journal 2022 Journal Article

A model-based approach to assess reproducibility for large-scale high-throughput MRI-based studies

  • Zeyu Jiao
  • Yinglei Lai
  • Jujiao Kang
  • Weikang Gong
  • Liang Ma
  • Tianye Jia
  • Chao Xie
  • Shitong Xiang

Magnetic Resonance Imaging (MRI) technology has been increasingly used in neuroscience studies. Reproducibility of statistically significant findings generated by MRI-based studies, especially association studies (phenotype vs. MRI metric) and task-induced brain activation, has been recently heavily debated. However, most currently available reproducibility measures depend on thresholds for the test statistics and cannot be use to evaluate overall study reproducibility. It is also crucial to elucidate the relationship between overall study reproducibility and sample size in an experimental design. In this study, we proposed a model-based reproducibility index to quantify reproducibility which could be used in large-scale high-throughput MRI-based studies including both association studies and task-induced brain activation. We performed the model-based reproducibility assessments for a few association studies and task-induced brain activation by using several recent large sMRI/fMRI databases. For large sample size association studies between brain structure/function features and some basic physiological phenotypes (i.e. Sex, BMI), we demonstrated that the model-based reproducibility of these studies is more than 0.99. For MID task activation, similar results could be observed. Furthermore, we proposed a model-based analytical tool to evaluate minimal sample size for the purpose of achieving a desirable model-based reproducibility. Additionally, we evaluated the model-based reproducibility of gray matter volume (GMV) changes for UK Biobank (UKB) vs. Parkinson Progression Marker Initiative (PPMI) and UK Biobank (UKB) vs. Human Connectome Project (HCP). We demonstrated that both sample size and study-specific experimental factors play important roles in the model-based reproducibility assessments for different experiments. In summary, a systematic assessment of reproducibility is fundamental and important in the current large-scale high-throughput MRI-based studies.

AAAI Conference 2022 Conference Paper

Modify Self-Attention via Skeleton Decomposition for Effective Point Cloud Transformer

  • Jiayi Han
  • Longbin Zeng
  • Liang Du
  • Xiaoqing Ye
  • Weiyang Ding
  • Jianfeng Feng

Although considerable progress has been achieved regarding the transformers in recent years, the large number of parameters, quadratic computational complexity, and memory cost conditioned on long sequences make the transformers hard to train and implement, especially in edge computing configurations. In this case, a dizzying number of works have sought to make improvements around computational and memory efficiency upon the original transformer architecture. Nevertheless, many of them restrict the context in the attention to seek a trade-off between cost and performance with prior knowledge of orderly stored data. It is imperative to dig deep into an efficient feature extractor for point clouds due to their irregularity and a large number of points. In this paper, we propose a novel skeleton decomposition-based self-attention (SD-SA) which has no sequence length limit and exhibits favorable scalability in long-sequence models. Due to the numerical low-rank nature of self-attention, we approximate it by the skeleton decomposition method while maintaining its effectiveness. At this point, we have shown that the proposed method works for the proposed approach on point cloud classification, segmentation, and detection tasks on the Model- Net40, ShapeNet, and KITTI datasets, respectively. Our approach significantly improves the efficiency of the point cloud transformer and exceeds other efficient transformers on point cloud tasks in terms of the speed at comparable performance.

YNIMG Journal 2022 Journal Article

Risk-taking in humans and the medial orbitofrontal cortex reward system

  • Edmund T. Rolls
  • Zhuo Wan
  • Wei Cheng
  • Jianfeng Feng

Risk-taking differs between humans, and is associated with the personality measures of impulsivity and sensation-seeking. To analyse the brain systems involved, self-report risk-taking, resting state functional connectivity, and related behavioral measures were analyzed in 18, 740 participants of both sexes from the UK Biobank. Functional connectivities of the medial orbitofrontal cortex, ventromedial prefrontal cortex (VMPFC), and the parahippocampal areas were significantly higher in the risk-taking group (p < 0. 001, FDR corrected). The risk-taking measure was validated in that it was significantly associated with alcohol drinking amount (r = 0. 08, p = 5. 1×10−28), cannabis use (r = 0. 12, p = 6. 0×10−66), and anxious feelings (r = -0. 12, p = 7. 6×−98). The functional connectivity findings were cross-validated in two independent datasets. The higher functional connectivity of the medial orbitofrontal cortex and VMPFC included higher connectivity with the anterior cingulate cortex, which provides a route for these reward-related regions to have a greater influence on action in risk-taking individuals. In conclusion, the medial orbitofrontal cortex, which is involved in reward value and pleasure, was found to be related to risk-taking, which is associated with impulsivity. An implication is that risk-taking is driven by specific orbitofrontal cortex reward systems, and is different for different rewards which are represented differently in the brains of different individuals. This is an advance in understanding the bases and mechanisms of risk-taking in humans, given that the orbitofrontal cortex, VMPFC and anterior cingulate cortex are highly developed in humans, and that risk-taking can be reported in humans.

YNIMG Journal 2022 Journal Article

The human language effective connectome

  • Edmund T. Rolls
  • Gustavo Deco
  • Chu-Chung Huang
  • Jianfeng Feng

To advance understanding of brain networks involved in language, the effective connectivity between 26 cortical regions implicated in language by a community analysis and 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography, all using the HCP multimodal parcellation atlas. A (semantic) network (Group 1) involving inferior cortical regions of the superior temporal sulcus cortex (STS) with the adjacent inferior temporal visual cortex TE1a and temporal pole TG, and the connected parietal PGi region, has effective connectivity with inferior temporal visual cortex (TE) regions; with parietal PFm which also has visual connectivity; with posterior cingulate cortex memory-related regions; with the frontal pole, orbitofrontal cortex, and medial prefrontal cortex; with the dorsolateral prefrontal cortex; and with 44 and 45 for output regions. It is proposed that this system can build in its temporal lobe (STS and TG) and parietal parts (PGi and PGs) semantic representations of objects incorporating especially their visual and reward properties. Another (semantic) network (Group 3) involving superior regions of the superior temporal sulcus cortex and more superior temporal lobe regions including STGa, auditory A5, TPOJ1, the STV and the Peri-Sylvian Language area (PSL) has effective connectivity with auditory areas (A1, A4, A5, Pbelt); with relatively early visual areas involved in motion, e.g., MT and MST, and faces/words (FFC); with somatosensory regions (frontal opercular FOP, insula and parietal PF); with other TPOJ regions; and with the inferior frontal gyrus regions (IFJa and IFSp). It is proposed that this system builds semantic representations specialising in auditory and related facial motion information useful in theory of mind and somatosensory / body image information, with outputs directed not only to regions 44 and 45, but also to premotor 55b and midcingulate premotor cortex. Both semantic networks (Groups 1 and 3) have access to the hippocampal episodic memory system via parahippocampal TF. A third largely frontal network (Group 2) (44, 45, 47l; 55b; the Superior Frontal Language region SFL; and including temporal pole TGv) receives effective connectivity from the two semantic systems, and is implicated in syntax and speech output.

YNIMG Journal 2021 Journal Article

Sensory, somatomotor and internal mentation networks emerge dynamically in the resting brain with internal mentation predominating in older age

  • Lu Zhang
  • Jiajia Zhao
  • Qunjie Zhou
  • ZhaoWen Liu
  • Yi Zhang
  • Wei Cheng
  • Weikang Gong
  • Xiaoping Hu

Age-related changes in the brain are associated with a decline in functional flexibility. Intrinsic functional flexibility is evident in the brain's dynamic ability to switch between alternative spatiotemporal states during resting state. However, the relationship between brain connectivity states, associated psychological functions during resting state, and the changes in normal aging remain poorly understood. In this study, we analyzed resting-state functional magnetic resonance imaging (rsfMRI) data from the Human Connectome Project (HCP; N = 812) and the UK Biobank (UKB; N = 6,716). Using signed community clustering to identify distinct states of dynamic functional connectivity, and text-mining of a large existing literature for functional annotation of each state, our findings from the HCP dataset indicated that the resting brain spontaneously transitions between three functionally specialized states: sensory, somatomotor, and internal mentation networks. The occurrence, transition-rate, and persistence-time parameters for each state were correlated with behavioural scores using canonical correlation analysis. We estimated the same brain states and parameters in the UKB dataset, subdivided into three distinct age ranges: 50-55, 56-67, and 68-78 years. We found that the internal mentation network was more frequently expressed in people aged 71 and older, whereas people younger than 55 more frequently expressed sensory and somatomotor networks. Furthermore, analysis of the functional entropy - a measure of uncertainty of functional connectivity - also supported this finding across the three age ranges. Our study demonstrates that dynamic functional connectivity analysis can expose the time-varying patterns of transition between functionally specialized brain states, which are strongly tied to increasing age.

ICRA Conference 2020 Conference Paper

3DCFS: Fast and Robust Joint 3D Semantic-Instance Segmentation via Coupled Feature Selection

  • Liang Du 0004
  • Jingang Tan
  • Xiangyang Xue 0001
  • Lili Chen
  • Hongkai Wen 0001
  • Jianfeng Feng
  • Jiamao Li
  • Xiaolin Zhang

We propose a novel fast and robust 3D point clouds segmentation framework via coupled feature selection, named 3DCFS, that jointly performs semantic and instance segmentation. Inspired by the human scene perception process, we design a novel coupled feature selection module, named CFSM, that adaptively selects and fuses the reciprocal semantic and instance features from two tasks in a coupled manner. To further boost the performance of the instance segmentation task in our 3DCFS, we investigate a loss function that helps the model learn to balance the magnitudes of the output embedding dimensions during training, which makes calculating the Euclidean distance more reliable and enhances the generalizability of the model. Extensive experiments demonstrate that our 3DCFS outperforms state-of-the-art methods on benchmark datasets in terms of accuracy, speed and computational cost. Codes are available at: https://github.com/Biotan/3DCFS.

YNIMG Journal 2020 Journal Article

Automated anatomical labelling atlas 3

  • Edmund T. Rolls
  • Chu-Chung Huang
  • Ching-Po Lin
  • Jianfeng Feng
  • Marc Joliot

Following a first version AAL of the automated anatomical labeling atlas (Tzourio-Mazoyer et al., 2002), a second version (AAL2) (Rolls et al., 2015) was developed that provided an alternative parcellation of the orbitofrontal cortex following the description provided by Chiavaras, Petrides, and colleagues. We now provide a third version, AAL3, which adds a number of brain areas not previously defined, but of interest in many neuroimaging investigations. The 26 new areas in the third version are subdivision of the anterior cingulate cortex into subgenual, pregenual and supracallosal parts; subdivision of the thalamus into 15 parts; the nucleus accumbens, substantia nigra, ventral tegmental area, red nucleus, locus coeruleus, and raphe nuclei. The new atlas is available as a toolbox for SPM, and can be used with MRIcron.

YNIMG Journal 2020 Journal Article

Sensation-seeking is related to functional connectivities of the medial orbitofrontal cortex with the anterior cingulate cortex

  • Zhuo Wan
  • Edmund T. Rolls
  • Wei Cheng
  • Jianfeng Feng

Sensation-seeking is a multifaceted personality trait with components that include experience-seeking, thrill and adventure seeking, disinhibition, and susceptibility to boredom, and is an aspect of impulsiveness. We analysed brain regions involved in sensation-seeking in a large-scale study with 414 participants and showed that the sensation-seeking score could be optimally predicted from the functional connectivity with typically (in different participants) 18 links between brain areas (measured in the resting state with fMRI) with correlation r ​= ​0. 34 (p ​= ​7. 3 ​× ​10−13) between the predicted and actual sensation-seeking score across all participants. Interestingly, 8 of the 11 links that were common for all participants were between the medial orbitofrontal cortex and the anterior cingulate cortex and yielded a prediction accuracy r ​= ​0. 30 (p ​= ​4. 8 ​× ​10−10). We propose that this important aspect of personality, sensation-seeking, reflects a strong effect of reward (in which the medial orbitofrontal cortex is implicated) on promoting actions to obtain rewards (in which the anterior cingulate cortex is implicated). Risk-taking was found to have a moderate correlation with sensation-seeking (r ​= ​0. 49, p ​= ​3. 9 ​× ​10−26), and three of these functional connectivities were significantly correlated (p ​< ​0. 05) with the overall risk-taking score. This discovery helps to show how the medial orbitofrontal and anterior cingulate cortices influence behaviour and personality, and indicate that sensation-seeking can involve in part the medial orbitofrontal cortex reward system, which can thereby become associated with risk-taking and a type of impulsiveness.

YNIMG Journal 2019 Journal Article

A powerful and efficient multivariate approach for voxel-level connectome-wide association studies

  • Weikang Gong
  • Fan Cheng
  • Edmund T. Rolls
  • Chun-Yi Zac Lo
  • Chu-Chung Huang
  • Shih-Jen Tsai
  • Albert C. Yang
  • Ching-Po Lin

We describe an approach to multivariate analysis, termed structured kernel principal component regression (sKPCR), to identify associations in voxel-level connectomes using resting-state functional magnetic resonance imaging (rsfMRI) data. This powerful and computationally efficient multivariate method can identify voxel-phenotype associations based on the whole-brain connectivity pattern of voxels, and it can detect linear and non-linear signals in both volume-based and surface-based rsfMRI data. For each voxel, sKPCR first extracts low-dimensional signals from the spatially smoothed connectivities by structured kernel principal component analysis, and then tests the voxel-phenotype associations by an adaptive regression model. The method's power is derived from appropriately modelling the spatial structure of the data when performing dimension reduction, and then adaptively choosing an optimal dimension for association testing using the adaptive regression strategy. Simulations based on real connectome data have shown that sKPCR can accurately control the false-positive rate and that it is more powerful than many state-of-the-art approaches, such as the connectivity-wise generalized linear model (GLM) approach, multivariate distance matrix regression (MDMR), adaptive sum of powered score (aSPU) test, and least-square kernel machine (LSKM). Moreover, since sKPCR can reduce the computational cost of non-parametric permutation tests, its computation speed is much faster. To demonstrate the utility of sKPCR for real data analysis, we have also compared sKPCR with the above methods based on the identification of voxel-wise differences between schizophrenic patients and healthy controls in four independent rsfMRI datasets. The results showed that sKPCR had better between-sites reproducibility and a larger proportion of overlap with existing schizophrenia meta-analysis findings. Code for our approach can be downloaded from https: //github. com/weikanggong/sKPCR.

YNICL Journal 2019 Journal Article

Adolescent binge drinking disrupts normal trajectories of brain functional organization and personality maturation

  • Hongtao Ruan
  • Yunyi Zhou
  • Qiang Luo
  • Gabriel H. Robert
  • Sylvane Desrivières
  • Erin Burke Quinlan
  • ZhaoWen Liu
  • Tobias Banaschewski

Adolescent binge drinking has been associated with higher risks for the development of many health problems throughout the lifespan. Adolescents undergo multiple changes that involve the co-development processes of brain, personality and behavior; therefore, certain behavior, such as alcohol consumption, can have disruptive effects on both brain development and personality maturation. However, these effects remain unclear due to the scarcity of longitudinal studies. In the current study, we used multivariate approaches to explore discriminative features in brain functional architecture, personality traits, and genetic variants in 19-year-old individuals (n = 212). Taking advantage of a longitudinal design, we selected features that were more drastically altered in drinkers with an earlier onset of binge drinking. With the selected features, we trained a hierarchical model of support vector machines using a training sample (n = 139). Using an independent sample (n = 73), we tested the model and achieved a classification accuracy of 71.2%. We demonstrated longitudinally that after the onset of binge drinking the developmental trajectory of improvement in impulsivity slowed down. This study identified the disrupting effects of adolescent binge drinking on the developmental trajectories of both brain and personality.

AAAI Conference 2019 Conference Paper

GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition

  • Hanqing Chao
  • Yiwei He
  • Junping Zhang
  • Jianfeng Feng

As a unique biometric feature that can be recognized at a distance, gait has broad applications in crime prevention, forensic identification and social security. To portray a gait, existing gait recognition methods utilize either a gait template, where temporal information is hard to preserve, or a gait sequence, which must keep unnecessary sequential constraints and thus loses the flexibility of gait recognition. In this paper we present a novel perspective, where a gait is regarded as a set consisting of independent frames. We propose a new network named GaitSet to learn identity information from the set. Based on the set perspective, our method is immune to permutation of frames, and can naturally integrate frames from different videos which have been filmed under different scenarios, such as diverse viewing angles, different clothes/carrying conditions. Experiments show that under normal walking conditions, our single-model method achieves an average rank-1 accuracy of 95. 0% on the CASIA-B gait dataset and an 87. 1% accuracy on the OU-MVLP gait dataset. These results represent new state-of-the-art recognition accuracy. On various complex scenarios, our model exhibits a significant level of robustness. It achieves accuracies of 87. 2% and 70. 4% on CASIA-B under bag-carrying and coat-wearing walking conditions, respectively. These outperform the existing best methods by a large margin. The method presented can also achieve a satisfactory accuracy with a small number of frames in a test sample, e. g. , 82. 5% on CASIA-B with only 7 frames. The source code has been released at https: //github. com/AbnerHqC/GaitSet.

NeurIPS Conference 2019 Conference Paper

On Fenchel Mini-Max Learning

  • Chenyang Tao
  • Liqun Chen
  • Shuyang Dai
  • Junya Chen
  • Ke Bai
  • Dong Wang
  • Jianfeng Feng
  • Wenlian Lu

Inference, estimation, sampling and likelihood evaluation are four primary goals of probabilistic modeling. Practical considerations often force modeling approaches to make compromises between these objectives. We present a novel probabilistic learning framework, called Fenchel Mini-Max Learning (FML), that accommodates all four desiderata in a flexible and scalable manner. Our derivation is rooted in classical maximum likelihood estimation, and it overcomes a longstanding challenge that prevents unbiased estimation of unnormalized statistical models. By reformulating MLE as a mini-max game, FML enjoys an unbiased training objective that (i) does not explicitly involve the intractable normalizing constant and (ii) is directly amendable to stochastic gradient descent optimization. To demonstrate the utility of the proposed approach, we consider learning unnormalized statistical models, nonparametric density estimation and training generative models, with encouraging empirical results presented.

ICML Conference 2018 Conference Paper

Chi-square Generative Adversarial Network

  • Chenyang Tao
  • Liqun Chen 0001
  • Ricardo Henao
  • Jianfeng Feng
  • Lawrence Carin

To assess the difference between real and synthetic data, Generative Adversarial Networks (GANs) are trained using a distribution discrepancy measure. Three widely employed measures are information-theoretic divergences, integral probability metrics, and Hilbert space discrepancy metrics. We elucidate the theoretical connections between these three popular GAN training criteria and propose a novel procedure, called $\chi^2$ (Chi-square) GAN, that is conceptually simple, stable at training and resistant to mode collapse. Our procedure naturally generalizes to address the problem of simultaneous matching of multiple distributions. Further, we propose a resampling strategy that significantly improves sample quality, by repurposing the trained critic function via an importance weighting mechanism. Experiments show that the proposed procedure improves stability and convergence, and yields state-of-art results on a wide range of generative modeling tasks.

YNIMG Journal 2018 Journal Article

Neural and genetic determinants of creativity

  • ZhaoWen Liu
  • Jie Zhang
  • Xiaohua Xie
  • Edmund T. Rolls
  • Jiangzhou Sun
  • Kai Zhang
  • Zeyu Jiao
  • Qunlin Chen

Creative thinking plays a vital role in almost all aspects of human life. However, little is known about the neural and genetic mechanisms underlying creative thinking. Based on a cross-validation based predictive framework, we searched from the whole-brain connectome (34, 716 functional connectivities) and whole genome data (309, 996 SNPs) in two datasets (all collected by Southwest University, Chongqing) consisting of altogether 236 subjects, for a better understanding of the brain and genetic underpinning of creativity. Using the Torrance Tests of Creative Thinking score, we found that high figural creativity is mainly related to high functional connectivity between the executive control, attention, and memory retrieval networks (strong top-down effects); and to low functional connectivity between the default mode network, the ventral attention network, and the subcortical and primary sensory networks (weak bottom-up processing) in the first dataset (consisting of 138 subjects). High creativity also correlates significantly with mutations of genes coding for both excitatory and inhibitory neurotransmitters. Combining the brain connectome and the genomic data we can predict individuals' creativity scores with an accuracy of 78. 4%, which is significantly better than prediction using single modality data (gene or functional connectivity), indicating the importance of combining multi-modality data. Our neuroimaging prediction model built upon the first dataset was cross-validated by a completely new dataset of 98 subjects (r = 0. 267, p = 0. 0078) with an accuracy of 64. 6%. In addition, the creativity–related functional connectivity network we identified in the first dataset was still significantly correlated with the creativity score in the new dataset (p< 10 − 3 ). In summary, our research demonstrates that strong top-down control versus weak bottom-up processes underlie creativity, which is modulated by competition between the glutamate and GABA neurotransmitter systems. Our work provides the first insights into both the neural and the genetic bases of creativity.

YNIMG Journal 2017 Journal Article

Functional connectivity decreases in autism in emotion, self, and face circuits identified by Knowledge-based Enrichment Analysis

  • Wei Cheng
  • Edmund T. Rolls
  • Jie Zhang
  • Wenbo Sheng
  • Liang Ma
  • Lin Wan
  • Qiang Luo
  • Jianfeng Feng

A powerful new method is described called Knowledge based functional connectivity Enrichment Analysis (KEA) for interpreting resting state functional connectivity, using circuits that are functionally identified using search terms with the Neurosynth database. The method derives its power by focusing on neural circuits, sets of brain regions that share a common biological function, instead of trying to interpret single functional connectivity links. This provides a novel way of investigating how task- or function-related networks have resting state functional connectivity differences in different psychiatric states, provides a new way to bridge the gap between task and resting-state functional networks, and potentially helps to identify brain networks that might be treated. The method was applied to interpreting functional connectivity differences in autism. Functional connectivity decreases at the network circuit level in 394 patients with autism compared with 473 controls were found in networks involving the orbitofrontal cortex, anterior cingulate cortex, middle temporal gyrus cortex, and the precuneus, in networks that are implicated in the sense of self, face processing, and theory of mind. The decreases were correlated with symptom severity.

YNIMG Journal 2017 Journal Article

Generalized reduced rank latent factor regression for high dimensional tensor fields, and neuroimaging-genetic applications

  • Chenyang Tao
  • Thomas E. Nichols
  • Xue Hua
  • Christopher R.K. Ching
  • Edmund T. Rolls
  • Paul M. Thompson
  • Jianfeng Feng

We propose a generalized reduced rank latent factor regression model (GRRLF) for the analysis of tensor field responses and high dimensional covariates. The model is motivated by the need from imaging-genetic studies to identify genetic variants that are associated with brain imaging phenotypes, often in the form of high dimensional tensor fields. GRRLF identifies from the structure in the data the effective dimensionality of the data, and then jointly performs dimension reduction of the covariates, dynamic identification of latent factors, and nonparametric estimation of both covariate and latent response fields. After accounting for the latent and covariate effects, GRLLF performs a nonparametric test on the remaining factor of interest. GRRLF provides a better factorization of the signals compared with common solutions, and is less susceptible to overfitting because it exploits the effective dimensionality. The generality and the flexibility of GRRLF also allow various statistical models to be handled in a unified framework and solutions can be efficiently computed. Within the field of neuroimaging, it improves the sensitivity for weak signals and is a promising alternative to existing approaches. The operation of the framework is demonstrated with both synthetic datasets and a real-world neuroimaging example in which the effects of a set of genes on the structure of the brain at the voxel level were measured, and the results compared favorably with those from existing approaches.

YNIMG Journal 2016 Journal Article

Using real-time fMRI to influence effective connectivity in the developing emotion regulation network

  • Kathrin Cohen Kadosh
  • Qiang Luo
  • Calem de Burca
  • Moses O. Sokunbi
  • Jianfeng Feng
  • David E.J. Linden
  • Jennifer Y.F. Lau

For most people, adolescence is synonymous with emotional turmoil and it has been shown that early difficulties with emotion regulation can lead to persistent problems for some people. This suggests that intervention during development might reduce long-term negative consequences for those individuals. Recent research has highlighted the suitability of real-time fMRI-based neurofeedback (NF) in training emotion regulation (ER) networks in adults. However, its usefulness in directly influencing plasticity in the maturing ER networks remains unclear. Here, we used NF to teach a group of 17 7–16 year-olds to up-regulate the bilateral insula, a key ER region. We found that all participants learned to increase activation during the up-regulation trials in comparison to the down-regulation trials. Importantly, a subsequent Granger causality analysis of Granger information flow within the wider ER network found that during up-regulation trials, bottom-up driven Granger information flow increased from the amygdala to the bilateral insula and from the left insula to the mid-cingulate cortex, supplementary motor area and the inferior parietal lobe. This was reversed during the down-regulation trials, where we observed an increase in top-down driven Granger information flow to the bilateral insula from mid-cingulate cortex, pre-central gyrus and inferior parietal lobule. This suggests that: 1) NF training had a differential effect on up-regulation vs down-regulation network connections, and that 2) our training was not only superficially concentrated on surface effects but also relevant with regards to the underlying neurocognitive bases. Together these findings highlight the feasibility of using NF in children and adolescents and its possible use for shaping key social cognitive networks during development.

YNICL Journal 2014 Journal Article

Altered functional connectivity links in neuroleptic-naïve and neuroleptic-treated patients with schizophrenia, and their relation to symptoms including volition

  • Weidan Pu
  • Edmund T. Rolls
  • Shuixia Guo
  • Haihong Liu
  • Yun Yu
  • Zhimin Xue
  • Jianfeng Feng
  • Zhening Liu

In order to analyze functional connectivity in untreated and treated patients with schizophrenia, resting-state fMRI data were obtained for whole-brain functional connectivity analysis from 22 first-episode neuroleptic-naïve schizophrenia (NNS), 61 first-episode neuroleptic-treated schizophrenia (NTS) patients, and 60 healthy controls (HC). Reductions were found in untreated and treated patients in the functional connectivity between the posterior cingulate gyrus and precuneus, and this was correlated with the reduction in volition from the Positive and Negative Symptoms Scale (PANSS), that is in the willful initiation, sustenance, and control of thoughts, behavior, movements, and speech, and with the general and negative symptoms. In addition in both patient groups interhemispheric functional connectivity was weaker between the orbitofrontal cortex, amygdala and temporal pole. These functional connectivity changes and the related symptoms were not treated by the neuroleptics. Differences between the patient groups were that there were more strong functional connectivity links in the NNS patients (including in hippocampal, frontal, and striatal circuits) than in the NTS patients. These findings with a whole brain analysis in untreated and treated patients with schizophrenia provide evidence on some of the brain regions implicated in the volitional, other general, and negative symptoms, of schizophrenia that are not treated by neuroleptics so have implications for the development of other treatments; and provide evidence on some brain systems in which neuroleptics do alter the functional connectivity.

YNICL Journal 2013 Journal Article

Brain-wide functional inter-hemispheric disconnection is a potential biomarker for schizophrenia and distinguishes it from depression

  • Shuixia Guo
  • Keith M. Kendrick
  • Jie Zhang
  • Matthew Broome
  • Rongjun Yu
  • Zhening Liu
  • Jianfeng Feng

Schizophrenia is associated with disconnectivity in the brain although it is still unclear whether changes within or between hemispheres are of greatest importance. In this paper, an analysis of 152 schizophrenia patients compared with 122 healthy controls was carried out. Comparisons were also made with 39 depression patients and 37 controls to examine whether brain-wide changes in inter- or intra-hemispheric functional connectivity are most associated with the disorder and can distinguish it from depression. The authors developed new techniques (first and second order symmetry) to investigate brain-wide changes in patients (45 regions per hemisphere) and their association with illness duration and symptom severity. Functional connectivity between the same regions in left- and right-hemispheres (first order symmetry) was significantly reduced as was that between the same pairs of regions in the left- and right-hemispheres (second order symmetry) or using all possible inter-hemispheric connections in schizophrenia patients. By contrast, no significant changes were found for brain-wide intra-hemispheric links. First order symmetry changes correlated significantly with positive and negative symptom severity for functional connections linked via the anterior commissure and negative symptoms for those linked via the corpus callosum. Support vector machine analysis revealed that inter-hemispheric symmetry changes had 73-81% accuracy in discriminating schizophrenia patients and either healthy controls or depressed patients. In conclusion, reduced brain-wide inter-hemispheric functional connectivity occurs in schizophrenia, is associated with symptom severity, and can discriminate schizophrenia patients from depressed ones or healthy controls. Brain-wide changes in inter-hemispheric connections may therefore provide a useful potential biomarker for schizophrenia.

YNIMG Journal 2013 Journal Article

Spatio-temporal Granger causality: A new framework

  • Qiang Luo
  • Wenlian Lu
  • Wei Cheng
  • Pedro A. Valdes-Sosa
  • Xiaotong Wen
  • Mingzhou Ding
  • Jianfeng Feng

That physiological oscillations of various frequencies are present in fMRI signals is the rule, not the exception. Herein, we propose a novel theoretical framework, spatio-temporal Granger causality, which allows us to more reliably and precisely estimate the Granger causality from experimental datasets possessing time-varying properties caused by physiological oscillations. Within this framework, Granger causality is redefined as a global index measuring the directed information flow between two time series with time-varying properties. Both theoretical analyses and numerical examples demonstrate that Granger causality is a monotonically increasing function of the temporal resolution used in the estimation. This is consistent with the general principle of coarse graining, which causes information loss by smoothing out very fine-scale details in time and space. Our results confirm that the Granger causality at the finer spatio-temporal scales considerably outperforms the traditional approach in terms of an improved consistency between two resting-state scans of the same subject. To optimally estimate the Granger causality, the proposed theoretical framework is implemented through a combination of several approaches, such as dividing the optimal time window and estimating the parameters at the fine temporal and spatial scales. Taken together, our approach provides a novel and robust framework for estimating the Granger causality from fMRI, EEG, and other related data.

YNIMG Journal 2012 Journal Article

Componential Granger causality, and its application to identifying the source and mechanisms of the top–down biased activation that controls attention to affective vs sensory processing

  • Tian Ge
  • Jianfeng Feng
  • Fabian Grabenhorst
  • Edmund T. Rolls

We describe a new measure of Granger causality, componential Granger causality, and show how it can be applied to the identification of the directionality of influences between brain areas with functional neuroimaging data. Componential Granger causality measures the effect of y on x, but allows interaction effects between y and x to be measured. In addition, the terms in componential Granger causality sum to 1, allowing causal effects to be directly compared between systems. We show using componential Granger causality analysis applied to an fMRI investigation that there is a top–down attentional effect from the anterior dorsolateral prefrontal cortex to the orbitofrontal cortex when attention is paid to the pleasantness of a taste, and that this effect depends on the activity in the orbitofrontal cortex as shown by the interaction term. Correspondingly there is a top–down attentional effect from the posterior dorsolateral prefrontal cortex to the insular primary taste cortex when attention is paid to the intensity of a taste, and this effect depends on the activity of the insular primary taste cortex as shown by the interaction term. Componential Granger causality thus not only can reveal the directionality of effects between areas (and these can be bidirectional), but also allows the mechanisms to be understood in terms of whether the causal influence of one system on another depends on the state of the system being causally influenced. Componential Granger causality measures the full effects of second order statistics by including variance and covariance effects between each time series, thus allowing interaction effects to be measured, and also provides a systematic framework within which to measure the effects of cross, self, and noise contributions to causality. The findings reveal some of the mechanisms involved in a biased activation theory of selective attention.

YNIMG Journal 2012 Journal Article

Increasing power for voxel-wise genome-wide association studies: The random field theory, least square kernel machines and fast permutation procedures

  • Tian Ge
  • Jianfeng Feng
  • Derrek P. Hibar
  • Paul M. Thompson
  • Thomas E. Nichols

Imaging traits are thought to have more direct links to genetic variation than diagnostic measures based on cognitive or clinical assessments and provide a powerful substrate to examine the influence of genetics on human brains. Although imaging genetics has attracted growing attention and interest, most brain-wide genome-wide association studies focus on voxel-wise single-locus approaches, without taking advantage of the spatial information in images or combining the effect of multiple genetic variants. In this paper we present a fast implementation of voxel- and cluster-wise inferences based on the random field theory to fully use the spatial information in images. The approach is combined with a multi-locus model based on least square kernel machines to associate the joint effect of several single nucleotide polymorphisms (SNP) with imaging traits. A fast permutation procedure is also proposed which significantly reduces the number of permutations needed relative to the standard empirical method and provides accurate small p-value estimates based on parametric tail approximation. We explored the relation between 448, 294 single nucleotide polymorphisms and 18, 043 genes in 31, 662 voxels of the entire brain across 740 elderly subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Structural MRI scans were analyzed using tensor-based morphometry (TBM) to compute 3D maps of regional brain volume differences compared to an average template image based on healthy elderly subjects. We find method to be more sensitive compared with voxel-wise single-locus approaches. A number of genes were identified as having significant associations with volumetric changes. The most associated gene was GRIN2B, which encodes the N-methyl-d-aspartate (NMDA) glutamate receptor NR2B subunit and affects both the parietal and temporal lobes in human brains. Its role in Alzheimer's disease has been widely acknowledged and studied, suggesting the validity of the approach. The various advantages over existing approaches indicate a great potential offered by this novel framework to detect genetic influences on human brains.

YNIMG Journal 2011 Journal Article

Granger causality with signal-dependent noise

  • Qiang Luo
  • Tian Ge
  • Jianfeng Feng

It is generally believed that the noise variance in in vivo neuronal data exhibits time-varying volatility, particularly signal-dependent noise. Despite a widely used and powerful tool to detect causal influences in various data sources, Granger causality has not been well tailored for time-varying volatility models. In this technical note, a unified treatment of the causal influences in both mean and variance is naturally proposed on models with signal-dependent noise in both time and frequency domains. The approach is first systematically validated on toy models, and then applied to the physiological data collected from Parkinson patients, where a clear advantage over the classical Granger causality is demonstrated.

YNIMG Journal 2010 Journal Article

On a Gaussian neuronal field model

  • Wenlian Lu
  • Enrico Rossoni
  • Jianfeng Feng

Can we understand the dynamic behaviour of leaky integrate-and-fire (LIF) networks, which present the major, and possibly the only, analytically tractable tool we employ in computational neuroscience? To answer this question, here we present a theoretical framework on the spike activities of LIF networks by including the first order moment (mean firing rate) and the second order moment statistics (variance and correlation), based on a moment neuronal network (MNN) approach. The spike activity of a LIF network is approximated as a Gaussian random field and can reduce to the classical Wilson–Cowan–Amari (WCA) neural field if the variances vanish. Our analyses reveal several interesting phenomena of LIF networks. With a small clamped correlation and strong inhibition, the firing rate response function could be non-monotonic (not sigmoidal type), which can lead to interesting dynamics. For a feedforward and recurrent neuronal network, our setup allows us to prove that all neuronal spike activities rapidly synchronize, a well-known fact observed in both experiments and numerical simulations. We also present several examples of wave propagations in this field model. Finally, we test our MNN with the content-dependent working memory setting. The potential application of this random neuronal field idea to account for many experimental data is also discussed.

v2026.09.13