Author name cluster

Xufeng Yao

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

5 papers

1 author row

YNIMG Journal 2024 Journal Article

Brain age prediction via cross-stratified ensemble learning

Xinlin Li
Zezhou Hao
Di Li
Qiuye Jin
Zhixian Tang
Xufeng Yao
Tao Wu

As an important biomarker of neural aging, the brain age reflects the integrity and health of the human brain. Accurate prediction of brain age could help to understand the underlying mechanism of neural aging. In this study, a cross-stratified ensemble learning algorithm with staking strategy was proposed to obtain brain age and the derived predicted age difference (PAD) using T1-weighted magnetic resonance imaging (MRI) data. The approach was characterized as by implementing two modules: one was three base learners of 3D-DenseNet, 3D-ResNeXt, 3D-Inception-v4; another was 14 secondary learners of liner regressions. To evaluate performance, our method was compared with single base learners, regular ensemble learning algorithms, and state-of-the-art (SOTA) methods. The results demonstrated that our proposed model outperformed others models, with three metrics of mean absolute error (MAE), root mean-squared error (RMSE), and coefficient of determination (R2) of 2. 9405 years, 3. 9458 years, and 0. 9597, respectively. Furthermore, there existed significant differences in PAD among the three groups of normal control (NC), mild cognitive impairment (MCI) and Alzheimer's disease (AD), with an increased trend across NC, MCI, and AD. It was concluded that the proposed algorithm could be effectively used in computing brain aging and PAD, and offering potential for early diagnosis and assessment of normal brain aging and AD.

Details DOI

YNICL Journal 2024 Journal Article

From bench to bedside: Overview of magnetoencephalography in basic principle, signal processing, source localization and clinical applications

Yanling Yang
Shichang Luo
Wenjie Wang
Xiumin Gao
Xufeng Yao
Tao Wu

Magnetoencephalography (MEG) is a non-invasive technique that can precisely capture the dynamic spatiotemporal patterns of the brain by measuring the magnetic fields arising from neuronal activity along the order of milliseconds. Observations of brain dynamics have been used in cognitive neuroscience, the diagnosis of neurological diseases, and the brain-computer interface (BCI). In this study, we outline the basic principle, signal processing, and source localization of MEG, and describe its clinical applications for cognitive assessment, the diagnoses of neurological diseases and mental disorders, preoperative evaluation, and the BCI. This review not only provides an overall perspective of MEG, ranging from practical techniques to clinical applications, but also enhances the prevalent understanding of neural mechanisms. The use of MEG is expected to lead to significant breakthroughs in neuroscience.

Details DOI

AAAI Conference 2024 Conference Paper

p-Laplacian Adaptation for Generative Pre-trained Vision-Language Models

Haoyuan Wu
Xinyun Zhang
Peng Xu
Peiyu Liao
Xufeng Yao
Bei Yu

Vision-Language models (VLMs) pre-trained on large corpora have demonstrated notable success across a range of downstream tasks. In light of the rapidly increasing size of pre-trained VLMs, parameter-efficient transfer learning (PETL) has garnered attention as a viable alternative to full fine-tuning. One such approach is the adapter, which introduces a few trainable parameters into the pre-trained models while preserving the original parameters during adaptation. In this paper, we present a novel modeling framework that recasts adapter tuning after attention as a graph message passing process on attention graphs, where the projected query and value features and attention matrix constitute the node features and the graph adjacency matrix, respectively. Within this framework, tuning adapters in VLMs necessitates handling heterophilic graphs, owing to the disparity between the projected query and value space. To address this challenge, we propose a new adapter architecture, p-adapter, which employs p-Laplacian message passing in Graph Neural Networks (GNNs). Specifically, the attention weights are re-normalized based on the features, and the features are then aggregated using the calibrated attention matrix, enabling the dynamic exploitation of information with varying frequencies in the heterophilic attention graphs. We conduct extensive experiments on different pre-trained VLMs and multi-modal tasks, including visual question answering, visual entailment, and image captioning. The experimental results validate our method's significant superiority over other PETL methods. Our code is available at https://github.com/wuhy68/p-Adapter/.

PDF Details DOI

AAAI Conference 2024 Conference Paper

Progressively Knowledge Distillation via Re-parameterizing Diffusion Reverse Process

Xufeng Yao
Fanbin Lu
Yuechen Zhang
Xinyun Zhang
Wenqian Zhao
Bei Yu

Knowledge distillation aims at transferring knowledge from the teacher model to the student one by aligning their distributions. Feature-level distillation often uses L2 distance or its variants as the loss function, based on the assumption that outputs follow normal distributions. This poses a significant challenge when distribution gaps are substantial since this loss function ignores the variance term. To address the problem, we propose to decompose the transfer objective into small parts and optimize it progressively. This process is inspired by diffusion models from which the noise distribution is mapped to the target distribution step by step. However, directly employing diffusion models is impractical in the distillation scenario due to its heavy reverse process. To overcome this challenge, we adopt the structural re-parameterization technique to generate multiple student features to approximate the teacher features sequentially. The multiple student features are combined linearly in inference time without extra cost. We present extensive experiments performed on various transfer scenarios, such as CNN-to-CNN and Transformer-to-CNN, that validate the effectiveness of our approach.

PDF Details DOI

AAAI Conference 2022 Conference Paper

Context-Based Contrastive Learning for Scene Text Recognition

Xinyun Zhang
Binwu Zhu
Xufeng Yao
Qi Sun
Ruiyu Li
Bei Yu

Pursuing accurate and robust recognizers has been a longlasting goal for scene text recognition (STR) researchers. Recently, attention-based methods have demonstrated their effectiveness and achieved impressive results on public benchmarks. The attention mechanism enables models to recognize scene text with severe visual distortions by leveraging contextual information. However, recent studies revealed that the implicit over-reliance of context leads to catastrophic out-ofvocabulary performance. On the contrary to the superior accuracy of the seen text, models are prone to misrecognize unseen text even with good image quality. We propose a novel framework, Context-based contrastive learning (ConCLR), to alleviate this issue. Our proposed method first generates characters with different contexts via simple image concatenation operations and then optimizes contrastive loss on their embeddings. By pulling together clusters of identical characters within various contexts and pushing apart clusters of different characters in embedding space, ConCLR suppresses the side-effect of overfitting to specific contexts and learns a more robust representation. Experiments show that ConCLR significantly improves out-of-vocabulary generalization and achieves stateof-the-art performance on public benchmarks together with attention-based recognizers.

PDF Details