Author name cluster

Weihong Lin

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

5 papers

1 author row

AAAI Conference 2026 Conference Paper

DIN: Dual Impulse Network for Multi-view Representation Learning

Yilin Wu
Weihong Lin
Renjie Lin
Zihan Fang
Shide Du
Shiping Wang

Multi-view representation learning, which utilizes multiple channels to improve perceptual accuracy, is recognized for its effectiveness in the analysis of multi-view data. However, deploying these methods in real-world scenarios presents two primary challenges. 1) Lack of Variegation: Multi-view representation techniques commonly observe along a singular axis, i.e., the attribute axis; 2) Insufficient Relationship: Most multi-view models lack mechanisms for exploring potential relationships between attribute axis and channel axis. To mitigate these obstacles, we design a Dual Impulse Network framework for multi-view representation learning (DIN) to train a feature representation. In this framework, a strategy observed along the channel axis and attribute axis simultaneously is introduced, and two different representations are generated by two analogous impulse networks, which are capable of extracting information corresponding to different axes. Furthermore, we incorporate an integration network that analyzes the potential relationship between attribute axis and channel axis to generate two attention matrices. The final two feature representations derived from these attention matrices are aggregated to amplify the expression of internal information. Comprehensive experimental results support the efficacy and superiority of the proposed framework, demonstrating improvements in classification performance compared to state-of-the-art methods.

PDF Details DOI

YNIMG Journal 2024 Journal Article

Refining hemodynamic correction in in vivo wide-field fluorescent imaging through linear regression analysis

Jing Li
Fan Yang
Kathleen Zhang
Shiqiang Wu
James Niemeyer
Mingrui Zhao
Peijuan Luo
Nan Li

Accurate interpretation of in vivo wide-field fluorescent imaging (WFFI) data requires precise separation of raw fluorescence signals into neural and hemodynamic components. The classical Beer-Lambert law-based approach, which uses concurrent 530-nm illumination to estimate relative changes in cerebral blood volume (CBV), fails to account for the scattering and reflection of 530-nm photons from non-neuronal components leading to biased estimates of CBV changes and subsequent misrepresentation of neural activity. This study introduces a novel linear regression approach designed to overcome this limitation. This correction provides a more reliable representation of CBV changes and neural activity in fluorescence data. Our method is validated across multiple datasets, demonstrating its superiority over the classical approach.

Details DOI

AAAI Conference 2023 Conference Paper

A Question-Answering Approach to Key Value Pair Extraction from Form-Like Document Images

Kai Hu
Zhuoyuan Wu
Zhuoyao Zhong
Weihong Lin
Lei Sun
Qiang Huo

In this paper, we present a new question-answering (QA) based key-value pair extraction approach, called KVPFormer, to robustly extracting key-value relationships between entities from form-like document images. Specifically, KVPFormer first identifies key entities from all entities in an image with a Transformer encoder, then takes these key entities as questions and feeds them into a Transformer decoder to predict their corresponding answers (i.e., value entities) in parallel. To achieve higher answer prediction accuracy, we propose a coarse-to-fine answer prediction approach further, which first extracts multiple answer candidates for each identified question in the coarse stage and then selects the most likely one among these candidates in the fine stage. In this way, the learning difficulty of answer prediction can be effectively reduced so that the prediction accuracy can be improved. Moreover, we introduce a spatial compatibility attention bias into the self-attention/cross-attention mechanism for KVPFormer to better model the spatial interactions between entities. With these new techniques, our proposed KVPFormer achieves state-of-the-art results on FUNSD and XFUND datasets, outperforming the previous best-performing method by 7.2% and 13.2% in F1 score, respectively.

PDF Details DOI

NeurIPS Conference 2022 Conference Paper

Expediting Large-Scale Vision Transformer for Dense Prediction without Fine-tuning

Weicong Liang
Yuhui Yuan
Henghui Ding
Xiao Luo
Weihong Lin
Ding Jia
Zheng Zhang
Chao Zhang

Vision transformers have recently achieved competitive results across various vision tasks but still suffer from heavy computation costs when processing a large number of tokens. Many advanced approaches have been developed to reduce the total number of tokens in the large-scale vision transformers, especially for image classification tasks. Typically, they select a small group of essential tokens according to their relevance with the [\texttt{class}] token, then fine-tune the weights of the vision transformer. Such fine-tuning is less practical for dense prediction due to the much heavier computation and GPU memory cost than image classification. In this paper, we focus on a more challenging problem, \ie, accelerating large-scale vision transformers for dense prediction without any additional re-training or fine-tuning. In response to the fact that high-resolution representations are necessary for dense prediction, we present two non-parametric operators, a \emph{token clustering layer} to decrease the number of tokens and a \emph{token reconstruction layer} to increase the number of tokens. The following steps are performed to achieve this: (i) we use the token clustering layer to cluster the neighboring tokens together, resulting in low-resolution representations that maintain the spatial structures; (ii) we apply the following transformer layers only to these low-resolution representations or clustered tokens; and (iii) we use the token reconstruction layer to re-create the high-resolution representations from the refined low-resolution representations. The results obtained by our method are promising on five dense prediction tasks including object detection, semantic segmentation, panoptic segmentation, instance segmentation, and depth estimation. Accordingly, our method accelerates $40\%\uparrow$ FPS and saves $30\%\downarrow$ GFLOPs of ``Segmenter+ViT-L/$16$'' while maintaining $99. 5\%$ of the performance on ADE$20$K without fine-tuning the official weights.

PDF Details

NeurIPS Conference 2021 Conference Paper

HRFormer: High-Resolution Vision Transformer for Dense Predict

Yuhui Yuan
Rao Fu
Lang Huang
Weihong Lin
Chao Zhang
Xilin Chen
Jingdong Wang

We present a High-Resolution Transformer (HRFormer) that learns high-resolution representations for dense prediction tasks, in contrast to the original Vision Transformer that produces low-resolution representations and has high memory and computational cost. We take advantage of the multi-resolution parallel design introduced in high-resolution convolutional networks (HRNet [45]), along with local-window self-attention that performs self-attention over small non-overlapping image windows [21], for improving the memory and computation efficiency. In addition, we introduce a convolution into the FFN to exchange information across the disconnected image windows. We demonstrate the effectiveness of the HighResolution Transformer on both human pose estimation and semantic segmentation tasks, e. g. , HRFormer outperforms Swin transformer [27] by 1. 3 AP on COCO pose estimation with 50% fewer parameters and 30% fewer FLOPs. Code is available at: https: //github. com/HRNet/HRFormer

PDF Details