Author name cluster

Yuchen Chen

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

4 papers

2 author rows

IJCAI Conference 2025 Conference Paper

A³-Net: Calibration-Free Multi-View 3D Hand Reconstruction for Enhanced Musical Instrument Learning

Geng Chen
Xufeng Jian
Yuchen Chen
Pengfei Ren
Jingyu Wang
Haifeng Sun
Qi Qi
Jing Wang

Precise 3D hand posture is essential for learning musical instruments. Reconstructing highly precise 3D hand gestures enables learners to correct and master proper techniques through 3D simulation and Extended Reality. However, exsiting methods typically rely on precisely calibrated multi-camera systems, which are not easily deployable in everyday environments. In this paper, we focus on calibration-free multi-view 3D hand reconstruction in unconstrained scenarios. Establishing correspondences between multi-view images is particularly challenging without camera extrinsics. To address this, we propose A^3-Net, a multi-level alignment framework that utilizes 3D structural representations with hierarchical geometric and explicit semantic information as alignment proxies, facilitating multi-view feature interaction in both 3D geometric space and 2D visual space. Specifically, we first perfrom global geometric alignment to map multi-view features into a canonical space. Subsequently, we aggregate information into predefined sparse and dense proxies to further integrate cross-view semantics through mutual interaction. Finnaly, we perfrom 2D alignment to align projected 2D visual features with 2D observations. Our method achieves state-of-the-art results in the multi-view 3D hand reconstruction task, demonstrating the effectiveness of our proposed framework.

PDF Details DOI

ECAI Conference 2023 Conference Paper

Region-Aware Dynamic Filtering Network for 3D Hand Reconstruction

Yuchen Chen
Pengfei Ren 0001
Jingyu Wang 0001
Haifeng Sun 0001
Qi Qi 0001
Jing Wang 0039
Jianxin Liao

3D hand reconstruction from RGB image has attracted a lot of attention due to its crucial role in human-computer interaction. Nevertheless, it is still challenging to perform 3D hand reconstruction under conditions of hand-object interaction due to severe mutual occlusion. Previous methods usually adopt fixed convolution kernel to extract features. We argue that simply sharing the static filter for all regions is impertinent, given that the occlusion degree varies across different regions, resulting in inconsistent visual representations. To address this issue, we proposed Region-aware Dynamic Filtering Network (RDFNet), which dynamically generates convolution kernels based on the features of different regions, thereby adaptively extracting region-related information. Furthermore, we introduce a dynamic receptive field selection mechanism to determine the most appropriate scale for the convolution kernel. For the severely occluded regions, larger receptive field is needed to capture semantic-related features, while the visible regions are mainly concerned with their own local pattern to accumulate spatial-related features and avoid the interference of irrelevant information. Our proposed RDFNet outperforms state-of-the-art methods by a large margin on several challenging hand-object interaction datasets.

Details

AAAI Conference 2023 Conference Paper

Two Heads Are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation

Pengfei Ren
Yuchen Chen
Jiachang Hao
Haifeng Sun
Qi Qi
Jingyu Wang
Jianxin Liao

Depth images and point clouds are the two most commonly used data representations for depth-based 3D hand pose estimation. Benefiting from the structuring of image data and the inherent inductive biases of the 2D Convolutional Neural Network (CNN), image-based methods are highly efficient and effective. However, treating the depth data as a 2D image inevitably ignores the 3D nature of depth data. Point cloud-based methods can better mine the 3D geometric structure of depth data. However, these methods suffer from the disorder and non-structure of point cloud data, which is computationally inefficient. In this paper, we propose an Image-Point cloud Network (IPNet) for accurate and robust 3D hand pose estimation. IPNet utilizes 2D CNN to extract visual representations in 2D image space and performs iterative correction in 3D point cloud space to exploit the 3D geometry information of depth data. In particular, we propose a sparse anchor-based "aggregation-interaction-propagation'' paradigm to enhance point cloud features and refine the hand pose, which reduces irregular data access. Furthermore, we introduce a 3D hand model to the iterative correction process, which significantly improves the robustness of IPNet to occlusion and depth holes. Experiments show that IPNet outperforms state-of-the-art methods on three challenging hand datasets.

PDF Details DOI

YNICL Journal 2021 Journal Article

An automatic machine learning approach for ischemic stroke onset time identification based on DWI and FLAIR imaging

Haichen Zhu
Liang Jiang
Hong Zhang
Limin Luo
Yang Chen
Yuchen Chen

Current thrombolysis for acute ischemic stroke (AIS) treatment strictly relies on the time since stroke (TSS) less than 4.5 h. However, some patients are excluded from thrombolytic treatment because of the unknown TSS. The diffusion-weighted imaging (DWI) and fluid-attenuated inversion recovery (FLAIR) mismatch can simply identify TSS since lesion intensities are not identical at different onset time. In this paper, we propose an automatic machine learning method to classify the TSS less than or more than 4.5 h. First, we develop a cross-modal convolutional neural network to accurately segment the stroke lesions from DWI and FLAIR images. Second, the features are extracted from DWI and FLAIR according to the segmentation regions of interest (ROI). Finally, the features are fed to machine learning models to identify TSS. In DWI and FLAIR ROI segmentation, the networks obtain high Dice coefficients with 0.803 and 0.647. The classification test results show that our model achieves an accuracy of 0.805, with a sensitivity of 0.769 and a specificity of 0.840. Our approach outperforms human reading DWI-FLAIR mismatch model, illustrating the potential for automatic and fast TSS identification.

Details DOI