Author name cluster

Baoyu Fan

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

4 papers

2 author rows

EAAI Journal 2025 Journal Article

SSmokeDet: A novel network dedicated to small-scale smoke detection

Jingjing Wang
Li Wang
Runze Zhang
Xiaochuan Li
Baoyu Fan

Small smoke detection is essential for the warning of early and distant smoke. However, small-scale smoke occupies few pixels and only provides limited semantic information, causing a considerable challenge for its detection. To this end, we propose a novel network dedicated to small-scale smoke detection (SSmokeDet). Firstly, we put forward a small-net (SNet) backbone to control the receptive field of the model, which facilitates a better observation of the small smoke. Secondly, combined with a residual connection, a multiple spatial pyramid pooling (MultiSPP) is designed to compensate for the lack of small smoke information on the high level by contextual information reinforcement. Lastly, a self-cooperation head (SCHead) is devised for cross-layer communication after refining branching features at different scales. Moreover, an anchor-free mechanism is employed to break the size limitation of predefined anchor boxes and decode the smoke location information directly for the small-scale smoke detection task. Extensive experiments are conducted on both self-made and synthetic databases with various scenes, and the results demonstrate that our SSmokeDet is superior to the state-of-the-art methods. Compared with the baseline, the accuracy of small-scale smoke is effectively improved by 10. 2%, and the average precision is increased by 4. 9%.

Details DOI

IROS Conference 2024 Conference Paper

FDNet: Feature Decoupling Framework for Trajectory Prediction

Yuhang Li 0007
Changsheng Li
Baoyu Fan
Rongqing Li
Ziyue Zhang
Dongchun Ren
Ye Yuan 0001
Guoren Wang

Trajectory prediction plays a significant role in autonomous driving, with current challenges primarily focused on capturing complex interactions in traffic scenes. Previous methods usually directly encode non-interactive and interactive information together, and then decode them for trajectory prediction. However, given the complexity inherent property in the trajectory generation process (e. g. , the generation of trajectory points are influenced by the interactions among multiple moving agents, as well as the interactions between agents and the static environment), previous approaches fail to precisely capture separate variations of the trajectory generation process. In this paper, we propose a general and plug-and-play feature decoupling framework for trajectory prediction called FDNet, which can learn the interactive and non-interactive factors in the latent space to capture separate variations of the trajectory generation process. At its core, FDNet is comprised of a Non-interactive Feature Extraction Module to extract non-interactive features, and an Interactive Feature Decoupling Module to decouple interactive features. Extensive experiments conducted on Argoverse and nuScenes demonstrate that FDNet significantly improves the performance of existing methods.

Details

AAAI Conference 2024 Conference Paper

Image Content Generation with Causal Reasoning

Xiaochuan Li
Baoyu Fan
Runze Zhang
Liang Jin
Di Wang
Zhenhua Guo
Yaqian Zhao
Rengang Li

The emergence of ChatGPT has once again sparked research in generative artificial intelligence (GAI). While people have been amazed by the generated results, they have also noticed the reasoning potential reflected in the generated textual content. However, this current ability for causal reasoning is primarily limited to the domain of language generation, such as in models like GPT-3. In visual modality, there is currently no equivalent research. Considering causal reasoning in visual content generation is significant. This is because visual information contains infinite granularity. Particularly, images can provide more intuitive and specific demonstrations for certain reasoning tasks, especially when compared to coarse-grained text. Hence, we propose a new image generation task called visual question answering with image (VQAI) and establish a dataset of the same name based on the classic Tom and Jerry animated series. Additionally, we develop a new paradigm for image generation to tackle the challenges of this task. Finally, we perform extensive experiments and analyses, including visualizations of the generated content and discussions on the potentials and limitations. The code and data are publicly available under the license of CC BY-NC-SA 4.0 for academic and non-commercial usage at: https://github.com/IEIT-AGI/MIX-Shannon/blob/main/projects/VQAI/lgd_vqai.md.

PDF Details DOI

NeurIPS Conference 2024 Conference Paper

Infer Induced Sentiment of Comment Response to Video: A New Task, Dataset and Baseline

Qi Jia
Baoyu Fan
Cong Xu
Lu Liu
Liang Jin
Guoguang Du
Zhenhua Guo
Yaqian Zhao

Existing video multi-modal sentiment analysis mainly focuses on the sentiment expression of people within the video, yet often neglects the induced sentiment of viewers while watching the videos. Induced sentiment of viewers is essential for inferring the public response to videos and has broad application in analyzing public societal sentiment, effectiveness of advertising and other areas. The micro videos and the related comments provide a rich application scenario for viewers’ induced sentiment analysis. In light of this, we introduces a novel research task, Multimodal Sentiment Analysis for Comment Response of Video Induced(MSA-CRVI), aims to infer opinions and emotions according to comments response to micro video. Meanwhile, we manually annotate a dataset named Comment Sentiment toward to Micro Video (CSMV) to support this research. It is the largest video multi-modal sentiment dataset in terms of scale and video duration to our knowledge, containing 107, 267 comments and 8, 210 micro videos with a video duration of 68. 83 hours. To infer the induced sentiment of comment should leverage the video content, we propose the Video Content-aware Comment Sentiment Analysis (VC-CSA) method as a baseline to address the challenges inherent in this new task. Extensive experiments demonstrate that our method is showing significant improvements over other established baselines. We make the dataset and source code publicly available at https: //github. com/IEIT-AGI/MSA-CRVI.

PDF Details DOI