Author name cluster

Jiaming Han

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

4 papers

2 author rows

EAAI Journal 2025 Journal Article

Applications of machine vision technology for conveyor belt deviation detection: A review and roadmap

Jiaming Han
Ting Fang
Wensheng Liu
Chenxiao Zhang
Molin Zhu
Jibin Xu
Jie Ji
Xianhua He

Conveyor belt deviation is a frequent challenge in product transportation filed, and failure to promptly detect and rectify this anomaly not only significantly reduces transport efficiency but also poses a risk of serious safety accidents, leading to enormous economic losses. Traditional contact-based deviation detection technologies, with their inherent limitations of high costs and complicated maintenance, have struggled to meet the practical demands of long-distance conveyor belt inspection. In this context, non-contact machine vision technology has emerged as a prominent solution in the field of conveyor belt deviation detection, thanks to its notable advantages of a simple hardware structure and round-the-clock operational capability. Recently, with the rapid development of artificial intelligence theories, this research field has accumulated a series of effective solutions that have been proven through machine vision practical applications. This paper delves into the technical principles of the existing solutions, systematically summarizes them and objectively evaluates their strengths and weaknesses in practical applications. Based on this foundation, this paper also provides an insight on the future development trends of intelligent monitoring for conveyor belt deviation, aiming to offer valuable reference and guidance to technicians in related fields.

Details DOI

NeurIPS Conference 2025 Conference Paper

Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representations

Jiaming Han
Hao Chen
Yang Zhao
Hanyu Wang
Qi Zhao
Ziyan Yang
Hao He
Xiangyu Yue

This paper presents a multimodal framework that attempts to unify visual understanding and generation within a shared discrete semantic representation. At its core is the Text-Aligned Tokenizer (TA-Tok), which converts images into discrete tokens using a text-aligned codebook projected from a large language model's (LLM) vocabulary. By integrating vision and text into a unified space with an expanded vocabulary, our multimodal LLM, Tar, enables cross-modal input and output through a shared interface, without the need for modality-specific designs. Additionally, we propose scale-adaptive encoding and decoding to balance efficiency and visual detail, along with a generative de-tokenizer to produce high-fidelity visual outputs. To address diverse decoding needs, we utilize two complementary de-tokenizers: a fast autoregressive model and a diffusion-based model. To enhance modality fusion, we investigate advanced pre-training tasks, demonstrating improvements in both visual understanding and generation. Experiments across benchmarks show that Tar matches or surpasses existing multimodal LLM methods, achieving faster convergence and greater training efficiency. All code, models, and data will be made publicly available.

PDF Details

ICLR Conference 2024 Conference Paper

LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention

Renrui Zhang
Jiaming Han
Chris Liu
Aojun Zhou
Pan Lu
Yu Qiao 0001
Hongsheng Li 0001
Peng Gao 0007

With the rising tide of large language models (LLMs), there has been a growing interest in developing general-purpose instruction-following models, e.g., ChatGPT. To this end, we present LLaMA-Adapter, a lightweight adaption method for efficient instruction tuning of LLaMA. Using 52K self-instruct demonstrations, LLaMA-Adapter only introduces 1.2M learnable parameters upon the frozen LLaMA 7B model, and costs less than one hour for fine-tuning. Specifically, a zero-initialized attention mechanism is proposed. It adopts a learnable zero gating to adaptively inject the instructional cues into LLaMA within self-attention layers, contributing to a stable training process and superior final performance. In this way, LLaMA-Adapter can generate high-quality responses to diverse language instructions, comparable to Alpaca with fully fine-tuned 7B parameters. Besides language commands, by incorporating an image encoder, our approach can be simply extended to a multi-modal LLM for image-conditioned instruction following, which achieves superior multi-modal reasoning capacity on several popular benchmarks (MME, MMBench, LVLM-eHub). Furthermore, we also verify the proposed zero-initialized attention mechanism for fine-tuning other pre-trained models (ViT, RoBERTa, CLIP) on traditional vision and language tasks, demonstrating the effectiveness and generalizability of our approach. Code and models are released at https://github.com/OpenGVLab/LLaMA-Adapter.

Details

AAAI Conference 2023 Conference Paper

Few-Shot Object Detection via Variational Feature Aggregation

Jiaming Han
Yuqiang Ren
Jian Ding
Ke Yan
Gui-Song Xia

As few-shot object detectors are often trained with abundant base samples and fine-tuned on few-shot novel examples, the learned models are usually biased to base classes and sensitive to the variance of novel examples. To address this issue, we propose a meta-learning framework with two novel feature aggregation schemes. More precisely, we first present a Class-Agnostic Aggregation (CAA) method, where the query and support features can be aggregated regardless of their categories. The interactions between different classes encourage class-agnostic representations and reduce confusion between base and novel classes. Based on the CAA, we then propose a Variational Feature Aggregation (VFA) method, which encodes support examples into class-level support features for robust feature aggregation. We use a variational autoencoder to estimate class distributions and sample variational features from distributions that are more robust to the variance of support examples. Besides, we decouple classification and regression tasks so that VFA is performed on the classification branch without affecting object localization. Extensive experiments on PASCAL VOC and COCO demonstrate that our method significantly outperforms a strong baseline (up to 16%) and previous state-of-the-art methods (4% in average).

PDF Details DOI