CareCom: Generative Image Composition with Calibrated Reference Features

Image composition aims to seamlessly insert foreground object into background. Despite the huge progress in generative image composition, the existing methods are still struggling with simultaneous detail preservation and foreground pose/view adjustment. To address this issue, we extend the existing generative composition model to multi-reference version, which allows using arbitrary number of foreground reference images. Furthermore, we propose to calibrate the global and local features of foreground reference images to make them compatible with the background information. The calibrated reference features can supplement the original reference features with useful global and local information of proper pose/view. Extensive experiments on MVImgNet and MureCom demonstrate that the generative model can greatly benefit from the calibrated reference features.

Authors

• Jiaxuan Chen Zhejiang University
• Bo Zhang Zhejiang University
• Qingdong He Tencent Youtu Lab
• Jinlong Peng Tencent Youtu Lab
• Li Niu Shanghai Jiao Tong University

Keywords

No keywords are indexed for this paper.