FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models

Diffusion models have demonstrated outstanding performance in generative tasks, making them ideal candidates for image editing. Recent studies highlight their ability to apply desired edits effectively by following textual instructions, yet with two key challenges remaining. First, these models struggle to apply multiple edits simultaneously, resulting in computational inefficiencies due to their reliance on sequential processing. Second, relying on textual prompts to determine the editing region can lead to unintended alterations to the image. We introduce FunEditor, an efficient diffusion model designed to learn atomic editing functions and perform complex edits by aggregating simpler functions. This approach enables complex editing tasks, such as object movement, by aggregating multiple functions and applying them simultaneously to specific areas. Our experiments demonstrate that FunEditor significantly outperforms recent inference-time optimization methods and fine-tuned models, either quantitatively across various metrics or through visual comparisons or both, on complex tasks like object movement and object pasting. In the meantime, with only 4 steps of inference, FunEditor achieves 5--24 times inference speedups over existing popular methods.

Authors

• Mohammadreza Samadi Huawei Technologies Canada
• Fred X. Han Huawei Technologies Canada
• Mohammad Salameh Huawei Technologies Canada
• Hao Wu Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Fengyu Sun Huawei Kirin Solution
• Chunhua Zhou Huawei Kirin Solution
• Di Niu University of Alberta

Keywords

No keywords are indexed for this paper.