Improving Diffusion-Based Image Restoration with Error Contraction and Error Correction

Generative diffusion prior captured from the off-the-shelf denoising diffusion generative model has recently attained significant interest. However, several attempts have been made to adopt diffusion models to noisy inverse problems either fail to achieve satisfactory results or require a few thousand iterations to achieve high-quality reconstructions. In this work, we propose a diffusion-based image restoration with error contraction and error correction (DiffECC) method. Two strategies are introduced to contract the restoration error in the posterior sampling process. First, we combine existing CNN-based approaches with diffusion models to ensure data consistency from the beginning. Second, to amplify the error contraction effects of the noise, a restart sampling algorithm is designed. In the error correction strategy, the estimation-correction idea is proposed on both the data term and the prior term. Solving them iteratively within the diffusion sampling framework leads to superior image generation results. Experimental results for image restoration tasks such as super-resolution (SR), Gaussian deblurring, and motion deblurring demonstrate that our approach can reconstruct high-quality images compared with state-of-the-art sampling-based diffusion models.

Authors

• Qiqi Bao Zhejiang University of Science and Technology
• Zheng Hui Columbia University
• Rui Zhu City, University of London
• Peiran Ren Tongyi Lab
• Xuansong Xie Tongyi Lab
• Wenming Yang

Keywords

• CV: Computational Photography, Image & Video Synthesis
• CV: Low Level & Physics-based Vision