PanFlow: Decoupled Motion Control for Panoramic Video Generation

Panoramic video generation has attracted growing attention due to its applications in virtual reality and immersive media. However, existing methods lack explicit motion control and struggle to generate scenes with large and complex motions. We propose PanFlow a novel approach that exploits the spherical nature of panoramas to decouple the highly dynamic camera rotation from the input optical flow condition, enabling more precise control over large and dynamic motions. We further introduce a spherical noise warping strategy to promote loop consistency in motion across panorama boundaries. To support effective training, we curate a large-scale, motion-rich panoramic video dataset with frame-level pose and flow annotations. We also showcase the effectiveness of our method in various applications, including motion transfer and video editing. Extensive experiments demonstrate that PanFlow significantly outperforms prior methods in motion fidelity, visual quality, and temporal coherence.

Authors

• Cheng Zhang
• Hanwen Liang
• Donny Y. Chen
• Qianyi Wu Monash University
• Konstantinos N. Plataniotis The Edward S Rogers Sr. ECE Department, University of Toronto, Toronto, M5S3G8, Canada
• Camilo Cruz Gambardella Building 4.0 CRC, Caulfield East, Victoria, Australia Future Building Initiative, Monash University, Caulfield East, Victoria, Australia
• Jianfei Cai

Keywords

No keywords are indexed for this paper.