patchDPCC: A Patchwise Deep Compression Framework for Dynamic Point Clouds

When compressing point clouds, point-based deep learning models operate points in a continuous space, which has a chance to minimize the geometric fidelity loss introduced by voxelization in preprocessing. But these methods could hardly scale to inputs with arbitrary points. Furthermore, the point cloud frames are individually compressed, failing the conventional wisdom of leveraging inter-frame similarity. In this work, we propose a patchwise compression framework called patchDPCC, which consists of a patch group generation module and a point-based compression model. Algorithms are developed to generate patches from different frames representing the same object, and more importantly, these patches are regulated to have the same number of points. We also incorporate a feature transfer module in the compression model, which refines the feature quality by exploiting the inter-frame similarity. Our model generates point-wise features for entropy coding, which guarantees the reconstruction speed. The evaluation on the MPEG 8i dataset shows that our method improves the compression ratio by 47.01% and 85.22% when compared to PCGCv2 and V-PCC with the same reconstruction quality, which is 9% and 16% better than that D-DPCC does. Our method also achieves the fastest decoding speed among the learning-based compression models.

Authors

• Zirui Pan Department of Computer Science and Technology, Tsinghua University
• Mengbai Xiao Shandong University
• Xu Han Huazhong University of Science and Technology
• Dongxiao Yu Shandong University
• Guanghui Zhang Shandong University
• Yao Liu

Keywords

• APP: Other Applications
• CV: 3D Computer Vision
• CV: Applications