Toward Understanding Convolutional Neural Networks from Volterra Convolution Perspective

We make an attempt to understand convolutional neural network by exploring the relationship between (deep) convolutional neural networks and Volterra convolutions. We propose a novel approach to explain and study the overall characteristics of neural networks without being disturbed by the horribly complex architectures. Specifically, we attempt to convert the basic structures of a convolutional neural network (CNN) and their combinations to the form of Volterra convolutions. The results show that most of convolutional neural networks can be approximated in the form of Volterra convolution, where the approximated proxy kernels preserve the characteristics of the original network. Analyzing these proxy kernels may give valuable insight about the original network. Based on this setup, we present methods to approximate the order-zero and order-one proxy kernels, and verify the correctness and effectiveness of our results. [abs] [ pdf ][ bib ] [ code ] &copy JMLR 2022. ( edit, beta )

Authors

• Tenghui Li
• Guoxu Zhou School of Automation, Guangdong University of Technology, Guangzhou, 510006, China Key Laboratory of Intelligent Detection and The Internet of Things in Manufacturing, Ministry of Education, Guangzhou, 510006, China
• Yuning Qiu School of Automation, Guangdong University of Technology, Guangzhou, 510006, China RIKEN Center for Advanced Intelligence Project, Tokyo, 1030027, Japan
• Qibin Zhao RIKEN AIP Tokyo University of Agriculture and Technology

Keywords

No keywords are indexed for this paper.