GoTube: Scalable Statistical Verification of Continuous-Depth Models

We introduce a new statistical verification algorithm that formally quantifies the behavioral robustness of any timecontinuous process formulated as a continuous-depth model. Our algorithm solves a set of global optimization (Go) problems over a given time horizon to construct a tight enclosure (Tube) of the set of all process executions starting from a ball of initial states. We call our algorithm GoTube. Through its construction, GoTube ensures that the bounding tube is conservative up to a desired probability and up to a desired tightness. GoTube is implemented in JAX and optimized to scale to complex continuous-depth neural network models. Compared to advanced reachability analysis tools for timecontinuous neural networks, GoTube does not accumulate overapproximation errors between time steps and avoids the infamous wrapping effect inherent in symbolic techniques. We show that GoTube substantially outperforms state-of-theart verification tools in terms of the size of the initial ball, speed, time-horizon, task completion, and scalability on a large set of experiments. GoTube is stable and sets the stateof-the-art in terms of its ability to scale to time horizons well beyond what has been previously possible.

Authors

• Sophie A. Gruenbacher
• Mathias Lechner MIT CSAIL
• Ramin Hasani
• Daniela Rus Massachusetts Institute of Technology
• Thomas A. Henzinger Institute of Science and Technology Austria
• Scott A. Smolka
• Radu Grosu Vienna University of Technology

Keywords

No keywords are indexed for this paper.