Efficient Bayesian local model learning for control

Model-based control is essential for compliant control and force control in many modern complex robots, like humanoid or disaster robots. Due to many unknown and hard to model nonlinearities, analytical models of such robots are often only very rough approximations. However, modern optimization controllers frequently depend on reasonably accurate models, and degrade greatly in robustness and performance if model errors are too large. For a long time, machine learning has been expected to provide automatic empirical model synthesis, yet so far, research has only generated feasibility studies but no learning algorithms that run reliably on complex robots. In this paper, we combine two promising worlds of regression techniques to generate a more powerful regression learning system. On the one hand, locally weighted regression techniques are computationally efficient, but hard to tune due to a variety of data dependent meta-parameters. On the other hand, Bayesian regression has rather automatic and robust methods to set learning parameters, but becomes quickly computationally infeasible for big and high-dimensional data sets. By reducing the complexity of Bayesian regression in the spirit of local model learning through variational approximations, we arrive at a novel algorithm that is computationally efficient and easy to initialize for robust learning. Evaluations on several datasets demonstrate very good learning performance and the potential for a general regression learning tool for robotics.

Authors

• Franziska Meier
• Philipp Hennig
• Stefan Schaal

Keywords

• Computational modeling
• Data models
• Frequency modulation
• Robots
• Predictive models
• Bayes methods
• Approximation methods
• High-dimensional
• Learning Algorithms
• Computational Efficiency
• Bayesian Regression
• Humanoid
• Linear Model
• Computational Cost
• Posterior Probability
• Length Scale
• Local Function
• Radial Basis Function
• Gaussian Process
• Function Approximation
• Kriging
• Regression Parameters
• Radial Basis Function Kernel
• Posterior Mean
• Constant Function
• Localizer
• Hidden Variables
• Precision Parameter
• Local Regression Model
• Posterior Covariance
• Notion Of Model
• Test Data Points
• Degrees Of Freedom
• Data Streams
• Test Points
• Training Data Points