Arrow Research search

Author name cluster

Sandra Hirche

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

61 papers
2 author rows

Possible papers

61

AAAI Conference 2025 Conference Paper

Asynchronous Distributed Gaussian Process Regression

  • Zewen Yang
  • Xiaobing Dai
  • Sandra Hirche

In this paper, we address a practical distributed Bayesian learning problem with asynchronous measurements and predictions due to diverse computational conditions. To this end, asynchronous distributed Gaussian process (AsyncDGP) regression is proposed, which is the first effective online distributed Gaussian processes (GPs) approach to improve the prediction accuracy in real-time learning tasks. By leveraging the devised evaluation criterion and established prediction error bounds, AsyncDGP enables the distinction of contributions of each model for prediction ensembling using aggregation strategy. Furthermore, we extend its utility to dynamic systems by introducing a learning-based control law, ensuring guaranteed control performance in safety-critical applications. Additionally, a networked online learning simulation platform for distributed GPs, namely online GP gym (GPgym), is introduced for testing the performance of learning and control of dynamical systems. Numerical simulations within GPgym across regression tasks with real-world data sets and dynamical control scenarios demonstrate the effectiveness and applicability of AsyncDGP.

ICML Conference 2025 Conference Paper

Learning Safe Control via On-the-Fly Bandit Exploration

  • Alexandre Capone
  • Ryan K. Cosner
  • Aaron D. Ames
  • Sandra Hirche

Control tasks with safety requirements under high levels of model uncertainty are increasingly common. Machine learning techniques are frequently used to address such tasks, typically by leveraging model error bounds to specify robust constraint-based safety filters. However, if the learned model uncertainty is very high, the corresponding filters are potentially invalid, meaning no control input satisfies the constraints imposed by the safety filter. While most works address this issue by assuming some form of safe backup controller, ours tackles it by collecting additional data on the fly using a Gaussian process bandit-type algorithm. We combine a control barrier function with a learned model to specify a robust certificate that ensures safety if feasible. Whenever infeasibility occurs, we leverage the control barrier function to guide exploration, ensuring the collected data contributes toward the closed-loop system safety. By combining a safety filter with exploration in this manner, our method provably achieves safety in a general setting that does not require any prior model or backup controller, provided that the true system lies in a reproducing kernel Hilbert space. To the best of our knowledge, it is the first safe learning-based control method that achieves this.

ICRA Conference 2025 Conference Paper

Reinforcement Learning with Lie Group Orientations for Robotics

  • Martin Schuck
  • Jan Brüdigam
  • Sandra Hirche
  • Angela P. Schoellig

Handling orientations of robots and objects is a crucial aspect of many applications. Yet, ever so often, there is a lack of mathematical correctness when dealing with orientations, especially in learning pipelines involving, for example, artificial neural networks. In this paper, we investigate reinforcement learning with orientations and propose a simple modification of the network's input and output that adheres to the Lie group structure of orientations. As a result, we obtain an easy and efficient implementation that is directly usable with existing learning libraries and achieves significantly better performance than other common orientation representations. We briefly introduce Lie theory specifically for orientations in robotics to motivate and outline our approach. Subsequently, a thorough empirical evaluation of different combinations of orientation representations for states and actions demonstrates the superior performance of our proposed approach in different scenarios, including: direct orientation control, end effector orientation control, and pick-and-place tasks.

ICRA Conference 2024 Conference Paper

Autonomous and Teleoperation Control of a Drawing Robot Avatar

  • Lingyun Chen
  • Abdeldjallil Naceri
  • Abdalla Swikir
  • Sandra Hirche
  • Sami Haddadin

A drawing robot avatar is a robotic system that allows for telepresence-based drawing, enabling users to remotely control a robotic arm and create drawings in real-time from a remote location. The proposed control framework aims to improve bimanual robot telepresence quality by reducing the user workload and required prior knowledge through the automation of secondary or auxiliary tasks. The introduced novel method calculates the near-optimal Cartesian end-effector pose in terms of visual feedback quality for the attached eye-to-hand camera with motion constraints in consideration. The effectiveness is demonstrated by conducting user studies of drawing reference shapes using the implemented robot avatar compared to stationary and teleoperated camera pose conditions. Our results demonstrate that the proposed control framework offers improved visual feedback quality and drawing performance.

IROS Conference 2024 Conference Paper

Data-driven Force Observer for Human-Robot Interaction with Series Elastic Actuators using Gaussian Processes

  • Samuel Tesfazgi
  • Markus Keßler
  • Emilio Trigili
  • Armin Lederer
  • Sandra Hirche

Ensuring safety and adapting to the user’s behavior are of paramount importance in physical human-robot interaction. Thus, incorporating elastic actuators in the robot’s mechanical design has become popular, since it offers intrinsic compliance and additionally provide a coarse estimate for the interaction force by measuring the deformation of the elastic components. While observer-based methods have been shown to improve these estimates, they rely on accurate models of the system, which are challenging to obtain in complex operating environments. In this work, we overcome this issue by learning the unknown dynamics components using Gaussian process (GP) regression. By employing the learned model in a Bayesian filtering framework, we improve the estimation accuracy and additionally obtain an observer that explicitly considers local model uncertainty in the confidence measure of the state estimate. Furthermore, we derive guaranteed estimation error bounds, thus, facilitating the use in safety-critical applications. We demonstrate the effectiveness of the proposed approach experimentally in a human-exoskeleton interaction scenario.

AAMAS Conference 2024 Conference Paper

Whom to Trust? Elective Learning for Distributed Gaussian Process Regression

  • Zewen Yang
  • Xiaobing Dai
  • Akshat Dubey
  • Sandra Hirche
  • Georges Hattab

This paper introduces an innovative approach to enhance distributed cooperative learning using Gaussian process (GP) regression in multi-agent systems (MASs). The key contribution of this work is the development of an elective learning algorithm, namely prioraware elective distributed GP (Pri-GP), which empowers agents with the capability to selectively request predictions from neighboring agents based on their trustworthiness. The proposed Pri-GP effectively improves individual prediction accuracy, especially in cases where the prior knowledge of an agent is incorrect. Moreover, it eliminates the need for computationally intensive variance calculations for determining aggregation weights in distributed GP. Furthermore, we establish a prediction error bound within the Pri-GP framework, ensuring the reliability of predictions, which is regarded as a crucial property in safety-critical MAS applications.

NeurIPS Conference 2023 Conference Paper

Koopman Kernel Regression

  • Petar Bevanda
  • Max Beier
  • Armin Lederer
  • Stefan Sosnowski
  • Eyke Hüllermeier
  • Sandra Hirche

Many machine learning approaches for decision making, such as reinforcement learning, rely on simulators or predictive models to forecast the time-evolution of quantities of interest, e. g. , the state of an agent or the reward of a policy. Forecasts of such complex phenomena are commonly described by highly nonlinear dynamical systems, making their use in optimization-based decision-making challenging. Koopman operator theory offers a beneficial paradigm for addressing this problem by characterizing forecasts via linear time-invariant (LTI) ODEs, turning multi-step forecasts into sparse matrix multiplication. Though there exists a variety of learning approaches, they usually lack crucial learning-theoretic guarantees, making the behavior of the obtained models with increasing data and dimensionality unclear. We address the aforementioned by deriving a universal Koopman-invariant reproducing kernel Hilbert space (RKHS) that solely spans transformations into LTI dynamical systems. The resulting Koopman Kernel Regression (KKR) framework enables the use of statistical learning tools from function approximation for novel convergence results and generalization error bounds under weaker assumptions than existing work. Our experiments demonstrate superior forecasting performance compared to Koopman operator and sequential data predictors in RKHS.

NeurIPS Conference 2023 Conference Paper

Sharp Calibrated Gaussian Processes

  • Alexandre Capone
  • Sandra Hirche
  • Geoff Pleiss

While Gaussian processes are a mainstay for various engineering and scientific applications, the uncertainty estimates don't satisfy frequentist guarantees and can be miscalibrated in practice. State-of-the-art approaches for designing calibrated models rely on inflating the Gaussian process posterior variance, which yields confidence intervals that are potentially too coarse. To remedy this, we present a calibration approach that generates predictive quantiles using a computation inspired by the vanilla Gaussian process posterior variance but using a different set of hyperparameters chosen to satisfy an empirical calibration constraint. This results in a calibration approach that is considerably more flexible than existing approaches, which we optimize to yield tight predictive quantiles. Our approach is shown to yield a calibrated model under reasonable assumptions. Furthermore, it outperforms existing approaches in sharpness when employed for calibrated regression.

ICML Conference 2022 Conference Paper

Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications

  • Alexandre Capone
  • Armin Lederer
  • Sandra Hirche

Gaussian processes have become a promising tool for various safety-critical settings, since the posterior variance can be used to directly estimate the model error and quantify risk. However, state-of-the-art techniques for safety-critical settings hinge on the assumption that the kernel hyperparameters are known, which does not apply in general. To mitigate this, we introduce robust Gaussian process uniform error bounds in settings with unknown hyperparameters. Our approach computes a confidence region in the space of hyperparameters, which enables us to obtain a probabilistic upper bound for the model error of a Gaussian process with arbitrary hyperparameters. We do not require to know any bounds for the hyperparameters a priori, which is an assumption commonly found in related work. Instead, we are able to derive bounds from data in an intuitive fashion. We additionally employ the proposed technique to derive performance guarantees for a class of learning-based control problems. Experiments show that the bound performs significantly better than vanilla and fully Bayesian Gaussian processes.

IROS Conference 2021 Conference Paper

Distributed Event- and Self-Triggered Coverage Control with Speed Constrained Unicycle Robots

  • Yuni Zhou
  • Lingxuan Kong
  • Stefan Sosnowski
  • Qingchen Liu
  • Sandra Hirche

Voronoi coverage control is a particular problem of importance in the area of multi-robot systems, which considers a network of multiple autonomous robots, tasked with optimally covering a large area. This is a common task for fleets of fixed-wing Unmanned Aerial Vehicles (UAVs), which are described in this work by a unicycle model with constant forward-speed constraints. We develop event-based control/communication algorithms to relax the resource requirements on wireless communication and control actuators, an important feature for battery-driven or otherwise energy-constrained systems. To overcome the drawback that the event-triggered algorithm requires continuous measurement of system states, we propose a self-triggered algorithm to estimate the next triggering time. Hardware experiments illustrate the theoretical results.

ICML Conference 2021 Conference Paper

Gaussian Process-Based Real-Time Learning for Safety Critical Applications

  • Armin Lederer
  • Alejandro Jose Ordóñez Conejo
  • Korbinian Maier
  • Wenxin Xiao
  • Jonas Umlauft
  • Sandra Hirche

The safe operation of physical systems typically relies on high-quality models. Since a continuous stream of data is generated during run-time, such models are often obtained through the application of Gaussian process regression because it provides guarantees on the prediction error. Due to its high computational complexity, Gaussian process regression must be used offline on batches of data, which prevents applications, where a fast adaptation through online learning is necessary to ensure safety. In order to overcome this issue, we propose the LoG-GP. It achieves a logarithmic update and prediction complexity in the number of training points through the aggregation of locally active Gaussian process models. Under weak assumptions on the aggregation scheme, it inherits safety guarantees from exact Gaussian process regression. These theoretical advantages are exemplarily exploited in the design of a safe and data-efficient, online-learning control policy. The efficiency and performance of the proposed real-time learning approach is demonstrated in a comparison to state-of-the-art methods.

NeurIPS Conference 2019 Conference Paper

Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control

  • Armin Lederer
  • Jonas Umlauft
  • Sandra Hirche

Data-driven models are subject to model errors due to limited and noisy training data. Key to the application of such models in safety-critical domains is the quantification of their model error. Gaussian processes provide such a measure and uniform error bounds have been derived, which allow safe control based on these models. However, existing error bounds require restrictive assumptions. In this paper, we employ the Gaussian process distribution and continuity arguments to derive a novel uniform error bound under weaker assumptions. Furthermore, we demonstrate how this distribution can be used to derive probabilistic Lipschitz constants and analyze the asymptotic behavior of our bound. Finally, we derive safety conditions for the control of unknown dynamical systems based on Gaussian process models and evaluate them in simulations of a robotic manipulator.

IROS Conference 2018 Conference Paper

RAMCIP - A Service Robot for MCI Patients at Home

  • Georgia Peleka
  • Andreas Kargakos
  • Evangelos Skartados
  • Ioannis Kostavelis
  • Dimitrios Giakoumis
  • Iason Sarantopoulos
  • Zoe Doulgeri
  • Michalis Foukarakis

This video features RAMCIP, a new service robot developed to provide proactive and discreet assistance to elderly with Mild Cognitive Impairments (MCI), supporting their daily activities at home. Starting with a thorough analysis of needs and requirements of the target population, the RAMCIP robot was developed as an integrated ensemble of advanced H/W and S/W components, realizing the robot skills of perception, cognition, safe navigation, grasping, manipulation, and human-robot communication, ample to operate in real, rather challenging domestic environments. The RAMCIP use-cases include proactive assistance provision to user's cooking, eating and medication activities, through discreet user monitoring and robot interventions by reminders and robotic manipulations. , RAMCIP can bring the medicine, recognize fallen objects and electric appliance that has been forgotten turned on. It also recognizes the user walking in low-light conditions and turns on the light, as well as detects cases of emergency such as a fall. The robot provides also the user with cognitive training games and stimulates the user to contact with relatives through video-calls. Pilot trials of the RAMCIP robot have been performed in real homes of more than ten different users, in Barcelona, Spain; the video at hand exhibits the robot performing the target use cases.

ICRA Conference 2017 Conference Paper

Bayesian uncertainty modeling for programming by demonstration

  • Jonas Umlauft
  • Yunis Fanger
  • Sandra Hirche

Programming by Demonstration allows to transfer skills from human demonstrators to robotic systems by observation and reproduction. One aspect that is often overlooked is that humans show different trajectories over multiple demonstrations for the same task. Observed movements may be more precise in some phases and more diverse in others. It is well-known that the variability of the execution carries important information about the task. Therefore, we propose a Bayesian approach to model uncertainties from training data and to infer them in regions with sparse information. The approach is validated in simulation, where it shows higher precision than existing methods, and a robotic experiment with variance based impedance adaptation.

ICRA Conference 2017 Conference Paper

Estimating unknown object dynamics in human-robot manipulation tasks

  • Denis Cehajic
  • Pablo Budde gen. Dohmann
  • Sandra Hirche

Knowing accurately the dynamic parameters of a manipulated object is required for common coordination strategies in physical human-robot interaction. Bias in object dynamics results in inaccurately calculated robot wrenches, which may disturb the human during interaction and bias the recognition of the human motion intention. This paper presents an identification strategy of object dynamics for physical human-robot interaction, which allows the tracking of desired human motion and inducing the motions necessary for parameter identification. The estimation of object dynamics is performed online and the estimator minimizes the least square error between the measured and estimated wrenches acting on the object. Identification-relevant motions are derived by analyzing the persistence of excitation condition, necessary for estimation convergence. Such motions are projected in the null space of the partial grasp matrix, relating the human and the robot redundant motion directions, to avoid disturbance of the human desired motion. The approach is evaluated in a physical human-robot object manipulation scenario.

ICML Conference 2017 Conference Paper

Learning Stable Stochastic Nonlinear Dynamical Systems

  • Jonas Umlauft
  • Sandra Hirche

A data-driven identification of dynamical systems requiring only minimal prior knowledge is promising whenever no analytically derived model structure is available, e. g. , from first principles in physics. However, meta-knowledge on the system’s behavior is often given and should be exploited: Stability as fundamental property is essential when the model is used for controller design or movement generation. Therefore, this paper proposes a framework for learning stable stochastic systems from data. We focus on identifying a state-dependent coefficient form of the nonlinear stochastic model which is globally asymptotically stable according to probabilistic Lyapunov methods. We compare our approach to other state of the art methods on real-world datasets in terms of flexibility and stability.

ICRA Conference 2017 Conference Paper

Port-Hamiltonian based control for human-robot team interaction

  • Martin Angerer
  • Selma Music
  • Sandra Hirche

In this paper we consider the problem in which the human commands the overall behavior of a robot team while the robots are controlled to comply with formation constraints. Such human-robot team interaction is challenging in terms of system complexity and control synthesis. Port-Hamiltonian framework is suitable for modeling the interconnected systems. In this paper we model the robotic team, cooperatively manipulating an object, as a constrained port-Hamiltonian system. Furthermore, we propose a passivity-based control approach in the port-Hamiltonian framework for the cooperative manipulation system guided by the human. The control mechanism is based on the energy shaping for achieving a desired behavior of the formation and its preservation. An energy tank in the cascade is introduced to guarantee passivity of the system commanded by the human and safe interaction with humans in the robot environment. We validate the proposed approach with simulation and experiments.

IROS Conference 2017 Conference Paper

Robot team teleoperation for cooperative manipulation using wearable haptics

  • Selma Music
  • Gionata Salvietti
  • Pablo Budde gen. Dohmann
  • Francesco Chinello
  • Domenico Prattichizzo
  • Sandra Hirche

Robot teams require planning and adaptive capabilities in order to perform cooperative manipulation tasks in dynamic or unstructured environments. Since these capabilities are inherent to humans, it is suitable to consider human-robot team teleoperation for cooperative manipulation where a single human collaborates with the robot team. In this paper, we present a subtask-based control approach which enables a simultaneous execution of two subtasks by the robot team, interacting with the object: trajectory tracking and formation preservation. Control inputs for both subtasks are provided by the human operator. The commands are projected onto the spaces of subtasks using a command mapping strategy. Analogously, measured interacting forces are projected onto the space of feedback signals, provided to the human via wearable fingertip haptic devices through a feedback mapping strategy. Experimental results validate the proposed approach.

IROS Conference 2016 Conference Paper

Constrained robot control using control barrier functions

  • Manuel Rauscher
  • Melanie Kimmel
  • Sandra Hirche

Many robotic applications, especially if humans are involved, require the robot to adhere to certain joint, workspace, velocity or force limits while simultaneously executing a task. In this paper, we introduce a control structure, which merges an arbitrary desired robot behavior with given constraints. Using a quadratic program (QP), control barrier functions (CBFs) are combined with an arbitrary nominal control law, which determines the desired behavior. The CBFs enforce the constraints, overruling nominal control whenever necessary. We show that the concept is applicable with arbitrary numbers of constraints and any nominal control law. In order to illustrate the capabilities of the approach, the control scheme is applied to an anthropomorphic manipulator, which is constrained by static as well as moving constraints.

IROS Conference 2016 Conference Paper

Gaussian processes for dynamic movement primitives with application in knowledge-based cooperation

  • Yunis Fanger
  • Jonas Umlauft
  • Sandra Hirche

Dynamic Movement Primitives (DMPs) represent stable goal-directed or periodic movements, which are learned from observations or demonstrations. They rely on proper function approximators, which are sufficiently flexible to represent arbitrary movements but also ensure goal convergence in point-to-point motions. This work shows that Gaussian Processes (GPs) are suitable as a regressor for learning movements with DMPs ensuring stability. In addition, GPs provide a measure for the uncertainty about the current movement, which we exploit by proposing a new cooperation scheme for DMPs: For better reproduction of demonstrations, we follow the intuition, that individuals with more knowledge lead towards the goal, while others follow and focus on cooperation. Along with simulation results, we validate the presented methods in a robotic cooperative object manipulation task.

ICRA Conference 2016 Conference Paper

Impedance-based Gaussian Processes for predicting human behavior during physical interaction

  • Jose Ramon Medina
  • Satoshi Endo
  • Sandra Hirche

For seamless physical human-robot interaction (pHRI), estimating human intention is essential. Most system identification approaches to pHRI model the human as a black box without prior assumptions about the underlying behavioral structure. However, integrating a priori knowledge about behavioral characteristics of the human provides superior prediction performance. In this work we present a novel method for human behavior prediction during physical interaction that incorporates an empirically supported human motor control model. The arm dynamics of the human are modeled as a mechanical impedance that follows a latent desired trajectory. We adopt a Bayesian perspective setting Gaussian Process (GP) priors on impedance parameters and the desired trajectory, which allows regression about human behavior from observed trajectories and interaction forces. The proposed impedance-based GP model is validated in simulation and in an experiment with human participants to demonstrate its prediction performance and generalization capability.

IROS Conference 2015 Conference Paper

Active safety control for dynamic human-robot interaction

  • Melanie Kimmel
  • Sandra Hirche

In human-robot interaction (HRI) and especially in close or physical interaction, it is essential to ensure the human's safety. This is achieved by introducing virtual constraints defining a region, in which the robot is allowed to move safely. These safety regions may change over time during human-robot interaction, which may be either due to human motion or changed environmental conditions. In consequence it is important for the applied control scheme to handle dynamic boundaries. This work proposes an invariance-based control approach, which enforces adherence to boundaries with dynamic parameters. We extend the invariance control approach, which provides a computationally efficient and systematic method for defining constraints on system states and outputs, such that it handles the constraint dynamics. Stability and invariance properties are analyzed and validated in an experimental evaluation on a 7-DoF anthropomorphic manipulator.

IROS Conference 2015 Conference Paper

Dynamic load distribution in cooperative manipulation tasks

  • Andrea Zambelli Bais
  • Sebastian Erhart
  • Luca Zaccarian
  • Sandra Hirche

In cooperative manipulation tasks, load allocation is a crucial step in order to solve the intrinsic redundancy of the system. The desired wrench needs to be suitably distributed between the end-effectors to implement the desired motion of the manipulated object. In this framework, both the grasp kinematics and the individual capacities of each manipulator provide relevant constraints. On one hand, the end effector wrenches act on the object via the grasp geometry. On the other hand, the individual admissible payload further depends on the current configuration of the robots. In this paper we focus on a heterogeneous cooperative manipulation setting and we design a proper allocation strategy to distribute the desired object wrench, considering both constant and time-varying constraints for the load distribution. The relevance of our findings is illustrated by means of an experimental study involving two anthropomorphic robots manipulating a common object.

IROS Conference 2015 Conference Paper

Grasp pose estimation in human-robot manipulation tasks using wearable motion sensors

  • Denis Cehajic
  • Sebastian Erhart
  • Sandra Hirche

Knowledge of the human grasp pose is crucial in common control schemes for human-robot object manipulation tasks. Biased estimates of the grasp pose cause undesired interaction wrenches on the human partner, which disturbs the interaction and the recognition of motion intention. A use of wearable motion sensors for tracking the human motion facilitates the grasp pose estimation without a global sensing system. This paper presents an approach for estimating an unknown grasp pose of the human using wearable motion sensors while minimizing undesired interaction wrenches applied to the human. A condition necessary for convergence of the estimator together with appropriate robot motion strategies are provided. Estimation of relative orientation and displacement is performed online and based on minimizing the error in the least-square sense. The estimation process does not rely on a global sensing system and it considers only the measurements of the velocity and acceleration of the cooperating partners in their respective local frames. The approach is experimentally evaluated in a physical human-robot interaction scenario.

IROS Conference 2015 Conference Paper

Multi-robot manipulation controlled by a human with haptic feedback

  • Dominik Sieber
  • Selma Music
  • Sandra Hirche

The interaction of a single human with a team of cooperative robots, which collaboratively manipulate an object, poses a great challenge by means of the numerous possibilities of issuing commands to the team or providing appropriate feedback to the human. In this paper we propose a formation-based approach in order to avoid deformations of the object and to virtually couple the human to the formation. Here the human can be interpreted as a leader in a leader-follower formation with the robotic manipulators being the followers. The results of a controllability analysis in such a leader-follower formation suggest that it is beneficial to measure the state of the human (leader) by all physically cooperating manipulators (followers). The proposed approach is evaluated in a full-scale multi-robot cooperative manipulation experiment with humans.

ICRA Conference 2015 Conference Paper

Online deformation of optimal trajectories for constrained nonprehensile manipulation

  • Alexander Pekarovskiy
  • Thomas Nierhoff
  • Jochen Schenek
  • Yoshihiko Nakamura
  • Sandra Hirche
  • Martin Buss

This paper discusses an online dynamic motion generation scheme for nonprehensile object manipulation by using a set of predefined motions and a trajectory deformation algorithm capable of incorporating positional and velocity boundary constraints. By creating optimal trajectories offline and deforming them online, computational complexity during execution is reduced considerably. As tight convex hulls of the deformed trajectories can be found, possible obstacles or workspace boundaries can be circumnavigated precisely without collision. The approach is verified through experiments on an inclined planar air-table for volleyball scenario using two 3-DoF robots.

IROS Conference 2015 Conference Paper

Uncertainty-dependent optimal control for robot control considering high-order cost statistics

  • Jose Ramon Medina
  • Sandra Hirche

As the application of probabilistic models in robotic applications increases, the necessity of a systematic robot-control method that considers the effects of multiple uncertainty sources becomes more evident. Motivated by human sensorimotor findings, in this work we study the stochastic locally optimal feedback control problem with high-order cost statistics where dynamics have multiple additive noise sources and cost variability produced by each uncertainty source is evaluated marginally. We present risk-sensitive and cost-cumulant solutions for this problem for non-linear dynamics and non-quadratic costs. Locally optimal solutions are found by iteratively performing a linear quadratic approximation around a nominal trajectory, solving the local problem and updating the trajectory until convergence. Simulation results of a point mass robot and a two-link manipulator validate the applicability of the proposed approach and illustrate its peculiarities.

IROS Conference 2014 Conference Paper

Cooperative suspended object manipulation using reinforcement learning and energy-based control

  • Ivana Palunko
  • Philine Donner
  • Martin Buss
  • Sandra Hirche

Cooperative dynamic object manipulation can extend the manipulation capabilities of robot-robot and human-robot teams. In order to be able to inject energy into various suspended objects of unknown parameters, in this paper we propose an adaptive controller which combines reinforcement learning with energy based swing-up control. The proposed controller is successfully verified in a single robot and human-robot experimental setup for different types of suspended objects.

ICRA Conference 2014 Conference Paper

Dynamic Movement Primitives for cooperative manipulation and synchronized motions

  • Jonas Umlauft
  • Dominik Sieber
  • Sandra Hirche

Cooperative manipulation, where several robots jointly manipulate an object from an initial configuration to a final configuration while preserving the robot formation, poses a great challenge in robotics. Here, we treat the problem of designing motion primitives for cooperative manipulation such that the robots move in formation and are robust with respect to external disturbances. Individual robot trajectories are generated by Dynamic Movement Primitives (DMPs) and coupled by a formation control approach enabling the DMP-trajectories to preserve a given formation while performing the manipulation. The proposed control scheme achieves an increased adaptability under external disturbances. The approach is evaluated in a full-scale experiment with two prototypical cooperative manipulation and synchronized motion tasks.

ICRA Conference 2014 Conference Paper

Full body motion adaption based on task-space distance meshes

  • Thomas Nierhoff
  • Sandra Hirche
  • Wataru Takano
  • Yoshihiko Nakamura

This paper presents a novel robot pose measure for human movement imitation based entirely on the Euclidean distance information between any two links of a robot and any link and object in the robot's environment in a Cartesian task space. A Hidden Markov Model is used to encode the spatio-temporal information of multiple demonstrations. In combination with Gaussian Mixture Regression for extracting the important task properties, feasible full-body motion adaption can be achieved. The method is suited for use with a humanoid robot by considering additional constraints like balance control and collision avoidance. In order to tackle modeling errors occurring due to the human movement demonstration and the robotic reproduction, a manipulability based weighting scheme is proposed. Complexity reduction of the otherwise redundant pose measure is performed based upon a mechanical analogy of an interconnected spring system. Experiments are conducted using a HRP-4 robot and display the applicability of the presented methods for robotic full-body motion imitation tasks.

ICRA Conference 2014 Conference Paper

Gaussian process kernels for rotations and 6D rigid body motions

  • Muriel Lang
  • Oliver Dunkley
  • Sandra Hirche

Gaussian Processes (GPs) are gaining increasing popularity due to their expressive power for learning the dynamics of non-linear time series data, e. g. for human motion prediction. However, so far they are restricted to Euclidean space: input data such as position and velocity need to be Euclidean. In this paper, we examine GPs over time series of 6D rigid body motions including large rotations. As the use of Euler angles with large rotations results in inaccurate predictions, we present an extension of the valid input data to quaternions H and dual quaternions H D. The quality of a GP prediction over unit quaternions is compared with GP prediction over Euler angles. The results are evaluated based on experimental data from a quadrotor and in a learning task of a collision free 6D motion trajectory incorporating large rotations based on artificial data from a motion planner.

IROS Conference 2014 Conference Paper

Sampling-based trajectory imitation in constrained environments using Laplacian-RRT

  • Thomas Nierhoff
  • Sandra Hirche
  • Yoshihiko Nakamura

This paper presents an incremental sampling-based approach for trajectory imitation in cluttered environments using the RRT* algorithm. Inspired by the discrete Laplace-Beltrami operator the underlying distance metric is based upon the difference from a reference trajectory through a quadratic distance term incorporating velocity and acceleration deviations along the trajectory. Mathematically-backed approximations in combination with a task-space bias make it possible to use standard nearest neighbor methods in task space when expanding the RRT*-tree. It is shown that metric-consistent biases considerably increase the convergence speed. The proposed approach is validated in simulations in a 2D environment and in experiments using a HRP-4 humanoid robot.

ICRA Conference 2014 Conference Paper

Workspace analysis for a kinematically coupled torso of a torque controlled humanoid robot

  • Alexander Dietrich
  • Melanie Kimmel
  • Thomas Wimböck
  • Sandra Hirche
  • Alin Albu-Schäffer

The workspace and performance of a humanoid robot is decisively influenced by the design of its torso. The joints or spinal discs are usually the weak points due to the high stress they are exposed to, e. g. when lifting heavy objects. One way to circumvent the necessity of large motors is to use parallel mechanisms to optimize the distribution of loads. Here, we analyze the workspace of the humanoid robot Rollin' Justin of the German Aerospace Center (DLR) w. r. t. the constraints imposed by kinematic coupling of torso joints via tendons. The results of the analysis can be used for planning and reactive control to efficiently exploit the torso performance capabilities of the robotic system. As an application, we design a potential field based controller to avoid violating these constraints and implement it on the real robot.

IROS Conference 2013 Conference Paper

Adaptive force/velocity control for multi-robot cooperative manipulation under uncertain kinematic parameters

  • Sebastian Erhart
  • Sandra Hirche

Multi-robot cooperative manipulation of a common object requires precise kinematic coordination of the attached end effectors in order to avoid excessive forces on the object and the manipulators. A manipulation task is considered successful if the desired object motion and forces are tracked accurately. In this paper we present a systematic analysis on the effect of uncertain kinematic parameters on the tracking behavior in a planar manipulation task. An adaptive control scheme is proposed, which achieves the desired control goal asymptotically. The presented scheme employs the current force/motion data of the attached end effectors without relying on a common reference frame. The algorithm is applicable to common manipulator types with wrist-mounted force/torque sensors and implementable in real-time. The performance of the proposed control scheme is evaluated experimentally with two 7DoF manipulators who cooperatively manipulate an object of uncertain length.

IROS Conference 2013 Conference Paper

An impedance-based control architecture for multi-robot cooperative dual-arm mobile manipulation

  • Sebastian Erhart
  • Dominik Sieber
  • Sandra Hirche

Cooperative manipulation in robotic teams likely results in an increased manipulation performance due to complementary sensing and actuation capabilities or increased redundancy. However, a precise coordination of the involved manipulators is required in order to avoid undesired stress on the manipulated object. Extending the workspace of the robots by means of mobile platforms greatly enlarges the potential task spectrum but simultaneously poses new challenges for example in terms of increased kinematic errors. In this paper we show how kinematic errors in the closed kinematic chain originating from uncertainties in the geometry of object and manipulators limit the cooperative task performance. We extend an impedance-based coordination control scheme towards mobile multi-robot manipulation to limit undesired internal forces in the presence of kinematic uncertainties. Furthermore, we employ a task-space decoupling approach to reduce the impact of disturbances at the mobile platforms on the end effectors. The presented control scheme for cooperative, mobile dualarm manipulation is applicable in real-time and suitable for a team of heterogeneous manipulators. We evaluate the presented architecture by means of a large-scale experiment with four 7DoF manipulators on two mobile platforms.

ICRA Conference 2013 Conference Paper

Dynamic strategy selection for physical robotic assistance in partially known tasks

  • Jose Ramon Medina
  • Martin Lawitzky
  • Adam Molin
  • Sandra Hirche

It is well-known that physical robotic assistance to humans is significantly enhanced by including human behavior anticipation into robot planning and control. The challenge arises when the human goal/plan is uncertain or unknown to the robot. In this paper we propose a novel control scheme which dynamically selects between a model-based and a model-free strategy depending on the level of disagreement between the human and the robot. The disagreement is measured in terms of the interaction force. A task specific model-based controller is selected when the human's motion intention coincides with the robot's goal. A model-free control scheme based on the human force as motion prediction source is selected in case of disagreement and when the human goal/plan is unknown. The benefits of this approach are demonstrated in a human user study on human-robot cooperative object transport through a 2D maze in virtual reality.

IROS Conference 2013 Conference Paper

Formation-based approach for multi-robot cooperative manipulation based on optimal control design

  • Dominik Sieber
  • Frederik Deroo
  • Sandra Hirche

Cooperative manipulation, where several robots collaboratively transport an object, poses a great challenge in robotics. In order to avoid object deformations in cooperative manipulation, formation rigidity of the robots is desired. This work proposes a novel linear state feedback controller that combines both optimal goal regulation and a relaxed form of the formation rigidity constraint, exploiting an underlying distributed impedance control scheme. Since the presented control design problem is in a biquadratic LQR-like form, we present an iterative design algorithm to compute the controller. As an intermediate result, an approximated state-space model of an interconnected robot system is derived. The controller design approach is evaluated in a full-scale multi-robot experiment.

ICRA Conference 2013 Conference Paper

Human-robot cooperative object swinging

  • Philine Donner
  • Alexander Mortl
  • Sandra Hirche
  • Martin Buss

This paper investigates goal-directed cooperative object swinging as a novel physical human-robot interaction scenario. We develop an energy-based control concept, which enables a robot to cooperate with a human in a goal-directed swing-up task. The robot can be assigned to be a leader or an actively contributing follower. We conduct a virtual reality experiment to compare effort sharing and performance of mixed human-human and human-robot dyads. The leader and the follower controllers yield similar results compared to their human standard.

ICRA Conference 2013 Conference Paper

Risk-sensitive interaction control in uncertain manipulation tasks

  • Jose Ramon Medina
  • Dominik Sieber
  • Sandra Hirche

Manipulation tasks are a great challenge for robots due to the uncertainty arising from unstructured environments. In this paper we propose a novel control scheme for contact tasks based on risk-sensitive optimal feedback control. It provides a systematic approach to adjust the trade-off between motion and force control under uncertainty. Following a previously acquired task model, the proposed approach provides both a variable stiffness solution and a motion reference adaptation. This control scheme achieves increased adaptability under previously unseen environmental variability. An implementation on a robotic manipulator validates the applicability and adaptability of the proposed control approach in two different manipulation tasks.

ICRA Conference 2013 Conference Paper

Trajectory generation under the least action principle for physical human-robot cooperation

  • Martin Lawitzky
  • Melanie Kimmel
  • Peter Ritzer
  • Sandra Hirche

Trajectory generation for active physical assistance to humans in cooperative haptic tasks gains increasing interest in recent literature. Planning-based approaches represent one class of trajectory synthesis methods for active robotic partners. To overcome the limitations of kinematic planning algorithms in dynamic tasks, we propose a three-step approach to the synthesis of trajectories under the principle of least action. This is motivated by neuroscientific findings on human effort minimization in motor tasks. A trajectory is generated by optimized sequencing of optimal motion primitives. The benefits of the proposed method for physical human-robot cooperation are demonstrated in human user studies in a 2D cooperative transport task in a virtual maze.

IROS Conference 2012 Conference Paper

6D workspace constraints for physical human-robot interaction using invariance control with chattering reduction

  • Melanie Kimmel
  • Martin Lawitzky
  • Sandra Hirche

For safety in physical human-robot interaction (pHRI) the robot motion must be restricted to an admissible (safe) region. In this work, we propose a systematic approach to guarantee the satisfaction of virtual workspace constraints in 6D for arbitrary manipulator dynamics based on an extended invariance control concept. Invariance control yields a computationally efficient method to render multiple virtual nonlinear workspace boundaries. In order to make the scheme suitable for pHRI we present an approach to reduce chattering by explicitly considering the discrete-time Euler solver output. Orientation constraints are unambiguously represented as unit quaternions. The theoretical results are successfully validated in simulation and experiments on a 7-DoF anthropomorphic manipulator.

IROS Conference 2012 Conference Paper

Autonomous manipulation of deformable objects based on teleoperated demonstrations

  • Matthias Rambow
  • Thomas Schauss
  • Martin Buss
  • Sandra Hirche

While humans can manipulate deformable objects smoothly and naturally, this is still a challenge for autonomous robots due to the complex object dynamics. The presence of rigid environment constraints and altering contact phases between the deformable object, the manipulator, and the environment makes this problem even more challenging. This paper presents a framework for deformable object manipulation that makes use of a single human demonstration of the task. The recorded trajectories are automatically segmented into a sequence of haptic control primitives involving contact with the rigid environment and vision-guided grasp primitives. The recorded motion/force trajectories serve as reference for a compliant control scheme in contact situations. In order to cope with positioning uncertainties a variable admittance control is proposed. The proposed approach is validated in an experimental mounting task for a deformable linear object with multiple re-grasping. The task is demonstrated with a multimodal teleoperation system and transfered to a robotic platform with a pair of seven degrees of freedom manipulators.

ICRA Conference 2012 Conference Paper

Beyond classical teleoperation: Assistance, cooperation, data reduction, and spatial audio

  • Thomas Schauss
  • Carolina Passenberg
  • Nikolay Stefanov
  • Daniela Feth
  • Iason Vittorias
  • Angelika Peer
  • Sandra Hirche
  • Martin Buss

In this video we present a teleoperation system which is capable of solving complex tasks in human-sized wide area environments. The system consists of two mobile teleoperators controlled by two operators, and offers haptic, visual, and auditory feedback. The task examined here, consists of repairing a robot by removing a computer and replacing a defective hard-drive. To cope with the complexity of such a task, we go beyond classical teleoperation by integrating several advanced software algorithms into the system.

IROS Conference 2012 Conference Paper

Disagreement-aware physical assistance through risk-sensitive optimal feedback control

  • Jose Ramon Medina
  • Tamara Lorenz
  • Dongheui Lee
  • Sandra Hirche

Proactive physical robotic assistance in the presence of human prediction uncertainty is a very challenging control problem. In this paper we propose a risk-sensitive optimal feedback controller for physical assistance that autonomously adapts the robot's behavior even during unknown situations. Using a probabilistic model to represent the cooperative task execution behavior and modeling the human as a source of process noise in the system, the proposed assistive controller proactively contributes to the task anticipating the human motion. Estimating online the current level of disagreement and prediction uncertainty, the assistive controller consequently calculates the optimal task contribution providing higher adaptability. A psychological evaluation compares different assistive control strategies in a virtual scenario using a two-Degree-of-Freedom haptic experimental setup. Results show that considering the current level of disagreement enhances the performance of the controller in terms of helpfulness and human effort minimization.

IROS Conference 2012 Conference Paper

Feedback motion planning and learning from demonstration in physical robotic assistance: differences and synergies

  • Martin Lawitzky
  • Jose Ramon Medina
  • Dongheui Lee
  • Sandra Hirche

Goal-directed physical assistance to the human is one of the most challenging problems in the area of human-robot interaction. Planning and learning from demonstration represent two conceptually different approaches to achieve goal-directed behavior. Here we examine the properties of a planning-based and a learning-based approach in the context of physical robotic assistance for the prototypical task of cooperative object maneuvering. In order to exploit the complementary strengths of planning and learning-based approaches we derive three novel synergy strategies. The algorithms are experimentally evaluated in a human user study in a planar virtual-reality scenario and in a proof-of-concept study with a human-sized mobile robot with two 7DoF arms. The results show that combinations of planning and learning algorithms are superior over the individual approaches.

IROS Conference 2012 Conference Paper

Learning and generalizing force control policies for sculpting

  • Vasiliki Koropouli
  • Sandra Hirche
  • Dongheui Lee

Humans exhibit exceptional skills in using tools and manipulating objects of their environment by skillfully controlling exerted force and arm impedance. One of the basic components of this mechanism is the generation of internal models which associate kinematic variables with applied force. On the other hand, making robots capable of skillfully using tools and adapting their motor behavior to new environmental conditions is rather complex. In the present paper, we investigate learning of force control policies for robotic sculpting given multiple task demonstrations. These policies express the relationship between constrained motions and exerted force and are learned in Cartesian space where the coupling of dynamics between different directions of motion is also taken into account. In addition, a novel algorithm is proposed to generalize these policies to new motion tasks, executed in a sufficiently homogeneous environment, same with that in demonstrations, but in presence of new motion-dependent external forces. To this aim, a differential calculus approach is proposed where not only the mapping from motion to force but also from difference in motion to difference in force is learned to generalize the policies to new contexts. This is achieved by learning apart from a set of policy parameters, some newly introduced quantities, so called weight differentials, which express the rate of change of the policy parameters. The proposed approach is validated in simple real-world sculpting experiments by using a two degrees-of-freedom haptic device.

ICRA Conference 2012 Conference Paper

Risk-Sensitive Optimal Feedback Control for Haptic Assistance

  • Jose Ramon Medina
  • Dongheui Lee
  • Sandra Hirche

While human behavior prediction can increase the capability of a robotic partner to generate anticipatory behavior during physical human robot interaction (pHRI), predictions in uncertain situations can lead to large disturbances for the human if they do not match the human intentions. In this paper we present a novel control concept in which the assistive control parameters are adapted to the uncertainty in the sense that a the robot takes a more or less active role depending on its confidence in the human behavior prediction. The approach is based on risk-sensitive optimal feedback control. The human behavior is modeled using probabilistic learning methods and any unexpected disturbance is considered as a source of noise. The proposed approach is validated in situations with different uncertainties, process noise and risk-sensitivities in a tow- Degree-of-Freedom virtual reality experiment.

IROS Conference 2012 Conference Paper

Tire mounting on a car using the real-time control architecture ARCADE

  • Thomas Nierhoff
  • Lei Lou
  • Vasiliki Koropouli
  • Martin Eggers
  • Timo Fritzsch
  • Omiros Kourakos
  • Kolja Kühnlenz
  • Dongheui Lee

In comparison to industrial settings with structured environments, the operation of autonomous robots in unstructured and uncertain environments is more challenging. This video presents a generic control and system architecture ARCADE, applicable for real-time robot control in complex task situations. Several methods to cope with uncertainties are demonstrated with the example task of changing tires on a car. Approaches of object detection (applied to car, tires, and humans), robust real-time control of robot arms under perception uncertainty, and human-friendly haptic interaction are detailed. The video shows two robots jointly performing the task of mounting a mock-up tire to a real car using the proposed methods, realizing robust performance in an uncertain environment.

IROS Conference 2012 Conference Paper

Trajectory Classification in n Dimensions using Subspace Projection

  • Thomas Nierhoff
  • Sandra Hirche

This paper presents a novel descriptor for trajectory classification in n dimensions, which is invariant with respect to scaling and rigid transformation. Using a hierarchical approach, the descriptor is able to capture both local and global features of the trajectory. The algorithm iteratively splits up every trajectory into smaller trajectory segments resulting in a binary tree. Inspired by the Frenet-Serret formulas, a projection onto a lower dimensional subspace is performed for every trajectory segment, providing a characteristic description of every trajectory. The subspace projection acts as a pseudo-curvature measure in every dimension. Successful applicability is shown through classification experiments in three and six dimensions using an RGB-D camera. For comparison with other algorithms, the Australian Sign Language dataset is also used for classification, showing a superior classification rate.

IROS Conference 2011 Conference Paper

An experience-driven robotic assistant acquiring human knowledge to improve haptic cooperation

  • Jose Ramon Medina
  • Martin Lawitzky
  • Alexander Mortl
  • Dongheui Lee
  • Sandra Hirche

Physical cooperation with humans greatly enhances the capabilities of robotic systems when leaving standardized industrial settings. Our novel cognition-enabled control framework presented in this paper enables a robotic assistant to enrich its own experience by acquisition of human task knowledge during joint manipulation. Our robot incrementally learns semantic task structures during joint task execution using hierarchically clustered Hidden Markov Models. A semantic labeling of recognized task segments is acquired from the human partner through speech. After a small number of repetitions, the robot uses an anticipated task progress to generate a feed-forward set point for an admittance feedback control scheme. This paper describes the framework and its implementation on a mobile bi-manual platform. The evolution of the robot's task knowledge is presented and discussed. Finally, the cooperation quality is measured in terms of the robot's task contribution.

IROS Conference 2011 Conference Paper

Learning interaction control policies by demonstration

  • Vasiliki Koropouli
  • Dongheui Lee
  • Sandra Hirche

This paper explores learning of interaction force skills by human demonstration in dynamic interaction tasks. Skillful force regulation is required in many cases to achieve the goal of a task and at the same time, not to cause undesired stress on the manipulator or the object under manipulation which could result in physical failure. For example, manipulation of compliant objects with varying physical properties or artistic tasks such as engraving require skillful force modulation. Humans gracefully manipulate objects by using their sense of touch and skillfully regulating exerted forces. To learn the demonstrated force for a task by demonstration, an interaction force control policy, in terms of a goal-directed dynamical system, is proposed which stems from the parallel force/position control. The control policy is parameterized and its parameters are learned by Locally Weighted Regression from human demonstrated data to learn a force trajectory. Scaling of learned force is possible by modifying the goal of the system. The proposed method is evaluated in virtual manipulation tasks using a two degrees-of-freedom haptic device.

ICRA Conference 2011 Conference Paper

Performance-oriented networked visual servo control with sending rate scheduling

  • Haiyan Wu
  • Lei Lou
  • Chih-Chung Chen
  • Sandra Hirche
  • Kolja Kühnlenz

In order to speed up image processing in visual servoing, the distributed computational power across networks and appropriate data transmission mechanisms are of particular interest. In this paper, a high sampling rate of visual feedback is achieved by distributed computation on a cloud image processing platform. For target tracking with a networked visual servo control system, a switching control law considering the varying feedback delay caused by image processing and data transmission is applied to improve the control performance. A sending rate scheduling strategy aiming at saving the network load is proposed based on the tracking error. Experiments on a 7 degree-of-freedom (DoF) manipulator are carried out to validate the proposed approach. The proposed approach shows a similar control performance as a system without sending rate scheduling, however, beneficially with largely reduced network load.

ICRA Conference 2011 Conference Paper

Playing pool with a dual-armed robot

  • Thomas Nierhoff
  • Omiros Kourakos
  • Sandra Hirche

This video presents a robot capable of playing pool on a normal sized pool table using two arms. For successfully completing this task several issues need to be addressed, including the perception of relevant environment information, planning of actions and finally an efficient execution. The video outlines how the robot accurately locates the pool table, the balls on the table and the cue and subsequently plans the next shot. In order to improve the stroke speed, an optimization algorithm for the arm configuration is described. Finally, it is shown how all these modules are integrated to achieve a working two-handed robotic pool play

ICRA Conference 2010 Conference Paper

A control strategy for operating unknown constrained mechanisms

  • Ewald Lutscher
  • Martin Lawitzky
  • Gordon Cheng
  • Sandra Hirche

This work aims at the development of a versatile control strategy for operating unknown mechanically constrained devices such as drawers or doors. Few assumptions on the device's shape as well as the utilized hardware are required. Our approach is based on an on-line estimation of the constraint manifold which serves as a reference input for an admittance-type controller providing the compliance required. The direction estimation is obtained from the velocity signal in task space. An on-line adaptation of the admittance controller according to the estimated moving direction reduces contact forces. The functionality of the control strategy is demonstrated on a mobile manipulator in a kitchen environment.

ICRA Conference 2010 Conference Paper

A switching control law for a networked visual servo control system

  • Haiyan Wu
  • Chih-Chung Chen
  • Jiayun Feng
  • Kolja Kühnlenz
  • Sandra Hirche

In this paper, a novel switching controller is proposed for a networked visual servo control system with varying feedback delay due to image processing and data transmission. The varying image processing delay caused by the varying number of extracted features for pose estimation due to different view angles, illumination conditions and noise, is modeled by its occurrence probability. The time delay due to transmission over the communication network is also modeled as random process. By using a sampled-data system approach and an input-delay approach, the linearized visual servo control system is reformulated into a stochastic continuous-time system with time-varying delay. A novel stability condition and associated switching controller are derived based on the occurrence probabilities of delays. Experiments on a 1-DoF linear module equipped with a camera are conducted to validate the proposed approach. A non-switching controller approach is implemented for comparison. The experimental results demonstrate significant performance improvement of the proposed control approach.

IROS Conference 2010 Conference Paper

Distributed computation and data scheduling for networked visual servo control systems

  • Haiyan Wu
  • Lei Lou
  • Chih-Chung Chen
  • Kolja Kühnlenz
  • Sandra Hirche

The stability and performance of visual servo control systems strongly depend on the delays caused by image processing. In order to accelerate the visual feedback, the distributed computational power across networks and appropriate data transmission mechanism are of particular interest. In this paper, a novel distributed computation with data scheduling is proposed for networked visual servo control systems (NVSCSs) aiming at improving the control performance. A realtime transport protocol is developed for image data transmission. For a NVSCS which is modeled as a continuous-time system with computation, transmission and holding delays, a switching control law is applied. A probabilistic sampling scheduler is derived such that the control performance and the network load caused by image data transmission are balanced. Experiments on two 1-DoF linear modules equipped with a camera are conducted to validate the proposed approach. A visual servo system without data scheduling is implemented for comparison. The experimental results demonstrate a comparable control performance of the proposed approach with an advantage of reduced network load.

ICRA Conference 2010 Conference Paper

High-fidelity telepresence and teleaction

  • Robert Bauernschmitt
  • Martin Buss
  • Barbara Deml
  • Klaus Diepold
  • Berthold Färber
  • Georg Färber
  • Ulrich Hagn
  • Gerhard Hirzinger

The collaborative research center SFB453 (www. sfb453.de) aims to realize high-fidelity telepresence and teleaction systems.

IROS Conference 2010 Conference Paper

Interconnected performance optimization in complex robotic systems

  • Florian Rohrmüller
  • Omiros Kourakos
  • Matthias Rambow
  • Drazen Brscic
  • Dirk Wollherr
  • Sandra Hirche
  • Martin Buss

The overall performance of a robotic system is commonly expressed by a single scenario-specific metric which is supposed to be optimized. However, the metric describing the performance of a single subtask within a scenario may be different. Nevertheless, the scenario performance is most likely dependent on the subtask performances but a mutual transformation is not straightforward in general, especially in complex robotic systems. This leads to what we call the common pricing problem, i. e. the problem to determine the functional relationship among a set of different performance criteria and then account for this relationship in the various optimizations throughout all system layers. In this paper we present an approach to first learn a probabilistic model of the metric interdependencies, and thereafter utilize this model for performance estimation and optimal task parameterization during planning and execution respectively. The proposed method is validated in a simulation.

IROS Conference 2008 Conference Paper

Intercontinental cooperative telemanipulation between Germany and Japan

  • Angelika Peer
  • Sandra Hirche
  • Carolina Weber
  • Inga Krause
  • Martin Buss
  • Sylvain Miossec
  • Paul Evrard
  • Olivier Stasse

The video shows an intercontinental cooperative telemanipulation task, whereby the operator site is located in Munich, Germany and the teleoperator site in Tsukuba, Japan. The human operator controls a remotely located teleoperator, which performs a task in the remote environment. Hereby the human operator is assisted by another person located at the remote site. The task consists in jointly grasping an object, moving it to a new position and finally releasing it, see Fig. 1.

IROS Conference 2008 Conference Paper

Intercontinental multimodal tele-cooperation using a humanoid robot

  • Angelika Peer
  • Sandra Hirche
  • Carolina Weber
  • Inga Krause
  • Martin Buss
  • Sylvain Miossec
  • Paul Evrard
  • Olivier Stasse

In multimodal tele-cooperation as considered in this paper two humans in distant locations jointly perform a task requiring multimodal including haptic feedback. One human operator teleoperates a remotely placed humanoid robot which is collocated with the human cooperator. Time delay in the communication channel as destabilizing factor is one of the multiple challenges associated with such a tele-cooperation setup. In this paper we employ a control architecture with force-position exchange accounting for the admittance type of the haptic input device and the telerobot, which both are position-based admittance controlled. Llewellynpsilas stability criteria are employed for the parameter tuning of the virtual impedances in the presence of time delay. The control strategy is successfully validated in an intercontinental tele-cooperation experiment with the humanoid telerobot HRP-2 located in Japan/Tsukuba and a multimodal human-system-interface located in Germany/Munich, see also the corresponding video submission. The proposed setup gives rise to a large number of exciting new research questions to be addressed in the future.

ICRA Conference 2006 Conference Paper

Lossy Data Reduction Methods for Haptic Telepresence Systems

  • Martin Kuschel
  • Philipp Kremer
  • Sandra Hirche
  • Martin Buss

Telepresence systems are often deployed in scenarios where communication bandwidth is limited. Consequently, data exchanged between operator and teleoperator has to be reduced. In case of haptic telepresence, data reduction has an influence on the stability of the overall system. This paper provides a step towards a systematic framework for communication data bandwidth reduction in haptic telepresence systems discussing stability for a class of lossy data reduction (LDR) algorithms. Simulation and experimental results validate the efficacy