In human-robot interaction (HRI) it is essential that the robot interprets and reacts to a human's utterances in a manner that reflects their intended meaning. In this paper we present a collection of novel techniques that allow a robot to interpret and execute spoken commands describing manipulation goals involving qualitative spatial constraints (e. g. "put the red ball near the blue cube"). The resulting implemented system integrates computer vision, potential field models of spatial relationships, and action planning to mediate between the continuous real world, and discrete, qualitative representations used for symbolic reasoning.

Authors

• Michael Brenner Albert-Ludwigs-University Freiburg
• Nick Hawes University of Oxford
• John Kelleher Dublin Institute of Technology
• Jeremy Wyatt Michael Zillich

Keywords

No keywords are indexed for this paper.