An extendable Framework for Expectation-Based Visual Servoing Using Enviroment Models

Visual servoing is a manipulation control strategy that precisely positions objects using imprecisely calibrated camera-lens-manipulator systems. In order to quickly and easily integrate sensor-based manipulation strategies such as visual servoing into robotic systems, a system framework and a task representation must exist which facilitates this integration. The framework must also be extendable so that obsolete sensor systems can be easily replaced or extended as new technologies become available. In this paper we present a framework for expectation-based visual servoing which visually guides tasks based on the expected visual appearance of the task. The appearance of the task is generated by a model of the environment that uses texture-mapped geometric models to represent objects. A system structure which facilitates the integration of various configurations of visual servoing systems is presented, as well as a hardware implementation of the proposed system and experimental results using a stereo camera system.

Authors

• Bradley J. Nelson
• Pradeep K. Khosla

Keywords

• Visual servoing
• Solid modeling
• Robot sensing systems
• Sensor systems
• Hardware
• World Wide Web
• Cameras
• Robustness
• Manipulator dynamics
• Control System
• Use Of Strategies
• Visual System
• Visual Feedback
• Robotic System
• Environmental Model
• Camera System
• Geometric Model
• Tracking Algorithm
• Hardware Implementation
• Vision Sensors
• Laser Ranging
• Stereo Camera
• Task Representations
• Stereo Pairs
• Sensor Space
• Use Of Motion
• Feedback Loop
• Visual Representation
• Visual Control
• Mental Representations
• Template Feature
• Feature Tracking
• Optical Flow
• Jacobian Matrix
• Task Space
• Sensor Configuration
• Velocity Vector
• Sensor Data