Abstract

Much of the previous work on hand-eye coordination has emphasized the reconstructive aspects of vision. Recently, techniques that avoid explicit reconstruction by placing visual feedback into a control loop have been developed. When properly defined, these methods lead to calibration insensitive hand-eye coordination. In this article, recent work on projective geometry as applied to vision is used to extend this paradigm in two ways. First, it is shown how results from projective geometry can be used to perform online calibration. Second, results on projective invariance are used to define setpoints for visual control that are independent of viewing location. These ideas are illustrated through a number of examples and have been tested on an implemented system. 1 Introduction The goal of hand-eye coordination research is to provide a general-purpose mechanism for controlling a robotic mechanism from visual inputs. A natural paradigm to follow in this quest is to emphasize the reconst...

Citations

460	What can be seen in three dimensions with an uncalibrated stereo rig - Faugeras - 1992
208	Geometric Invariance in Computer Vision - Mundy, Zisserman - 1990
66	Uncalibrated stereo hand/eye coordination - Hollinghurst, Cipolla - 1993
48	Visual control of robot manipulators— A review - Corke
43	Weighted selection of image features for resolved rate visual feedback control - Feddema, Lee, et al. - 1991
38	Vision and control techniques for robotic visual tracking - Papanikolopoulos, Khosla, et al. - 1991
29	Classification and realization of the different vision-based tasks - Chaumette, Rives, et al. - 1993
27	Manipulator control by visual servoing with stereo vision - Maru, Kase, et al. - 1993
26	Real-time feature tracking and projective invariance as a basis for hand-eye coordination - Hager - 1994
22	A Tutorial Introduction to Visual Servo Control - Hutchinson, Hager, et al. - 1996
18	Hand-eye coordination for robotic tracking and grasping - Allen, Timcenko, et al. - 1993
5	Six dof visual control of relative position - Hager - 1994
5	A framework for real-time vision-based tracking using off-the-shelf hardware - Hager, Puri, et al. - 1993