## This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART B: CYBERNETICS 1 Cyclorotation Models for Eyes and Cam

### BibTeX

@MISC{Hansard_thisarticle,

author = {Miles Hansard and Radu Horaud},

title = {This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART B: CYBERNETICS 1 Cyclorotation Models for Eyes and Cam},

year = {}

}

### OpenURL

### Abstract

Abstract—The human visual system obeys Listing’s law, which means that the cyclorotation of the eye (around the line of sight) can be predicted from the direction of the fixation point. It is shown here that Listing’s law can conveniently be formulated in terms of rotation matrices. The function that defines the observed cyclorotation is derived in this representation. Two polynomial approximations of the function are developed, and the accuracy of each model is evaluated by numerical integration over a range of gaze directions. The error of the simplest approximation for typical eye movements is less than half a degree. It is shown that, given a set of calibrated images, the effect of Listing’s law can be simulated in a way that is physically consistent with the original camera. This condition is important for robotic models of human vision, which typically do not reproduce the mechanics of the oculomotor system. Index Terms—Biological control systems, robot kinematics, visual system. I.

### Citations

161 |
Movements of the eyes
- Carpenter
- 1988
(Show Context)
Citation Context ...ented in a headfixed coordinate system, as illustrated in Fig. 1. The origin is located at the rotational center of the left eye, e =(0, 0, 0) ⊤ , which is assumed to coincide with the optical center =-=[5]-=-. The axes of the coordinate system are {x, y, z}, with x and y being parallel to the coronal (“face”) plane. The vector x points rightward along the interocular axis (according to the subject’s point... |

66 |
Human photoreceptor topography
- Curcio, Sloan, et al.
- 1997
(Show Context)
Citation Context ...mera matrix) are subject to Listing’s law and are physically consistent with the original camera. Other aspects of biological vision, e.g., the nonuniform distribution of photoreceptors on the retina =-=[35]-=-, can be modeled by further transformations of the new coordinates. It is also possible to adapt the aforementioned model to a spherical projection, which may be more appropriate for the human eye; in... |

54 |
Survey of eye movement recording methods
- Young, Sheena
- 1975
(Show Context)
Citation Context ... latter type are, compared with the Helmholtz configuration, more difficult to construct and control [17]. D. Gaze Tracking Listing’s law is also relevant to the design of gaze-tracking systems [21], =-=[22]-=-. For example, greater accuracy can be achieved by accounting for the small angular difference between the line of sight (defined in relation to the fovea) and the optical axis of the eye [5], [23]. I... |

40 |
Geometry of Binocular Vision and a Model for Stereovision
- Koenderink, Doorn
- 1976
(Show Context)
Citation Context ...s law can be imposed on a suitable set of calibrated images. There is considerable interest in the relationship between Listing’s law and other visual processes, such as spatial vision and stereopsis =-=[2]-=-, [4], and [38]. For example; if the binocular fixation point is relatively close, then Listing’s law must be modified [36], [37]. Future work will include an extension of the present analysis to the ... |

40 |
On the parameterization of the three-dimensional rotation group
- Stuelpnagel
- 1964
(Show Context)
Citation Context ...5]. E. Geometric Models The mathematical expression of Listing’s law depends on the representation of the relevant eye movements. The 3-D rotation group can be parameterized in several different ways =-=[26]-=-. The quaternion [8], [12], [14], rotation vector [27], [28], and geometric algebra [29] parameterizations, which are closely related, are particularly well suited to the modeling of ocular kinematics... |

39 |
An Adaptive Algorithm for Numerical Integration over an N-Dimensional Rectangular Region
- Genz, Malik
- 1980
(Show Context)
Citation Context ... of the spherical cap, over which the integration is performed. This term is easily obtained from the formula A(r) =2π(1 − cos r). (32) The integral (31) was evaluated by a standard numerical routine =-=[34]-=-. Table I shows the results of the evaluation. Each functional |g| r 0 was evaluated for all eye movements up to eccentricity r = 15 ◦ ,30 ◦ ,45 ◦ ,60 ◦ , and 75 ◦ . Note that 0 ≤ φ ≤ 30 ◦ represents ... |

32 |
Geometric relation of eye position and velocity vectors during saccades
- Tweed, T
- 1990
(Show Context)
Citation Context ... eye is called the primary position. The reference direction, which is determined by experiment, is approximately straight ahead. It follows that Listing’s plane is approximately parallel to the face =-=[7]-=-. Note that Listing’s law does not determine the rotational movement of the eye; rather, it states that the observed torsion is compatible with a particular choice of rotation. Listing’s law is applic... |

29 |
naturally occurring human saccades have magnitudes of 15 degrees or
- BAHILL, ADLER, et al.
- 1975
(Show Context)
Citation Context ...e of gaze angles α, β ∈ [−90◦, 90◦ ]. The maximum range of human eye movements is smaller than this value, and the typical range is much smaller; an average saccade magnitude of 15◦ has been reported =-=[33]-=-. This result suggests that a simplified form of the torsion function (22) may be valid in practice. Moreover, there are three particular reasons for considering approximate torsion functions: 1) a be... |

27 |
Computing three-dimensional eye position quaternions and eye velocity from search coil signals
- Tweed, Cadera, et al.
- 1990
(Show Context)
Citation Context ...responds to the visual direction of p from the left optical center e. Note that the left and right visual directions lie in a common epipolar plane. no longer orthogonal to the initial direction [6], =-=[8]-=-. Most of the relevant experimental literature is concerned with primate vision, although support for Listing’s law has also been found in other species, including chameleons [9]. Donders’ law can be ... |

20 |
MultiView Geometry in Computer Vision
- Hartley, Zisserman
- 2000
(Show Context)
Citation Context ...metric and numerical methods to explore a kinematic property of human eye-movements. The objective is to model the rotation of the human eye in terms of the standard camera model from computer vision =-=[1]-=-. This paper is motivated by the need to use real image data in computational models of the human vision. It will be shown, in particular, that the images from a standard robotic camera mounting can b... |

19 |
Considerations on Listing’s law and the primary position by means of a matrix description of eye position control
- Haustein
- 1989
(Show Context)
Citation Context ... Listing’s law depends on the representation of the relevant eye movements. The 3-D rotation group can be parameterized in several different ways [26]. The quaternion [8], [12], [14], rotation vector =-=[27]-=-, [28], and geometric algebra [29] parameterizations, which are closely related, are particularly well suited to the modeling of ocular kinematics. It is also possible to represent a rotation by a pai... |

18 | Design of stereo heads
- Murray, Du, et al.
- 1992
(Show Context)
Citation Context ...ltz coordinates, because each elevation plane contains corresponding epipolar lines in the C. Robotic Systems The Helmholtz scheme is also the natural configuration for an active binocular robot head =-=[17]-=-, [18], because the left and right pan motors can be fixed parallel to each other such that the visual axes are coplanar. It follows that, as the cameras converge, the axes will (ideally) intersect in... |

15 | Invariant body kinematics I: Saccadic and compensatory eye movements. Neural Networks
- Hestenes
- 1993
(Show Context)
Citation Context ...esentation of the relevant eye movements. The 3-D rotation group can be parameterized in several different ways [26]. The quaternion [8], [12], [14], rotation vector [27], [28], and geometric algebra =-=[29]-=- parameterizations, which are closely related, are particularly well suited to the modeling of ocular kinematics. It is also possible to represent a rotation by a pair of reflections, which leads to a... |

15 |
Binocular eye orientation during fixations: Listing’s law extended to include eye vergence, Vision Research 33: 691–708
- Rijn, Berg
- 1993
(Show Context)
Citation Context ...s law and other visual processes, such as spatial vision and stereopsis [2], [4], and [38]. For example; if the binocular fixation point is relatively close, then Listing’s law must be modified [36], =-=[37]-=-. Future work will include an extension of the present analysis to the binocular case [15]. The results presented here, as described in the introduction, make it possible to evaluate such models with ... |

14 | Cyclopean geometry of binocular vision
- Hansard, Horaud
- 2008
(Show Context)
Citation Context ...sion in a future issue of this journal. Content is final as presented, with the exception of pagination. 2 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART B: CYBERNETICS left and right images =-=[15]-=-. Fourth, the definition of γ(α, β) is simple and symmetric in the Helmholtz coordinate system (see Section VI). The alternative definition in “Fick” coordinates [5], [16], where α and β are the longi... |

13 |
Visual-motor optimization in binocular control
- Tweed
- 1997
(Show Context)
Citation Context ... will be consistent with the behavior of the oculomotor system. The results described here provide a foundation for further development of both monocular and binocular models of biological vision [2]–=-=[4]-=-. A. Visual Orientation There are several types of human eye movements, including those that are used to stabilize the retinal image during motion of the head and those that are specific to binocular ... |

13 | von Helmholtz. Treatise on Physiological Optics, vol - F - 1925 |

13 |
Kinematics of the eye
- WESTHEIMER
- 1957
(Show Context)
Citation Context ... the parameterization of visual direction. Here, the angles α and β will be assigned to the elevation and azimuth of the target, respectively. This pair is the “Helmholtz” coordinate system [4], [6], =-=[12]-=-–[14], in which the visual direction swings in a plane that contains the interocular axis; the plane itself rotates around the interocular axis, as shown in Fig. 1. This azimuth−elevation scheme is th... |

10 |
Mathematics of three-dimensional eye rotations. Vision Res
- Haslwanter
- 1995
(Show Context)
Citation Context ...parameterization of visual direction. Here, the angles α and β will be assigned to the elevation and azimuth of the target, respectively. This pair is the “Helmholtz” coordinate system [4], [6], [12]–=-=[14]-=-, in which the visual direction swings in a plane that contains the interocular axis; the plane itself rotates around the interocular axis, as shown in Fig. 1. This azimuth−elevation scheme is the nat... |

9 |
Active stereo vision and cyclotorsion
- Jenkin, Tsotsos
- 1994
(Show Context)
Citation Context ... the method in Section IX can be used to appropriately cyclorotate the original images. This paper, to simulate human vision, provides an alternative to the mechanical implementation of Listing’s law =-=[19]-=-, [20]. Robot heads of the latter type are, compared with the Helmholtz configuration, more difficult to construct and control [17]. D. Gaze Tracking Listing’s law is also relevant to the design of ga... |

7 |
A novel gaze estimation system with one calibration point
- Villanueva, Cabeza
(Show Context)
Citation Context ...23]. If the latter can be estimated, then the plane that contains the two rays can be obtained from Listing’s law. The line of sight is at a fixed angular offset, in this plane, from the optical axis =-=[24]-=-. Listing’s law can also be used to relate the direction of gaze to the projection of the iris in a calibrated video of the eye [25]. E. Geometric Models The mathematical expression of Listing’s law d... |

7 |
A theoretical analysis of three-dimensional eye position measurement using polar cross-correlation
- Haslwanter, ST
- 1995
(Show Context)
Citation Context ... is at a fixed angular offset, in this plane, from the optical axis [24]. Listing’s law can also be used to relate the direction of gaze to the projection of the iris in a calibrated video of the eye =-=[25]-=-. E. Geometric Models The mathematical expression of Listing’s law depends on the representation of the relevant eye movements. The 3-D rotation group can be parameterized in several different ways [2... |

6 |
A general framework for selecting world coordinate systems in perspective and catadioptric imaging application
- Barreto, Araujo
(Show Context)
Citation Context ...ordinates, because each elevation plane contains corresponding epipolar lines in the C. Robotic Systems The Helmholtz scheme is also the natural configuration for an active binocular robot head [17], =-=[18]-=-, because the left and right pan motors can be fixed parallel to each other such that the visual axes are coplanar. It follows that, as the cameras converge, the axes will (ideally) intersect in space... |

5 |
Binocular eye movements not coordinated during REM sleep, Exp. Brain Res
- Zhou, King
- 1997
(Show Context)
Citation Context ...e of freedom. Experimental evidence suggests that the human eye is not mechanically constrained to behave this way. For example, irregular torsion is observed in eye movements that occur during sleep =-=[10]-=-. The particular form of Listing’s law has been justified with respect to both “motor” and “visual” criteria. For example, it has been shown that the law is related to the minimization of muscular eff... |

5 | A Quantitative Analysis of Extraocular Muscle Cooperation and Squint,” Investigative Opthalmology - Robinson - 1975 |

4 |
Models for the design of bioinspired robot eyes
- Cannata, Maggiali
- 2008
(Show Context)
Citation Context ...ethod in Section IX can be used to appropriately cyclorotate the original images. This paper, to simulate human vision, provides an alternative to the mechanical implementation of Listing’s law [19], =-=[20]-=-. Robot heads of the latter type are, compared with the Helmholtz configuration, more difficult to construct and control [17]. D. Gaze Tracking Listing’s law is also relevant to the design of gaze-tra... |

4 |
A real-time gaze position estimation method based on a 3-D eye model
- Park
- 2007
(Show Context)
Citation Context ...], [22]. For example, greater accuracy can be achieved by accounting for the small angular difference between the line of sight (defined in relation to the fovea) and the optical axis of the eye [5], =-=[23]-=-. If the latter can be estimated, then the plane that contains the two rays can be obtained from Listing’s law. The line of sight is at a fixed angular offset, in this plane, from the optical axis [24... |

4 |
Visual test of Listing’s law during vergence
- Somani, DeSouza, et al.
- 1998
(Show Context)
Citation Context ...ectively. Then, it follows from (23) that, for each eye that obeys Listing’s law, the nasal half of the horizontal retinal meridian will turn up out of the Helmholtz elevation plane (for example, see =-=[31]-=- and [32]). Furthermore, a rotation [see (17)] of the elevation plane by γℓ > 0 around the left visual axis would align it with the horizontal meridian of the left retina. Likewise, a rotation [see (1... |

3 |
den Berg, “Kinematics of Eye Movement Control
- van
- 1995
(Show Context)
Citation Context ...e of these approximations is that they dispense with the trigonometric functions in the exact formula, which makes it easier to incorporate cyclorotation into theoretical models of oculomotor control =-=[3]-=-, [4]. The aforementioned results are visualized by stereographic projection. The objective of the visualization is to understand the pattern of cyclorotation across the visual field. A procedure for ... |

3 |
Theoretical explanations of Listing’s law and their implication for binocular vision. Vision Res. 35:3237--3241
- Hepp
- 1995
(Show Context)
Citation Context ...th respect to both “motor” and “visual” criteria. For example, it has been shown that the law is related to the minimization of muscular effort, total cyclorotation, and binocular disparity [4], [6], =-=[11]-=-. It is useful, as previously explained, to think of Donders’ law as a rule γ(α, β) that associates a cyclorotation angle γ with each visual direction (α, β) such that the complete orientation of the ... |

3 |
Kinematics of Eye Movement
- Bolina, Monteiro
- 2000
(Show Context)
Citation Context ...NETICS left and right images [15]. Fourth, the definition of γ(α, β) is simple and symmetric in the Helmholtz coordinate system (see Section VI). The alternative definition in “Fick” coordinates [5], =-=[16]-=-, where α and β are the longitude and latitude, respectively, is less concise. Fig. 1. Two eyes fixate a point p in the scene, which is shown here from the back left. The rotation of one eye (here, th... |

3 |
Reflection Makes Sense of Rotation of the Eyes
- Judge
- 2006
(Show Context)
Citation Context ...re particularly well suited to the modeling of ocular kinematics. It is also possible to represent a rotation by a pair of reflections, which leads to a more geometric interpretation of Listing’s law =-=[30]-=-. This paper emphasizes the computational aspects of Listing’s law, which is formulated here in terms of rotation matrices. The matrix representation has the advantages of being both mathematically fa... |

2 |
The oculomotor control system: A review. Proc
- ROBINSON
- 1968
(Show Context)
Citation Context ...of the latter type are, compared with the Helmholtz configuration, more difficult to construct and control [17]. D. Gaze Tracking Listing’s law is also relevant to the design of gaze-tracking systems =-=[21]-=-, [22]. For example, greater accuracy can be achieved by accounting for the small angular difference between the line of sight (defined in relation to the fovea) and the optical axis of the eye [5], [... |

1 |
Chameleon eye position obeys Listing’s law
- Sandor, Frens, et al.
- 2001
(Show Context)
Citation Context ...nitial direction [6], [8]. Most of the relevant experimental literature is concerned with primate vision, although support for Listing’s law has also been found in other species, including chameleons =-=[9]-=-. Donders’ law can be justified with respect to the kinematics of the eye, i.e., cyclorotation is not a component of visual direction, and thus, the oculomotor control problem can be simplified by rem... |

1 |
On Listing’s law,” Commun
- Hepp
- 1990
(Show Context)
Citation Context ...ng’s law depends on the representation of the relevant eye movements. The 3-D rotation group can be parameterized in several different ways [26]. The quaternion [8], [12], [14], rotation vector [27], =-=[28]-=-, and geometric algebra [29] parameterizations, which are closely related, are particularly well suited to the modeling of ocular kinematics. It is also possible to represent a rotation by a pair of r... |

1 |
Visually evoked cyclovergence and extended Listing’s law
- Hooge, Berg
- 2000
(Show Context)
Citation Context ... Then, it follows from (23) that, for each eye that obeys Listing’s law, the nasal half of the horizontal retinal meridian will turn up out of the Helmholtz elevation plane (for example, see [31] and =-=[32]-=-). Furthermore, a rotation [see (17)] of the elevation plane by γℓ > 0 around the left visual axis would align it with the horizontal meridian of the left retina. Likewise, a rotation [see (17)] of th... |

1 |
Rotation of Listing’s plane during vergence,” Vis
- Mok, Ro, et al.
- 1992
(Show Context)
Citation Context ...sting’s law and other visual processes, such as spatial vision and stereopsis [2], [4], and [38]. For example; if the binocular fixation point is relatively close, then Listing’s law must be modified =-=[36]-=-, [37]. Future work will include an extension of the present analysis to the binocular case [15]. The results presented here, as described in the introduction, make it possible to evaluate such models... |

1 |
eye position sense, and perception of the vertical
- Nakayama, Balliet, et al.
- 1977
(Show Context)
Citation Context ...mposed on a suitable set of calibrated images. There is considerable interest in the relationship between Listing’s law and other visual processes, such as spatial vision and stereopsis [2], [4], and =-=[38]-=-. For example; if the binocular fixation point is relatively close, then Listing’s law must be modified [36], [37]. Future work will include an extension of the present analysis to the binocular case ... |