Eye Tracking System and Method

The present invention relates generally to devices for tracking the gaze of the human eye, and more particularly to an optical device for tracking eye movement by analysis of the reflection off the eye of an infrared (IR) beam.

Existing systems for tracking eye movement include electronystagmography methods and magnetic tracking of scleral induction coils imbedded in annuli attached to the eye with a contact lens. These methods are invasive and of limited accuracy and generally require careful subject preparation, substantially constant recorder calibration and a controlled laboratory environment. Another system uses differences in IR light reflected from the iris and sclera as detected by a pair of photodetectors, which differences are linearly related to eye rotation over a range of about .+-.25.degree.. This system can accurately track the limbus horizontally but not vertically, since the limbus is partially occluded by the eyelid, and requires apparatus the placement of which partially obstructs the vision of the subject.

It is a principal object of the invention to provide a method and apparatus for real time, non-invasive and nonoccluding measurement of eye position.

It is a further object of the invention to provide two dimensional tracking of the human eye, including indication of horizontal and vertical position of the eye.

It is a further object of the invention to provide compact, lightweight and portable apparatus for eye tracking.

It is another object of the invention to provide means for fixation monitoring in field-of-vision testing.

It is yet another object of the invention to provide means for tracking both eyes in stereoscopic vision in tracking the fixation point of a subject's gaze in a three-dimensional volume of space.

It is yet another object of the invention to provide means for computer cursor positioning using eye movement.

It is yet another object of the invention to provide means for two-dimensional eye gaze control of a cursor in a computer display.

It is yet another object of the invention to provide means for three-dimensional control of a cursor in a stereoscopic computer display.

These and other objects of the invention will become apparent as a detailed description of representative embodiments proceeds.

In accordance with the foregoing principles and objects of the invention, system and method for tracking the gaze of the eye are described which comprise directing an infrared light beam along an optical axis into the eye, and displaying the reflected optical light distribution on a position sensing detector to determine eye position, considering the differences in infrared reflectivities between the pupil and the surrounding iris and sclera.

The invention will be more clearly understood from the following detailed description of representative embodiments thereof read in conjunction with the accompanying drawings wherein:

FIG. 1 is a perspective view of one embodiment of the invention as applied to a subject;

FIG. 2 is a schematic view of the optical elements comprising the FIG. 1 device;

FIG. 3 is a schematic of the essential electronic components for generating x,y coordinates of eye position using the device of FIGS. 1 and 2;

FIG. 4 is a schematic of the arrangement of optical elements in a device for tracking the pupil as a dark field; and

FIG. 5 is a schematic of the arrangement of optical elements for simultaneous tracking of the pupil as a dark field and for presentation of a computer monitor display.

Referring to FIG. 1, shown therein is a perspective view of an embodiment of the invention as applied to subject S. Device 10 of FIG. 1 may comprise generally a suitable housing 11 enclosing the various optical, light source and electronic detection elements described in detail below in relation to FIGS. 2-6. Headband 12 supports device 10 on subject S. Cable 14 provides means for supplying power to the light sources contained within device 10 and for conducting signals therefrom in the practice of the invention. Controllable presentation 16 may be attached to housing 11 as suggested in FIG. 1 or provided as a separate display (not shown) for presenting images for observation by subject S along viewing axis G in the controlled tracking of eye movement as discussed fully below. It should be noted at the outset that the embodiments of the invention described herein as illustrative are directed to configurations applied to only one eye, but it is understood that embodiments including devices applied to either eye or to both eyes simultaneously are included within the scope of these teachings and of the appended claims. It is emphasized that in applying a system to each eye, tracking of the gaze in real or virtual three-dimensional space may be accomplished.

Referring now to FIG. 2, shown therein is a drawing of elements comprising the internal structure of eye tracking device 10. Dichroic beamsplitter 21 is disposed along viewing axis G to reflect into eye E substantially all near infrared (IR) radiation above about 700 nm (e.g., 850 nm) while transmitting along axis G substantially all visible light (about 400 to 700 nm) as not to substantially interfere with the view of eye E. Source 23 of IR radiation is positioned to transmit IR beam B along optical axis O through collimating lens 24 and beamsplitter 25. Source 23 is any suitable IR source as would occur to the skilled artisan, such as a GaAs light emitting diode, laser source, or other light source filtered to pass only near IR (700-1100 nm). Motorized positioners 26,27 may be operatively connected to lens 24 in order to track the pupil. Beamsplitter 25 is a polarizing type disposed to reflect vertically polarized (polarization selection is not critical) portion B' of beam B along axis O' and to transmit horizontally polarized portion B" to an absorbing target 29. Mirror 28 may be suitably disposed along axis O' for folding beam B' toward beamsplitter 21 and into eye E. The IR illumination of eye E by beam B' is highly reflected by the iris and sclera, but only slightly reflected by the pupil. Portion R of beam B' reflected by eye E is projected back along axis O' toward beamsplitter 25. Vertically polarized radiation in reflected beam portion R is reflected by beamsplitter 25 toward source 23, but depolarized, scattered radiation is transmitted along axis O' as IR image R' of eye E. Objective lens 30 and eyepiece 31 comprising telescope system 32 are disposed along axis O' substantially as shown for projecting image R' onto position sensing detector 33. Dichroic filter 34 may be disposed in front of detector 33 to filter out all but the IR radiation in image R'.

The pupil image appears on detector 33 as a bright generally circular spot surrounded by a dark region defining the image of the iris, and eye position can be determined from data derivable from the pupil image. This requires a two-dimensional position sensitive detector 33. Detector 33 may be any type suitable for the purpose, such as a United Detector Technology PIN-Sc position sensitive detector which provides stable output, fast response time and about 0.0001 inch resolution. Output signals 38-41 define detector 33 response and the corresponding pupil image position relative to axis O'.

Referring now to FIG. 3, shown therein is a schematic of the essential electronic components for analyzing signals 38-41 defining x,y position coordinates of the pupil image on detector 33. Signals 38-41 are input to respective variable gain transimpedance amplifiers 42-45 which convert detector 33 currents into analog voltages. Voltage output signals 46-49 from amplifiers 42-45 are input to microprocessor controller and analog to digital converter 50 (e.g., Motorola 6811 microprocessor) which sequentially samples the inputs at Nyquist or higher rates. The vertical (y) and horizontal (x) positions of eye E are derived by determining the position of the light pupil image position according to the following relationships: ##EQU1##

Although the numerators (signal differences) in each equation would suffice for defining eye position, each signal difference is divided by the corresponding sum to cancel fluctuations in intensity level which might affect signal difference and present a false eye position. The x,y coordinates may be calculated by microprocessor 50 and sent to computer 52 via suitable a suitable interface. Memory resident software interprets the data sent and displays a cursor position on corresponding display 53. Computer 52 may also send tracking signals to pupil tracking positioner driver 54.

Referring now to FIG. 4, shown therein is a schematic of another optical system 55 according to the invention for tracking the pupil. A pair of IR light emitting diodes 56,57 are disposed for directing respective IR beams p,q into eye E. Beams p,q are identically polarized (e.g. vertically) by suitably placed polarizing filters 59,60. Beams p,q are reflected into eye E using dichroic mirror 62 which reflects about 99% IR but passes about 90% visible light. That portion of beams p,q reflected by the iris and sclera back along viewing axis G is reflected along axis O through filter 64 for filtering (horizontal) polarization and through filter 66 for passing only IR and for removing unwanted reflections from the corneal surface and other stray light. Fast imaging lens system 67 focuses the (dark) image of the pupil onto two-axis position sensing detector 69. Position signals 70-73 from detector 69 are processed substantially as described above for signals 38-41 of system 10 of FIGS. 2 and 3. It may be noted that the system of FIG. 4 as well as that of FIG. 2 are insensitive to pupil diameter fluctuations and are compact, lightweight and easily head-mounted.

Referring now to FIG. 5, shown therein is a schematic of a combination of optical elements for tracking the pupil according to FIG. 4 and for presenting a computer monitor display. Accordingly, system 55 may be mounted for viewing by subject S as in FIG. 4, and, additionally, (miniature) CRT display 75 or other suitable display may be helmet mounted or otherwise supported along axis G for use in conjunction with system 55. Display 75 may be configured to receive signal 76 characteristic of eye position from the computer (e.g., FIG. 3 #52). Subject S may then, with the aid of conjugate focusing lens system 77 view a cursor on display 75. Cursor position may be designated as (or related to) the actual gaze angle coordinate of eye E, so that subject S may position the curser on display 75 simply by moving eye E to the desired location on display 75. As suggested above, an additional system 55' and display 75' may be presented to the other eye of subject S so that each eye tracks the cursor on the corresponding display. With such an arrangement applied to each eye, the cursor assumes three dimensional virtual reality. The computer controlling signals to displays 75 may be configured to compensate for stereopsis by appropriate linear transformations of cursor data for each eye, and subject S may position the cursor in virtual three dimensional space.

The invention therefore provides system and method for tracking eye position. It is understood that modifications to the invention may be made as might occur to one with skill in the field of the invention within the scope of the appended claims. All embodiments contemplated hereunder which achieve the objects of the invention have therefore not been shown in complete detail. Other embodiments may be developed without departing from the spirit of the invention or from the scope of the appended claims.