Display System Using Conjugate Optics and Accommodation Features and Method of Displaying and Viewing an Image

Copending U.S. patent applications Ser. No. 08/295,383, filed Aug. 24, 1994, now U.S. Pat. No. 5,621,572 entitled "Optical system for a head mounted display using a retro-reflector and method of displaying an image" and Ser. No. 08/383,466, filed Feb. 3, 1995, now U.S. Pat. No. 5,606,458 entitled "Head mounted display and viewing system using a remote retro-reflector and method of displaying and viewing an image" hereby are incorporated in their entirety by this reference thereto.

The present invention relates generally, as is indicated, to optical displays and viewing systems, and, more particularly, to such systems in which at least part is head mounted or otherwise positioned relative to a viewer and using conjugate optics and accommodation features, and to a method of displaying and viewing an image.

Various types of head mounted displays are known. An exemplary head mounted display (throughout the following specification the initials "HMD" may be used to mean "head mounted display") includes optics or optical components such as lenses, mirrors or the like, to direct the image from an image source to an eye or to the respective eyes of a person viewing the image (viewer). The image source develops and/or provides an image intended to be viewed and may or may not be part of the HMD. Head mounted display systems are used in the field of virtual reality and also in aircraft, for example, as part of a heads-up display system, and in other fields, too. Exemplary use of such display systems include three dimensional (3-D) or stereoscopic display and viewing features. Also, such systems may be used for simulators, such as flight simulators for pilot training or the like.

Many prior head mounted display systems use light emitting sources to create an image, such as a cathode ray tube, light emitting diode, etc. Several disadvantages to such light sources and head mounted displays using them are relatively large size, weight, and cumbersome nature. For example, in some virtual reality display systems, counterbalancing weights and support systems are needed to hold or to help to hold the helmet containing the virtual reality image source and optics so that it does not severely weigh down the head, neck, shoulders, etc. of the user.

In some prior display systems a modulator modulates light from a source; the images created are a function of modulation. A liquid crystal cell or liquid crystal display device may be such a modulator. A disadvantage of such modulating systems is the reduction in light output due to light blocking and/or absorption occurring in the modulator. To overcome such reduction in brightness, sometimes the intensity of the light source is increased, which draws additional energy, creates heat, requires a larger light source, etc.

Another disadvantage to prior head mounted display systems is the complexity of the components and of the arrangement of the components to provide the desired display or image output. Complexity, size, and so forth usually increase the cost for such systems and reduce the robustness of the system.

It is desirable that a display, especially an HMD, have adequate eye relief. and comfort with which images provided by the HMD can be viewed. One aspect of comfort is the distance at which the image is viewed; a comfortable viewing distance is about twenty inches or more, for example, approximate reading distance. An aspect of eye relief is the distance between the eye and the last optical element (such as the output objective of the display) closest to the eye; often it is desirable that such distance be relatively large to provide adequate eye relief. If adequate eye relief is not provided and/or if the viewing distance at which the image is seen is less than about twenty inches, then the eye may be strained to view the image, which may be uncomfortable and usually is undesirable.

The definition of eye relief also is described in Information Display, Vol. 10, No. 7 & 8, July/August 1994, pages 12-16, the article by Robert E. Fisher entitled "Optics For Head-Mounted Displays."

It would be desirable to reduce the size, weight and complexity of a display system, especially a head mounted display system.

It would be desirable to provide a relatively uncomplicated, small and robust display system, especially for an HMD.

It also would be desirable to provide a high quality image, e.g., bright and of good contrast and, if used, color, for viewing using an HMD, and especially to derive the image using a small display device.

Further, it would be desirable to obtain a relatively wide field of view in an optical display system, especially a head mounted one, and efficiently to deliver light produced by the light source to the viewer. Efficient delivery of light reduces the brightness requirement of the light source, energy requirements and output heat, while providing good brightness, resolution and contrast of the viewed image.

Additionally, it would be desirable to provide adequate eye relief in a head mounted optical display system.

Many prior HMDs and other displays have had a limited head box, which is the size of the area or location at which the viewer's head must be placed so the eyes see a desired image. For example, if a display were mounted on the head, the eyes are at a location which is relatively fixed to the place where an image is seen, such as a screen or image source, e.g., a projector and/or projection lens, liquid crystal display, CRT display, etc. In some circumstances it would be desirable to enlarge the head box to allow increased movement and positioning of the head while still permitting viewing of the displayed image.

Accommodation is the term used to describe the ability of the human eye to adjust its focus to various distances. This ability is used by the brain as an added cue in depth perception. If this cue is at variance with other depth cues such as vergences (stereo parallax) the brain will be confused, leading to eye strain and an increased susceptibility to motion sickness. It is therefore, highly desirable in 3-D display systems for all of the cues to be in agreement with one another. There must also be agreement between the camera system and the display system. The vergence is controlled by the spacing and toe-in of the cameras and projectors. These can easily be set in agreement. The accommodation is controlled by the focus of the camera lens. This can be set to the focal distance of the objects of interest by one of the standard auto-focus methods. All that is then required for proper accommodation is that the focus of the projector be set the same as that of the camera.

According to one aspect of the invention, a head mounted display system includes a retro-reflector, and optical means including an accommodation feature for directing light from an image source to the retro-reflector, light reflected by the retro-reflector being provided for viewing. The image source may be included as part of the HMD.

Briefly, according to the invention, light from an image source is directed by focusing optics to a conjugate optics path including an accommodation feature along which the light is directed to the eye or eyes of a viewer for viewing of an image.

In an embodiment of the invention the conjugate optics path is provided by one retro-reflector or more than one retro-reflector which at least substantially maintains the characteristics of the light incident thereon, including the results of the focusing by the focusing optics, while reflecting the light to the eye(s) of the viewer. In an embodiment of the invention a beamsplitter directs incident light from the focusing optics into the conjugate optics path, e.g., reflecting light or transmitting light with respect to the retro-reflector and to the eye(s) for viewing.

Also, light directed to the retro-reflector from the focusing optics mentioned above is reflected such that the light continues to have essentially or substantially the same direction it had when it impinged on the retro-reflector so that optically the lens of the eye can appear to be in effect at the focusing optics and the retina of the eye can appear to be in effect at the source of the image.

A further aspect is to use a relatively simple lens system to obtain a good angle of view and comfortable eye relief in an HMD.

Yet an additional aspect is to use a retro-reflector in an HMD, to focus light from an image source at a location relative to the retro-reflector, and to direct the light at least partly along the path incident to the retro-reflector for viewing of an image by a viewer, whereby a substantial amount of light from the image source is delivered to the eye of the viewer.

Even another aspect is to reduce the illumination requirements and/or size of the image source for an HMD by using an at least partially conjugate optical system to direct an image to the eyes of a viewer for viewing.

Even an additional aspect is to reduce the illumination requirements and/or size of the image source for an HMD by using an at least partially conjugate optical system to direct an image to the eyes of a viewer for viewing while providing comfortable eye relief and an accommodation feature to provide depth characteristics.

According to another aspect, a display system includes means for forming an image for viewing by an eye of an observer, delivery means for delivering the image from the means for forming to the eye of the observer, and the means for forming and the delivery means being cooperative to provide the image to the eye of the observer at a size at the retina of the eye that is approximately the size of the retina.

According to another aspect, a method of display includes forming an image, and reflecting the image to the eye of an observer such that the image at the retina of the eye is approximately the size of the retina of the eye.

One or more of these and other objects, features and advantages of the present invention are accomplished using the invention described and claimed below.

To the accomplishment of the foregoing and related ends, the invention, then, comprises the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative embodiments of the invention. These embodiments are indicative, however, of but a few of the various ways in which the principles of the invention may be employed.

Although the invention is shown and described with respect to certain preferred embodiments, it is obvious that equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications, and is limited only by the scope of the claims.

In the annexed drawings:

FIG. 1 is a schematic illustration of a head mounted display (HMD) optical system in accordance with the present invention shown mounted on the head of a person relative to one of the eyes;

FIG. 2 is a schematic illustration of an HMD optical system utilizing a retro-reflector;

FIG. 3 is a schematic illustration of the HMD optical system showing the relationship of the size of the image on the retina of the viewing eye relative to the object to image distance;

FIG. 4 is a simplified schematic illustration of an HMD optical system similar to FIG. 2 showing a comfortable viewing distance for the eye;

FIG. 5 is a schematic illustration of a modified HMD optical system similar to FIG. 2 using an additional lens component to obtain comfortable viewing distance while reducing the actual size of the system;

FIG. 6 is a simplified schematic illustration of an HMD optical system similar to FIG. 2 showing a comfortable viewing distance for the eye;

FIG. 7 is a schematic illustration of a modified HMD optical system similar to FIG. 2 using an additional lens component to obtain comfortable viewing distance while reducing the actual size of the system;

FIG. 8 is a schematic top view of the heads-up/see-through display system of FIGS. 6 and 7 with a portion mounted on the head of a person and a remotely located retro-reflector;

FIGS. 9 and 10 are schematic top views of the heads-up/see-through display system of FIGS. 6-8 showing limitations on viewing distance for three dimensional (stereoscopic) viewing;

FIG. 11 is a schematic view of the heads-up/see-through display system with automatic focusing adjustment for viewing distance control;

FIG. 12 is schematic illustration of a heads-up/see-through display system utilizing conjugate optics to view an image in a relatively wide head box;

FIG. 13 is a schematic side elevation of the heads-up/see-through display system of FIG. 12 with a portion mounted on the head of a person and a remotely located retro-reflector;

FIG. 14 is a schematic top view of the heads-up/see-through display system of FIGS. 12 and 13 with a portion mounted on the head of a person and a remotely located retro-reflector;

FIGS. 15 and 16 are schematic top views of the heads-up/see-through display system of FIGS. 12-14 showing limitations on viewing distance for three dimensional (stereoscopic) viewing;

FIG. 17 is a schematic view of the heads-up/see-through display system with automatic focusing adjustment for viewing distance control;

FIG. 18 is a schematic illustration of an accommodation system useful in the invention illustrated in the other drawing figures; and

FIG. 19 is a graphical representation of the transfer function for the accommodation system of FIG. 18.

Referring to the drawings in which like reference numerals designate like parts in the several figures, and initially to FIG. 1, a head mounted display system (referred to below as HMD) according to one example of the invention is shown at 10. The HMD 10 includes a housing 11 and a support 12. The HMD is intended to be mounted with respect to a person who can view images provided by the HMD. An exemplary eye 13 of a person is shown in FIG. 1 positioned relative to the HMD 10. The HMD may have two optical portions (only one being shown in FIG. 1 for simplicity of illustration), each being similar to that shown in the several drawings, for respectively providing images to the respective eyes of a person. The images may be coordinated to provide a three dimensional (3-D) viewing effect (sometimes referred to as stereoscopic viewing), a two dimensional (planar) viewing effect, or some other effect. Alternatively, one device, such as that shown in FIGS. 1-3, 6 and/or 7, for example, may provide images to both eyes of a person. The HMD 10 also may be used to provide images to other devices, such as cameras (still, motion, video, electronic, etc.), measuring equipment, optical evaluation equipment, copiers, scanners, etc. For illustrative purposes the HMD will be described in detail with respect to use to provide images for viewing by a person.

The HMD 10 preferably is relatively small and lightweight to facilitate positioning relative to a person, and especially to facilitate positioning relative to the head of a person to provide images to the eyes. In the embodiment illustrated in FIG. 1 the housing 11 is mounted by the support 12 to the head of a person whose eye 13 is depicted schematically. The support 12 may include a strap, cap, temple piece as in eye glasses, or other device to mount the housing 11 on the head or body of a person or relative thereto to position the housing 11 in front of the eyes. The support 12 may be part of or may be attached to another support structure mounted on a wall, floor, ceiling, or other structure of a building, vehicle, etc.

The housing 11 contains one or more of the components of the optical system 14 of the HMD 10, as will be described in greater detail below. The optical system 14 may include, as is designated at 15, for example, a light source and/or source of images to be provided by the HMD for viewing, or the housing and optical system may be coupled to another source, for example, an external source, such as a liquid crystal display, a cathode ray tube display (CRT), a television, or some other source, which supplies light and/or images. The housing 11 may completely or partially enclose the various optical components of the HMD 10. The housing has an opening or outlet as a viewing port 16 through which the eye 13 can view images provided by the HMD. Alternatively, the housing 11 may have one or more additional openings to receive light and/or a source of images, etc., for delivery ultimately to the viewing port 16. As a further alternative, the housing 11 may be one or several structural members which support but do not necessarily enclose one or more optical components of the HMD so that those members are in relative position to provide images for viewing.

In FIG. 2 details of optical components of the optical system 14 of the HMD 10 are shown. The optical components shown in FIG. 2 are similar to those included in the housing 11 of FIG. 1; however, in FIG. 2 the housing 11 and support 12 are not shown to facilitate illustrating the invention and to simplify the drawing.

The optical components 20 of the optical system 14 of the HMD 10 include focusing optics 21 (sometimes referred to simply as "lens" or as projection optics or as a projector), a beamsplitter 22 and retro-reflector 23. The HMD also may include an image source 24 (also designated 15 above) which provides images or light having characteristics of an image and, if desired, may be part of the mentioned projector. An exemplary image source is a liquid crystal display, such as a small liquid crystal television having a cross-sectional display area on the order of about one square inch or less. Alternatively, the image source may be separate and simply used to provide one or more images or light having image characteristics that can be provided by the HMD to the eye 13. Additional optical components of the optical system 14 may include linear polarizers, circular polarizers, waveplates, focusing elements, such as lenses or mirrors, prisms, filters, shutters, apertures, diaphragms, and/or other components that may be used to provide a particular type of output image for viewing by the eye 13. Examples of several embodiments using such additional optical components are described below with respect to other drawing figures.

The invention is useful with virtually any type of image source or display source. An example of such a display source is a compact flat panel display, and especially one utilizing a reflective liquid crystal display made from a single crystal silicon active matrix array. An example of such image source is disclosed in copending, commonly owned U.S. patent application Ser. No. 08/275,907, filed Jul. 5, 1994, the entire disclosure of which hereby is incorporated by reference.

In FIG. 2 the image source 24 displays an image 25, which is shown in the drawing as an arrow 26. The light 27 leaving the image source 24 represents an image or has characteristics of an image, and that light is collected by the focusing optics 21 of the optical system 14 of the HMD 10 and travels to the beamsplitter 22. In FIG. 2 and in a number of the other drawing figures hereof the focusing optics 21 is represented as a single lens. However, it will be appreciated that the focusing optics 21 may include one or more other components, such as lenses, reflectors, filters, polarizers, waveplates, etc.

Although the image source(s) 24 is shown in the drawings located relatively above the beamsplitter 22, the image source may alternatively be located below the beamsplitter.

At least some of the light 27a incident on the beamsplitter 22 is reflected by the beamsplitter as light 27b toward the retro-reflector 23. The retro-reflector may be, for example, a screen made of retro-reflecting material. Exemplary retro-reflectors are well known. One example is that known as a corner reflector or a sheet having a plurality of corner reflectors. Another example is a material having plural glass beads or other refracting and/or reflecting devices on or in a support. An example of a retro-reflector is a film or sheet material having a plurality of comer cubes which material is sold by Reflexite Corporation of New Britain, Conn. Such material is available having about forty-seven thousand corner reflectors per square inch.

The light (light rays) 27c, which are shown as broken lines, are reflected by the retro-reflector 23 such that their path is exactly back along their direction of incidence on the retro-reflector. In this way the light rays 27c pass through the beamsplitter 22 and are focused, i.e., so as to present a real image in focus as is seen by the light ray diagram of FIG. 2, at a point or location in space, which is generally designated 28 in the illustration of FIG. 2. The eye 13 of a viewer (person) can be placed approximately at location 28 to see the image, and the pupil and lens, individually and collectively designated 29, of the eye, accordingly, are shown at that point. The lens 29 focuses the light incident thereon as an image on the retina of the eye 13.

In FIG. 2 the broken lines represent light rays which travel after reflection by the retro-reflector along the same or substantially the same path, but in the opposite direction to, respective incident light rays impinging on the retro-reflector. Thus, the retro-reflector 23 is part of a conjugate optics path 23a in which light incident thereon is reflected in the same path and opposite direction as reflected light. The beamsplitter 22 directs light from the focusing optics 21 into that conjugate optics path and toward the retro-reflector; and the beamsplitter also passes light in the conjugate optics path from the retro-reflector to the output port 16 (FIG. 1) for viewing by the eye 13. The beamsplitter 22 and retro-reflector 23 cooperate as a conjugate optics system to provide that conjugate optics path.

Using the described conjugate optics path and system, relatively minimal amount of the light from the image source 24 and focusing optics 21 is lost and, conversely, relatively maximum amount of light is directed to the eye 13. Also, there is substantial accuracy of image and image resolution conveyed to the eye. Furthermore, especially if a relatively good quality retro-reflector is used so that the precise location at which the image 30 is in focus will not be critical, e.g., it can be behind or in front of the retro-reflector, the tolerance required for the relative positioning of the components of the optical system 14 is less severe. This makes the HMD 10 relatively robust and reliable.

In FIG. 2 the viewed image 30 is represented by an enlarged arrow 31. Such arrow 31 is shown in FIG. 2 as a magnified focused image of the image 25 from the image source 24. The image 30 may be in focus at or approximately at the retro-reflector 23, and this is especially desirable for good quality images to be provided the eye 13 when a relatively low quality retro-reflector is used. A low quality retro-reflector is one which has relatively low resolution or accuracy of reflecting light in a conjugate manner in the same path but opposite direction relative to the incident light. With a low or poor quality retro-reflector and the image not being focused at the retro-reflector, it is possible that too much light may be lost from the desired conjugate optics path back to the eye 13, and this can reduce the quality of the image seen. However, the image 30 may be in focus at another location or plane either behind the retro-reflector (relative to the eye) or in front of the retro-reflector, and this is easier to do while maintaining a good quality image for viewing when the retro-reflector is a good quality one. The better the retro-reflector, the more self-conjugating is the optical system 14 and the less the need to focus with precision at the retro-reflector.

Retro-reflector quality may be indicated by the radians of beam spread of light reflected. For example, a relatively good quality retro-reflector may have from zero or about zero radians of beam spread to a few milliradians of beam spread. The quality usually is considered as decreasing in proportion to increasing beam spread of reflected light.

In considering the brightness of the image seen by the viewer, the nature of the beamsplitter 22 plays a role. The light produced by the image source 24 may be polarized or unpolarized. If the beamsplitter 22 is of a non-polarizing type, then a balanced situation is to have 50% of the light incident on the beamsplitter 22 be reflected and 50% transmitted. Thus, of the light 27a incident on the beamsplitter 22, 50% is reflected and sent toward the retro-reflector screen 23 as light 27b. Of the reflected light 27c from the retro-reflector 23, 50% of the light will be transmitted through the beamsplitter 22 and will travel to the viewer's eye 13. This configuration of the optical components 20 of the HMD 10 can transfer to the viewer's eye a maximum of 25% of the light produced by the image source 24. If desired, the beamsplitter 22 can be modified in ways that are well known to change the ratio of the reflected light to transmitted light thereby. Also, the beamsplitter 22 may include an anti-reflection coating so that all or an increased amount of the image comes from one side of the beamsplitter and thus to reduce the likelihood of a double image.

Since the optical system 14 of the HMD 10 provides good resolution of the image and maintains the characteristics thereof, the image source can be a relatively inexpensive one that does not have to compensate for substantial loss of image quality that may occur in prior HMD systems. Furthermore, since a relatively large amount of the light provided by the image source 24 is provided to the eye 13 for viewing, e.g., since the retro-reflector can virtually focus the light for viewing at the eye, additional brightness compensation for loss of light, as may be needed in prior HMD systems, ordinarily would not be required.

For exemplary purposes, in FIG. 2 three light rays 40a, 40b, 40c (collectively 40) originating at the tip of the arrow 26 constitute a portion of the light 27. Three light rays schematically shown at 41a, 41b, 41c (collectively 41) also are examples of light emanating at the tail of the arrow 26. The light 27 has characteristics of the image 25 from or provided by or at the image source 24, and represented by the exemplary light rays 40 and 41, is focused by the focusing optics 21 onto the retro-reflector 23. The size of the image 30 seen as the arrow 31 on the retro-reflector 23 depends on the focal length of the focusing optics 21 and the distances between the image source 24 and the retro-reflector 23 from the focal points 43, 44 of the focusing optics 21. The image source 24 should be located relative to the focusing optics 21 such that an image can be focused, e.g., in focus as is shown in FIG. 2, at or approximately at the retro-reflector. For example, the image source 24 may be beyond the focal point 43 of the focusing optics 21, and the retro-reflector likewise preferably is beyond the focal point 44 of the focusing optics so that the image can be focused at the retro-reflector.

In the illustration of FIG. 2 the image 30 on the retro-reflector 23 is magnified relative to the size of the image at the image source 24; it does not have to be magnified. The image 30 may be the same size as the image 25 or it may be smaller. Thus, although the image source 24 may be relatively small and/or may provide a relatively small size image 25 at its output, the size of the image 30 viewed by the eye 13 may be different.

The optical system 14 is operable to place the image plane effectively at the retina of the viewer's eye 13. This is accomplished by effectively putting the plane of the eye lens (or pupil) 29 effectively at the position occupied by the focusing optics 21 relative to the source of the image provided to the focusing optics. In a sense the lens 21 is optically superimposed on the lens 29 of the eye 13.

The invention provides an optical system in which there are conjugate paths from a lens, such as focusing optics 14, which corresponds to the "lens means" of an optical sensor, e.g., the eye 13. Stated in another way, the invention presents visual information with a wide field of view by taking the output from a lens (focusing optics 21) and reflecting the light back onto the same lens, but actually direct that reflected light onto the eye. This is obtained by using the conjugate optics arrangement disclosed herein.

Turning to FIG. 3, the arrangement of optical components in the optical system 14 of the HMD 10 is presented to demonstrate the obtaining of a wide field of view in accordance with the invention. As is seen in FIG. 3, exemplary light rays 40b, 41b originate from the respective ends of the image 25 arrow 26 at the image source 24, and light ray 50 originates from the center of the arrow 26. These light rays 27a pass through the focusing optics 21, here shown as a lens, are reflected by the beamsplitter 22, and are incident on the retro-reflector screen 23 as light 27b. The light rays are retro-reflected by the retro-reflector screen 23 as light 27c so that they converge, i.e., are focused, at a point 28 in space. As is seen in FIG. 3, when the pupil of a viewer's eye 13 is placed at this point 28 in space, lens 29 focuses the image onto the retina and it is possible to see the image 30.

To obtain a relatively wide field of view the entire retina 51 of the eye 13 may be filled with the image, shown at 52 in FIG. 3. The more the retina is filled, the wider will be the field of view. In the illustrated HMD 10 the magnification of the image 52 on the retina 51 equals the object distance between the image source 24 and the focusing optics 21, for example, which is shown at 52 in FIG. 3, divided by the image distance shown at 54. The image distance, of course, is the distance between the lens 55 of the eye 13 and the retina 51.

Also, in the arrangement of optical components 20 of the HMD as illustrated in FIG. 3, the pupil 30 of the eye 13 is located at a distance from the beamsplitter 22. This distance, which is usually considered in relation to "eye relief", also is determined by the f# of the focusing optics 21. By adjusting the parameters, such as f# and object distance, the eye relief can be made at any distance that is comfortable and convenient.

In operation of the HMD 10, light having characteristics of an image is provided by the image source 24. The focusing optics 21 directs the light to the beamsplitter 22, which reflects the light to the retro-reflector 23 for focusing approximately at or near the retro-reflector. Light is reflected by the retro-reflector to transmit through the beamsplitter and to reach the eye 13. The eye lens 29 focuses the light onto the retina 51 to see the image.

The back of the eye 13, e.g., the retina, in effect is at the image source 24 relative to the focusing optics 21, and the lens 29 of the eye in effect is at the focusing optics relative to the image source. Thus, the lens 29 of the eye stands relative to the image source 24 in the same relation as the lens of the focusing optics 21 stands relative to the image source. One has a full field of view as provided by the focusing optics. The location of the image seen by the eye 13 is a function of the plane at which the focusing optics focuses its projected image.

According to the invention, the HMD uses a retro-reflector, and the focusing optics 21 focuses the image from the image source at or approximately at the retro-reflector. Thus, a large amount, for example, substantially all the light from the focusing optics, can be directed by the retro-reflector and put at the eye 13. Of course, there may be other losses in the various components of the optical system, and there may be loss of light due to transmission of the incident light from the focusing optics onto the beamsplitter; and there may be reflection of light from the retro-reflector by the beamsplitter back toward the focusing optics and image source. Some of these losses are addressed in the several embodiments described further below. However, in view of the efficiency of the optical system 14 of the invention, only relatively low illumination level may be needed from the image source.

Using the invention it is possible to magnify the image from a relatively small display to create a suitable image for viewing without having to place the optics and/or image source too close to the eyes, and, therefore, comfortable eye relief can be obtained. Furthermore, using a relatively simple and uncomplicated focusing optics 21, such as a single lens or a camera lens system, such as that used in a conventional SLR camera, it is possible to obtain a relatively good angle of view and good, comfortable eye relief. Using the invention it may be unnecessary to use an output objective or other objective that is placed rather close to the eye of the viewer while still providing an acceptable image for viewing.

For some magnification situations, as is described further in detail below, it is desirable to use a relatively short focal length focusing optics 21 such that the focal length thereof is less than that of the lens 29 of the eye 13 to the back of the eye. Also, to provide a relatively large or wide "sweet spot" or place where the eye 13 can be positioned relative to the optical system 14 and/or the output port 16, while still being able to see a good quality (bright, good resolution, and/or good contrast, etc.) image preferably also with a relatively wide field of view, it is desirable to use a relatively short focal length lens or focusing optics 21, and even more preferably to use such a focusing optics 21, indeed, optical system 14 overall, which has a relatively low f#.

It may be desirable to use lens (focusing optics) 21 having a relatively low f# and short focal length. The exit aperture size of the image lens 21 determines the size of the sweet spot. The optical system 14 can change the field of view between relatively wide and relatively narrow by changing the focal length of the focusing (projection) optics 21.

Summarizing the operation of the invention depicted in FIGS. 2 and 3, for example, light representing the image 25 provided by an image source, such as that shown at 24, is directed via the focusing optics 21 and beamsplitter 22 to the retro-reflector 23 to form a real image at or near the retro-reflector. Preferably a broad image field is focused at the retro-reflector. Light reflected by the retro-reflector 23 is directed toward the location 28 via the beamsplitter 22, and the lens 29 of an eye 13 may be placed at the location 28 to receive light reflected by the retro-reflector. The retina 51 (FIG. 3) is located at the image plane of the lens 29 which focuses the light there to form the viewed or seen image.

The optical components 20 used in the optical system 14 of the invention are operative in a sense as a viewer or in other words like an eyepiece or objective for use to view an image. The optical components 20 are able to provide the viewing or eyepiece function usually independently of the light source or source of images intended for viewing. Therefore, although the focusing optics 21 may provide the function of projecting an image or directing an image toward the retro-reflector 23, it will be appreciated that the invention may be considered, at least in part, as a viewer or a technique for viewing images rather than as a conventional projector which projects images onto a conventional movie screen. The invention may effectively make the image plane reflective to the eye(s) of a viewer; for example, the retro-reflector 23 reflects the light forming the real image toward the eye 13 which is able to view the image.

The size of the exit pupil of the optical system 14 as provided to the eye 13 is proportional to the diameter of the lens or focusing optics 21. If there are no other focusing type (lenses or mirrors, for example) optical components in the optical system 14 other than the lens 21, then the exit pupil of the optical system 14 will be the same as the diameter of the lens or focusing optics 21. Magnification is proportional to the focal length of the lens or focusing optics 21. However, if the focal length of the lens 21 is too short, the lens 21 and the exit pupil of the optical system 14 will not cover the entire field of the image source 24.

The location at which the image, which is provided by or viewed via the optical system 14, by the eye is a function of the plane at which the lens 21 focuses its projected image. That location can be at the retro-reflector 23, which is preferred if a relatively low quality retro-reflector is used; or that location can be behind or in front of the retro-reflector, which is especially possible when a relatively good quality retro-reflector is used.

The invention may be used to present a real image over a relatively wide field. For example, the angle of the field of view may be on the order of about 100 degrees using only a single retro-reflector. This is in contrast to many conventional heads up displays in which there is a relatively narrow field of view of an image, for example, on the order of 10-30 degrees, which is superimposed or adjacent part of a broader real view and which is image essentially focused at infinity.

Furthermore, it will be appreciated that although the invention is described and illustrated herein as having the beamsplitter reflect light from the image source to the retro-reflector; and then the beamsplitter transmits light from the retro-reflector to the eye, other arrangements of the optical components also are possible. An example of another such arrangement would have the image source, beamsplitter and retro-reflector in a straight line so the beamsplitter transmits light from the image source and focusing optics to the retro-reflector; and light that is reflected by the retro-reflector is reflected by the beamsplitter to the eye for viewing.

The human eye is most comfortable when viewing an image at a distance of about twenty inches, approximately at the distance at which one would place a book, document, etc. to be read. It is desirable that the final image as seen by the viewer be located at such distance, e.g., approximately twenty inches from the pupil 29 of the eye. This can be accomplished in the manner illustrated in FIG. 6. The retro-reflector 23 on which the focused image from the image source 24 is moved to twenty inches from the pupil 29 of the eye 13. A disadvantage with this system, though, is the large size of the HMD 10 required to provide such distance between the eye and the retro-reflector.

The HMD can be made more compact compared to the HMD illustrated in FIG. 6 by adding an additional optical system 70 between the beamsplitter 22 and the eye 13. In FIG. 7 such optical system 70 is depicted as a single lens; however, it will be appreciated that it may include other optical components as was mentioned above, for example, with respect to the focusing optics 21. In the HMD 10 of FIG. 7 the retro-reflector 23 is closer to the eye 13 than it is in FIG. 6 making a more compact system. The viewer is provided with a virtual image 30' of the image source 24 at the desired viewing distance (twenty inches, for example) by the cooperation between the focusing optics, retro-reflector, and additional optical system 70.

In the example of FIG. 7, the additional viewing lens 70 may be, for example, about 10 diopters. To present to the eye 13 an image which appears at a comfortable viewing distance, such as about 20 inches or more away, the lens 70 may be located from about 1/2 to 1 inch in front of the eye. Although in many viewing devices further spacing between the eye and the optical component of the optical system nearest the eye may be desired to obtain desired eye relief, the use of lens 70 at the indicated distance of about 1/2 to 1 inch from the eye usually is acceptable and reasonably comfortable because that is the approximate spacing of ordinary eye glasses to which people ordinarily relatively easily become accustomed.

The function of the lens 70 may be obtained by using a negative lens at the focusing optics 21.

Referring, now, to FIGS. 12-17, another embodiment of display and viewing system 210 in accordance with the invention is illustrated. The various components and features of the invention described in the several embodiments presented above may be used in the embodiment of FIGS. 12-17, as will become further evident from the description below. In FIGS. 12-17 the same reference numerals as were used above to designate similar parts in the embodiments of FIGS. 1-11 are used with the addition of the value 200. Therefore, reference numerals 210, 213, etc., generally corresponds to reference numerals 10, 13, etc., described above.

The display and viewing system 210 in a sense is a hybrid head mounted display in that the housing 211 contains or supports the focusing optics 221, beamsplitter 222 and image source 224 and may be mounted on the head or in a position where the head can be placed relatively near thereto to view an image, and the retro-reflector 223 is relatively remotely located and does not necessarily have to be located in, on or attached with respect to the housing 211. The optical system 214 includes the focusing optics 221, beamsplitter 222 and retro-reflector 223, but the retro-reflector may be located relatively remotely with respect to those other components of the optical system.

In using the display and viewing system 210, light 227a shown in solid lines from the image source 224 is directed from the focusing optics 221 via the beamsplitter 222 and then as light 227b toward the retro-reflector 223; and that light is so focused as to form a real image at the retro-reflector or in front or behind the retro-reflector. Since the retro-reflector 223 may have some dispersion or beam spreading characteristics, e.g., it is not perfect, and since the retro-reflector may be relatively far from the beamsplitter and focusing optics, it may be desirable to focus the real image at the retro-reflector, e.g., in the plane thereof if the retro-reflector is flat. The retro-reflector 223 reflects the incident light in a conjugate path 223a as light 227c toward the beamsplitter 222 via which the light reaches the eye 213, as is shown by the dotted lines in FIG. 12, for example.

The housing 211 may include a support 300 for supporting a plurality of image sources 224L (left) and 224R (right), and associated focusing optics 221L and 221R for directing light via a shared beamsplitter 222 or separate respective beamsplitters along the path represented by light 227b. It will be appreciated that the beamsplitter 222 may be a single one having shared by both image sources and focusing optics with respective left and right eye light paths reflected by or transmitted through respective left and right portions of the beamsplitter; or the beamsplitter may be divided as two separate ones, each positioned in a respective one of the light paths to operate in the manner described herein. In FIG. 14 the left eye 213L image is provided by the image source 224L and the right eye image is provided by the image source 224R; light from those image sources is shown directed along respective light paths 227bL and 227bR.

The housing 211 and support 300 may be mounted on the head 301 of a person by appropriate headgear 302 shown in FIGS. 13-16, for example. Various types of headgear are known in the art and may be used for this purpose. It is desirable to minimize the mass and size of the headgear, and, therefore, a rather simple form such as that shown using circumferential and top straps may be used. Size adjustments 303 may be used, as is shown schematically in FIG. 13. This is consistent with the use of a relatively remotely located retro-reflector which does not have to be supported on the headgear 302 or housing 211 in this embodiment. Since the retro-reflector is relatively remotely located the size and weight of the housing 211 and of those portions of the optical system 214 which would have to be otherwise supported on or with respect to the head of a person can are reduced relative to the embodiments described above with respect to FIGS. 1-11, for example.

An electrical cable 304 may provide electrical power and image signals to the respective image sources 224L, 224R. Other means may be used for these purposes. For example, a battery power supply may be mounted on the headgear 302 and/or housing 211; and other means may be used to couple image or information signals to the image sources 224, e.g., radio or optical transmission, etc. The image signals may be provided by optical cable or some other means from a remote source and those optical image signals may be directed to the focusing optics 221 for forming a real image at the retro-reflector 223. Various other equivalent means may be used to provide power and a source of image signals.

The embodiment of display and viewing system 210 as a number of advantages and distinctions from the system 10. The head box becomes inherently large. It is possible to look directly through the beamsplitter 222 to see images and objects essentially the same as one would see them when looking through a clear medium, such as glass or plastic. As will be evident from the description hereof, images from the image sources 224 will be directed to the eyes of the person or apparatus wearing or using the system 210 only when light 224b is incident on a retro-reflector. That portion of the system 210 which would be mounted on the head is relatively lighter weight because there is no need to support the retro-reflector thereon.

When a user looks in a direction other than at a retro-reflector, the image(s) from the image source(s) 224 will not be returned and all that is seen is a view of the "outside world". Additionally, the headgear 302 and system 210 not only permit an unobstructed view of the outside world, but also accomplishes this with enough eye relief to allow the user easily to wear eye glasses. This is particularly beneficial if the user requires bifocals, in which case if the user looks down, the beamsplitter 222 is not encountered at all. Therefore, the bifocal eye glasses permit the user to perform close-up tasks as normal and, if desired, to look up through the beamsplitter toward a retro-reflector material to see the image(s) originating from the images source(s) 224.

The image reflected by the retro-reflector 223 for viewing by a user of the system 210 is relatively private due to the conjugate optical paths along which light travels from the image source(s) via the beamsplitter(s) to the retro-reflector and then back via the retro-reflector to the eye(s) of the user. The retro-reflector preferably has relatively little beam spread so other people in a room, for example, may not even know that a user is seeing an image reflected by a retro-reflector in the room.

In using the system 210, a user wears the housing 211 on which the two image sources 224L, 224R, which may be considered, in combination with the respective focusing optics 221, projectors 305 (e.g., 305L, 305R for left and right eye images, respectively) in view of the fact that they project light. The headgear 302 may be adjusted for comfortable fit. A retro-reflector is placed anywhere the user wishes to see an image. For example, if the user is sitting at a desk, the retro-reflector may be placed flat on the desk similar to a piece of paper. Alternatively, the retro-reflector could be oriented in a position similar to the front of a computer monitor or other type of display device. The user would see the image only when looking at the retro-reflector. It is only in this circumstance that the light emitted by a projector(s) (image source 224 and focusing optics 221) would be returned to the user's eye(s). When the user looks in another direction, the projector image is not returned, and all that is seen is a view of the outside world.

Since there are two projectors 305L, 305R, the image can be stereoscopic or three dimensional. To get a good quality stereoscopic imagery, it is necessary that the right eye image not be seen by the left eye and vice versa. In order to assure that this is the case consideration may be given to the design of the system 211, as follows. The light returned from the retro-reflector 223 actually has some small divergence, e.g., on the order of a few milliradians, as the retro-reflector likely would not be a perfect retro-reflector that reflects all incident light precisely along respective perfect conjugate optical paths. This spread in the reflected or returned light beam means that there is a maximum distance between the user and the retro-reflector for which the images to the eyes do not overlap, as is illustrated in FIG. 15. In the illustration of FIG. 15, it will be appreciated that all light emanating from the left projector 305L and directed as light 227bL toward the retro-reflector is reflected by the retro-reflector 223 as light 227cL to the left eye 13L; and even though there is some beam spread of light reflected by the retro-reflector, none of the spread light reaches the right eye 13R. Similarly the light from the right projector 305R is directed to the right eye 13R and does not reach the left eye.

However, as is illustrated in FIG. 16, there is relatively more beam spread that occurs in the light reflected by the retro-reflector 223 because the retro-reflector is further from the housing 211 than is the case in the illustration of FIG. 15. The increased beam spread also or additionally may be due to a lower quality retro-reflector in the illustration of FIG. 16 than that used in the illustration of FIG. 15. In FIG. 16 it is seen that light 227bL (the light envelope of which is represented solid lines) is directed from the left projector 305L to the retro-reflector 223. However, the light reflected by the retro-reflector 223 as light 227cL spreads in a sufficiently wide pattern that some is received by the left eye 13L but some also is received by the right eye 13R. Similarly, in the illustration of FIG. 16 light from the right projector 305R may be spread sufficiently wide as to be received upon reflection by the retro-reflector 223 also by the left eye 13L.

The overlapping images degrades the operation of the system 210 for stereoscopic image viewing. Therefore, when the viewed images are to provide stereoscopic views, it is desired that the left and right eye images would not overlap. This can be accomplished, for example, by using a relatively good quality retro-reflector with small beam spread or by locating the retro-reflector remotely of the housing 211 but sufficiently close so that the beam spread does not result in image overlap.

For the user to see a relatively sharp image it usually is necessary for the projector(s) 305 to be focused on the plane of the retro-reflector 223, e.g., to focus a real image there. If the retro-reflector to user distance is relatively fixed, then the focus of the system 210 can be set up at the time of initial use. However, if the situation is such that the system 210 is to be used in a variety of retro-reflector to user distance conditions, then a manual adjustment can be provided to adjust the focus of both focusing optics systems 221L and 221R separately or simultaneously in order to obtain the desired focusing mentioned. Such manual focus control adjustment 309 is shown schematically in FIG. 17.

As also is shown in FIG. 17, an automatic focus control can be provided. An automatic focus control device, such as that used in a conventional automatic focusing camera, may be used for this purpose as is indicated at 310. The automatic control 310 may include an ultrasonic emitter and detector 311 which may be mounted on the headgear 302, for example, or elsewhere to provide a measurement or detection of the distance of the retro-reflector from the focusing optics 221L, 221R. The time required for a round trip pulse allows the calculation of the distance. The focusing optics or lenses 221L, 221R can be adjusted to proper focus by the focus control 312 according to such distance information. Other types of distance measuring and/or control devices also may be used in accordance with this focusing feature of the invention.

Although the system 210 shown in FIGS. 12-17 show use of two projectors 305L, 305R, it will be appreciated that a single projector may be used to develop the images. The images may be provided in field sequential fashion to alternate eyes using optical dividing devices, such as reflectors and beamsplitters, not shown, in order to obtain stereoscopic images. Alternatively, the images to the left and right eyes may be essentially the same and produced either in field sequential manner or simultaneously to obtain a planar (non-stereoscopic) image for viewing in the manner described herein.

Accommodation may be used, for example, in the system 210 of FIGS. 12-17. Accommodation describes the ability of the human eye to adjust its focus to various distances. This ability is used by the brain as an added cue in depth perception. If this cue is a variance with other depth cues such as vergences (stereo parallax) the brain will be confused, leading to eye strain and an increased susceptibility to motion sickness. It is, therefore, desirable in 3-D display systems for all of the cues to be in agreement with one another. There also should be agreement between the camera system and the display system. The vergence is controlled by the spacing and toe-in of the cameras which pick up the images and projectors, such as those at 305L and 305R, which display the images from the cameras for viewing. These can easily be set in agreement. The accommodation is controlled by the focus of the camera lens. This can be set to the focal distance of the objects of interest by one of the standard auto-focus methods. All that is then required for proper accommodation is that the focus of the respective projector (305L, 305R, for example) be set the same as that of the camera.

An auto-focusing lens, such as that conventionally used with CCD cameras, takes an electronic signal generated by the camera and uses it to control a servo motor inside of the lens. This motor controls the position of the optical elements of the lens, which in turn determines the distance to the object plane. The images of objects which are located at this distance, will be in focus at the CCD element. The algorithm for generating this signal is built into the hardware of the camera and is commercially available.

The signal which controls the lens on the camera can also be used to control the projection lens of a conjugate optics projector, such as lenses 221L, 221R, for example. If the same focal length lens is used for both the camera and the projector, then signal can be fed directly to both lenses. The lens to LCD (224L, 224R, for example) distance of the projector will be servo locked, equal to the lens to CCD distance of the camera. As a result, the image distance for the projector will always be the same as the object distance for the camera. In general, because the CCD and LCD elements are not the same size, different focal length lenses will be used on the camera and projector. This will require some electronic processing of the signal going to the projector lenses 221L, 221R, for example, in order to correctly scale their positions, and such processing may be easily carried out.

In order for the user of the conjugate optics system 210, for example, including an accommodation feature, to see the projected image in focus, the retro-reflector 223 should be placed reasonably close to the image plane. If the retro-reflector is located at fixed distance from the projection lens, the useful range will be restricted. Alternatively, the position of the retro-reflector could be changed to follow the focal plane of the projector. This would be difficult to do with a remote retro-reflector. But, if an extra lens 400, called a conjugation lens, is added between the beamsplitter 222 and the retro-reflector 223, then the retro-reflector can be moved quite close to the projector. See FIG. 18 for an illustration of the geometry. An image of the LCD 224 is focused at a point 401 in the far field by the projection lens 221. Normally the retro-reflector would be located at this point. When the conjugation lens 400 is introduced, it refocuses the image to a point 402 much closer. The retro-reflector is now placed at this new image plane. The nature of the retro-reflector 223 is to return any ray of light impinging on it, back along the same path to its source. As it passes back through the conjugation lens 400, the ray is returned to the same path it would have followed had the retro-reflector been placed at the original image plane and the conjugation lens removed. The viewer sees the same image with either system. The advantage of the close retro-reflector of FIG. 18 is that the refocused image plane moves only a short distance as the original image plane moves from infinity to the near field. This short travel means that the position of the retro-reflector 223 can be easily controlled by a servo which is linked back to the servo that controls the projection lens 221. The relationship (sometimes referred to as a transfer function) between the projector lens image distance and the retro-reflector position is given by the formula: ##EQU1## Where: D=The distance between the conjugation lens and the retro-reflector (see FIG. 18)

C=The distance between the conjugation lens and the LCD (see FIG. 18)

F.sub.1 =The focal length of the projection lens

F.sub.2 =The focal length of the conjugation lens

R=The distance projection lens and its image focal plane (see FIG. 18)

FIG. 19 provides a graphical example of this transfer function.

In view of the foregoing, it will be appreciated that the present invention may be used to display images for viewing by using conjugate optics and accommodation techniques.