US 6,518,939 B1Grant
Image observation apparatus
Issue Date:2003-02-11
•2 Claims
•28 Drawing Sheets
Abstract
This image observation apparatus comprises: a head-mounted image display unit for displaying images, derived from video signals supplied to itself, on image display units corresponding to observer's left and right eyes respectively; a computer having specifications suitable to production of images displayed on the head-mounted image display unit and including an output part for outputting video signals expressing the images; and a controller being inserted in a signal transmission line between the computer and head-mounted image display unit and performing operator's optional operation regarding supply aspects of the video signals from the computer to the head-mounted image display unit.
Metadata
Assignee
- Olympus Optical Co., Ltd.
Inventor
- Kumi Kikuchi
Application Information
Application Number:US 08/965,142
Filing Date:1997-11-06
Priority Date:1996-11-08
Art Unit:7
Classifications
IPC:
G09G 500H04N 1300G02F 11335A63F 1300
Field of Search:
348 53348 51349 11349 13349 14349 15359630359631359632
Patent Drawings (28 sheets)
Description
Background of the Invention
[0002] 1. Field of the Invention
[0003] The present invention relates to an image observation apparatus, and more particularly, improvement of an image observation apparatus such that it can be easily performed for a small scale apparatus to create three-dimensional (hereinafter, 3D) images and process images of games and so on.
[0004] 2. Related Background Art
[0005] FIG. 44 among drawings incorporated in this application shows an example of work flows for creating motion pictures with using 3D images. First, object data (basic data) is created at process P1, and at the next process P2, an animation work, that is, a motion picture creation work is performed. Subsequently, at process P3, a final rendering work, i.e., a complete motion picture creation work is performed. Motion picture data created at process P3 is recorded on a recording medium or media at process P4 as a recording work. These works are common in this field.
[0006] For example, when 3D images are created, the works in the above-mentioned object data creation process (process P1 are shown in FIG. 49. The works contain providing two image-sensing apparatus (camera L and camera R) in line, taking an image of a subject with each camera, and recording a pair of image L and image R in respective recording apparatus (video deck L and video deck R). Then, this recorded pair of images becomes animation data of a live-action having a binocular parallax.
[0007] On the other hand, for example, as the works in the object data creation process, two works are performed. The first work of them is to create a pair of images, one image to be played back for a left eye and the other to be done for a right eye, every frame by a computer and the like respectively (so-called computer graphics (CG)). This produced pair of images is made to be animation data, and the next work is to create a final animation on the basis of this data. Further, the pair of animation images having a binocular parallax is recorded on separate recording apparatuses respectively.
[0008] With further elaborating, for example, as a procedure for producing 3D images in the CG, first, in an object data producing process P1 shown in FIG. 44, the image data regarding the fundamental skelton of the object is produced in rough polygons, that is, a small number of polygons. In addition, simple color data is also set.
[0009] Next, animation data regarding the image data produced in the above-mentioned process P1, is produced in the animation work performed in the process P2. In this work, popular application software for edition of animation and the like are used. After completion of this edition of the animation, the final rendering work is performed in the next process P3.
[0010] In the process P3, the final rendering work is performed every screen frame. Thus, with forming a minute shape with a plenty of polygons, setting of proper color data such as texture mapping is performed.
[0011] The image data completed in this manner is recorded in the recording work in the process P4. That is, the image data is outputted from a computer for edition to a recording apparatus such as a video deck conforming to a common standard, for example, VHS or β-cam, the image data which is recorded on a recording medium such as a video recording tape by the recording apparatus.
[0012] In addition, when a 3D image is produced with using live-action data, its procedure is as follows.
[0013] First, it is performed to sense the images of an object. With using two video camera recorders (VCRs) and the like, an image for a right eye that should be played back to only the right eye (hereinafter called an R image) and an image for a left eye that should be played back to only the left eye (hereinafter called an L image) are sensed respectively at the same time.
[0014] These images sensed in this manner are played back to left and right eyes respectively with synchronizing the R image and L image with each other. Further, by confirming 3D effects such as an offset quantity (described later), it is checked whether proper 3D images could be sensed. Thus, this confirms whether proper 3D image-sensing was performed. Then, until the recorded images become proper ones, after revising, for example, a sensing position of the VCR, the distance between the VCR and object, and the like, the processes of image-sensing and playback check are repeated. Although these processes are the work corresponding to the process P2 shown in FIG. 44, it is possible to produce a 3D image in only the above-mentioned processes of the image-sensing and playback check in case of live-action data.
[0015] Here, 3D images using a binocular parallax will be described below with reference to FIGS. 45-48 among drawings incorporated in this application.
[0016] An image for a left eye, referred to as code L in FIG. 45, and an image for a right eye, referred to as code R are images of object data taken or created by supposing the case that a single object, shown as a round object in FIG. 46 is observed by observer's left and right eyes respectively.
[0017] If the image for a left eye, L and the image for a right eye, R are played back independently to observer's left and right eyes and are displayed on display means such as an LCD, observer's left and right eyes, as shown in FIG. 46 look at a virtual image screen of display means (LCD etc.) in a playback apparatus. However, in this time, object data on the virtual image screen of the display means, that is, two object data of the image for the left eye, L and the image for the right eye, R can be observed as a single object by being recognized as an identical object (this phenomenon is called “fusion”).
[0018] In addition, in order to enable an object to be observed as if it protruded in this side, i.e., to enable the object to be observed three-dimensionally, a pair of images L and R of object data are taken or created, the pair of images being composed of an image for the left eye, L and an image for the right eye, R, as shown in FIG. 47. In this case, positions of the two object data composed of the image for the left eye, L and the image for the right eye, R are mutually reversed on a virtual image screen of display means (LCD etc.) as shown in FIG. 48. Owing to this, the object image being recognized as an identical object by observer's eyes is observed as if the object protruded in this side by an offset quantity shown in FIG. 48.
[0019] Furthermore, heretofore, taking or creating object data during above-mentioned works for creating 3D images is composed of the following works. The first work is to provide two independent cameras, that is, a camera to take an image for the left eye, L and another camera to take an image for the right eye, R as shown in FIG. 49, in line to a subject. The second work is to record a pair of images (an image for the left eye, L and an image for the right eye, R) taken with respective cameras L and R, in two independent recording apparatuses, that is, a video deck L for recording the image for the left eye, L and a video deck R for recording the image for the right eye, R. These images are recorded on separate recording media, which are used as basic data (animation data having a binocular parallax).
[0020] Moreover, reference codes La and Ra shown in FIG. 49 show angles of view of image pickup optical systems for cameras L and R, i.e., ranges where images can be taken, and the angle of view of the camera L, La and the angle of view of the camera R, Ra are set to become approximately equal and to overlap each other. In addition, by providing this overlapped part, 3D sense to a subject included in this range can be obtained.
[0021] Furthermore, conventionally, confirmation of 3D images of the object data (basic data) taken or created, and recorded as described above is performed as follows.
[0022] Thus, as shown in FIG. 50, for example, the above-mentioned confirmation of the 3D images at the time of creating the images is performed by playing the image for the left eye, L and the image for the right eye, R simultaneously back with two individual video decks L and R keeping synchronization, and outputting respective image signals to two video camera recorders (VCRs) each having a recording and playback function, L and R. Furthermore, respective images L and R are displayed separately for observer's left and right eyes on finder parts for confirmation of the 3D images which are observation means and display means, both of which are provided in these video camera recorders L and R, and each comprise a display unit such as a liquid crystal display (LCD) and a CRT.
[0023] In this manner, it is requested to advance production with confirming every time the 3D images are taken or created in the process of creating the object data (P1), the animation process (P2), the final rendering process (P3) and so on as described above in FIG. 44.
[0024] There are various items to be confirmed at the time of image production such as what extent of 3D sense is adequate, whether verve is sufficient, and whether the pair of left and right images has parallax to disable images to fuse (excessively large parallax). Further items are whether the balance of offset amounts in the longitudinal direction is adequate among images in former and latter scenes when scenes are connected by editing respective images, and so on.
[0025] The above-mentioned requirement, that is, the requirement to advance works with confirmation at the time of image production becomes stronger in the case of using the 3D images to be produced in games, amusements, entertainment, etc., and in particular, in the case of desiring to obtain images having enough presence.
[0026] On the other hand, various types of image-sensing apparatuses (systems) for taking 3D images have been proposed.
[0027] For example, the 3D image-sensing apparatus disclosed in Japanese Unexamined Patent Publication No. 7-75134 comprises a camera apparatus composed of a pair of left and right small cameras, a controller for controlling the position of this camera apparatus, a monitor unit for displaying images taken with the camera apparatus respectively, etc.
[0028] In addition, the monitor unit is provided with a pair of small monitors respectively displaying the images from the pair of left and right small cameras, and eye-cups internally having lenses to enlarge the images taken with the camera apparatus and to enable an observer to observe 3D images.
[0029] Furthermore, the camera apparatus can be moved in the up and down directions and the left and right directions by the controller, and hence, an observer can easily observe images in the desired direction by controlling the position of the camera apparatus with the controller.
[0030] On the other hand, recently, so-called computer games, each of which is run by displaying a motion picture on a screen of a TV set, or a display unit of a personal computer (PC) and the like (hereafter, a display and the like) have been in the market.
[0031] These games have various types of content. For example, as shown in FIG. 51, a game has a long screen frame, a displayed screen scrolls vertically (Y arrow directions shown in FIG. 51), and the game proceeds, for example, by shooting down enemy fighters in turn. Another game, as shown in FIG. 52 has a wide screen frame, a displayed screen scrolls horizontally (X arrow directions shown in FIG. 52), and the game proceeds, for example, by falling enemy characters in turn.
[0032] Therefore, conditions such as an optimal screen frame size, and an aspect ratio of the screen are different every game, the conditions being not only for most enjoying each game but also for producing better comfortableness and presence.
[0033] In addition, in a game where emphasis is put on speed sense, the game can be sufficiently enjoyed even if CPU's processing is set for speed to acquire the priority and quality of display images is set low. However, in a game where emphasis is put on contents of the game (story) and/or display images of game characters including motion pictures themselves, it is better for further enjoying the game to set the display images at precise images.
[0034] Then, when each of various types of game software is created, it is desirable to use a display and the like for confirming images, which are similar to the display and the like for playing the game, regarding a screen frame size, an aspect ratio, picture quality, etc.
[0035] However, presently, in case of home video games that are enjoyed personally at usual home, it is common to use home TV sets as displays and the like for them. Owing to this, it is usual that the screen frame size, aspect ratio, picture quality and the like cannot be set and changed in conditions suitable to contents of various types of games. Therefore, various types of current game software are produced with scarcely considering change of various parameter settings.
[0036] On the other hand, in order to make it possible to enjoy any types of games, a dedicated display and the like, having a high resolution screen and a large screen frame, may be provided. However, since this type of display is extremely expensive and also requires a broad space, this is not practical.
[0037] Above problems are common not only at home, but also in amusement parks, gaming centers, and development sites of game software.
[0038] Then, recently, head-mounted types of display units such as so-called head-mounted displays (HMDs), each of which is mounted on observer's head with the display covering from his/her head to his/her face, have been proposed as small-sized displays for displaying images and using for various types of games.
[0039] For example, a display for games, disclosed in Japanese Unexamined Patent Publication No. 4-33679 comprises an image projection unit and a light path changing member (mirror) arranged for directing image display light, projected from this image projection unit, toward a predetermined direction. Furthermore, the image projection unit comprises: optical image display means having a display screen to display images corresponding to image signals from the main frame of a game machine; and an optical member to project the image display light projected from the display screen toward the light path change member (mirror).
[0040] According to this, it becomes possible to be absorbed in the world of games (atmosphere) since surrounding unnecessary information can be cut off. Moreover, it is also possible to reduce eye fatigue and lowering of vision by adaptively keeping the distance between eyes and display images.
[0041] In addition, a shooting toy, disclosed in Japanese Unexamined Patent Publication No. 5-180595, comprises a mock gun, a goggle, and a cable transmitting signals between the mock gun and the goggle. Its control means judges hitting on the basis of a trigger signal from the mock gun and the status of a signal received by infrared ray receiving means. Meanwhile, the control means judges that the game player is hit when the infrared ray receiving means of the goggle receives a predetermined infrared signal, and then, the control means makes the display means display information of hitting, being hit, etc. on a part of glass in the goggle.
[0042] However, as described above, during producing the 3D images, if two separate image-sensing/playback apparatuses are used, the confirmation and revision of the once-recorded images must be performed by operating the two separate image-sensing apparatuses simultaneously, and hence, this toy has a problem that this requires time and labor for performing the creation work of the object data.
[0043] Furthermore, in order to take an image similar to an object image when an observer looks at the object with naked eyes, it is necessary to arrange two cameras L and R so that the pupil distance, that is, the distance between both eyes may be approximately equal to the space between two cameras L and R (base-line length; normally, the base-line length is set nearly 50-70 mm and the average length is 65 mm) for taking the image. Furthermore, it is also necessary to install two cameras L and R so that the installed angles of two cameras L and R may meet with the angle of convergence of eyes, when the observer looks at the object image with naked eyes, that is, the angle within which observation ranges of left and right eyes overlap each other.
[0044] Obtaining such fine 3D images requires many setting items of image-sensing conditions regarding the arrangement of two cameras L and R for sensing images. Hence, this toy has another problem that, if two image-taking cameras are separate, setting of the image-sensing conditions becomes especially complex.
[0045] In addition, if the 3d images in production are confirmed, the finder parts of two video camera recorders L and R separately located are arranged, as conventionally performed. However, this has still another problem that it is extremely difficult to achieve the arrangement due to mutual physical interference of both arranged finder parts.
[0046] Furthermore, this has a further problem that observing or confirming the 3D images with a conventional liquid crystal shutter (hereinafter, an LC shutter) type of eye glasses requires a special work of recording the 3D images L and R again for converting to field-sequential images, and hence, this is inefficient due to consumption of time and cost.
[0047] Still more, a system, comprising cameras, video decks, etc. (refer to FIG. 50), for observation (confirmation) of the 3D images is composed of the system which is different from units for production of the 3D images such as a computer. Therefore, for confirming the 3D images produced by this computer and the like, it is necessary to move from the installed position of the computer and the like for production of the images to the display units fixedly installed at the different position, that is, the finder parts of the cameras L and R (refer to FIG. 50). Hence, this has an additional problem that working efficiency decreases.
[0048] Furthermore, since this requires two image-sensing apparatus, the entire system becomes large, and hence, this has another problem that it is difficult not only to keep a location for installing the system including two image-sensing apparatus, but also to carry and use the system.
[0049] Moreover, according to means disclosed in Japanese Unexamined Patent Publication No. 7-75134, its structure becomes large similarly to that of the image-sensing apparatus exemplified in FIG. 49 and the observation system exemplified in FIG. 50. Therefore, it is difficult to carry and use this apparatus, and hence, it seems that object data can not be easily created using this apparatus.
[0050] In addition, if it is performed to create and process an image for the left eye and an image for the right eye separately using two separate computers, it becomes necessary to take a pair of left and right created images with two image-sensing apparatuses. Therefore, this apparatus may become a larger system.
[0051] On the other hand, a head-mounted display and the like disclosed in the above-mentioned Japanese Unexamined Patent Publication No. 4-33679 and Japanese Unexamined Patent Publication No. 5-180595 do not display information about adequate screen frame and the like corresponding to the contents of various types of games. However, these displays are dedicated ones to respective games, and hence, in these specific games, these displays can be used optimally. However, if they are used in other games, presence in the games may be insufficient, and comfortableness of playing the games may be reduced.
[0052] In addition, a head-mounted display can be easily used as a small display for playing various types of games, a display for confirming images at the time of creating various types of game software, and the like. However, since it is impossible to see the surrounding status with wearing this type of head-mounted display, it is difficult and complex to perform various settings of this display itself such as adjustment of the pupil distance and adjustment of visibility, etc. This is another problem.
[0053] Furthermore, if a game player does not understand or does not know how to operate the game to be started, the player can not refer to its operation manual with wearing this head-mounted display, which is an additional problem.
[0054] Still more, if an unexpected accident such as power failure when a game is being played, the game in progress will be interrupted at that time. Therefore, the progress status and results of the game just before the power failure may be deleted without being stored in a recording medium such as memory.
Summary of the Invention
[0055] It is a first object of the present invention to provide an image observation apparatus that not only can easily confirm 3D images when the 3D images are created, but also can display the images on a large screen, and further that is small and has superior portability.
[0056] In addition, it is a second object of the present invention to provide an image observation apparatus that can be easily set and modified (for example, on an aspect ratio, picture quality, etc.) when display images of a game and the like are displayed.
[0057] Further more, it is a third object of the present invention to provide an image observation apparatus that can be easily set on the apparatus itself such as adjustment of a pupil distance and adjustment of visibility even if a head-mounted display is worn.
[0058] Still more, it is a fourth object to provide an image observation apparatus that does not require an operation manual after wearing a head-mounted display by displaying the operation method of a game to be started on the image display unit of the image observation apparatus.
[0059] Moreover, it is a fifth object of the present invention to provide an image observation apparatus that can securely protect the progress status and the like of a game when power supply to the apparatus is interrupted during using the apparatus for a game and the like.
[0060] In short, an image observation apparatus according to the present invention is characterized in comprising: a head-mounted image display unit (HMD) for displaying images, derived from video signals supplied to itself, by an image display unit corresponding to observer's eyes; a computer having specifications suitable to the production of images displayed on the head-mounted image display unit, and including an output part for outputting an video signal expressing the images; and a controller being inserted in a signal transmission line between the computer and the head-mounted image display unit and performing operator's optional operation regarding supply aspect of the video signals from the computer to the head-mounted image display unit.
[0061] Therefore, the head-mounted image display unit of the image observation apparatus according to the present invention displays images, derived from video signals supplied to itself, by the image display unit corresponding to observer's eyes; the computer produces images to be displayed by the head-mounted image display unit and outputs the video signal expressing the images from the output part; and the controller is inserted in the signal transmission line between the computer and the head-mounted image display unit and performs operator's optional operation regarding supply aspect of the video signal from the computer to the head-mounted image display unit.
[0062] In addition, an image observation apparatus according to the present invention is characterized in comprising: a head-mounted image display unit for displaying images, derived from video signals supplied to itself, by an image display unit corresponding to observer's eyes; and a controller being capable of selectively mounting a recording medium storing image data having a binocular parallax, performing operator's optional operation to image data read from the mounted recording medium, and supplying a video signal, corresponding to the image data performed the operation, to the head-mounted image display unit.
[0063] Therefore, the head-mounted image display unit of the image observation apparatus according to the present invention displays images, derived from video signals supplied to itself, by an image display unit corresponding to observer's eyes; and the controller can selectively mount a recording medium storing image data having a binocular parallax, performs operator's optional operation to image data read from the mounted recording medium, and supplies a video signal, corresponding to the image data performed the operation, to the head-mounted image display unit.
[0064] These and other objects and advantages of the present invention will become more apparent from the following detailed description.
[0065] According to the present invention, it is possible not only to easily confirm 3D images when the 3D images are created, but also to display the images on a large screen, and further, to provide an image observation apparatus having a small shape and excellent portability.
[0066] In addition, according to the present invention, it is possible to provide an image observation apparatus facilitating various settings and changes such as an aspect ration and picture quality when images of games and the like are displayed.
[0067] Furthermore, it is possible to provide an image observation apparatus facilitating various settings of the apparatus itself such as adjustment of a pupil distance and a parallax even if a head-mounted display is worn.
[0068] Still more, it is possible to provide an image observation apparatus not requiring to refer to an operation manual after wearing a display unit by making an image display part of the image observation apparatus display operation methods for a game to be started.
[0069] In addition, it is possible to provide an image observation apparatus capable of securely protecting the progress status of a game if power supply to the apparatus is interrupted when the apparatus is used for the game.
Brief Description of the Drawings
[0070] FIG. 1 is a schematic diagram showing the structure of a first embodiment according to the present invention;
[0071] FIG. 2 is a schematic perspective view showing appearance of a head-mounted image display unit used for the image observation apparatus shown in FIG. 1;
[0072] FIG. 3 is a conceptual drawing for explaining parameters set in rendering software;
[0073] FIG. 4 is also a conceptual drawing for explaining parameters set in rendering software;
[0074] FIG. 5 is a flow chart showing a process of playback operation when 3D images created are confirmed during production of the 3D images using the image observation apparatus shown in FIG. 1;
[0075] FIG. 6 is a block diagram showing a signal converter in a controller which is used for the image observation apparatus shown in FIG. 1;
[0076] FIG. 7 is a block diagram showing a modified example of the signal converter in the controller which is used for the image observation apparatus shown in FIG. 1;
[0077] FIG. 8 is a drawing exemplifying display images in the case that video signals displayed respectively on an image display unit for a left eye and an image display unit for a right eye are not synchronized by the field:
[0078] FIG. 9 is a schematic diagram showing the structure of a second embodiment of the image observation apparatus according to the present invention;
[0079] FIG. 10 is a schematic perspective view showing appearance of a controller used for the image observation apparatus shown in FIG. 9;
[0080] FIG. 11 is a block diagram showing a sync circuit located in the controller used for the image observation apparatus shown in FIG. 9;
[0081] FIG. 12 is a flow chart showing a sequence for playback and display of images which is applied when a production work of 3D images is performed by the image observation apparatus shown in FIG. 9;
[0082] FIG. 13 is a flow chart showing a sequence for switching of image display modes which is applied when a production work of 3D images is performed by the image observation apparatus shown in FIG. 9;
[0083] FIG. 14 is a schematic diagram showing the structure of a third embodiment of the image observation apparatus according to the present invention;
[0084] FIG. 15 is a block diagram simply showing the structure of the image observation apparatus shown in FIG. 14;
[0085] FIG. 16A is a conceptual drawing showing states when a video signal for a left eye is read and displayed in the image observation apparatus shown in FIG. 14;
[0086] FIG. 16B is a conceptual drawing showing states when a video signal for a right eye is read and displayed in the image observation apparatus shown in FIG. 14;
[0087] FIG. 17 is a schematic drawing showing the structure of a fourth embodiment of the image observation apparatus according to the present invention;
[0088] FIG. 18 is a block diagram simply showing the structure of the image observation apparatus shown in FIG. 17;
[0089] FIG. 19 is a partially enlarged perspective view showing only one side of display units constructing an image display unit of a head-mounted image display unit used in the image observation apparatus shown in FIG. 17;
[0090] FIG. 20 is a drawing for explaining operation of the display unit of the image display unit constructing the head-mounted image display unit in the image observation apparatus shown in FIG. 17 and for showing the state of displaying a long screen frame;
[0091] FIG. 21 is a drawing for explaining an operation of the display unit of the image display unit constructing the head-mounted image display unit in the image observation apparatus shown in FIG. 17 and for showing the state of displaying a wide screen frame;
[0092] FIG. 22 is a partially enlarged perspective view showing a modified example of the fourth embodiment of the present invention, and showing a display unit constructing an image display unit of a head-mounted image display unit used in the image observation apparatus;
[0093] FIG. 23 is a partially enlarged perspective view showing only LCD unit constructing an image display unit used in the image observation apparatus shown in FIG. 22;
[0094] FIG. 24 is a side view of the LCD unit and an optical unit used in the image observation apparatus shown in FIG. 22, the view being a conceptual drawing showing light paths where light radiated by a back light and images displayed on the LCD unit reach at observer's eye;
[0095] FIG. 25 is a drawing showing a modified example of the fourth embodiment of the present invention, the drawing being a schematic side view of the head-mounted image display unit;
[0096] FIG. 26 is a partially enlarged perspective view simply showing only one side of display units constructing an image display unit of the head-mounted image display unit shown in FIG. 25;
[0097] FIG. 27 is a conceptual drawing showing the structure of a fifth embodiment of the image observation apparatus according to the present invention;
[0098] FIG. 28 is a schematic diagram showing the display unit constructing the image display unit of the head-mounted image display unit in the image observation apparatus shown in FIG. 27, the diagram showing the state of the display unit being set in a low resolution mode;
[0099] FIG. 29 is a schematic diagram showing the display unit constructing the image display unit of the head-mounted image display unit in the image observation apparatus shown in FIG. 27, the diagram showing the state of the display unit being set in a high resolution mode;
[0100] FIG. 30 is a drawing showing an example of display images being observed if the low resolution mode is set in the image observation apparatus shown in FIG. 27;
[0101] FIG. 31 is a drawing showing an example of display images being observed if the high resolution mode is set in the image observation apparatus shown in FIG. 27;
[0102] FIG. 32 is a flow chart showing operation performed when a picture quality mode is selected at the time of observing the images displayed by the image observation apparatus shown in FIG. 27;
[0103] FIG. 33 is a conceptual drawing showing the structure of a sixth embodiment of the image observation apparatus according to the present invention;
[0104] FIG. 34 is a drawing exemplifying the image data of an online manual and the like that is stored in memory means in the controller of the image observation apparatus shown in FIG. 33, the drawing showing display images regarding the explanation of the mounting method of the head-mounted image display unit;
[0105] FIG. 35 is a drawing exemplifying the image data of an online manual and the like that is stored in memory means in the controller of the image observation apparatus shown in FIG. 33, the drawing showing display images regarding the explanation of the adjusting and setting methods of the head-mounted image display unit;
[0106] FIG. 36 is a flow chart showing the operation of the image observation apparatus shown in FIG. 33;
[0107] FIG. 37 is a conceptual drawing showing the structure of a seventh embodiment of the image observation apparatus according to the present invention;
[0108] FIG. 38 is a drawing for explaining the operation of displaying images (a game and the like) that is performed by the image observation apparatus shown in FIG. 37, the drawing showing Picture “a” in the case that Pause button is pushed;
[0109] FIG. 39 is a drawing for explaining the operation of displaying images (a game and the like) that is performed by the image observation apparatus shown in FIG. 37, the drawing showing a display image regarding explanation of “operation of a control Pad” among display images regarding guide information;
[0110] FIG. 40 is a drawing for explaining the operation of displaying images (a game and the like) that is performed by the image observation apparatus shown in FIG. 37, the drawing showing a display image regarding explanation of “operation of characters” among display images regarding guide information;
[0111] FIG. 41 is a conceptual drawing showing the structure of a eighth embodiment of the image observation apparatus according to the present invention;
[0112] FIG. 42 is a drawing showing image data of a “game saving” confirmation screen that is stored in memory means included in a controller of the image observation apparatus shown in FIG. 41;
[0113] FIG. 43 is a flow chart showing the operation of the image observation apparatus shown in FIG. 41;
[0114] FIG. 44 is a flow chart showing a conventional work flow for performing the production of 3D images;
[0115] FIGS. 45 and 46 are conceptual drawings for explanation of 3D images using a binocular parallax;
[0116] FIGS. 47 and 48 are other conceptual drawings for explanation of 3D images using a binocular parallax;
[0117] FIG. 49 is a conceptual drawing showing the operation of image-sensing of basic data in a conventional object data creation process;
[0118] FIG. 50 is a conceptual drawing showing the operation of 3D image confirmation that is performed at the time of conventional motion picture creation;
[0119] FIG. 51 is a drawing for exemplifying a display image showing an example of conventional games, the drawing showing a game proceeding by a display screen scrolling vertically (Y arrow directions); and
[0120] FIG. 52 is a drawing for exemplifying a display image showing an example of conventional games, the drawing showing a game proceeding by a display screen scrolling transversely (X arrow directions).
Detailed Description of the Preferred Embodiments
[0121] FIG. 1 is a schematic diagram showing a first embodiment of an image observation apparatus according to the present invention. The below-described first embodiment of the image observation apparatus is an example of producing 3D images and confirming the 3D images created during this production work, using this image observation apparatus.
[0122] Thus, this image observation apparatus comprises: a head-mounted image display unit 1 that is made to display images, derived from video signals supplied to itself, respectively on an image display unit corresponding to observer's eyes; a computer 3 (L and R) having specifications suitable to the production of images displayed on the head-mounted image display unit 1, and including an output part for outputting video signals expressing the respective images; and a controller 2 being inserted in a signal transmission line between the computer 3 and the head-mounted image display unit 1 and performing operator's optional operation regarding supply aspects of the video signals from the computer 3 to the head-mounted image display unit 1.
[0123] The above-mentioned computer 3 are composed of two sets of computers, that is, a computer 3L mainly processing a video signal for a left eye, and a computer 3R mainly processing a video signal for a right eye, both video signals being included in video signals forming the 3D images. These computers 3L and 3R are network-linked with a cable 3a. In addition, the specifications of the computers 3L and 3R are approximately similar.
[0124] The computer 3 (L and R) comprises: a computer mainframe 3dhaving a control circuit and the like constructed with a CPU and so on; a display 3ethat is display means for a work for displaying a video signal; and a keyboard 3fthat is command input means for inputting a command and the like to the control circuit in the computer mainframe 3dby operator's optional operation. Further, a video signal (for example, S-Video signal, VGA signal, etc.) outputted from the computer mainframe 3dis outputted to the controller 2 via a cable 3bwhose terminal is connected to an output part.
[0125] In addition, a video signal is outputted from the output part of the computer 3 (L and R) to the controller 2 while synchronization of output timing of video signals for left and right eyes is secured by a timing controller that is a sync circuit provided in the computer 3 (L and R).
[0126] Furthermore, an audio signal is also outputted from the computer mainframe 3dto the controller 2 via a cable 3cwhose terminal is connected to the output part of the computer mainframe 3d. Still more, this audio signal may be outputted from the computer mainframe 3dof either the computer 3L or the computer 3R. Because, the computers 3L and 3R are network-linked. FIG. 1 shows a case that the cable 3cfor transmitting the audio signal is connected to the computer 3L.
[0127] In addition, the computer 3 (L and R) has built-in software for various types of image processing (not shown) such as modeling software for creation of original images (basic data), software for edition and production of original images, and rendering software for edition and production of final images. Furthermore, large size of memory (not shown) is securely kept so as to perform above-mentioned image processing, that is, various types of calculation and data processing.
[0128] Further, the above-mentioned rendering software can perform the following processing for original image data (basic data) of an object produced by modeling software:
[0129] 1) Polygon; A figure that is expressed by triangles, into which 3D data is transformed in computer graphics (CG) and the like.
[0130] 2) Solid model; one of 3D expressions in CG, also having data of contents surrounded by 3D planes.
[0131] Thus, for example, when the original image data of an object is processed as 3D images using rendering software, it is possible to display the object from various points of view, and hence, it is possible to freely express the object according to camera angles and positions of the object.
[0132] Further elaborating, as shown in FIG. 3, if profile (image) data of an object 5 is created to create 3D images, assume that images of the object 5 are sensed with, for example, two image-sensing apparatuses (cameras) 4L and 4R arranged side by side. Then, a pair of images, that is, image data for the left eye, L and image data for the right eye, R are created, the pair being obtained respectively by image-sensing apparatuses (cameras) 4L and 4R virtually installed.
[0133] In this case, in the above-mentioned rendering software, a user can optionally set an observation point (camera angle, etc.), a point of regard (distance to the object), the distance between cameras (base-line length; reference code D shown in FIG. 3), an installation angle of cameras (angle corresponding to an angle of convergence of both eyes; reference code A shown in FIG. 4), and the like.
[0134] In addition, the gap between the virtual cameras 4L and 4R (base-line length D), as described above, is usually set to be nearly 50-70 mm (average: 65 mm). Because this number is an average value of human pupil distances, and by setting the gap between cameras in this manner, it becomes possible to obtain natural image data similar to naked eyes.
[0135] In this manner, the above-mentioned rendering software can express various types of 3D image sense by making the observation points, the installation angle, and the like of the virtual cameras 4L and 4R parameters.
[0136] FIG. 2 is a schematic perspective view showing appearance of a head-mounted image display unit used for a first embodiment of an image observation apparatus.
[0137] As shown in FIG. 2, the head-mounted image display unit 1 comprises: a member for image display, 1a, that is, a body incorporating an image display unit and the like; a frame part 1bconnected to this body 1a; a forehead pressing part 1dbeing a supporting part provided on an upper front central part of the body 1a; a head band 1cbeing a supporting part provided in a side contacting to a head; a temple supporting part 1eprojecting from the vicinity of a position, where the frame part 1bis connected to the body 1a, to both temples being rear sides of both ears, and being supporting parts having leaf springs being elastic members; and speakers 1fbeing prolonged from the vicinity of the front portion of the base edge of this temple supporting part 1eto the downward slanting and backward direction and being provided at positions facing to both ears.
[0138] An image display unit corresponding to observer's eyes and having LCDs is provided in the body 1a. This image display unit displays images derived from video signals outputted from the output part of the computer 3 (L and R) to the head-mounted image display unit 1 via the controller 2 (details will be described below).
[0139] Regarding the above-mentioned image display unit, a pair of image display units is formed separately for a left eye and a right eye respectively. Therefore, video signals for the left and right eyes are displayed on respective image display units separately.
[0140] In addition, the head-mounted image display unit 1 has a so-called see-through function that makes it possible to selectively switch the images displayed on the image display unit and the outside world. This see-through function has two operation modes as follows. A first operation mode is for observing the images, derived from the video signals to this head-mounted image display unit 1, with shutting off the field of view to the outside world. In addition, a second operation mode is for securing only the field of view to the outside world. Furthermore, this function can selectively use these two modes.
[0141] Thus, this function makes it possible to selectively see the images and the outside world by making an liquid crystal (hereinafter called LC) shutter (not shown in FIG. 2) in the head-mounted image display unit 1 shut off or changing the transparency of the image display unit by adjusting the degree of open-close of the LC shutter. Therefore, by making this function effective, it becomes easy to perform other operation even if this head-mounted image display unit 1 is worn.
[0142] On the other hand, as described above with referring to FIG. 1, the controller 2 is inserted in the signal transmission line between the computer 3 (L and R) and the head-mounted image display unit 1. In addition, the video signals and the audio signal outputted from the output part of the computer 3 (L and R) are inputted to the controller 2 via cables 3band 3c.
[0143] Furthermore, this controller 2 can switch the supply modes of the video signals, inputted from the computer 3 (L and R) to the head-mounted image display unit 1, by operator's optional operation. Here, the switchable supply aspects of the video signals to the head-mounted image display unit 1 are, for example, as follows:
[0144] 1) A mode for displaying only the images derived from the video signal for a left eye on both display units for left and right eyes.
[0145] 2) A mode for displaying only the images derived from the video signal for a right eye on both display units for left and right eyes.
[0146] 3) A mode for displaying the images derived from the video signal for a left eye on the image display unit for a left eye, and displaying the images derived from the video signal for a right eye on the image display unit for a right eye, respectively.
[0147] Still more, the controller 2 is provided with a signal converter converting the video signals for left and right eyes, inputted from the computer 3, to signals displayed respectively on the image display units for left and right eyes in the head-mounted image display unit 1. This signal converter will be described below with reference to the block diagram of FIG. 6.
[0148] In addition, signal conversion performed by this signal converter is, for example, conversion of an interlaced signal to a non-interlaced signal.
[0149] As shown in FIG. 6, the video signals for left and right eyes (S-Video signals are exemplified in FIG. 6), which are inputted from the computers 3 (L and R) to the controller 2, each are divided into a set of RGB signals and a sync signal by each sync separator 2min the signal converter.
[0150] Furthermore, after each set of RGB signals is converted from analog signals to digital signals by an A/D converter 2n, the set of RGB signals is stored in a memory unit 2pincluding frame memory. On the other hand, each sync signal is stored in the memory unit 2pafter it is inputted to a TG (timing generator) 2tthrough a PLL (phase-locked loop) 2s. Simultaneously, the signal is supplied to an LCD driver 1m(L and R) of the head-mounted image display unit 1 as an H (horizontal clock) signal and a V (vertical clock) signal.
[0151] Then, the video signals stored in the memory unit 2pare outputted to the LCD driver 1m(L and R) after they are converted from the digital signals to the analog signals with a D/A converter 2r.
[0152] Thus, the above-mentioned TG 2tcontrols the timing when the video signals inputted are read from and written to the memory unit 2p.
[0153] In addition, the above-mentioned signal converter in the controller 2 is composed of two signal converter respectively for left and right eyes, and they separately process video signals for left and right eyes respectively. Therefore, it is possible to display the video signals, which are outputted from the computers 3 (L and R), as 3D images on the image display units (LCD) in of the head-mounted image display unit 1, if the timing controller in the computers 3 outputs the video signals to the controller 2 by securing synchronization of the output timing within the allowance of one frame.
[0154] Furthermore, in FIG. 6, signal lines between the head-mounted image display unit 1 and the controller 2, that is, signal lines of video signals (RGB signals) for left and right eyes and synchronous signals corresponding to them, i.e., H and V signals are shown separately. However, these signal lines can be gathered in a cable.
[0155] Playback operation for confirming the produced 3D images, which is performed during producing the 3D images in the first embodiment of the image observation apparatus constructed in this manner, will be simply described below with reference to the flow chart of FIG. 5.
[0156] As shown in FIG. 5, first, a playback command is inputted by an operator to the computer 3 through a keyboard 3ffor either of the computers 3L or 3R at step S1, the command being used for playing image data derived from the desired video signals, for example, CG data back. Then, the process goes to the next step S2.
[0157] Here, the computers 3L and 3R are network-linked as mentioned above, and hence, if the playback command is inputted from either keyboard 3f, the playback command is sent also to the other computer 3R (or 3L) through the present computer 3L (or 3R). Therefore, the computers 3L and 3R become as if the playback command were inputted to them simultaneously.
[0158] Next, the computer 3 starts playing the image data (for example, CG) derived from the desired video signals, that is, outputting the images played back from respective video signals for left and right eyes, at step S2. Then, the process goes to the next step S3.
[0159] When the image data derived from video signals are played back at step S2, the playback outputs of respective video signals for left and right eyes are synchronized with each other on output timing at step S3 by the timing controller (not shown) that is a sync circuit provided in the computer 3. Then, the process goes to the next step S4.
[0160] At step S4, the output part of the computer 3 outputs the image data (CG data) derived from the video signals to the controller 2 as, for example, S-Video signals, and then, the process proceeds to the next step S5.
[0161] The video signals (S-Video signals) outputted from the computer 3 at step S4 are inputted via the controller 2 to the head-mounted image display unit 1 at step S5. Then, the LCD drivers driving the image display units of the head-mounted image display unit 1 are driven, and the process goes to the next step S6.
[0162] In addition, after the LCD drivers make the image display units of the head-mounted image display unit 1 display the images derived from the desired video signals at step S6, a series of steps is completed (END).
[0163] As described above, according to the first embodiment, the image display apparatus, which is display means for displaying images, are head-mounted. Therefore, it is possible for a small-sized system to display the images on a large screen, and also to provide the image observation apparatus having a small shape and excellent portability.
[0164] Furthermore, it is possible to easily perform the confirmation work of the produced 3D images, which is executed during production of the 3D images, without interrupting the image production work.
[0165] Still more, since the head-mounted image display unit 1 has the see-through function, it is possible to optionally switch the field of view to the outside world and the image display easily, when image production work is performed. Thus, by switching the head-mounted image display unit 1 to the second mode with wearing this head-mounted image display unit 1, it becomes possible to secure the field of view to the outside world. Hence, it becomes also possible to perform various works such as operation of the keyboards 3f, and image confirmation on the displays 3eduring a work. On the other hand, by switching the head-mounted image display unit 1 to the first mode, it becomes possible to easily shut off the field of view to the outside world, and to instantly confirm the produced 3D images. Therefore, this embodiment can contribute to increase of the work efficiency.
[0166] In addition, since the timing controller, which is a sync circuit, is provided in the computer 3, video signals for left and right eyes, which are outputted from the output part of the computer 3, are securely synchronized with each other and outputted. Hence, fine display images can be observed.
[0167] Furthermore, in the above-mentioned first embodiment, two signal converters are separately provided in the controller 2 for separately processing respective video signals for left and right eyes. However, so as to construct the controller 2 in low cost, it is conceivable to construct each timing control circuit (PLL and TG are corresponding to this in FIG. 6) in a single circuit, and further to adopt field memory, which is cheaper than the frame memory, as memory units.
[0168] Here, FIG. 7 is a block diagram showing a modified example of the signal converter in the controller which is used for the above-mentioned first embodiment of the image observation apparatus. As shown in FIG. 7, this modified example has the construction fundamentally similar to that of the signal converter of the controller 2 described above in FIG. 6. Therefore, the same reference codes will be assigned to the similar members and their description will be omitted.
[0169] In this modified example, the video signals (S-Video signals are exemplified in FIG. 7) for left and right eyes, which are inputted from the computer 3 (L and R) to the controller 2a, are inputted to the sync separator 2min the signal converters respectively. In this sync separator 2m, at least either the video signal for a left eye or the video signal for a right eye (the video signal for a left eye is exemplified in FIG. 7) is separated into RGB signals and a sync signal. The RGB signals among these separated signals are converted from analog signals to digital signals by the A/D converter 2n, and thereafter they are stored in the memory unit 2pincluding field memory and constructing a part of the circuits for left eye. On the other hand, the sync signal is stored in the memory unit 2p, constructing both circuits for left and right eyes, via the timing controller 2t.
[0170] In addition, the other video signal (the video signal for a right eye is exemplified in FIG. 7) is outputted to the A/D converter 2nvia the sync separator 2m. After the video signal is converted from an analog signal to a digital signal by this A/D converter 2n, the video signal is stored in the memory unit 2p, constructing a part of circuits for a right eye.
[0171] Then, the sync signal in the timing controller 2tis supplied to the TG (timing generator) 1pin the head-mounted image display unit 1, which is connected with connecting means such as a flexible printing circuit board, as an H (horizontal clock) signal and a V (vertical clock) signal.
[0172] Next, RGB signals stored in both memory units 2pfor left and right eyes are read respectively with the sync signal in the timing controller 2t, and they are outputted to the D/A converters 2rfor left and right eyes respectively. Then, after each RGB signal is converted from a digital signal to an analog signal by this D/A converter 2r, each RGB signal is outputted to the RGB driver 1m(L and R) of the LCD driver (not shown in FIG. 7; refer to FIG. 6) in the head-mounted image display unit 1, which is connected with a flexible printing circuit board and the like.
[0173] On the other hand, the sync signal is outputted from the TG 1pto each RGB driver 1m(L and R) of the LCD driver, and each RGB driver 1m(L and R) outputs the RGB signal to each of the image display units (LCD) for left and right eyes, 1nwith securing synchronization. Owing to this, it becomes possible to display images as 3D ones.
[0174] In addition, if the above-mentioned modified example of the signal converter is adopted, video signals for left and right eyes, which are inputted to the controller 2aby the computer 3 (L and R), must be synchronized with each other by the field.
[0175] Thus, if they are not synchronized by the field, video signals displayed respectively on the image display unit for a left eye, 1n(L) and the image display unit for a right eye, 1n(R) of the head-mounted image display unit 1 are not synchronized with each other. Therefore, as shown in FIG. 8, the image displayed for a left eye (the image displayed on the LCD 1n(L)) and the image displayed for a right eye (the image displayed on the LCD 1n(R)) are shifted in time. Owing to this, these images can not be fused, and hence, 3D images can not be recognized.
[0176] As described above, according to the structure of the above-mentioned modified example, it is possible not only to obtain the effect similar to that of the above-mentioned first embodiment, but also to facilitate constructing the controller 2ain lower cost.
[0177] In addition, since this example has the timing generator in the head-mounted image display unit 1, images are displayed on the image display units with securing synchronization of the video signals for left and right eyes. Therefore, fine display images can be observed.
[0178] Next, a second embodiment of the present invention will be described below.
[0179] FIG. 9 is a schematic diagram showing the second embodiment of the image observation apparatus. Similarly to the above-mentioned first embodiment of the image observation apparatus, this second embodiment of the image observation apparatus is an example of producing 3D images and confirming the 3D images created during this production work, using this image observation apparatus.
[0180] Thus, this image observation apparatus comprises: a head-mounted image display unit 1A that is made to display images, derived from video signals supplied to itself, respectively on image display units corresponding to observer's eyes; a computer 3 (L and R) having specifications suitable to the production of images displayed on the head-mounted image display unit 1A, and including an output part for outputting video signals expressing the respective images; and a controller 2A being inserted in a signal transmission line between the computer 3A and the head-mounted image display unit 1A and performing operator's optional operation regarding supply aspects of the video signals from the computer 3A to the head-mounted image display unit 1A.
[0181] The above-mentioned computer 3A comprises: two computer mainframes, that is, a computer mainframe 3A(L) comprising controllers including a CPU and mainly processing a video signal for a left eye, and another computer mainframe 3A(R) similarly comprising controllers including a CPU and mainly processing a video signal for a right eye, both video signals being included in video signals forming the 3D images; and a key board 6 that is command input means for inputting a command and the like to the controllers of the computer mainframes 3A (L and R) by an operator's optional operation.
[0182] The above-mentioned keyboard 6 is electrically connected to not only the above-mentioned two computer mainframes 3A(L and R) with cables 3grespectively, but also the controller 2A (details will be described later; refer to FIG. 10). A change-over switch 6ais provided in the keyboard 6, the switch being interlocked with a display change-over switch 2Aa(refer to FIG. 10, too) that is a first switch of the controller 2A.
[0183] In short, although each computer mainframe 3dhas an independent keyboard 3fin the above-mentioned first embodiment; two above-mentioned computer mainframes 3A (L and R) can be operated with a keyboard by selectively switching the computer mainframes 3A (L and R), in the second embodiment.
[0184] In addition, video signals (for example, S-Video signals, VGA signals, etc.) are outputted from the output part of the computer 3A (L and R) to the controller 2A via cables 3bwhose terminals are connected to the output part respectively.
[0185] In addition, similarly to the above-mentioned first embodiment, the computer 3A (L and R) has built-in software for various types of image processing such as modeling software, software for image edition, and rendering software. Furthermore, large size of memory (not shown) is securely kept so as to perform these types of image processing, that is, various types of calculation and data processing regarding image information.
[0186] Furthermore, other specifications of the computer 3A (L and R) are similar to those of the computer 3 (L and R) in the first embodiment, and hence, detailed description of them will be omitted.
[0187] On the other hand, the controller 2A connects to not only two above-mentioned computers 3A (L and R) and the keyboard 6, but also the head-mounted image display unit 1A.
[0188] This head-mounted image display unit 1A is fundamentally the same as that of the first embodiment. However, near both temple parts of the body in the second embodiment of the head-mounted image display unit 1A, as shown in FIG. 9, change-over switches 1Aaand 1Abare provided. They have functions similar to those of the display change-over switch 2Aathat is a first switch of the controller 2A and an outside-world-image change-over switch 2Abthat is a second switch (these will be described later in detail; refer to FIG. 10). Owing to them, it becomes possible to switch display aspects of images to be displayed on the image display units of the head-mounted image display unit 1A, and to switch display aspects of videos and an outside-world image.
[0189] In addition, this second embodiment has not a display that is display means in the above-mentioned first embodiment and is used as a display unit for works. Alternatively, only the head-mounted image display unit 1A serves both as the display unit for works and a display unit (monitor) for confirming a 3D image produced.
[0190] FIG. 10 is a schematic perspective view showing appearance of the controller used for the second embodiment of the image observation apparatus, and is a drawing when viewed from a front operation panel.
[0191] As shown in FIG. 10, the display change-over switch 2Aaand the outside-world-image change-over switch 2Abare provided on one edge of the front operation panel of the controller 2A. Here, the switch 2Aais an operation part of a switching circuit for switching display aspects of images to be displayed on the image display units of the head-mounted image display unit 1A. Further, the switch 2Abswitches the see-through function of the head-mounted image display unit 1A and the like.
[0192] In addition, a volume control dial 2Adis provided on the other edge of the operation panel of the controller 2A. The control dial 2Adcontrols the sound volume of an audio signal that is outputted from the output part of the above-mentioned computer 3A (L and R), inputted to the controller 2A, and outputted to a speaker (refer to FIG. 2; reference code is 1f) of the head-mounted image display unit 1A.
[0193] Furthermore, a status display unit 2Acis provided on the operation panel of the controller 2A where the display unit 2Acis located between the above-mentioned display change-over switch 2Aaand outside-world-image change-over switch 2Ab, and the above-mentioned volume control dial 2Ad. Here, the status display unit 2Acinterlocks with the switching operation of the above-mentioned display change-over switch 2Aaand outside-world-image change-over switch 2Ab, displays the status of each switch, and includes, for example, LEDs (light-emitting diodes).
[0194] Still more, the above-mentioned display change-over switch 2Aa, as described above, is a switch for switching the display aspects of images to be displayed on the image display units of the head-mounted image display unit 1A. The switch 2Aacan switch the display aspects sequentially, for example, as follows:
[0195] 1) L MONITOR: A first display aspect of displaying a video signal for a left eye, supplied from the computer 3A(L), on the image display units (LCDs) corresponding to left and right eyes respectively.
[0196] 2) R MONITOR: A second display aspect of displaying a video signal for a right eye, supplied from the computer 3A(R), on the image display units (LCDs) corresponding to left and right eyes respectively.
[0197] 3) L/R MONITOR: A third display aspect of displaying both video signals for left and right eyes, supplied from the computer 3A (L and R), on the image display units (LCDs) corresponding to left and right eyes respectively.
[0198] In addition, the LED of the status display unit 2Ac, which corresponds to this selected aspect, is lit as interlocking with this switching.
[0199] Furthermore, following Table 1 shows the relation between the above-mentioned display change-over switch 2Aaand respective display aspects, that is, the above-mentioned first, second, and third aspects when images are displayed on the image display units for left and right eyes.
| TABLE 1 |
|---|
[0200] In addition, “2D” shown in this Table 1 means that an image displayed in first and second display aspects is plane, that is, two-dimensional. Further, “3D” means that an image displayed in a third display aspect is three-dimensional.
[0201] On the other hand, the outside-world change-over switch 2Abis a switch for switching the see-through function and the like of the head-mounted image display unit 1A. Therefore, this switch 2Ab, similarly to the above-mentioned display change-over switch 2Aa, can switch the operation modes sequentially, for example, as follows:
[0202] 1) NORMAL: A first operation mode for observing an image derived from video signals supplied to the head-mounted image display unit 1A with view of the outside world being cut out.
[0203] 2) SEE THROUGH: A second operation mode in which the see-through mode becomes available, wherein only the view of the outside world is secured.
[0204] 3) SUPER IMPOSE: A third operation mode in which the super impose mode becomes available, wherein it becomes possible to see an image derived from video signals supplied to the head-mounted image display unit 1A with the view of the outside world being overlapped.
[0205] In addition, the LED of the status display unit 2Ac, which corresponds to this selected mode, is lit as interlocking with this switching.
[0206] In addition, the example shown in FIG. 10 represents the status that the display change-over switch 2Aais set to “L MONITOR”, and the outside-world change-over switch 2Abis to “SEE THROUGH”.
[0207] Furthermore, a sync circuit is incorporated in the controller 2A, and hence, owing to this, video signals for a left eye and for a right eye, which are supplied from two computers 3A(L and R), are synchronized with each other. This sync circuit will be simply described below with reference to the block diagram shown in FIG. 11.
[0208] As shown in FIG. 11, a signal relating to an image (image signal) in a video signal for a left eye (a composite signal is exemplified in FIG. 11) is inputted to the A/D converter. After converted from an analog signal to a digital signal, the image signal is stored in a memory unit constructing a part of circuits for a left eye. At the same time, a sync signal in the video signal for a left eye is stored in the memory unit through a PLL(phase-locked loop).
[0209] On the other hand, a sync signal for reading can switch Gen Lock signals for a left eye and for a right eye. Owing to this, it becomes possible to secure synchronization of a video signal for a right eye by using the video signal for a left eye as a reference signal. Thus, a Gen Lock circuit is constructed.
[0210] Here, it will be simply described below with reference to flow charts shown in FIGS. 12 and 13 how to perform image playback for confirming a produced 3D image during a production work of the 3D image. In addition, it is exemplified how to render a video signal for a left eye with the computer 3A(L).
[0211] First, a sequence for switching image display modes will be described below with reference to FIG. 13. As shown in FIG. 13, it is confirmed at step S21 whether the display change-over switch 2Aaof the controller 2A was operated (is its status on?). Thus, by an operator operating the display change-over switch 2Aa, a display mode of images to be displayed on the image display units of the head-mounted image display unit 1A is selected. In consequence, if the display change-over switch 2Aais on, and hence, it is determined that a display mode is selected, the process goes to the next step S22.
[0212] At step S22, the controller 2A makes an LED, which corresponds to the selected display mode, light. Here, since rendering the video signal for a left eye is exemplified, the LED of the status display unit 2Ac, which corresponds to “L MONITOR”, is lit by the operator pushing the display change-over switch 2Aaof the controller 2A. Owing to this, the image derived from the video signal for a left eye can be displayed on both image display units (LCDs) for a left eye and for a right eye that are included the head-mounted image display unit 1A. Then, the process goes to the next step S23.
[0213] At step S23, interlocking with operation of the display change-over switch 2Aaof the controller 2A at the above-mentioned step S22, the change-over switch 6aof the keyboard 6 is switched so as to correspond to the display mode selected at the above-mentioned step S21. Here, the change-over switch 6aof the keyboard 6 becomes available as a keyboard for the computer 3A(L). Then, the process goes to the next step S24, where a sequence for playback and display of images that is shown in FIG. 12 is executed.
[0214] Next, when the process moves to the sequence for playback and display of images (FIG. 12), the operator inputs a playback command to the computer 3A(L) through the keyboard 6 at step S11 for playing image data derived from the video signal, for example, CG picture data back. Then, the process goes to the next step S12.
[0215] Subsequently, at step S12, playback operation of the image data for a left eye, derived from the desired video signal, is started, and the process goes to the next step S13. At this step S13, the image data for a left eye is outputted. At the next step S14, the image data for a left eye is converted from a digital signal to an analog signal by the D/A converter in the computer 3A(L). The image data is thereafter outputted from the output part of the computer 3A(L) to the controller 2A, and the process goes to the next step S15.
[0216] At step S15, the image data for a left eye, inputted from the output part of the computer 3A(L) to the controller 2A at step S14, is securely synchronized by the sync generator in this controller 2A. Thereafter, the image data is outputted to the head-mounted image display unit 1A, and the process goes to the next step S16.
[0217] The LCD drivers for driving the image display units of the head-mounted image display unit 1A are driven at step S16, and the process moves to the next step S17. At this step S17, the LCD drivers make both image display units (LCDS) for a left eye and for a right eye display the image, derived from the video signal for a left eye, simultaneously, and a series of steps is completed (RETURN).
[0218] In addition, the source of the images displayed on the image display units (LCDs) for a left eye and for a right eye that are included in the head-mounted image display unit 1A is the video signal for a left eye. However, since the images are securely synchronized by the sync generator in the controller 2A at the above-mentioned step S15, flicker of screens and the like does not make observation of the images difficult. Therefore, an observer observes plane images (two-dimensional images) with left and right eyes.
[0219] As described above, according to the second embodiment, only the head-mounted image display unit 1A is used as display means for the computers 3A(L and R). Therefore, not only the display means can be simplified and minimized, but also image production works and confirmation of the produced images can be easily performed.
[0220] In addition, it becomes possible to easily select a display mode of video signals displayed on the image display units of the head-mounted image display unit 1A by switching the display change-over switch 2Aaof the controller 2A. Hence, it is possible to observe each of display aspects by optionally switching them with wearing the head-mounted image display unit 1A. Therefore, this embodiment can contribute to increase of work efficiency.
[0221] Further, although it is not described here in details, it is needless to say that it is possible not only to optionally observe the images, but also to produce and revise the object data with observing each of monitors used in computer mainframes 3A (L and R).
[0222] Furthermore, the change-over switch 6aof the keyboard 6 is simultaneously switched with interlocking with the switching operation of the display change-over switch 2Aa, and hence, the display mode of the head-mounted image display unit 1A corresponds to the status of the keyboard 6. Therefore, it is possible to prevent misoperation such as mistake of the keyboard, which arises in case of using two keyboards.
[0223] Still more, since the single keyboard 6 is used by two computer mainframes 3A(L and R) through optionally switching them, the keyboard 6 as command input means is commonly used between two computer mainframes 3A(L and R). Therefore, this embodiment can contribute to simplification of the entire apparatus's construction and reduction of manufacturing cost.
[0224] In addition, similarly to the first embodiment, each dedicated keyboard can be provided for each computer mainframe. In this case, it becomes necessary not only to network-link two computer mainframes 3A(L and R), but also to provide a keyboard to each computer mainframe. However, it is not necessary to provide for each keyboard the change-over switch 6ainterlocking with the operation of the display change-over switch 2Aaof the controller 2A. Therefore, it becomes possible to omit a circuit for interlocking with the controller 2A and an electric circuit for status display of the keyboard 6 itself.
[0225] Next, the third embodiment of the present invention will be described below.
[0226] FIGS. 14 and 15 are drawings showing the outline of this third embodiment of the image observation apparatus, FIG. 14 is a schematic diagram showing this image observation apparatus, and FIG. 15 is a block diagram simply showing this image observation apparatus. In addition, this third embodiment of the image observation apparatus is an example of using this apparatus for playing a game and the like.
[0227] As shown in FIG. 14, this image observation apparatus comprises: a head-mounted image display unit 1B for displaying images, derived from video signals supplied to itself, on image display units corresponding to a left eye and a right eye of an observer respectively; and a controller 2B, into which a game card 8 being a memory medium where image data having a parallax are stored can be selectively inserted, and which supplies video signals, corresponding to the operated image data, to the head-mounted image display unit 1B by an operator operating image data with a control pad 7 that is operation means for the operator optionally operating image data read from the inserted game card 8.
[0228] The controller 2B has construction fundamentally similar to the controller 2A used in the second embodiment of the image observation apparatus. Thus, as shown in FIG. 14, the display change-over switch 2Baand the outside-world-image change-over switch 2Bbare provided on one edge of the front operation panel of the controller 2B. Here, the switch 2Bais an operation part of a switching circuit for switching display aspects of images to be displayed on the image display units of the head-mounted image display unit 1B. Further, the switch 2Bbswitches the see-through function of the head-mounted image display unit 1B and the like.
[0229] In addition, a volume control dial 2Bdis provided on the other edge of the operation panel of the controller 2B. The control dial 2Bdcontrols the sound volume of audio signals that are stored in a game card 8 and outputted from the speakers (refer to FIG. 2 reference code is 1f) of the head-mounted image display unit 1A.
[0230] Furthermore, a status display unit 2Bcis provided between the above-mentioned display change-over switch 2Baand outside-world-image change-over switch 2Bb, and the above-mentioned volume control dial 2Bdwhich are located on the operation panel of the controller 2B. Here, the status display unit 2Bcinterlocks with the switching operation of the above-mentioned display change-over switch 2Baand outside-world-image change-over switch 2Bb, displays the status of each switch, and includes, for example, LEDs (light-emitting diodes).
[0231] Still more, the above-mentioned display change-over switch 2Ba, as described above, is a switch for switching the display aspects of images to be displayed on the image display units of the head-mounted image display unit 1A. The switch 2Bacan switch at least two display aspects sequentially, for example, as follows:
[0232] 1) 2D: A display aspect of displaying two-dimensional video signals, supplied by a game card 8, on the image display units (LCDs) of the head-mounted image display unit 1B corresponding to left and right eyes respectively.
[0233] 2) 3D: A display aspect of displaying image data, having a binocular parallax and being supplied by a game card 8, on the image display units (LCDs) of the head-mounted image display unit 1B corresponding to left and right eyes respectively.
[0234] In addition, the LED of the status display unit 2Bcon the operation panel of the controller 2B, which corresponds to this selected aspect, is lit as interlocking with this switching.
[0235] In addition, the outside-world change-over switch 2Bbis a switch for switching the see-through function and the like of the head-mounted image display unit 1B, and has the same function as that of the above-mentioned display change-over switch 2Abof the second embodiment.
[0236] Further, the example shown in FIG. 14 represents the status that the display change-over switch 2Bais set to “2D”, and the outside-world-image change-over switch 2Bbis to “SEE THROUGH”.
[0237] On the other hand, the controller 2B has a game card 8, which is a memory medium storing image data having a binocular parallax and is selectively located in the attachable and detachable manner. Further, the controller 2B is connected to the head-mounted image display unit 1B and a control pad 7 for operator's optional operation.
[0238] The head-mounted image display unit 1B is approximately similar to that of the above-mentioned second embodiment fundamentally. Thus, change-over switches 1Baand 1Bb, provided in the vicinity of both temples of the body constructing the third embodiment of the head-mounted image display unit 1B, have functions similar to those of the above-mentioned display change-over switch 2Baand outside-world-image change-over switch 2Bbof the controller 2B. Owing to this, it becomes possible to switch the display aspects of images to be displayed on the image display units of the head-mounted image display unit 1B, and to switch video images and the outside-world image using the see-through function and the like.
[0239] In addition, as shown in FIG. 15, the controller 2B includes: a control circuit (computer) having a CPU and controlling this entire image observation apparatus; a video controller (IC) sequentially reading the image data stored in the game card 8 and converting the image data into video signals; an LCD driver for driving the image display units (LCDs) that are display elements of the head-mounted image display unit 1B, and making the image display units display images derived from the video signals; a speaker controller for controlling volume of the speakers in the head-mounted image display unit 1B; and a power supply (not shown in FIG. 15).
[0240] Furthermore, the game card 8 includes memory means 8acomposed of ROMs and the like. This memory means 8asuccessively stores image data having a binocular parallax, that is, image data L composed of a video signal for an left eye and image data R composed of a video signal for an right eye, respectively.
[0241] Still more, if a display aspect is set to be the “3D” mode by the display change-over switch 2Baof the controller 2B or the change-over switch 1Ba, image data for a left eye and for a right eye are alternately read in the field sequential method. Then, the image data are converted to video signals, and thereafter, a 3dimage is displayed using the image display units of the head-mounted image display unit 1B.
[0242] Thus, as shown in FIGS. 16A and 16B, first, a video signal for a left eye, L1 (one field; odd field; refer to FIG. 16A) is read from the memory means 8a(refer to FIG. 15) of the game card 8 by the video controller, outputted to and displayed on the image display unit for a left eye. After that, a video signal for a right eye, R1 (one field; even field;refer to FIG. 16B) corresponding to this video signal for a left eye, L1 is read, outputted to and displayed on the image display unit for a right eye.
[0243] Owing to this, between video signals of frame #1, the video signal for a left eye, L1 is displayed on the image display unit for a left eye, the video signal for a right eye R1 is on the image display unit for a right eye, and in consequence, display of one frame is formed. In addition, in this case, the video signal for a left eye, L1 is continuously displayed owing to the memory effect of the LCD while the video signal for a right eye, R1 is read and displayed. Further, the video signal for a right eye, R1 between video signals of frame #1, is continuously displayed while the video signal for a left eye, L2 (one field) in the next frame is read and displayed (refer to the diagonally shaded area in FIGS. 16A and 16B).
[0244] Therefore, on the image display units, corresponding to the observer's left and right eyes respectively, video signals respectively corresponding to the observer's eyes are displayed during one frame time (nearly {fraction (1/30)} sec.), but owing to holding the display during a field, the flicker of the display image is reduced.
[0245] After that, subsequent video signals L and R are alternately outputted in the field sequential method to each of image display units corresponding to a left eye and a right eye. Therefore, it becomes possible to observe a 3D image with the head-mounted image display unit 1B.
[0246] As described above, according to the above-mentioned third embodiment, with inserting into the controller 2B a game card 8 storing image data having the binocular parallax, it becomes easy to switch display modes by switching the display modes to the “3D” mode with the display change-over switch 2Baof the head-mounted image display unit 1B or the change-over switch 1Ba. Further, it is also possible to enjoy games, having 3D images, with a simpler apparatus.
[0247] In addition, since the head-mounted image display unit 1B is adopted as image display means, it becomes possible not only to miniaturize the entire apparatus, but also to let the head-mounted image display unit 1B be in the status of cutting off the outside-world image (the first operation mode) by optionally operating a change-over switch of the controller 2B or head-mounted image display unit 1B, that is, the outside-world-image change-over switch 2Bbor 1Bb. Therefore, it becomes possible to enjoy games having much verve and presence.
[0248] Furthermore, it is possible to easily enjoy various types of desired games by selectively inserting and/or detaching various types of game cards 8 storing image data having different contents to the controller 2B.
[0249] Still more, it is possible to display images supplied from computers in the field sequential method by using an apparatus having construction similar to that of the head-mounted image display unit 1B. In this case, a CRT controller is used.
[0250] Next, the fourth embodiment of the present invention will be described below.
[0251] FIGS. 17 and 18 are drawings showing the outline of this fourth embodiment of the image observation apparatus, FIG. 17 is a conceptual diagram showing this image observation apparatus, and FIG. 18 is a block diagram simply showing this image observation apparatus. In addition, this fourth embodiment of the image observation apparatus is an example of using this apparatus for playing a game and the like, and also, an example of an image observation apparatus capable of changing an aspect ratio of its screen.
[0252] As shown in FIG. 17, this image observation apparatus comprises: a head-mounted image display unit 1C for displaying images, derived from video signals supplied to itself, on image display units corresponding to a left eye and a right eye of an observer respectively; and a controller 2C, into which a game card 8C being a memory medium storing image data and supplementary information to define a display aspect of the image (picture mode) are stored can be selectively inserted, and which supplies video signals, corresponding to the operated image data, to the head-mounted image display unit 1C by an operator operating image data with a control pad 7 that is operation means for the operator optionally operating image data read from the inserted game card 8C.
[0253] A game card 8C is selectively located in the controller 2C in the attachable and detachable manner, and further, connects to the head-mounted image display unit 1C and the control pad 7. In addition, in this fourth embodiment, the above-mentioned control pad 7 is the same as that in the above-mentioned third embodiment.
[0254] A main power switch (POWER SW) 2Caswitching the main power supply to ON or OFF and a reset switch (RESET SW) 2Cbcapable of initializing a game card 8C inserted into the controller 2C are located on the front operation panel of the controller 2C.
[0255] In addition, as shown in FIG. 18, the controller 2C includes: a control circuit having a CPU and controlling this entire image observation apparatus; a game card insertion detecting circuit for detecting the insertion status of a game card 8C; an picture mode control circuit for reading from the inserted game card 8C the supplemental information defining the display aspect (picture mode) of the image and the like, controlling display aspects (picture modes) in the image display units of the head-mounted image display unit 1C with depending on this supplemental information; and display unit drivers, being controlled by this picture mode control circuit, for driving the display units of the head-mounted image display unit 1C, and switching arrangements of display units.
[0256] Furthermore, a game card 8C has memory means 8Caincluding memory such as ROM, the memory means 8Ca, as described above, storing the supplemental information 8Ccdefining the display aspect of the image and image data 8Cbfor forming the image.
[0257] Further, a concrete example of the above-mentioned supplemental information 8Ccis, for example, the information expressing an aspect ratio of the display screen where an observer can observe the image data in a game card 8C in optimum conditions.
[0258] The head-mounted image display unit 1C is fundamentally similar to that of the above-mentioned first embodiment. However, the construction of display units constructing the image display units of the head-mounted image display unit 1C in this fourth embodiment is different from that in the first embodiment.
[0259] Thus, FIG. 19 is a partially enlarged perspective view showing only one unit of display units constructing image display units of the head-mounted image display unit used in the fourth embodiment of the image observation apparatus, the display units being composed of a unit for a left eye and another unit for a right eye that correspond to observer's left and right eyes respectively. Here, although only one unit of the display units constructing the image display unit for left and right eyes is shown, and another unit is omitted, the image display unit of the head-mounted image display unit 1C is composed of a pair of the similar component units.
[0260] As shown in FIG. 19, the display unit 9 includes a liquid-crystal display panel (LCD) and back lights. Hence, the display unit 9 comprises: an image display unit 9efor displaying an image derived from a video signal; and an optical system 9afor guiding a light beam, forming the image displayed by this image display unit 9e, as the image to observer's eyes. In addition, the image display unit 9eand optical system 9aare formed in one piece. Further, a flexible printed circuit board 9dis connected to the above-mentioned image display unit 9e, and a video signal is supplied from the controller 2C to the image display unit 9evia this flexible printed circuit board 9d.
[0261] Furthermore, the display unit 9 has a display unit rotation shaft 9bfor rotating the entire display unit 9, and this rotation shaft has a fixed pinion gear 9c. This pinion gear 9cmeshes with a reduction gear 10a, and this reduction gear 10ais fixed to the rotating shaft of a motor 10 that is driving means and is capable of normal and reverse rotation.
[0262] Therefore, rotary driving power of the motor 10 is transferred to the display unit rotation shaft 9bthrough the reduction gear 10aand pinion gear 9c, and hence, the display unit 9 is rotated.
[0263] In addition, the above-mentioned head-mounted image display unit 1C in this fourth embodiment differing from those in the first, second, and third embodiments, the unit IC has not a change-over switch for an outside-world image regarding the see-through function and the like. Hence, in regard to the outside-world image, a head-mounted image display unit is adopted, the unit having so-called negative types of LC shutters which are normally-closed and common.
[0264] Operation of the fourth embodiment of the image observation apparatus constructed in this manner will be simply described below.
[0265] First, an optional game card 8C is inserted in the controller 2C whose main power switch 2Cais turned on. Then, insertion of the game card 8C is detected by the game card insertion detecting circuit in the controller 2C, and this information is transferred to the CPU in the controller 2C.
[0266] Then, the CPU in the controller 2C issues the information readout command to the picture mode control circuit. Owing to this, the picture mode control circuit reads the supplemental information 8Ccdefining information regarding the picture mode, stored in the memory means 8Caof the inserted game card 8C, such as the display aspect of the image and the like. In addition, the controller circuit controls the display unit drivers in the basis of the read supplemental information, and switches arrangements of the display units 9.
[0267] Thus, the picture mode control circuit reads from the memory means 8Caof the game card 8C the information expressing the aspect ratio of the screen and the like as the supplemental information 8Ccdefining the display aspect and the like of the read image. Further, the control circuit also switches arrangements of the display units 9 on the basis of this supplemental information 8Cc.
[0268] Here, if the information expressing the aspect ratio of the screen, as the supplemental information, is “a wide screen,” the picture mode control circuit, as shown in FIG. 20, rotates the motor 10 (not shown in FIG. 20; refer to FIG. 19) by controlling the display unit driver. Further, the control unit also rotates the display unit rotation shaft 9btoward the direction of the arrow A shown in FIG. 20. Owing to this, the display unit 9 rotates toward the same direction entirely, and in consequence, the unit 9 becomes in the status shown in FIG. 21. Hence, observer's eyes 20 can observe the image in a wide screen frame.
[0269] In addition, if starting a different type of game (a game by a different game card 8C), an observer remove the inserted game card 8C, which is used this time, from the controller 2C, the observer inserts another game card 8C, which will be used next time, into the controller 2C. Then, by pushing the reset switch 2Cb, the controller 2C is initialized without turning the main power switch 2Caoff. Owing to this, the controller 2C detects again insertion of the game card 8C with the game card insertion detecting circuit. Then, the controller 2C reads the supplemental information regarding the display aspect stored in the memory means 8Caof the newly inserted game card 8C. Further, the control circuit also performs similar operation on the basis of this read supplemental information.
[0270] As described above, according to the fourth embodiment, the memory means 8Cain the game card 8C stores supplemental information 8Cc(for example, information of the aspect ratio of the display screen) defining the display aspect (picture mode) and the like of the image beforehand. Then, the supplemental information 8Ccregarding this picture mode is read if it is detected that this game card 8C is inserted into the controller 2C. Next, by rotating the display unit constructing the image display unit on the basis of this read supplemental information 8Cc, the aspect ratio of the screen is controlled. Therefore, it becomes possible to observe the image in the optimum status for the image in the inserted game card 8C, that is, an optimum aspect ratio. Hence, it is possible to enjoy the game with better comfortableness and presence.
[0271] Further, owing to adopting the head-mounted image display unit 1C as the image display means, miniaturization of the entire apparatus can be achieved.
[0272] In addition, although the fourth embodiment performs the control of rotating the entire display unit, the present invention is not limited to this, but it can be conceivable to adopt the construction of that only the image display unit rotates.
[0273] Thus, FIG. 22 is a drawing showing a modified example of the fourth embodiment, and a partially enlarged perspective view simply showing one unit between display units constructing an image display unit for left and right eyes that is a component of a head-mounted image display unit used in the image observation apparatus.
[0274] Further, also in FIG. 22, similarly to FIG. 19, the image display unit of the head-mounted image display unit is composed of a pair of the similar component units, and hence, only one unit between display units constructing the image display unit for left and right eyes is shown, and another unit is omitted.
[0275] In addition, this modified example of the display unit fundamentally has the construction similar to the display unit 9 of the fourth embodiment (refer to FIG. 19). Therefore, the same reference codes will be assigned to the similar members and their description will be omitted.
[0276] As shown in FIG. 22, this modified example of the display unit 9A comprises an LCD panel and back lights. Thus, the display unit 9A comprises: an LCD unit, image display unit 9Aefor displaying an image derived from a video signal; and an optical unit 9Aafor guiding a light beam, forming the image displayed by this image display unit 9Ae, as the image to observer's eyes.
[0277] The optical unit 9Aais fixed in the head-mounted image display unit, and the LCD unit 9Aais located with freely rotating to the optical unit 9Aa. Thus, the LCD unit 9Aehas an LCD unit rotation shaft 9Abfor rotating this LCD unit 9Aeagainst the optical unit 9Aa, and this LCD unit rotation shaft 9Abhas a fixed pinion gear 9c. This pinion gear 9cmeshes with a reduction gear 10a, and this reduction gear 10ais fixed to the rotating shaft of a motor 10 that is driving means and is capable of normal and reverse rotation.
[0278] Therefore, rotary driving power of the motor 10 is transferred to the LCD unit rotation shaft 9Abthrough the reduction gear 10aand pinion gear 9c, and hence, the LCD unit 9Aeis rotated.
[0279] FIG. 23 is a partially enlarged perspective view showing only the LCD unit 9Aeconstructing this modified example of the display unit 9A.
[0280] As shown in FIG. 23, the LCD unit 9Aecomprises: a back light substrate 11b; a back light 11alocated on this back light substrate 11b; an LCD panel 12b; an LCD display part 12alocated on this LCD panel 12b; and a flexible printed circuit board 13 electrically connecting the back light substrate 11band LCD panel 12b.
[0281] Since the irradiation surface of the back light 11ais located toward the optical unit 9Aa(not shown in FIG. 23; refer to FIG. 22), irradiation light from the back light 11aenters from the back side of the LCD display part 12a. After the irradiation light passes through the LCD display part 12a, it is guided into the optical unit 9Aa.
[0282] FIG. 24 is a side view of the LCD unit 9Aeand optical unit 9Aa, and a conceptual drawing showing light paths along which irradiation the light radiated by the back light 11aand the image displayed on the LCD display part 12areach at observer's eye 20.
[0283] As shown in FIG. 24, the optical unit 9Aacomprises a half mirror 15 and a convex mirror 14. On the upper surface of this optical unit 9Aa, the back light 11aand LCD display part 12aconstructing the LCD unit 9Aeare provided. Further, the above-mentioned half mirror 15 is located at the angle of 45° against the irradiation light from the back light 11a.
[0284] In the modified example composed in this manner, the irradiation light from the back light 11apasses the LCD display part 12a, and is irradiated from the upper surface of the optical unit 9Aato the lower side. Owing to this, the image displayed on the LCD display part 12ais illuminated by the irradiation light from the back light 11a.
[0285] Then, the image displayed on the LCD display part 12apasses the half mirror 15, enters to the convex mirror 14, and is condensed by this convex mirror 14. After that, the light reflects on the inclined surface of the back side of the half mirror 15, its path is folded, and the light enters into observer's eye 20. Therefore, observer's eye 20 can observe the image displayed on the LCD display part 12a.
[0286] In addition, operation of the modified example of the image observation apparatus that is constructed is approximately similar to that of the fourth embodiment.
[0287] Thus, the picture mode control circuit (refer to FIG. 18) reads the supplemental information defining the information regarding the picture mode stored in the memory means of the inserted game card, that is, the display aspect and the like. Further, the control circuit also switches arrangements of the LCD unit 9Aeby controlling the display unit driver on the basis of this supplemental information.
[0288] Thus, the picture mode control circuit, as shown in FIG. 22, controls the display unit driver by the supplemental information defining the display aspect of the read image, for example, the information expressing the aspect ratio of the screen to make the driver rotate the motor. In consequence, the control circuit makes the LCD unit rotation shaft 9Abrotate toward the direction of the arrow B shown in FIG. 22. Owing to this, only the LCD unit 9Aerotates toward the direction and becomes in the status shown by the dotted lines in FIG. 22. Therefore, the observer can observe the image in a long screen frame.
[0289] As described above, according to the modified example of the fourth embodiment, it is possible to obtain the effects quite similar to those of the fourth embodiment.
[0290] In addition, since only the LCD unit 9Aeis rotated in this modified example, it is possible to obtain the similar effects with smaller driving power in comparison with the case that the entire display unit 9 is rotated in the fourth embodiment. Further, since the rotating and moving members are small, smaller spaces are enough for the rotating and moving members, and hence, this example can contribute to miniaturization of the apparatus.
[0291] Further, in this modified example, it is possible to locate all the members for rotating and moving the LCD unit 9Aeat positions except the front of the display unit 9. Hence, it is better to use a negative type of LC shutter for the head-mounted image display unit, which is similarly to that for the fourth embodiment and superior in light proof characteristics. However, it is also possible to use a positive type of LC shutter. In this case, it is necessary for the controller and head-mounted image display unit to have the same construction as that of the first, second, and third embodiments, that is, outside-world-image change-over switches 2Bband 1Bb.
[0292] Still more, in the fourth embodiment and its modified example, rotation of the display unit 9 or LCD unit 9Aeis performed by driving members such as the motor 10, but the present invention is not limited to this. For example, it can be acceptable that the motor 10 is deleted, an operation member such as a knob is fixed to the LCD unit rotation shaft, and this operation member is rotated manually.
[0293] FIG. 25 is a drawing showing another modified example of the fourth embodiment of the present invention, the drawing being a schematic side view of the head-mounted image display unit 1D. Further, FIG. 26 is a partially enlarged perspective view simply showing only one unit of display units constructing an image display unit for left and right eyes that is a component of the head-mounted image display unit.
[0294] In addition, also in FIG. 26, similarly to FIGS. 19 and 22, the image display unit of the head-mounted image display unit is composed of a pair of the similar component units, and hence, only one unit between display units constructing the image display unit for left and right eyes is shown, and another unit is omitted.
[0295] As shown in FIGS. 25 and 26, in this modified example, an operation member 16 such as a knob is provided on a display unit 9B located in the head-mounted image display unit 1D with freely rotating toward the directions of the arrow C shown in FIGS. 25 and 26.
[0296] The display unit 9B, similarly to the modified example of the display unit 9A, comprises an LCD panel and a back light. Thus, the display unit 9B comprises: the LCD unit 9Be, and an optical unit 9Bafor guiding a light beam, which forms the image displayed by this LCD unit 9Be, as the image to observer's eyes.
[0297] The optical unit 9Bais fixed in the head-mounted image display unit 1D, and the LCD unit 9Beis located with freely rotating to the optical unit 9Ba. Thus, the LCD unit 9Behas an LCD unit rotation shaft 9Bbfor rotating this LCD unit 9Beagainst the optical unit 9Ba, and this LCD unit rotation shaft 9Bbhas a fixed operation member 16. In addition, in an approximately central portion of the LCD unit rotation shaft 9Bb, a protruding member 16ais provided in the direction orthogonal to the shaft direction of this LCD unit rotation shaft 9Bb.
[0298] Hence, by manually rotating the operation member 16 toward the directions of the arrow C, the LCD unit rotation shaft 9Bbrotates. However, since stopper members 9Bcand 9Bdare provided on the LCD unit 9Bewith extruding, the above-mentioned extruding member 16acontacts to these stopper members 9Bcand 9Bd, and hence, rotation of the LCD unit rotation shaft 9Bbis limited.
[0299] Thus, the LCD unit rotation shaft 9Bbis not only allowed to rotate only within the range between the stopper members 9Bcand 9Bd, but also limited in its position by the stopper members 9Bcand 9Bd.
[0300] As described above, according to another modified example of the fourth embodiment, by controlling the aspect ratio of the display screen through rotating the LCD unit 9Be, an observer can observe the image data of the inserted game card in the optimum aspect ratio of the display screen. Therefore, the observer can enjoy games with better comfortableness and presence.
[0301] In addition, since rotation of the LCD unit 9Becan be optionally operated manually, it becomes possible to omit electric circuits such as the picture mode control circuit and display unit driver (refer to FIG. 18), and driving members such as the motor and reduction gear train. Further, the observer (operator) can optionally select the desired aspect ratio of the screen.
[0302] Furthermore, in this modified example, similarly to the above-mentioned modified example, it is possible to locate all the members for rotating and moving the LCD unit 9Beat positions except the front of the display unit 9. Hence, it is better to use a negative type of LC shutter for the head-mounted image display unit, which is similarly to that for the fourth embodiment and superior in light proof characteristics. However, it is also possible to use a positive type of LC shutter. In this case also, it is necessary for the controller and head-mounted image display unit to have the outside-world-image change-over switches 2Bband 1Bb.
[0303] Next, a fifth embodiment of the present invention will be described below.
[0304] FIG. 27 is a conceptual drawing showing the fifth embodiment of the image observation apparatus. In addition, this fifth embodiment of the image observation apparatus, similarly to the third and fourth embodiments, is an example of using this apparatus for playing a game and the like. Further, this embodiment is also an example of an image observation apparatus capable of changing picture quality of a display image and magnification of the image.
[0305] Furthermore, since this fifth embodiment fundamentally has the similar construction to those of the third and fourth embodiments, description of similar members will be omitted, and only the different members will be described below.
[0306] As shown in FIG. 27, this image observation apparatus comprises: a head-mounted image display unit 1 for displaying an image, derived from video signals supplied to itself, on an image display unit corresponding to a left eye and a right eye of an observer respectively; and a controller 2D, into which a game card 8 being a memory medium storing image data can be selectively inserted, and which performs operator's optional operation to the image data read from the game card 8, and supplies video signals, corresponding to the operated image data, to the head-mounted image display unit 1.
[0307] A picture quality change-over switch 2Daand the like are provided on a front.operation panel of the controller 2D, and two display aspects can be sequentially switched each time the switch 2Dais pushed. The two display aspects are, for example, as follows:
[0308] 1) A low resolution mode in which an image is displayed in high magnification and low pixel density, and speed and power are given priorities (refer to FIG. 30).
[0309] 2) A high resolution mode in which an image is displayed in low magnification and high pixel density, and high definition of the image is given a priority (refer to FIG. 31).
[0310] In addition, interlocking with this switching operation, a corresponding LED of a status display unit (omitted in FIG. 27; refer to FIGS. 10 and 14) on the operation panel of the controller 2D is lit.
[0311] Furthermore, although not shown in FIG. 27, an LC shutter driver and the like, which will be described below, are provided in the controller 2D, the LC shutter driver and the like which are controlled by a control circuit that controls the entire apparatus and is composed of a CPU and the like.
[0312] FIGS. 28 and 29 are schematic diagrams showing a display unit constructing an image display unit of the head-mounted image display unit 1 in this fifth embodiment of the image observation apparatus. FIG. 28 shows the state of the display unit being set in the low resolution mode, and FIG. 29 shows the state of the display unit being set in the high resolution mode.
[0313] As shown in FIGS. 28 and 29, the display unit 9 comprises: an LCD unit including a back light 11aand an LCD display part 12a; and an optical unit including a half mirror 15, a first concave mirror 14A, a second concave mirror 14B, a first LC shutter 17A, and a second LC shutter 17B.
[0314] In addition, it is assumed that the above-mentioned LCD unit is composed of the same members as those of the fourth embodiment, and hence, here, their description is omitted.
[0315] Further, the optical unit is provided with members for guiding to an observer's eye a light beam for displaying an image in a low resolution mode as one display aspect, that is, the half mirror 15, first concave mirror 14A, and first LC shutter 17A cutting off an unnecessary light beam. The members are located on the bottom of the optical unit. Still more, the optical unit is also provided with members for guiding to an observer's eye a light beam for displaying an image in a high resolution mode as another display aspect, that is, the half mirror 15, second concave mirror 14B, and second LC shutter 17B. The members are located in the side opposing to the position of the observer's eye 20 observing the display image.
[0316] In addition, the head-mounted image display unit 1 of this fifth embodiment, similarly to that of the fourth embodiment, has not a change-over switch for an outside-world image obtained with a see-through function and the like. Therefore, this embodiment uses a head-mounted image display unit having so-called negative types of LC shutters which are normally-closed and common.
[0317] Further, as described above, if a display image is observed by the above-mentioned display unit constructed in this manner, a picture quality mode is selected by pushing the picture quality change-over switch 2Daof the controller 2D. Operation in this case will be described below with reference to the flow chart in FIG. 32.
[0318] As shown in FIG. 32, first, the status of the picture quality change-over switch 2Dais confirmed at step S25. Here, if the picture quality change-over switch 2Dais ON, it is determined that the low resolution mode (low picture quality mode) is selected, and the process goes to the next step S27. On the other hand, if the picture quality change-over switch 2Dais OFF, it is determined that the high resolution mode (high picture quality mode) is selected, and the process goes to the next step S26.
[0319] If, at the above-mentioned step S25, it is determined that the low resolution mode (low picture quality mode) is selected, and the process goes to the next step S27, an LC shutter driver in the controller 2D is driven at this step S27. Therefore, as shown in FIGS. 28 and 32, the second LC shutter 17B becomes opaque, incidence of the light beam to the second concave mirror 14B is obstructed, and the process goes to the next step S28.
[0320] At step S28, the image is displayed. Thus, the image, displayed on the LCD display part 12A in the status at step S27, is illuminated by the irradiation light of the back light 11a. Then, the light beam proceeds to the lower part of the optical unit, permeates the half mirror 15 and first LC shutter 17A that becomes transparent, and enters onto the first concave mirror 14A.
[0321] Then, the light beam entered onto the first concave mirror 14A is condensed by this first concave mirror 14A, proceeds toward the half mirror 15 again, and reflects on the inclined surface of the back side of this half mirror 15. Thus, the light beam, whose path is changed by the mirror 15, enters into the observer's eye 20.
[0322] Owing to this, The observer's eye 20 can observe the image displayed on the LCD display part 12a. The image to be observed here, as shown in FIG. 30, is displayed in high magnification and low pixel density (low resolution) within the screen frame. Then, a series of steps is completed (END).
[0323] On the other hand, if it is determined at the above-mentioned step S25 that a high resolution mode is selected, and the process goes to step S26, the LC shutter driver in the controller 2D is driven similarly to the process at the above-mentioned step S27. Hence, as shown in FIGS. 29 and 32, the first LC shutter 17A becomes opaque, incidence of the light beam to the first concave mirror 14A is obstructed, and the process goes to the next step S28.
[0324] At step S28, the image is displayed. Thus, the image, displayed on the LCD display part 12ain the status at step S26, is illuminated by the irradiation light of the back light 11a. Then, the light beam proceeds to the lower part of the optical unit, and reflects on the top reflection surface of the half mirror 15. Then, the light beam, whose path is changed by the mirror 15, proceeds toward the second LC shutter 17B that becomes transparent, permeates this second LC shutter 17B, and enters onto the second concave mirror 14B.
[0325] Further, the light beam entered onto the second concave mirror 14B is condensed by this second concave mirror 14B, proceeds toward the half mirror 15 again, permeates this half mirror 15, and enters into the observer's eye 20.
[0326] Owing to this, the observer's eye 20 can observe the image displayed on the LCD display part 12a. The image to be observed here, as shown in FIG. 31, is displayed in low magnification and high pixel density (high resolution) within the screen frame. Then, a series of steps is completed (END).
[0327] In addition, the curvature radius of the first concave mirror 14A is set to be less than that of the second concave mirror 14B. Here, let the angle between an optical axis and the light path be θ, the angle being formed when the light path enters from the LCD display part 12ato the observer's eye 20. Further, let this angle in the low resolution mode shown in FIG. 28 be θA and let it in the high resolution mode shown in FIG. 29 be θB. Then, the relation between both angles is θA >θB.
[0328] Here, as the angle θ becomes larger, an image with higher magnification can be displayed, and as the magnification becomes higher, the pixel number of the display image in the same area of screen frame becomes fewer. Thus, the image becomes in low resolution.
[0329] In this manner, by switching the first and second LC shutters 17A and 17B and changing the light path of the display image, it becomes possible to change the magnification of an image derived from the same video signal and to switch respective display aspects (picture quality modes).
[0330] In addition, preferably, the surfaces of the first and second LC shutters 17A and 17B, which face to the half mirror, may have nonreflective coating.
[0331] As described above, according to the fifth embodiment, by changing the light path of the display image in the display unit through switching the picture quality change-over switch 2Daof the controller 2D, it can easily performed to switch each display aspect (picture quality mode). Therefore, an observer (operator) can easily select the picture quality mode optimum for the game and the like to be observed, and hence, the observer can play the game with better comfortableness and presence.
[0332] In addition, although, in the fifth embodiment, a picture quality mode is selected by optionally switching the picture quality change-over switch 2Daof the controller 2D, the present invention is not limited to this. For example, it is conceivable to store also supplemental information defining the display aspect (in this case, a picture quality mode) like the fourth embodiment in addition to the image data as information stored in the memory means of a game card 8.
[0333] In this case, when the game card 8 is inserted into the controller 2D, the controller 2D not only detects insertion of the game card 8, but also reads the above-mentioned supplemental information from the memory means of the game card 8. Then, according to this supplemental information, a picture quality switching circuit in the controller 2D controls shading and permeation of the first and second LC shutters 17A and 17B included in the display unit of the head-mounted image display unit 1.
[0334] By adopting this construction, the controller 2D controls the LC shutters included in the display unit of the head-mounted image display unit 1 on the basis of the supplemental information, which relates to the picture quality mode and is stored in the game card 8. Therefore, it is possible to automatically set the picture quality mode.
[0335] Hence, an observer (operator) of a game and the like can observe image data of this inserted game card 8 in the optimum picture quality so long as the observer inserts the game card 8 into the controller 2D without special setting operation. Thus, the observer can play games with better presence.
[0336] Next, a sixth embodiment will be described below.
[0337] FIG. 33 is a conceptual drawing showing this sixth embodiment of the image observation apparatus. In addition, this sixth embodiment is an example of automatically displaying images descriptive for using this image observation apparatus, that is, a so-called online manual and the like when the apparatus is turned on.
[0338] In addition, a head-mounted image display unit 1 and a controller 2E in this sixth embodiment of the image observation apparatus have construction fundamentally similar to that of the head-mounted image display unit and controller in each of the above-mentioned embodiments. Therefore, drawings and detailed description of the similar members will be omitted, and only the members relating to this sixth embodiment will be described below.
[0339] As shown in FIG. 33, this image observation apparatus comprises: a head-mounted image display unit 1 that is made to display images, derived from video signals supplied to itself, respectively on image display units corresponding to observer's eyes; and a controller 2E supplying video signals to the head-mounted image display unit 1.
[0340] The controller 2E includes: various types of circuits such as a control circuit having a CPU and controlling the entire image observation apparatus, a current detection circuit, and an LCD driver (not shown); a main power supply 2Ea; and memory means 2Ebsuch as ROM storing beforehand descriptive images for using this image observation apparatus, for example, image data (hereinafter called an online manual and the like) including the following descriptions:
[0341] 1) A description of a method for inserting the head-mounted image display unit (refer to FIG. 34)
[0342] 2) A description of a method for adjusting and setting the image display unit of the head-mounted image display unit (refer to FIG. 35)
[0343] 3) A description regarding various types of setting of the head-mounted image display unit itself (pupil distance, parallax adjustment, etc.).
[0344] An example of the image data such as the online manual and the like stored in the memory means 2Ebis, as shown in FIG. 34, a display image regarding the description of a method for inserting the head-mounted image display unit (item 1 described above). Another example is, as shown in FIG. 35, a display image regarding the description of a method for adjusting and setting the image display unit of the head-mounted image display unit (item 2 described above).
[0345] Operation of the sixth embodiment of the image observation apparatus constructed in this manner will be described below with reference to a flow chart shown in FIG. 36.
[0346] As shown in FIG. 36, first, by pushing a power switch and the like of the controller 2E at step S31, the main power supply 2Eais turned on. Then, at step S32, detection of current from the main power supply 2Eais started by a current detection circuit in the controller 1E. After current detected, the process goes to step S33, where the image data such as the online manual and the like stored in the memory means 2Eais read, and thereafter, the process goes to the next step S34.
[0347] At step S34, an LCD driver in the controller 2E is controlled by control means, and drives an image display unit (LCD) of the head-mounted image display unit 1. At the next step S35, the image data read (FIGS. 34 and 35) at the above-mentioned step S33 is displayed on the image display unit, and a series of steps is completed (END).
[0348] As described above, according to the sixth embodiment, power-up of the controller 2E is detected, the image data and the like such as the online manual and the like stored in the memory means 2Eais automatically read. Further, the read image data and the like are automatically displayed on the image display unit of the head-mounted image display unit 1. Therefore, it becomes unnecessary to read complicated manuals for confirmation, and hence, it is easily possible to simply use the image observation apparatus.
[0349] Further, in the sixth embodiment, data such as the online manual and the like stored in the memory means 2Eaof the controller 2E is stored as image data. However, the present invention is not limited to this, for example, it is also possible to store voice data and perform explanation with voice based on this voice data.
[0350] Next, a seventh embodiment of the present invention will be described below.
[0351] FIG. 37 is a conceptual drawing showing this embodiment of the image observation apparatus. In addition, this seventh embodiment of the image observation apparatus, similarly to the third, fourth, and fifth embodiments, is an example of using this apparatus for playing a game and the like. Further, this embodiment is also an example of an image observation apparatus capable of reading guide information expressing an operation method regarding an image of a game and the like from a memory medium inserted in a controller, and performing display concerning to this guide information on a image display unit of a head-mounted image display unit on the basis of this guide information.
[0352] Furthermore, since this seventh embodiment fundamentally has the similar construction to those of the third and fourth embodiments, description of similar members will be omitted, and only the different members will be described below.
[0353] As shown in FIG. 37, this image observation apparatus comprises: a head-mounted image display unit 1F for displaying an image, derived from video signals supplied to itself, on an image display unit corresponding to a left eye and a right eye of an observer respectively; and a controller 2F, into which a game card 8 being a memory medium storing image data and guide information expressing the operation method regarding the image of a game and the like can be selectively inserted, and which supplies video signals, corresponding to the operated image data, to the head-mounted image display unit 1F through an operator operating image data with a control pad 7F that is operation means for the operator optionally operating image data read from the inserted game card 8.
[0354] Further, the controller 2F has a game card 8 that is selectively located in the attachable and detachable manner, and connects to the head-mounted image display unit 1F and control pad 7F.
[0355] Furthermore, similarly to the controller 2C in the fourth embodiment, a main power switch 2Faswitching the main power supply to ON or OFF and a reset switch 2Fbcapable of initializing a game card 8, inserted into the controller 2C, regardless this main power switch 2Faare located on the front operation panel of the controller 2F.
[0356] A game card 8 is provided with memory means (not shown) including memory such as ROM, the memory means storing image data and guide information expressing the operation method regarding the image of a game and the like.
[0357] The control pad 7F is provided with button switches that are plural sorts of operation members for performing various types of operation. For example, the following button switches are located:
[0358] 1) START: A start button for instructing the start of image display (the game and the like)
[0359] 2) “A” and “B”: A selection button for instructing the selection of image display (the operation method of the game and the like)
[0360] 3) Arrows: A cursor buttons for instructing the movement of cursors (characters and the like) on the screen. (In FIG. 37, a large round button having arrows radiating toward the circumference of the button is exemplified.)
[0361] 4) MODE: A mode button for instructing the selection of an image display mode (game and the like)
[0362] 5) PAUSE: A pause button for temporarily stopping image display (progress of the game).
[0363] In addition, a pause switch 1Fa, having a function similar to the pause button of the control pad 7F, is located in the vicinity of both temples of the body constructing the head-mounted image display unit 1F. Hence, regardless the pause button of the control pad 7F, an operator can pause image display (progress of the game).
[0364] Operation for performing image display (or a game and the like) with the seventh embodiment of the image observation apparatus constructed in this manner will be described below.
[0365] First, when the main power switch 2Faof the controller 2F is turned on, it is started to read the guide information expressing an operation method regarding the image of a game and the like from the memory means of a game card 8 inserted into the controller 2F. The guide information is sequentially read every one image from an address of the memory means in the game card 8.
[0366] Next, the image relating to this guide information is displayed on the image display unit of the head-mounted image display unit 1 on the basis of the read guide information. The display aspect in this time is controlled so that the image may be held for 3-5 seconds every one image by, for example, a time counter (not shown) provided in the controller 2F, and the subsequent images may be sequentially displayed.
[0367] An example of the display relating to the above-mentioned guide information, as shown in FIG. 39, is the display image regarding the description of “operation of control pad”. Another example, as shown in FIG. 40, is the display image regarding the description of “operation of characters”.
[0368] Next, after a series of display relating to the guide information is performed, an observer can start the image display (the game and the like) by pushing the start button of the control pad 7F.
[0369] In addition, if the observer pushes the start button during performing the display relating to the guide information, the display relating to the guide information is interrupted, and then, the process moves to immediately start the image display (the game).
[0370] Further, with interlocking with a start command signal of the image display (the game and the like) by the start button of the control pad 7F, an LD shutter (not shown) constructing the image display unit (display unit) of the head-mounted image display unit 1F is shielded. On the other hand, if power supply to the controller 2F is cut off, and consequently, supply of a video signal to the head-mounted image display unit IF is cut off, the above-mentioned LD shutter automatically becomes transparent.
[0371] Furthermore, if it occurs that the operation method of the image display becomes unknown even during performing the image display using this image observation apparatus, the observer can refer to the above-mentioned guide information at any time.
[0372] In this case, first, the observer pushes the pause button of the control pad 7F, or the pause switch 1Faof the head-mounted image display unit 1. Then, as shown in FIG. 38, the display, showing that the pause button is pushed, that is, the display of “PAUSE” and the like appears at the predetermined positions with blinking for easy recognition. The display of “HELP”, “RETURN”, and the like appears at the predetermined positions, and the progress of the image display (the game and the like) is temporarily stopped. Next, the LC shutter of the image display unit in the head-mounted image display unit 1 becomes semitransparent (due to the superimposing function), and hence, the observer can see surroundings.
[0373] In this status, for example, by operating the cursor button of the control pad 7F, moving to the display “HELP” a pointer (not shown) on the screen, and thereafter, pushing the predetermined button such as the selection button “A” or “B”, or the start button, the display “HELP” is selected.
[0374] Then, the display (refer to FIGS. 39 and 40) relating to the guide information that was read at the time of power-up is performed again.
[0375] Further, by pushing the pause button again, the observer can restart the image display (the game, etc.) from the stopped point at any time.
[0376] Furthermore, as a method for selecting the display “HELP”, the above-mentioned example is that, by operating the cursor button of the control pad 7F, moving to the display “HELP” a pointer on the screen, and thereafter, pushing the predetermined button such as the selection button or start button, the display “HELP” is selected. However, the present invention is not limited to this because there are various ways. For example, it is conceivable that, by pushing the mode button, mode switching, that is, switching to the “HELP” mode is performed.
[0377] As described above, according to the seventh embodiment, the image data such as the guide information and the like stored in the memory means of the inserted game card 8 is automatically read at the time of power-up to the controller 2F. Further, the read image data is automatically displayed on the image display unit of the head-mounted image display unit 1. Therefore, it becomes unnecessary to read complicated manuals of game card 8 for confirmation, and hence, it is easily possible to simply use the image observation apparatus.
[0378] Further, even in the middle of image display (a game, etc.), it is possible to easily refer to the display relating to the guide information by pausing the image display (the game etc.) without ending the image display (the game etc.). Furthermore, it is also possible to immediately restore the paused image display (the game, etc.), and hence, an observer can continue the game comfortably.
[0379] Still more, the LC shutter of the image display unit in the head-mounted image display unit 1 is made to be opaque with interlocking with the start button. Therefore, the observer can be absorbed in the world of the display image (the game, etc.) without minding the surroundings if the observer is enjoying the image display (the game etc.). In addition, the LC shutter is also made to be semitransparent with interlocking with the pause button. Hence, the observer can easily see the surroundings by only pushing the pause button of the control pad 7F or the pause switch 1Faof the head-mounted image display unit 1.
[0380] Next, an eighth embodiment will be described below.
[0381] FIG. 41 is a schematic block diagram showing this eighth embodiment of the image observation apparatus. In addition, this eighth embodiment of the image observation apparatus, similarly to the third, fourth, fifth, and seventh embodiments, is an example of using this apparatus for playing a game and the like. Further, this embodiment is also an example of the image observation apparatus that can store the status at the time, when power supply is interrupted, without the game being interrupted because of provision of an auxiliary power supply in the controller even if the power supply is interrupted due to, for example, power failure.
[0382] Furthermore, since this eighth embodiment fundamentally has the similar construction to those of the third, fourth, fifth, and seventh embodiments, description of similar members will be omitted, and only the different members will be described below.
[0383] As shown in FIG. 41, this image observation apparatus comprises: a head-mounted image display unit 1 for displaying an image, derived from video signals supplied to itself, on an image display unit corresponding to a left eye and a right eye of an observer respectively; and a controller 2G for performing operator's optional operation to the image data read from an inserted memory medium, and supplying video signals, corresponding to the operated image data, to the head-mounted image display unit 1.
[0384] The controller 2G includes: a control circuit 2Gafor controlling the entire apparatus and having a CPU; memory means 2Gbhaving memory; a current detection circuit 2Gefor detecting the current from an external power supply 18; an auxiliary battery 2Gdthat is an auxiliary power supply; an auxiliary battery change-over switch 2Gffor switching to the auxiliary battery 2Gdso that power may be supplied from the auxiliary battery 2Gdif the power supply from the external power supply 18 is interrupted; and a video controller 2Gcfor sequentially reading image data stored in a memory medium (not shown), converting it into video signals, and outputting the converted video signals to the head-mounted image display unit 1.
[0385] The power of the controller 2G is supplied from the external power supply 18. During using this image observation apparatus, that is, during the power being supplied from the external power supply 18, the current detection circuit 2Gecontinues to detect the current from the external power supply 18.
[0386] In addition, the memory means 2Gbin the controller 2G stores the image data that is a confirmation picture of “game saving” as shown in FIG. 42.
[0387] The operation of the eighth embodiment of the image observation apparatus constructed in this manner will be described below with reference to the flow chart in FIG. 43.
[0388] As described above, during using this image observation apparatus, the current detection circuit 2Gecontinues to detect the current from the external power supply 18. However, at step S41 in FIG. 43, if the power supply from the external power supply 18 is interrupted due to an accident such as power failure and to misoperation with which a main power switch (not shown) is turned off, that is, if the interrupt of the power supply is detected by the current detection circuit 2Ge, the process goes to step S42.
[0389] At step 42, the current detection circuit 2Gecontrols the auxiliary battery change-over switch 2Gfthrough the control circuit 2Gaso that the power can be immediately supplied from the auxiliary battery 2Gd. Thus, the current detection circuit 2Geturns the change-over switch 2Gfon, and the process moves to the next step S43.
[0390] The control circuit 2Gacontrols the video controller 2Gcat step S43, and reads from the memory means 2Gbthe image data containing the confirmation picture of “game saving” (refer to FIG. 42). After that, the control circuit 2Gaconverts the image data into video signals, and displays the video signals on the image display unit of the head-mounted image display unit 1. Then the process goes to the next step S44.
[0391] At step S44, this embodiment instructs the observer to select a selection button “A” or “B” that is an operation member on a control pad (not shown; refer to FIG. 37). Here, if the selection button “A” (“YES”) is pushed, that is, if the game is ended after game saving, the process goes to step S45. At this step S45, the progress status and the like of the game played until the time when the power supply was interrupted are stored (saved) in the memory means 2Gd. After the game is ended at the next step S46, the process goes to step S47.
[0392] In addition, if the selection button “B” (“NO”) is pushed at step S44, that is, if the game is ended without game saving, the process goes to step S47.
[0393] At step S47, the auxiliary battery change-over switch 2Gfis turned off. Further, at the same time as this power-down, an LC shutter constructing a display unit of the image display unit in the head-mounted image display unit 1 is driven by an LCD driver (not shown) at step S48. Hence, the shutter becomes transparent, and thereafter, a series of steps is completed (END). Further, in this case, it is preferable to adopt a positive type of LC shutter, which becomes transparent without applying a voltage, as the LC shutter of the head-mounted image display unit 1.
[0394] As described above, according to the above-mentioned eighth embodiment, the auxiliary battery 2Gdis provided in the controller 2G. Therefore, if the power supply is interrupted due to the power failure, etc., the current detection circuit 2Gedetects the interrupt, and the power is supplied from the auxiliary battery 2Gd. Hence, it is possible to securely save and protect the status at the time when the power supply is interrupted, and the progress status of the game without interrupting the game and the like in progress. Therefore, when the power supply is restarted, it is possible to restart the game and the like continuously from the status at the time when it was interrupted.
[0395] It is apparent that it is possible to construct embodiments different in a wide range according to the present invention without departing from the sprit and scope thereof. The scope of the present invention should not limited to the embodiments described and should instead be defined by the accompanying claims.
Claims
What is claimed is:
1. A head mounted image observation apparatus comprising:
a head-mounted image display unit for displaying images derived from video signals supplied thereto, said head-mounted image display unit having a right eye image display unit corresponding to an observer's right eye and a left eye image display unit corresponding to an observer's left eye; and
a controller into which a memory medium storing image data having a binocular parallax can be selectively inserted, said controller supplies video signals to said head-mounted image display unit directly through a predetermined cable without any other circuit or device connected therewith;
wherein each of said right eye and left eye image display units includes;
an image source;
a first mirror for producing the image at the low resolution; and
a second mirror producing the images at the high resolution.
2. A head mounted image observation apparatus comprising: a head-mounted image display unit for displaying images derived from video signals supplied thereto, said head-mounted image display unit having a right eye image display unit corresponding to an observer's right eye and a left eye image display unit corresponding to an observer's left eye; a controller into which a memory medium storing image data having a binocular parallax can be selectively inserted, said controller supplies video signals to said head-mounted image display unit directly through a predetermined cable without any other circuit or device connected therewith; wherein each of said right eye and left eye image display units further include: an image source, a first mirror for producing the image at the low resolution; a second mirror producing the images at the high resolution; a half mirror disposed between the image source and the first and second mirrors; a first liquid crystal shutter disposed between the half mirror and the first mirror; and a second liquid crystal shutter disposed between the half mirror and the second mirror, wherein the first liquid crystal shutter is opaque when the right and left eye image display units are in the high resolution configuration and wherein the second liquid crystal shutter is opaque when the right and left eye
Patent Citations (10)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5581271(A) | 1996-12-01 | Kraemer | Examiner |
| US5708529(A) | 1998-01-01 | Togino et al. | Examiner |
| US5808589(A) | 1998-09-01 | Fergason | Examiner |
| US5808591(A) | 1998-09-01 | Mantani | Examiner |
| US5825539(A) | 1998-10-01 | Hoshi | Examiner |
| US5903395(A) | 1999-05-01 | Rallison et al. | Examiner |
| US5991085(A) | 1999-11-01 | Rallison et al. | Examiner |
| JP4-33679 | 1992-02-01 | Applicant | |
| JP5-180595 | 1993-07-01 | Applicant | |
| JP7-75134 | 1995-03-01 | Applicant |