US 5,325,473 AGrant
Apparatus and Method for Projection Upon a Three-Dimensional Object
Issue Date:1994-06-28
•30 Claims
•5 Drawing Sheets
Abstract
A projection apparatus and method for vivid and realistic projection is disclosed, with applications to amusement and optical engineering. Contemplated applications of the invention also include video shopping applications and cosmetic applications. Graphics data is entered into a user interface and is processed to generate an output representing an image to be projected onto a three-dimensional object. This output controls a light filter, such as a plurality of optically superposed color composite liquid crystal panels, to selectively filter projected light so that an image having a desired appearance is projected upon the object. The projected image may be interactively modified and it may also be stored in memory and projected as part of an image sequence so as to create apparent motion in the object.
Metadata
Assignee
- The Walt Disney Company
Inventors
- Marshall M. Monroe
- Willian G. Redmann
Application Information
Application Number:US 7760752
Filing Date:1991-10-11
Priority Date:1991-10-11
Art Unit:231
Classifications
IPC:
G06F 1500
Field of Search:
395358340125;129;130;131;152;155;16160;61701;703;702;705;706
Patent Drawings (5 sheets)
Description
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
Background of the Invention
The present invention relates to projection devices and, more particularly, to an apparatus and method for projection upon a three-dimensional object.
The projection of an image onto a three-dimensional object having various contours and shapes is not an easy task. It is generally known that the correction of all optical distortion problems inherent in flat, two-dimensional image projection is especially difficult when working with three-dimensional projection surfaces. These problems include proper image registration on the object, proper keystoning, corrections to ensure appropriate perspective appearances and focusing of the image within a specified range of depth.
Through the years, various attempts have been made to project images onto three-dimensional objects. For example, from the days of early artists it has been known to transfer three-dimensional images to two-dimensional images by using a pane of glass and tracing the three-dimensional image by eye onto the glass. In general, these three-dimensional images could not be accurately reconstituted from the glass by projection, because the human eye cannot reproduce the optical distortions induced by the condensing and objective lens systems used in most projectors. This is due in large part to the fact that the human eye generally cannot perceive depth or perspective in projected images.
In recent times, artists have nevertheless used projection in an effort to recreate three dimensional images. Attempts have been made, for example, to use two distinct but overlapping image projections of polarized light to create an illusion of depth. In these circumstances, special three-dimensional viewing glasses are worn for viewing the polarized image projections. These viewing glasses filter the polarized light to present one of the image projections to each eye. The discrepancies between these image projections create the impression of depth in the image.
Other approaches, such as holography, present a three-dimensional image through the interference patterns of two distinct projections of coherent light. In these applications, the phase difference between the light projections is varied such that some points in three-dimensional space appear brighter than others because of the superposition of the crests of the light waves.
The foregoing approaches have inherent limitations, however. Holograms, for example, are very limited in color pallet and exhibit uncontrollable color shift with varying viewing angle. The techniques they employ simply are not practical for reproducing a three-dimensional image from a two-dimensional depiction, because the two-dimensional image has to be initially captured and subsequently processed to include a depth component so that a three-dimensional image can be reconstituted.
Attempts have also been made to recreate three dimensional images by projecting a two-dimensional image upon a stationary three-dimensional object or a molded screen. However, these images are very difficult to edit and they cannot be modified in real time. The need for registration and alignment between the projected two-dimensional image and the three-dimensional projection surface affects the utility of these methods. Additionally, the requirement that these three-dimensional images be recorded in advance generally necessitates film preparation, which further contributes to the registration and keystoning difficulties, not to mention focusing problems associated within the desired depth of field.
In yet another system, interactive image modification is provided through a video shopping device that superimposes computer generated apparel upon an image of a human figure which is captured by a video camera. The human figure adorns an orientation identifying feature that can be recognized by image control circuitry which maps the appropriate orientation of the computer stored apparel image onto the figure and which then displays the composite two-dimensional image upon a viewing screen. This method, however, has drawbacks in that it requires a human figure to wear at least one orientation identifying feature, and it does not provide for the projection of vivid and realistic three-dimensional images. A method of projection which can interactively recreate three-dimensional images from two-dimensional depictions without the need for a video camera, advance processing or the adornment of orientation identifying features would therefore be desirable.
Accordingly, there has existed a definite need for an apparatus and method of projection which can recreate three-dimensional images from two-dimensional depictions without advance processing, and which solves the distortion problems inherent in flat image projection. Additionally, there has existed a need for such an apparatus and method that would allow for interactive image modification, and would therefore have applications in a wide range of fields, including by way of example, a guest-interactive amusement attraction, optical engineering, video shopping and cosmetic surgery. The present invention satisfies these needs and provides further related advantages.
Summary of the Invention
The present invention provides an apparatus and method for projecting images upon a three-dimensional object so as to impart a vivid and realistic appearance upon that object. The apparatus employs graphics processing equipment and a projection means for projecting an image upon the object in a manner which allows for user interaction with the projected image. Specific methods in accordance with the invention allow for an image to be created corresponding to the surface contour of the object, as well as the definition of regions within that contour which may be independently processed for projection upon the object. In this way, a user or guest may create and edit a complete artwork data file which contains all of the perspective, registration and optical keystoning corrections necessary for projecting a vivid and realistic image, and which accurately conveys depth when projected upon the object. The projected image also can be modified in real time, providing animation, interactivity, transformation and even translation.
More particularly, the apparatus includes a projector and an addressable light filter means which is adapted to filter and color the light projected onto the object. A user interface means receives graphics data for the creation of a properly aligned projection contour and regions within the contour. The graphics data is then fed to a graphics processing device, such as a computer coupled to the addressable light filter means, to generate and control projection of the desired image utilizing multi-dimensional bit-mapping.
In one form of the invention, the user interface means consists of a user interface and one or more simplified guest interfaces. A simplified guest interface, which may be in the form of a Polhemus device, joystick, gimballed stylus, mouse, etc., may be added so as to permit a guest of the user to input graphics data that is used to manipulate color patterns projected onto regions of the object without user supervision. The data received from the simplified guest interface corresponds to a particular position on the object and allows for selection of an active color pattern and for selective painting of that color pattern upon a region corresponding to the position on the object. Contour and other graphics data is typically generated at the user interface, which may include a stylus and digitizing pad or a mouse, by tracing an image or the like on the object.
The computer processes the graphics data and generates an output representing an image which corresponds to the surface contour of the object, as traced by the user. This output controls the light filter means and commands it to filter the projected light such that the image is projected onto the object in various colors, with the appearance of shading, surface textures and other characteristics as desired
In one aspect of the invention, the light filter means includes two or more optically superpositioned liquid crystal panels that are individually composited with a color filter. These displays are controlled in response to the output from the computer to filter the light from the projector to thereby produce color components and other projection features of the image. In addition, a display monitor also may be provided for connection to the processing device to permit two-dimensional display of the bit map data file on the monitor. Typically, the liquid crystal filter may be driven from the same graphics signal that is supplied to control the display monitor, and therefore consists of three such displays that subtract light for creating a color projected image.
In another aspect of the invention, the processing device comprises a computer having graphics software, with the display monitor being coupled to the computer. The graphics software is designed to store the processed graphics data in a memory, and to permit graphics data and image projection patterns corresponding to locations on the object to be created, generated, modified, maintained, erased or retrieved for subsequent projection.
In another form of the invention, a method of projecting an image onto a three-dimensional image is provided. The method includes the steps of entering the graphics data into the graphics input device and then processing that data to generate an output representing an image which corresponds to the surface contour of the object. The light filter is then controlled in response to the output to filter light from the projector such that the image is projected onto the object with a desired appearance. In various aspects of this method, the output may be stored in a buffer and then processed by the user to interactively modify the image. In addition, the output representing the image may be stored in a memory for subsequent recall and projection on the object. In this regard, a plurality of outputs may be stored to form a sequence of different but related images for sequential projection upon the object so as to make the object appear to be in motion.
Other features and advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention.
Brief Description of the Drawings
The accompanying drawings illustrate the invention. In such drawings:
FIG. 1 is a perspective view of an apparatus embodying the novel features of the present invention, showing a three-dimensional object and a simplified guest interface according to one preferred embodiment of the current invention;
FIG. 2 is another perspective view of the apparatus, showing a colorless three-dimensional object, projector, computer and interface for controlling projection upon the object;
FIG. 3 is another perspective view, similar to FIG. 2, showing projection of an image upon the three-dimensional object as selected by the simplified guest interface;
FIG. 4 is a plan view of the object and a projection device used for projecting the image onto the object and illustrates the depth of field of the object;
FIG. 5 is a block diagram depicting the functional interaction between the computer, the simplified guest interface, a liquid crystal filter projector, and a switch/lamp assembly;
FIG. 6 is another block diagram showing the functional interaction between a polhemus device, the computer and an overhead-type liquid crystal filter projector; and
FIG. 7 is a logic block diagram of the software necessary to direct the computer of the preferred embodiment to control projection of an image according to the current invention.
Detailed Description of the Preferred Embodiment
As shown in FIG. 1, the preferred embodiment of the present invention is embodied in an amusement apparatus, generally referred to by the reference numeral 10, for use in projecting images onto a three-dimensional object 12, for example, having the form of animated characters on a stage. An amusement guest 14 positioned in front of the object 12 directs a wand 18 at regions 16 of the object and utilizes a button 20, located on the wand, for selectively coloring or drawing upon a region determined from the orientation of the wand.
FIGS. 2-3 show the apparatus 10 in more detail. As shown in FIG. 2, the three-dimensional object 12 is in the form of a carousel horse supported on a raised platform 26 or the like. The three-dimensional object is a Bas-Relief with attention paid to avoiding "undercuts" where the projected light can't reach. While the object illustrated in the preferred embodiment is an animated character, it will be appreciated that various other types and forms of three-dimensional objects having diverse surface shapes and configurations may be used in the context of the present invention. In the preferred embodiment, the surface 28 of the object 12 is monochromatic neutral-colored projection surface. In this way, the images projected upon the object will not be affected by unwanted colors on the object itself.
In accordance with the invention, the apparatus 10 includes a projection means that is aligned so as to project light upon the object 12. The projection means, which may include any device suitable for projecting light, or a liquid crystal display projector or light valve projector, is illustrated in the preferred embodiment as comprising an overhead type projector 29 with a large format liquid crystal light filter. As described in more detail below, data processing means are responsive to inputs received by a user interface means for processing graphics data to generate an image 24 and for controlling projection of image upon the object 12.
More particularly, the data processing means includes a computer graphics system 30. The user interface means may have one, two or even more interfaces for interaction with the computer graphics system 30. In the preferred embodiment, there is typically a single user interface 32, consisting of a keyboard 34 and gimballed stylus 36 with a drawing surface 37 of a digitizing pad 38, and one or more simplified guest interfaces, generally referred to by the reference numeral 40. The simplified guest interface 40 may be any device that allows a guest to position a projected cursor or otherwise indicate position on the object 12, decide to paint a region or draw upon the object and select a current color pattern for projection onto the object.
In using the preferred embodiment of the apparatus and method of the invention, a user enters graphics data at the user interface 32 to define "regions" corresponding to positions 16 on the object 12. By inputting the data via the keyboard 34 and stylus 36 and digitizing pad 38, the user can trace the object while viewing both the projection of the traced lines on the object 12 and the formation of contours as depicted on a computer monitor 42. The user preferably creates by these contours at least one computer region corresponding to the object 12 and may further subdivide each region into multiple regions and store to memory the created image. The system is then set up for interaction with an amusement guest via the simplified guest interface 40.
Although the user interface 32 of the preferred embodiment utilizes a keyboard 34, stylus 36 and digitizing pad 38, there are many devices that may be equivalently employed as a user interface, for example, a digitizing pad and stylus alone, or a mouse, or a keyboard alone, or a track ball, as well as any other device that is effective to input data to the computer graphics system 30.
The guest 14 may use the simplified guest interface 40 to projectively color the object 12 in accordance with data provided by the guest 14. In the preferred embodiment, the simplified guest interface 40 includes the wand 18, a "mouseclick" button 20, and a set of twelve color pattern buttons 46. Four of these buttons will select a pattern, e.g., polka dot, stripes, stars and crescent moons, etc., and eight buttons are employed to present a color selection. The wand 18 may be presented as shown in FIG. 1, having an enlarged paintbrush 48 having a bristle-end 50 that is to be pointed at a position on the object 12. By pushing the mouseclick 20, which as shown in FIG. 6 is a button on the rearward end of the paintbrush 48, the simplified guest interface 40 causes the computer graphics system 30 to projectively paint a portion of the object 12 corresponding to the wand's orientation with the current color pattern. As an optional feature to the embodiment shown in FIG. 1, the bristle-end 50 may carry lights for illuminating the bristle-end with the current color pattern, in a manner to simulate paint on the bristle-end of the brush.
As a further refinement of the preferred embodiment, the simplified guest interface 40 may present the guest with an option to projectively paint brush strokes or draw upon the object 12, in addition to flooding portions of the object as defined by the software delineated "Regions."
There are many devices that may be incorporated into the simplified guest interface 40 to emulate signals to the computer graphics system 30 for identification of the paintbrush's 48 orientation with respect to the object 12. As shown in FIG. 6, the wand 18 may house a so-called Polhemus device 92. The polhemus device utilizes low-frequency magnetic field technology to determine the position and orientation of a sensor 94 in relation to a source unit 96 and presents information representative of six degrees of freedom in ASCII or binary format. In the preferred embodiment, a unit sold under the name 3SPACE.TM. ISOTPRAK.TM. has been found to be acceptable. There are, however, other units that may also be conveniently used in accordance with the invention. Utilization of a polhemus device may require modifications to the computer's graphics software such that the software accepts the protocol of the polhemus' data output. These modifications are well within the skill of anyone familiar with computer programming. For convenience, FIG. 7 includes a block diagram that illustrates the logic steps that the software incorporating the modifications needs to accomplish. A more detailed statement of the software is also located at the end of this detailed description.
In use, the guest 14 manipulates the wand 18 to provide data to a computer 52 in a manner to projectively draw upon the object 12 or paint portions 16 of the object 12. By processing the graphics data fed to the computer 52, all of the perspective, registration and optical keystoning corrections necessary for exact alignment of a re-projected image onto the object 12 are made.
The processing of the graphics data may be divided into two segments. In the first, input from the user (not shown) to the user interface 32 is used to create an artwork data file. The user traces closed contours corresponding to portions 16 of the object 12 which are bit-mapped and used to define "regions" via the software. These contours are aligned in projection with the object, because the user has observed the projected contours corresponding to the portions 16 of the object 12 contemporaneously with their having been traced upon the object. Inputs from the user interface 32 are also received to indicate color, shading, texturing and perspective which are selectively assigned to regions. This artwork file is then ready for interaction by guests, and may be stored to memory of the computer 52 if it is desired to recall the original artwork data file or impose a default image projection. The artwork data file also can be enhanced on the computer 52 by using the keyboard 40 to select appropriate commands so that when the images are projected onto the object, as shown in FIGS. 3-4, the object 24 appears to be a real character having appropriate coloring, shading and desired textured appearances.
The second segment of data processing includes processing of data from the simplified guest interface 40 to allow guest manipulation of the image. The guest 14 enters data via the simplified guest interface 40 that accesses the artwork data file. As the name implies, the simplified guest interface 40 may be any interface that permits the guest to interact with the artwork data file and preferably allows only limited access to that file, i.e., the guest 14 preferably does not have the choice to completely erase all information corresponding to the object 12 including definition of regions. In the preferred embodiment, the guest 14 may employ the twelve buttons 46 to select a current color pattern and then utilize the mouseclick 44 to assign that color pattern to one of the pre-defined regions that is identified by the orientation of the wand 18 such that the bristle end 50 of the paint brush 48 points to the portion 16 of the object that corresponds to that region.
By way of example, if a user desires to facilitate projection of an image on the character's tail 58 shown in FIGS. 2-4, the user will first trace the boundaries of the tail 58 by watching a projection pen tip of the stylus 36 create a contour on the object 12 itself. As graphics software has formatted for display on the computer monitor 42 an image created by the bit-mapping of the data received from the user interface 30 corresponding to the trace, the VGA signal emulated by the computer 52 to the monitor 42 is readily used as the projection control signal for the image. Once the outline of the tail 58 has been traced, a guest 14 may subsequently utilize the wand 18, mouseclick 20 and set of buttons 46 to select in real time an appropriate color, shading or the appearance of a particular texture to be projected within the traced area.
As an alternative option, a single button may replace the set of twelve buttons 46 which, when depressed, causes the computer 52 to select a new current color pattern. Or, color pattern selection could also be made by directing the wand 18 at a target, such as a paint bucket 51 of FIG. 1, and pressing the mouseclick 20.
In the preferred form of the invention's embodiments, entry of the graphics data via either of the user interface 32 or the simplified guest interface 40 generates signals which are transferred to a computer 52. The computer may be chosen to be a personal computer having one or more disk drives 54 for receiving graphics software. The keyboard 34 and the visual display monitor 42 are coupled to the central processing unit of the computer. The computer processes the graphics data entered by the user on the digitizing pad 38 and generates a VGA format RBG output corresponding to the image drawn or traced upon the pad. This output is then emulated to both the monitor 42 and the projector 29 for projection onto the object 12. In the preferred embodiment, the computer comprises a Macintosh personal computer manufactured by Apple Computer, Inc. of Cupertino, Calif. In the case of computers other than the Macintosh, a VGA board may be necessary for emulation of signals for driving the projector 29.
As shown in FIGS. 2 and 3, projector 29, which is preferably an overhead type projector, is aligned to face the three-dimensional object 12 and includes a 1,000 watt light source 86 for projecting light upon the object. An addressable light filter means 62 is mounted on the projector 29 in between an objective lens 64 and a condensing lens 66. These two lenses are conventional in most overhead-type projectors to enable focusing and alignment of the light for projection purposes. In the present invention, however, the objective lens and condensing lens are specially configured to provide a relatively large depth of field as shown by the reference designation D in FIG. 4. This is accomplished by using a wide angle objective lens 64. The addressable light filter means 62, which is taken to include any projection device that electronically enables projection of an image by filtering light, is coupled to the computer 52 and is adapted to selectively filter the light projected onto the object 12 in response to output control signals generated by the computer.
In the preferred embodiment, the light filter means 62 comprises a plurality of optically superpositioned liquid crystal panels 68. Each of these panels is composited with a color filter and is comprised of a plurality of addressable pixels (not shown) which are individually controlled in response to the computer output to generate color elements for the composite image. As mentioned, the liquid crystal panels 68 in the preferred embodiment are designed to accept VGA format signals from the computer 52. Accordingly, an RGB transcoder 70 is connected between the computer 52 and the liquid crystal panels 68 to convert the high resolution output graphics signals, generated by the Macintosh computer, into a VGA format.
The liquid crystal filter 68 is comprised of three superpositioned filters, yellow, cyan and magenta, and accordingly has 3 liquid crystal panels that are individually composited with these light filters. These secondary colors are chosen to subtract light from the projected light to project the image upon object. In addition, commercially available liquid crystal filters include a circuit, designated by the reference numeral 72 in FIGS. 2-3, that appropriately converts an RGB signal from the computer into control signals for each of the three panels.
FIG. 5 shows a functional block diagram of an embodiment of the system that utilizes an IBM compatible personal computer 74. The wand 18 is in the form of a joystick 78 with the familiar paintbrush 48 mounted at the end of the joystick. The mouseclick 20 is also located on one of the paintbrush and the joystick. The wand 18 is coupled to the personal computer which is fitted with I/O boards 82 and 84 for communication, with the LCD overhead display 29 and a twelve button set 46 for selection of colors and patterns, respectively.
FIG. 6 shows a partial connection block diagram of the preferred embodiment, including the wand 18 that includes the paintbrush 48, a pivotal mounting 90, and the polhemus device 92. The polhemus device 92 consists of a sensor 94, a source 96 and a polhemus controller 98 which emulates signals for receipt of the controller. Selection of a region identified by the orientation of the paintbrush 48 is accomplished by pushing the mouseclick 20, which is coupled to a mouse device 100. The mouse device 100 serially emulates a digital word to the computer 52 that indicates to the computer 52 and to the custom software that the guest desires to modify the current region. The computer 52 then edits the bit map data file stored in memory and emulates signals to the monitor and liquid crystal filter 68 of the overhead projector 29 to project the image upon the object 12.
In the preferred embodiment, the projector 29 has a one-thousand watt light source 86 for projecting the images onto the object 12. When using this arrangement, it has been found that liquid crystal panels 68 having a ten-inch-by-ten-inch cross-section mounted over the condensing lens 66 are best suited for in-focus projection over approximately a twenty-inch range of depth D with respect to the three-dimensional object 12. Of course, the lens system of the projector 29 may be modified as desired to achieve a different in-focus range of depth D over the object 12. Whatever range of depth D is selected, however, care must be taken to ensure that the surface 28 of the object 12 to be projected upon does not have a contour that varies from front to back by more than the desired range of depth.
By selecting the projection optics and optimizing the range of depth in which a focused image will be projected upon the object 12, a very high quality image can be generated, aligned on the object and enhanced by the computer graphics system 30 so that the user or other viewers will perceive the object 12 as having full, realistic three-dimensional features.
Sophisticated graphics software is used to select and generate various colors, shading effects, the appearance of texture, animated transformation, and other commands for processing, manipulating, editing and storing the image to be projected on the object 12. If a Macintosh brand personal computer is used, then commercial software programs sold under the names PIXEL PAINT,.TM. PHOTO SHOP.TM. OR MACROMIND DIRECTOR.TM. are suitable software programs (the latter offering the added feature of animation as well as bit-map painting) for processing of graphics data. When an IBM format personal computer is used, software programs sold under the names DELUXE PAINT II.TM. or ANIMATOR.TM. are suitable (the latter being an animation program as the name implies).
Also, as mentioned, additional software may be necessary in order that these programs can receive data from non-standard inputs. The Polhemus device 92 of the preferred embodiment is such a non-standard input. FIG. 7 shows a block diagram of the software used to control projection and the sophisticated graphics software and communication with peripherals, such as the simplified guest interface 40, to boards 82 and 84 and Polhemus device 92. Appendices A-F are a more detailed statement of this software.
In another aspect of the invention, a printer 102 is connected to the computer 52. The printer is adapted to produce hard color copies 104 of the viewed image for the amusement of the guest 14 or other viewers. This feature has special usefulness when the apparatus 10 is used as an amusement device in an amusement park or the like, since the guests will be able to take a sample of their design home with them. The printer 102 also has advantages to artists and others who may use the apparatus 10 in a commercial environment or other contexts. Engineers can use the device for analyzing and comparing different optical systems.
In operation, after all of the equipment described above is connected to the power source and turned on, a user will pick up the stylus 36 and apply it to the drawing surface 37 of the digitizing pad 38. Once the virtual pen tip of the stylus contacts the drawing surface, the user will see this pen tip as a point on the visual monitor 42 and on the three-dimensional object 12. Once an appropriate starting point has been selected, the user may, for example, trace the contours, forms and outline of the projection object 12 by watching the pen tip of the stylus 36 move around on the object. The traced image, which is displayed on the monitor 42 and object 12, defines software regions that carry data signifying desired colors, shading, or the appearance of texture. For example, the user may trace forms corresponding to items of clothing to be displayed upon the object, each such item having a corresponding region.
When the user has finished tracing on the digitizing pad, a two-dimensional bit-mapped digital artwork data file will have been created and may be stored in the computer 52. The artwork file thus contains graphics data which is processed by the computer 52 in conjunction with the graphics software to generate an output representing the images traced by the user.
The system is then ready for interactive use with a guest via a simplified guest interface. In the preferred embodiment, the simplified guest interface has been chosen to include a polhemus device 92, but any interface sufficient to designate or change position is sufficient. For example, a mouse or a joystick may be used in equivalent fashion.
The computer 52 then processes this graphics information to generate the desired image for projection onto, for example, the character's tail 58, as shown in FIG. 4.
Because the user and the guest 14 may observe the results of moving the wand 18 by looking up at the projection object 12 and observing a moving cursor, contour or virtual pen tip, the projected image registers exactly with the object's appearance or shape. In this way, the object will have high-quality three-dimensional color images and characteristics of three-dimensional form.
As shown in FIG. 7, user created software translates inputs from the simplified guest interface 40 for acceptance by the sophisticated graphics software, and performs incidental tasks, such as periodic blinking of the character's eyes (not shown). As an example, the software of the preferred embodiment for interaction with the sophisticated graphics software is attached hereto as Appendices A-F.
By using sophisticated graphics software of the type identified above, the user has the option of selecting commands using the keyboard 36 which are displayed in a border on the computer monitor 42. These commands allow for presentation to the guest of selection of various colors, shading effects, the appearance of textures, and various other commands for manipulating, storing and editing the displayed image. In this regard also, modification of the graphics software may be necessary if the simplified guest interface is to be presented a limited subset of available colors, or with only a decision to select a new color pattern rather than select from a range of color patterns available. Alternatively, the switch I/O board 84 may be configured with physical switches (not shown) to allow changes in the emulated protocol such that the graphics software may recognize signals emulated by the I/O board 84 as representing alternate sets of colors and patterns.
In other aspects of the invention, the output representing the image may be stored in a memory of the computer 52 such that it may be recalled and subsequently projected onto the object 12 as desired. By storing a plurality of these outputs, a sequence of different but related images may be collated. When these stored images are sequentially projected upon the object 12, the object may appear to be in motion or to display some other characteristic of movement, even though the object 12 itself is stationary. For example, FIG. 7 contains a software block 108 that automatically projects eyes on the object that appear to be blinking. An alternative, but as yet untested application of the present invention, would be to have a physical mechanical movement of the object. Video information could then be synched to the physical movement and a file of projected animation designed. By projecting the two-dimensional image in exact synchronization with the repeated movement of the projection object, a three-dimensional object having a wide range of physical movement would result.
The present invention has far ranging applications, including the fields of video shopping and cosmetic surgery, as well as the amusement field. As an example of the invention's application to video shopping, an image may be projected upon a shopper (not shown) to create an impression that the shopper is wearing desired apparel. In accordance with the invention, the shopper's outline may be traced and a specific field within that outline traced, perhaps corresponding to a shirt on the shopper's torso. The graphics information generated by this tracing may thereafter be processed and the light filter may be controlled such that green polka dots, for example, appear on the shopper's torso to make it appear that the shopper is wearing a green polka dotted shirt. Similarly, images may be projected upon a model of a car or house (also not shown) so as to impart apparent colors, styles or customizations to the car or house. As an example of the invention's cosmetic applications, features desired by cosmetic surgery may be projected onto the subject. The quality of projection is so good that the subject may be made to appear to have a different shaped nose, a beard, eyebrows, or nearly any other physical characteristic.
One specific contemplated use of this invention is as a guest operated amusement device, such as a three-dimensional coloring book for artistic applications. The device could be used as a display or as an attraction at an amusement park, whereby users can designate color features for display on an object and see the results of their work as they do it, in three-dimensional rather than two-dimensional form. It should be understood, however, that the above-mentioned applications of this invention are listed as examples only, to illustrate the broad applications and the usefulness of this invention, and they are not intended to limit this invention in any way.
While a particular form of the invention has been illustrated and described, it will be apparent that various modifications can be made without departing from the spirit and scope of the invention. Accordingly, it is not intended that the invention.-be limited, except as by the appended claims.
Appendices
Appendix A is a software listing of a "C" language program that calls routines to set-up menus, windows, initialize the system, move the cursor, reset the polhemus and define the paint regions.
Appendix B defines menus for Macintosh and Polhemus set-up parameters and also handles menu actions.
Appendix C is a routine for implementing polhemus driven cursor movements.
Appendix D is a routine for initializing serial communications and pausing the polhemus output.
Appendix E is a routine for managing window/cursor sealing, region definitions, and random color/pattern files, cursor tracking and character eye blinking.
Appendix F is a resource file for dialog boxes and display. ##SPC1## ##SPC2## ##SPC3## ##SPC4## ##SPC5## ##SPC6##
Claims
I claim:
1. An image display apparatus, comprising: a contoured, three-dimensional object; a projector that projects a visual image upon said contoured, three-dimensional object so as to thereby impart visual attributes to said contoured, three-dimensional object; interface means including a user interface and a simplified guest interface for receiving data from a user, via said user interface, that define an artwork file including parameters of graphics information that is to be projected onto the contoured, three-dimensional object, for receiving data from a guest, via said simplified guest interface, representative of a location upon said contoured, three-dimensional object and graphic information to be projected upon said contoured, three-dimensional object at said location, and for thereby generating and modifying said visual image to impart said visual attributes to desired locations of said contoured, three-dimensional object; and, data processing means for generating, in response to data received by said interface means, said visual image and for controlling said projector so as to project said visual image in alignment with said contoured, three-dimensional object such that said graphic information is reflected in said visual image at the selected location.
2. An image display apparatus according to claim 1, wherein: said interface means includes interaction means whereby the guest may observe projection of a cursor that represents an active position of said interface means, and input said data to modify said display image; and, said data processing means controls said projector to reflect input data in real-time, such that the guest may interactively modify visual attributes imparted to said contoured, three-dimensional object by said display image.
3. An image display apparatus comprising: a three-dimensional object; a projector having a lens system and being aligned so as to project light upon the three-dimensional object, said projector including addressable light filter means for selectively filtering the light of the projector so that an image is projected upon the three-dimensional object; user interface means for receiving data from a user to create at least one region corresponding to said image; simplified guest interface means for selecting among regions corresponding to the three-dimensional object and for selectively changing the graphical content of a selected region; a color pattern generator that is responsive to the simplified guest interface means to selectively generate a current color pattern that may be painted in the selected region; and, data processing means responsive to the user interface means for creating regions for filling a region with the color pattern in response to the an impetus to draw or fill a region from the simplified guest interface means and in response to the color pattern generator, and for controlling the addressable light filter means to cause the projection of the image upon the three-dimensional object.
4. The apparatus of claim 3, wherein the simplified guest interface means includes a guest data input which indicates a guest's decision either to change the current color pattern or a decision to paint a particular region of the three-dimensional object with the current color pattern, and wherein the addressable light filter means may be driven by the computer's monitor output signal.
5. The apparatus of claim 3, wherein the simplified guest interface means includes a polhemus device having an output that corresponds to a selected position on the three-dimensional object.
6. The apparatus of claim 3, wherein the data processing mean includes a memory for storing a plurality of images for sequential projection upon the three-dimensional object.
7. A method of projecting an image onto a three-dimensional object, comprising the steps of: (a) entering region data into a user interface to create at least one region that corresponds to a portion of the object; (b) entering pattern data into a simplified guest interface to select a current pattern corresponding to a region; (c) processing the pattern data to generate an output representing an image corresponding to the object; (d) projecting the image onto the object such that selected patterns for each region are projected upon each portion of the object corresponding to said regions; and (e) controlling the projection in response to the output such that the projected image is updated to reflect new pattern data.
8. The method of claim 7, further comprising the step of storing the output representing the image in a buffer and then processing that stored output with data entered into the simplified guests interface to interactively modify the image.
9. The method of claim 7, further comprising the step of (f) storing the output representing the image in a memory such that it may be recalled and subsequently projected onto the object as desired.
10. The method of claim 9, further comprising the steps of: (g) storing the output representing the image in a buffer and then processing that stored output with data entered into the simplified guest interface to interactively modify the image storing a plurality of outputs to form a sequence of different but related images for sequential projection upon the object, and (h) performing steps (f) and (g) a plurality of times to form a sequence in memory of related images for sequential projection upon the object.
11. The method of claim 7, wherein: the step of projecting the image onto the object includes the step of projecting light through a light filter, and the step of controlling the projection in response to the output includes the step of controlling the light filter to subtract projected light.
12. The method of claim 11, wherein: the step of projecting light through the light filter includes the step of projecting light through optically superposed liquid crystal panels to project the image onto the object, and the step of controlling the light filter includes the step of controlling two or more optically superposed liquid crystal panels in response to the output to thereby reproduce corresponding color components of the image.
13. The method of claim 7, wherein the step of processing the pattern data to generate an output representing the image corresponding the object includes the step of displaying the image upon a monitor for viewing by the user.
14. The method of claim 7, wherein: the step of processing the data to generate an output includes the step of identifying a region corresponding to the area of the object selected and painting the region with the current color pattern; and the step of controlling the projection in response to the output includes the step of projecting the color pattern upon the portion of the object corresponding to said region.
15. The method of claim 7, wherein: the step of entering data into the simplified guest interface to select a current color pattern includes the steps of entering, via the simplified guest interface, data to indicate a decision to projectively draw upon the object and data corresponding to a point on the object; the step of processing the data to generate an output includes the step of identifying a pixel within a region corresponding to the point on the object and painting that pixel with a selected current color pattern; and the step of controlling the projection in response to the output includes the step of projecting the selected color pattern upon an area of the object corresponding to said pixel.
16. A method of projecting light onto a three-dimensional object comprising the steps of: (a) entering, via a user interface, graphics data defining a region corresponding to a portion the three-dimensional object; (b) retrieving data from a simplified guest interface indicative of a point on the object, said simplified guest interface being manipulable by a guest to identify various points on the object; (c) retrieving data entered by the guest at the simplified guest interface indicative of a decision by the guest to select a current color pattern to be projected upon the object and processing said data indicative of a decision to select a current color pattern; (d) retrieving data entered by the guest at the simplified guest interface indicative of a decision to project the current color pattern upon an area on the object and processing said data indicative of a decision to project the current color pattern upon an area of the object and said data indicative of a point on the object to select a region corresponding to said point and to paint that region with the current color pattern; (e) processing the data received to format an image containing the region to be projected upon the object; and (f) projecting the image upon the object.
17. An image display apparatus, comprising: a contoured, three-dimensional object; a user interface that generates a first group of electronic signals in response to input decisions of a user; a simplified guest interface, distinct from said user interface, that generates a second group of electronic signals in response to input decisions of a guest; a projector aligned to project a visual image upon said contoured, three-dimensional object; a data processor that is coupled to said user interface to receive said first group of electronic signals, and also to said simplified guest interface to receive said second group of electronic signals, said data processor having an output to said projector that is an electronic projection signal that defines said visual image and causes said projector to project the same in alignment upon said contoured, three-dimensional object, said data processor including software that directs said data processor to process said first group of electronic signals received from said user interface to generate parameters of an artwork file, said parameters corresponding to the contours of said contoured, three-dimensional object, software that causes said data processor to process said second group of electronic signals received from said simplified guest interface and said artwork file to define values of display variables associated within the parameters of said artwork file, and generate therefrom an electronic computer image that corresponds to said contoured, three-dimensional image by defining visual attributes to be imparted to locations upon said contoured, three-dimensional object in response to said defined values, and, software that generates said electronic projection signal from said electronic computer image and that causes said projector to project said visual image in response thereto.
18. A display apparatus according to claim 17, wherein said projector is a light valve projector that includes three superimposed subtractive light filters, a first filter approximately yellow in color, a second approximately magenta in color, and a third filter approximately cyan in color, said light filters superimposed along a common optical axis to subtractively create and project said visual image.
19. A display apparatus according to claim 17, wherein: said simplified guest interface is selected from one of a polhemus device, a computer mouse, a joystick and a stylus and digitizing pad; and, said second group of electronic signals includes a position signal that represents a location upon said contoured, three-dimensional object.
20. A display apparatus according to claim 19, wherein: said second group of electronic signals further includes a pattern selection signal that represents a guest's choice of pattern, from among a pallet of patterns, to be displayed at an approximate location upon said contoured, three-dimensional object, as indicated by said position signal; and, said display apparatus further comprises display means for displaying a current pattern to the guest, said current pattern selected from a pallet of patterns.
21. A display apparatus according to claim 19, wherein: said software that directs said data processor to process said first group of electronic signals includes software that directs said data processor to process said first group of electronic signals received from said user interface to define parameters for an artwork file, said parameters including an outline that corresponds to at least one physical attribute of said three-dimensional object and that defines a geographic region; said software that directs said data processor to process said second group of electronic signals includes software that directs said data processor to process said second group of electronic signals received from said simplified guest interface to define display variables within said parameters, including color and texture of said geographic region upon said three-dimensional object; and, said software that controls said projector includes software that directs said projector to project said visual image in response to receipt of each of said first group of electronic signals and said second group of electronic signals in real-time, such that said outline and alterations to said display variables are displayed when created and such that selected color and texture is displayed in general alignment upon said physical attribute.
22. A display apparatus according to claim 17, wherein: said software that directs said data processor to process said first group of electronic signals includes software that directs said data processor to process said first group of electronic signals received from said user interface to define parameters for an artwork file, including a contour outline that corresponds to said three-dimensional object and that defines a geographic region; and, said software that directs said data processor to process said second group of electronic signals includes software that directs said data processor to process said second group of electronic signals received from said simplified guest interface to define display variables within said parameters, including color and texture of said geographic region, and, software that selectively saves to memory a sequence of successive ones of said visual image, said sequence representative of animation to be imparted to said contoured, three-dimensional object by rapid projection of said successive visual images.
23. A method of projecting a visual image onto a contoured, three-dimensional object, to thereby impart visual attributes to the contoured, three-dimensional object using a computer, associated memory and graphics software, a projector, a user interface and a simplified guest interface, said method comprising the steps of: entering data into the user interface to define a computer artwork file, including a plurality of regions that correspond to portions of the contoured, three-dimensional object; entering data into the simplified guest interface to select one of a location upon the contoured, three-dimensional object and a pattern to be associated with a preselected location, the preselected location defined by data also entered into the simplified guest interface; collecting a plurality of such data input to the simplified guest interface, such that a plurality of simplified guest interface are associated with preselected locations; processing the collected data with the computer and generating an electronic computer image that corresponds to the contoured, three-dimensional object, the electronic computer image representative of the selected patterns and associated locations; storing the electronic computer image in memory for subsequent modification; and, generating with the computer an electronic projection signal that causes the projector to project the visual image such that selected patterns are displayed upon their associated locations upon the contoured, three-dimensional object.
24. A method according to claim 23, further comprising the step of repeatedly processing the electronic computer image in memory to interactively modify the visual image.
25. A method according to claim 23, further comprising the steps of: generating a sequence of successive, related electronic computer images; and, generating therefrom and projecting a corresponding sequence of visual images upon the contoured, three-dimensional object to impart animation thereto.
26. A method according to claim 23, wherein a liquid crystal filter is positioned between an objective lens and a condensing lens of the projector, wherein the liquid crystal filter is adapted to separately filter pixels of light transmitted through the filter, and wherein the step of generating an electronic projection control signal that causes said projector to project the visual image includes the steps of formatting the electronic projection signal to represent subtraction of light to thereby arrive at a formatted signal representation of the visual image; and, applying the formatted signal to the liquid crystal filter to thereby control the liquid crystal filter to selectively block light at pixels of the liquid crystal filter to thereby project the visual image.
27. A method according to claim 26, wherein at least three such liquid crystal filters are used, each constituting a different color filter and being optically superimposed with respect to each other, wherein said method further comprises the steps of: formatting the electronic projection signal to represent subtraction of light for each different color component of the three liquid crystal filters to thereby arrive at three representations of portions of the visual image; and, applying the three representations to associated liquid crystal filters to thereby control the liquid crystal filters to successively and selectively block light at pixels of the liquid crystal filters that corresponds to unwanted color components, to thereby project the visual image.
28. A method of projecting light onto a contoured, three-dimensional object using a computer, the computer having associated memory and running graphics software, a user interface that is adapted to be used in creating an artwork file, a simplified guest interface, distinct from the user interface, that permits a guest to select a pattern for projection onto a selected physical attribute of the contoured, three-dimensional object, and a projector that projects an image that is electronically generated by the computer, said method comprising the steps of: tracing an outline of the three-dimensional object with the user interface by interactively using the projector to project the outline onto the three-dimensional object, to thereby create a computer artwork file that defines parameters for graphics information that may be projected onto desired areas of the three-dimensional object; using the user interface to define regions bearing a spacial relationship to the outline and that thereby also correspond to locations on the contoured, three-dimensional object to thereby define further parameters of the artwork file; causing the computer to repeatedly format an electronic projection signal that represents a display image to be projected upon the contoured three-dimensional object, the display image sized and formatted such that projected regions align with their associated locations; projecting the display image represented by the electronic projection signal upon the contoured, three-dimensional object; and, providing the guest with the simplified guest interface to thereby allow the guest to select at least one of a location upon the contoured, three-dimensional object and a pattern (from among a pallet of patterns), and also to thereby allow the guest to indicate a decision to paint a selected location with a selected pattern.
29. A method according to claim 28, wherein each of the steps of causing the computer to repeatedly format an electronic projection signal, projecting the display image represented by the electronic projection signal upon the contoured, three-dimensional object and providing the guest with the simplified guest interface is repeatedly performed, such that once an outline and region information has been created by the user, a guest may repeatedly modify visual attributes imparted to the three-dimensional object by the display image.
30. A method according to claim 28, wherein the step of providing the guest with the simplified guest interface includes the step of thereby allowing the guest to indicate a decision to paint an entire region of the contoured, three-dimensional object (as defined by the artwork file) in which a selected location falls within with a selected pattern.
Patent Citations (9)
Non-Patent Literature (2)
- Microsoft Windows Paint User's Guide, Version 2.0, 1987, pp. 12-21.
- Microsoft Paintbrush User's Guide, 1986, pp. 34-35.