Copyright
The appendices to this patent application contain material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
Background
1. Field of the Invention
This invention relates to computer-interleaved barrier screen and lenticular autostereography.
2. Background of the Invention
The present invention is a modification of the autostereographic method and apparatus disclosed in U.S. Pat. No. 5,113,213, which is incorporated by reference herein (the '213 patent).
In the invention described in the '213 patent, the number of images and pitch of the resultant autostereogram are related to the resolution of the hardcopy output device by the following formula: ##EQU1##
Where pitch is the number of lines per unit of the completed autostereogram, resolution is the number of pixels per unit available from the hardcopy output device, and images is the number of images in the autostereogram.
Since images must be an integer not less than 2, there are only a finite number of possible resolutions. For example, if a hardcopy output device has a resolution of 16 pixels/mm (406.4 pixels per inch), 13 images yields a pitch of 31.26 lines per inch. Twelve images yields a pitch of 33.87 lines per inch. Other pitches, such as 32 lines per inch, are then unavailable without changing the resolution of the hardcopy output device.
This is illustrated in simplified form in FIG. 1. FIG. 1 shows that a device having an output resolution of 15 pixels per inch, and a pitch of 3 lines per inch, requires 5 images. In FIG. 1, each pixel is labeled according to which image (image 1, 2, 3, 4 or 5) it represents.
This is a severe limitation, especially when it comes to working with lenticular material. Such material must be created to exactly match one of the pitches available on the desired hardcopy output device. This is far more expensive and time consuming than using available lenticular material, which is unlikely to match the available pitches.
A second limitation arises from the loss of resolution and light from the use of large numbers of images with a parallax barrier. Even in the ideal case, the barrier screen blocks (N-1) of the N images at each location. The more images that are used, the less light is transmitted. The percent of light transmitted by a barrier screen image is also related to the resolution of the hardcopy output device by the following formula: ##EQU2##
For 13 images, 7.7% of the light is transmitted by the barrier screen. This is an acceptable amount of light for most applications. However, if 100 images are required at the resolution discussed above, the pitch for 100 images would be 4.064 lines per inch, and the amount of light transmitted by the barrier screen would be only 1%, which is unacceptable. Because many applications, e.g. animation, require 100 or more images, this is an important limitation.
A third limitation of the invention disclosed in the '213 patent arises from the output of images having a selected edge of the interleaved images aligned with the printing direction of the hardcopy output device. Although in many cases aligning the image with either the rows or the columns of the image is advantageous, this may be a significant limitation in certain cases, e.g., if the number of images required for a particular application is different from the ratio of the resolution to the pitch, or if the desired pitch is not available according to the formula given above for the pitch in a '213-type autostereogram.
Summary of the Invention
The present invention eliminates the linkage between the pitch, the number of images, and the resolution of the hardcopy output device. Eliminating this linkage allows for the production of autostereographic images with pitches previously unavailable, and allows for the use of a larger number of images at a given pitch.
The key step in the present invention is the rotation of the interleaved image with respect to the direction of printing and the direction of the digital representation. This rotation results in increased numbers of images per unit pitch, by trading vertical resolution for horizontal resolution. As shown by FIG. 2, rotating an image requires a larger available output image size, to accommodate space for the rotation. FIG. 2 uses the output device parameters of FIG. 1, i.e., a resolution of 15 pixels per inch and a pitch of 3 pixels per inch. However, the number of images shown in FIG. 2 is 10 (instead of the 5 images illustrated in FIG. 1). Each pixel is labeled with the image (1, 2, 3, 4, 5, 6, 7, 8, 9 or 10) that it represents. The 10 images are rotated at an angle of 53.13.degree..
In one embodiment of the present invention, the rotation is a step separate from the interleaving step. The images are first interleaved, as described in the '213 patent, and then the interleaved image is stored digitally for further processing. The interleaved digital image is then rotated to provide a second rotated and interleaved digital image. Generally, the rotated image is then scaled down to the desired size (i.e., to the desired number of pixels), since the interleaving should be made at a higher resolution than the resolution ordinarily available on the hardcopy output device. This scaling step is used to match a desired pitch. The scaling step is used so that interleaving can proceed at a higher pixel resolution than the resolution of the hardcopy output device. The high resolution interleaved image is scaled down to the appropriate output resolution after rotation, but retains the higher image count of the high resolution image.
In a second preferred embodiment of the present invention, the digital image is rotated and interleaved in a single operation on the computer.
The desired angle of interleaving may vary for different situations. In the case of image output as four-color separations for offset printing, the angle of interleaving should be selected as an angle which does not interfere with any of the four angles selected for printing each of the offset colors. In the case of other output devices, such as those capable of continuous tone output, the angle may be selected to allow a desired image to fit on the available output image size. It may also be selected to provide an optimum tradeoff between horizontal and vertical resolution.
A wide range of angles provide drastic improvements over the interleaving method disclosed in the '213 patent. Rotations by angles of 25.degree., 30.degree. and 55.degree. have been demonstrated to dramatically improve the horizontal resolution of the autostereograph. Because angles near 45.degree. produce undesirable effects, the preferred ranges for the angle of interleaving are 10.degree. to 35.degree. and 55.degree. to 80.degree..
The horizontal resolution of the autostereograph improves because many more images can be used to create a better three-dimensional effect, smoother animation, and more images in a multi-image display. For example, using the present invention an animation of 100 images was created at a pitch which would have only allowed 13 images if it had been created using the invention disclosed in the '213 patent. The present invention has also been used to match the pitch of an existing lenticular screen, with more images than can be practically obtained with optical methods. For practical reasons, the upper bound to the number of images that can be used for a given pitch and angle of rotation is likely to be: ##EQU3##
For example, at a resolution of 406.4 pixels per inch and a pitch of 31.26 per inch, the upper bound would be approximately 169 images. The lowest practical resolution of the output device is about 100 pixels per inch; devices with resolutions of 1,000 to 3,000 pixels per inch are also available. For example, the present invention has been implemented using a Kodak LVT, which has a resolution of approximately 2,000 pixels per inch. Use of output devices having a resolution of 300 pixels per inch is recommended.
Brief Description of the Drawings
FIG. 1 is a schematic diagram illustrating the requirement imposed by the resolution and pitch of the output device on the number of images that can be interleaved.
FIG. 2 is a schematic diagram illustrating rotation of the interleaved image of FIG. 1.
FIG. 3 is a schematic diagram of the apparatus of the present invention.
FIG. 4 is a schematic diagram of the overlapping dots produced by a four color scanner.
FIGS. 5a-5d define the parameters used in the algorithm of Appendix I.
Detailed Description of Preferred Embodiments of the Invention
FIG. 3 is a block diagram of the present invention. Apparatus 100 comprises one or more computers 105, which accept digital inputs from at least one of input device 104 (a keyboard or a mouse), memory 103 (hard disk, a floppy disk, tape or other type of memory), digital camera or video frame digitizer 102 for directly providing digital images, and image scanner 101 for converting hard copy, such as positive or negative film transparencies or prints, or other images into digital images.
Any suitable means for inputting data into computer 102 may be employed in apparatus 100. For example, a suitable digital camera is the Logitech Photoman (available from Logitech, Mountain View, Calif.), and a suitable scanner is the Epson ES-600C scanner.
Computer 105, e.g., an Indigo 4000 computer available from Silicon Graphics Corporation, is used to manipulate the input digital images to produce a digital representation of interleaved planar images.
The output of computer 105 is then directed to a suitable high resolution full color, gray scale, or black and white output imaging device 106, and/or a suitable high resolution halftone output imaging device 107, e.g., the Kodak model LVT. A suitable halftone output device is the model 6461E Expose Unit Laser scanner manufactured by Crosfield Electronics, Inc.
The color separations produced by the halftone output imaging device 107 are then used to create a full color image. This may be done by making plates from the separations and printing an image on an offset printer 110, or by making a proof from the separations using a proof process 111, such as Dupont Chromolin.TM. or Matchprint.TM..
Halftone dots are laid down by the scanner at different angles and varying sizes for different colors, the intersections of which form a rosette pattern. It should be understood that the angles and spacing of the dots have been carefully chosen by the scanner manufacturers to minimize moires with one another. As illustrated in FIG. 4, a typical four color scanner such as the Crosfield device (in its elliptic dot mode) forms images comprising overlapping dots corresponding to yellow 30, magenta 32, cyan 34, and black 36. Although illustrated for clarity as being disposed at mutual angles of 45.degree., the angles between the magenta 32 and cyan 34 dots and the yellow dot 30 are actually 15.degree. and the black dot 36 is at an angle of 30.degree. with respect to the magenta or cyan dots.
It is important to note that, when producing images intended for halftone output and production, such as for a printing press, the lines of interleaving effectively form a fifth color. When the pitch of interleaving is close to the pitch of the halftone screen and a lenticular or barrier screen is applied to the printed image, a moire may result between the lenticular or barrier screen and one or more of the halftone colors. This effect may be eliminated or minimized in one of three ways.
The first way to minimize or eliminate moire is to select the angle of interleaving specifically so as to not interfere with the angles of the four colors. In the case shown in FIG. 4, for example, the angle of interleaving could be selected to be 15.degree. with respect to the black and magenta angles. Any angle of interleaving may be selected in order to minimize or eliminate the effect of moire, and the required angle may be different from case to case due to image content, pitch, and other factors.
The second way to minimize or eliminate moire is to select the angles of the four colors to not moire with the desired angle of interleaving. This may not be possible on all halftone output devices, but if the output device supports variable halftone angles, this approach may be advantageous. It is obvious, and even more advantageous, that the halftone angles and angle of interleaving may be mutually selected to minimize or eliminate problems with moire.
The simplest solution is to eliminate the color angles entirely. This may be done by the use of random dot screening, also referred to as stochastic screening. In this process, which is described in U.S. Pat. Nos. 4,037,533 and 4,259,905, which are incorporated by reference herein, halftone color separations are produced with a random screen which has no halftone angles whatsoever, and thus cannot cause a moire problem.
As shown in FIG. 3, computer 105 may also output information to a suitable CRT monitor 108 that enables the interactive manipulation of data input to computer 105.
The raw output of interleaved images must then be attached to a means for viewing, e.g., devices 109, 113, 114 of FIG. 3. The means for viewing may be a lenticular screen, a parallax barrier, or a line light source as described in U.S. Pat. No. 4,717,949 (which is incorporated by reference herein), a holographic optical element, or other means for viewing. The means for viewing may be affixed to the front of the raw output or, in the case of the line light source, to the rear of the raw output. The means for viewing may be affixed in a variety of manners known in the art, including, but not limited to, manual registration and lamination and automatic registration and lamination.
The step of attaching the viewing means may be combined with the step of producing the output image by directly printing the image onto a suitable means for viewing, such as a lenticular or barrier screen, or by printing a barrier screen on the reverse side of a transparent substrate from the image, either using a double-sided output imaging device, or by offset printing on both sides of the substrate. When printing a barrier screen on the reverse of a substrate, the barrier screen must have sufficient density to block light and produce the barrier screen effect, and the substrate must have sufficient thickness to produce the depth effect. Whether using a double-sided output imaging device or offset printing, a means for either registering the image to the means for viewing or registering the means for viewing to the image must be provided. This may be provided by alignment of an edge of the substrate material, sprocket holes, optical sensing devices, or other means.
Typical pitches of lenticular screens used with the present invention are 135/inch and 80/inch. Typical pitches of barrier screens used with the present invention are 31/inch, 45/inch, 60/inch and 80/inch. Typical thicknesses of the substrate are 0.250 inches, 0.0625 inches and 0.03125 inches.
Algorithms
The following is an example of a first algorithm that can be used to implement the second preferred embodiment of the present invention, by rotating and interleaving images in a single operation in the computer. Pseudocode for implementing this algorithm is included herein at Appendix I. A computationally more optimal rotation algorithm, which makes use of vector mathematics and the consistency of direction of computation due to the angle of interleaving, is included herein, in Appendix II. The Appendix II algorithm alleviates the need for expensive computation of rotation (which would otherwise have to be computed using trigonometric functions). However, the present invention is more readily explained with respect to the algorithm of Appendix I.
The present invention is not limited to methods which implement either the algorithm of Appendix I or the algorithm of Appendix II. One skilled in the art would readily recognize that image rotation can be accomplished using any of a wide range of different computational techniques.
The algorithm of Appendix I computes the size (X.sub.os,Y.sub.os) of the digital representation of the output image and allocates the needed storage in the computer, given a desired output image size (X.sub.s,Y.sub.s) and a desired rotation angle .theta.. FIGS. 5a-5d define the parameters used in the algorithm.
In FIG. 5a:
X.sub.OS and Y.sub.OS are the horizontal size and vertical size, respectively, of the output image needed to hold the rotated image.
X.sub.S and Y.sub.S are the horizontal size and vertical size, respectively, of the image.
(X.sub.OC, Y.sub.OC) is the center of the output image.
(X, Y) is the current pixel in the output image.
.theta. is the angle of the interleave.
.phi. is the angle to the current pixel from the output vertical.
Thus we have: ##EQU4##
FIG. 5b shows an example of the interleaved but unrotated image. In the preferred embodiment of the invention, this image is an abstraction, and is never actually created. In FIG. 5b:
X.sub.S, Y.sub.S, .theta. and .phi. were defined above with respect to FIG. 5a.
(X.sub.C, Y.sub.C) is the center of the interleaved image
(X', Y') is (X, Y) transformed by rotation into interleaved image space.
FIG. 5c is a detail from FIG. 5b. In FIG. 5c:
Pitch is the number of lines per unit distance.
1, 2, . . . I . . . N is an indication of the image in that column.
N is the number of images.
I is the current image for a given pixel, 1.ltoreq.I.ltoreq.N.
(X', Y') is defined in FIG. 5b.
The dashed line in FIG. 5c indicates a group repeat line. The dashed-dotted line in FIG. 5c indicates an image line boundary.
FIG. 5d shows individual images schematically. In FIG. 5d:
(X.sup.I,Y.sup.I) is the desired pixel in image I.
The selection of the image at a current X in the interleaved image: ##EQU5##
The X position is scaled in the interleaved image in relation to the individual image: ##EQU6##
The Y position is scaled in the interleaved image in relation to the individual image: ##EQU7##
The size (X.sub.os,Y.sub.os) of the digital representation of the output image is greater than the desired output image size because the digital representation must have "dead space" in the corners to allow for the rotation of the image. For each of the pixels in the output image, take the (X,Y) coordinate of that pixel and rotate it by .theta. around the center of the output image (X.sub.oc,Y.sub.oc). If the new location (X',Y') is not in the active image area--i.e., if it does not lie within the rectangle of size (X.sub.s,Y.sub.s), set the color of the pixel to a color representing unused image area (generally, either black or white). If the new location falls within the rectangle, determine the image to which that pixel belongs, by finding the horizontal position of that pixel relative to the edge of the nearest repetition of the pitch of interleaving. This is computed by taking the remainder of dividing the X position by the inverse of pitch. The remainder represents the horizontal position of the pixel within the line. Dividing this remainder again by the inverse of the pitch yields a real number between 0 and 1 (inclusive of 0, exclusive of 1). Multiplying this number by the number of images and retaining only the integral part provides the image number of that pixel.
For example, to create an image 10 inches wide, with a pitch of 100 lines per inch, with 8 input images, the image represented in a pixel having the position 10.003 horizontally is obtained by:
(1) Dividing 10.003 by the inverse of the pitch (0.01) to obtain a quotient of 1000 and a remainder of 0.003;
(2) Dividing the remainder (0.003) by the inverse of the pitch again, to obtain the ratio 0.3;
(3) Multiplying this ratio (0.3) by the number of images (8) to obtain 2.4;
(4) The integral part of 2.4 is 2; this represents image number 3 (since the first image is assigned to 0).
The position of a pixel in the planar image corresponding to the position in the output image is then determined, and then the pixel in the output image is set equal to the value of the pixel at the corresponding position in the selected planar input image. This process is continued for all of the pixels in the output image.
This algorithm has two significant advantages over prior art algorithms: (1) it is independent of the resolution, and (2) it is independent of the number of images. Moreover, this algorithm adjusts automatically to the size and number of the input images.
There are two important variations on this algorithm. First, anti-aliasing may be achieved by supersampling each pixel of the output image, by computing an average of several subpixels within each output pixel. This increases the computation time for the algorithm, but may provide a better image, especially when combined with the use of a continuous tone hardcopy output device. Second, the value of a given pixel in the input planar images may be computed by interpolating values in-between the provided images. This latter change can greatly enhance the quality of the final image at a very modest decrease in speed. ##SPC1##