US 5,502,505 AGrant
Special Effect Video Apparatus for Achieving Extended Dimming and Fading Effects
Issue Date:1996-03-26
•4 Claims
•3 Drawing Sheets
Abstract
During the carrying out of a dim effect, a signal generated at a generator is mixed with a video signal and a matt signal at a mixer, a key signal and background signal are added at an adder, and the resultant signal is outputted. During the carrying out of a fade effect, in similar manner, the signal is mixed with the key signal and a fixed value signal at the mixer, the video signal and background signal are added at the adder, and the resultant signal is outputted. Extended dim effect and extended fade effect give depth to a picture with a color approximation where the depth of the image does not completely merge into the background.
Metadata
Assignee
- Sony Corporation
Inventors
- Tetsuro Nakata
- Motomu Ueta
Application Information
Application Number:US 219709&
Filing Date:1994-03-29
Priority Date:1993-03-30
Art Unit:262
Classifications
IPC:
H04N 5265H04N 5275G06F 1500
Field of Search:
348345395593-595;584;586;578139130;122
Patent Drawings (3 sheets)
Description
Background
The present invention relates to a special effect apparatus, and particularly to a special effect apparatus which extends dimming effects and fading effects and realizes new effects.
Recently, it has been possible to view on, for example, television programs, signal processed video images which have been curved and wrapped around a background image, and being displayed so as to appear to have been pasted on paper, with this image then appearing to have been turned over in the way that a piece of paper would be turned over.
With this kind of free use of special effects, when a composite image is formed from a background picture and a signal processed picture (i.e. a foreground picture), this composite image is displayed by switching over between these two pictures in accordance with a key signal for inputting. This key signal is generated in accordance with the inputted key signal.
While this composite picture is being constructed, depth data is given, for example, to each of the picture elements, the depth data for the picture elements for the number of pictures which the image is to be composed of is compared, so that processing can then be carried out whereby the picture elements for, for example, the foreground are displayed and the picture elements for the background are concealed. This depth data (known as Z data) is then used for each of the other various special effects.
By using this kind of depth data, if the picture has depth, a dim effect whereby the picture darkens to a certain extent or a fading effect whereby the picture merges into the background can be obtained which can be utilized while the picture is being formed.
A special effects apparatus for carrying out the dim effect and fade effect in the prior art will now be described.
FIG. 1 shows a block diagram of the circuit for carrying out the prior art dim and fade effects. As shown FIG. 1, a signal G.sub.Z which varies between 0 and 1 is generated in the key signal by the G.sub.Z generator 41 using the depth data (Z data). This G.sub.Z signal is given by the following.
For example, when a picture is being formed which will darken with depth, the key signal G.sub.z given by equation (1) is used. In equation (1), Z is the depth data, Z.sub.0 is a standard value for the depth data and Z.sub.g is the gain, or the extent to which the picture is dark.
When carrying out the dim effect, the switch 42 is switched to the terminal 43a so that the signal G.sub.Z is inputted to the multiplier 44. This G.sub.Z signal is then multiplied with the video signal S.sub.V inputted via the input terminal 45 (the multiplied signal is taken as being the signal S.sub.VG) . After this, the signal S.sub.VG, the key signal S.sub.K inputted via the input terminal 46 and the background signal S.sub.B are added together at the mixer 48, and a picture signal which constitutes the carrying out of the dimming effect is outputted via the output terminal 49.
When carrying out the fade effect, the switch 42 is switched to the terminal 43b so that the signal G.sub.Z is inputted to the multiplier 47. This G.sub.Z signal is then multiplied with the key signal S.sub.K inputted via the input terminal 46 (the multiplied signal is taken as being the signal S.sub.KG). After this, the signal S.sub.KG, the video signal S.sub.V inputted via the input terminal 45 and the background signal S.sub.B are added together at the mixer 48, and a picture signal which constitutes the carrying out of the fading effect is outputted via the output terminal 49.
The following problems were encountered when the dim and fade effects were carried out using the prior art circuit apparatus.
When carrying out the dim effect, as the signal G.sub.Z and the video signal S.sub.V are simply multiplied together at the multiplier 44, a certain amount of darkening will take place if the depth data for the picture has depth, but if the video signal S.sub.V is at zero when the signal G.sub.Z is at zero, the picture becomes completely black and the desired picture cannot be obtained.
In the same way, when carrying out the fading effect, as the signal G.sub.Z and the key signal S.sub.K are simply multiplied together at the multiplier 47, a certain amount of fading into the background will take place if the depth data for the picture has depth, but if the key signal S.sub.K is at zero when the signal G.sub.Z is at zero, the picture fades completely into the background and the desired picture cannot be obtained.
As the present invention is put forward as a result of the circumstances encountered in the prior art, while the dim effect is being carried out, when the above-described signal G.sub.Z is reflected on the video signal S.sub.V, the signal G.sub.Z is not simply multiplied with the video signal S.sub.V, but is instead mixed with a matt signal. Also, while the fade effect is being carried out, the signal G.sub.Z is not multiplied with the key signal S.sub.K to become one at the time of reflection, but is instead mixed with a fixed value signal.
It is therefore an object of the present invention to provide a special effects apparatus which, by carrying out the kind of mixing described above, can provide an extended dim effect and an extended fade effect where the dim effect does not become completely dark and the fade effect does not cause the picture to fade completely into the background.
Summary of the Invention
In order to solve the problems described above, in the present invention, a video special effect apparatus for performing signal processing on an input video signal to impose a special effect on the video signal comprises a mix control signal generating means for generating a mix control signal from depth data set corresponding to the video signal, a first mixing means, to which the video signal and a matt signal showing a predetermined color are supplied, for changing a mixture rate of and outputting the video signal and the matt signal according to the mix control signal, a second mixing means, to which a key signal and a fixed value signal having a value are supplied, for changing a mixture rate of and outputting the key signal and the fixed value signal according to the mix control signal, and a third mixing means, to which a background signal showing a background and an output signal of the first mixing means are supplied, for changing a mixture rate of the background signal and the output signal of the first mixing means according to an output signal of the second mixing means.
Also, the present invention further comprises a switch for selectively supplying the mix control signal to the first mixing means and the second mixing means.
While the key signal generated from the depth data is reflected by the input video signal and the input key signal, rather than simply multiplying these signals, by mixing them it becomes possible to enhance the prior art dim and fade effects.
Drawings
These and other features, aspects and advantages of the present invention will become better understood with reference to the following description, appended claims and accompanying drawings, in which
FIG. 1 is a circuit block diagram of the structure of a special effects apparatus of the prior art;
FIG. 2 is a circuit block diagram of the structure of a special effects apparatus for a first embodiment of this invention;
FIG. 3 is a simplified view of each of the signals relating to the extended dim effect in the special effects apparatus in this invention;
FIG. 4 is a simplified view of each of the signals relating to the extended fade effect for the special effects apparatus in this invention; and
FIG. 5 is a simplified view of the structure of a second embodiment of the special effects apparatus of the invention.
Description
The following is a description with reference to the diagrams of an embodiment of the special effects apparatus for this invention.
As shown in FIG. 2, the G.sub.Z generator 11 generates a G.sub.Z signal having a key signal which varies between 0 and 1, as is shown in the aforementioned equation (1), using the depth data (Z data). When the extended dim effect in this invention is to be carried out, the switch 12 is connected to terminal 13a so that the G.sub.Z signal is inputted to the mixer 14. At this time, the G.sub.Z signal is mixed with the video signal S.sub.V inputted via the input terminal 15a and the matt signal S.sub.M for showing the monochrome present inputted via the input terminal 15b by the mixer 14 and is outputted (this output signal is taken to be the signal S.sub.X). This signal S.sub.X is mixed to a value shown by the following equation. FIG. 3 shows a simplified view of the G.sub.Z signal, the video signal S.sub.V, the matt signal S.sub.M and the signal S.sub.X. ##EQU1##
After this, the signal S.sub.X, the key signal S.sub.K inputted via the input terminal 16a and the background signal S.sub.B are added and a picture signal for carrying out the extended dim effect is outputted via the output terminal 19.
The extended dim effect in this invention will now be explained. With the dim effect in the prior art, the picture was dark to a certain extent depthways, until finally becoming completely dark. However, with the extended dim effect, the picture does not finally become dark but can be made to become an arbitrarily selected color.
This is to say that by mixing the matt signal S.sub.M with the video signal S.sub.V at the mixer 14 in accordance with equation (2), as the value of the G.sub.Z signal generated based on the depth data, which varies between 0 and 1, becomes 0, then according to equation (2), S.sub.X =S.sub.M, i.e. only the matt signal S.sub.M is present in the signal S.sub.X during the period M in FIG. 3. It therefore follows that the color indicated by the matt signal S.sub.M is selected. By using this effect, for example, the foreground of the picture going depthways becomes a sepia color, and it is possible to carry out decoloring in the same way.
As shown in FIG. 2, when carrying out the extended fade effect for this invention, the signal G.sub.Z can be inputted to the mixer 17 by connecting the changeover switch 12 to terminal 13b. At this time, the signal G.sub.Z is mixed with the key signal S.sub.K inputted via the input terminal 16a and the fixed value signal S.sub.C showing a constant value inputted via the input terminal 16b by the mixer 14 and then outputted (this output signal is taken to be the signal S.sub.Y). The mixed value of this signal S.sub.Y is given by the following equation in the same way as equation (2). ##EQU2##
After this, the signal S.sub.Y, the video signal S.sub.V inputted via the input terminal 15a and the background signal S.sub.B are added together at the adder 18 to be outputted from the output terminal 19 as picture signal for carrying out the extended fade effect. FIG. 4 shows a simplified view of the G.sub.Z signal, the key signal S.sub.K, the fixed value signal S.sub.C and the signal S.sub.Y.
The extended fade effect for this invention will now be described. In the prior art, the picture blends into the background depthways until it finally blends in completely. By using the extended fade effect, rather than fade completely into the background, it is possible instead to fade while leaving an outline.
This is to say that by mixing the fixed value signal S.sub.C with the video signal S.sub.K at the mixer 17 in accordance with equation (3), as the value of the G.sub.Z signal generated based on the depth data, which varies between 0 and 1, becomes 0, then according to equation (3), S.sub.Y =S.sub.C, i.e. only the fixed value signal S.sub.C is present in the signal S.sub.Y during the period M in FIG. 4. It follows that by having a fixed value signal S.sub.C present while the adder 18 is adding, the value of the video signal S.sub.V does not become zero even when the value of the G.sub.Z signal becomes zero, so that any foreground picture will not merge completely with the background. By using this effect, by having, for example, a picture in the foreground to a certain extent in the depth direction, a construction becomes possible whereby this picture will fade into the background, but its outline will not.
In this embodiment, a changeover switch is used for changing over between the extended dim effect and the extended fade effect. However, terminals 13a and 13b can both be connected to the G.sub.Z generator 11 so that the changeover switch 12 is not used and the extended dim effect and the extended fade effect may be used simultaneously (see FIG. 5). In this way, while a foreground picture is fading into the background, a construction may be adopted whereby rather than fading completely into the background, an outline of the picture in a color indicated by the matt signal S.sub.M will remain.
It is also possible to carry out prior art dim effects and fade effects using the special effects apparatus in this embodiment. This can be achieved by setting the value of the matt signal S.sub.M to zero during the dim effect and by setting the value of the fixed value signal S.sub.C to zero during the fade effect.
By outputting a signal which results from the mixing together of a video signal and a matt signal in accordance with a signal G.sub.Z generated from depth data and/or a background signal in accordance with a key signal while carrying out a dim effect, it is possible to get an approximate image of a foreground picture related to its depth in a particular designated color. On the other hand, by mixing together and outputting a signal resulting from the mixing together of a key signal corresponding to a mixing control signal generated from depth data and a fixed value control signal with a video signal and a background signal corresponding to this resultant signal while a fade effect is being carried out, a foreground picture will not merge completely with the background picture but an outline will instead remain. Also, this apparatus is very economical when compared with the prior art apparatus as the scale of the additional circuitry for ensuring that the overall number of mixers is kept the same as the number of multipliers and can be kept small.
Claims
What is claimed is:
1. A video special effect apparatus for processing a special effect on an image corresponding to an input video signal, comprising: mix control signal generating means for generating a mix control signal based on depth data determined according to the video signal; first mixing means for receiving the video signal and a matte signal showing a predetermined color and for changing a mixing rate of the video signal and the matte signal according to the mix control signal and outputting an output signal corresponding to the image subjected to an extended dim effect, the output signal representing the predetermined color when the video signal is identical to the matte signal; and second mixing means for receiving a background signal showing a background and the output signal of the first mixing means and for changing a mixing rate of the background signal and the output signal of the first mixing means according to a key signal.
2. A video special effect apparatus for processing a special effect on the image corresponding to an input video signal, comprising: mix control signal generating means for generating a mix control signal based on depth data determined according to the video signal; first mixing means for receiving a key signal and a fixed value signal having a constant value and for changing a mixing rate of the key signal and the fixed value signal according to the mix control signal and outputting an output signal; and second mixing means for receiving a background signal showing a background and the video signal and for changing a mixing rate of the background signal and the video signal according to the output signal of the first mixing means to generate a mixed signal corresponding to a processed image subjected to an extended fade effect, the processed image being the background with an outline of the original image when the key signal is identical to the fixed value signal.
3. A video special effect apparatus for processing a special effect on an image corresponding to an input video signal, comprising: mix control signal generating means for generating a mix control signal based on depth data determined according to the video signal; first mixing means for receiving the video signal and a matte signal showing a predetermined color and for changing a mixing rate of the video signal and the matte signal according to the mix control signal and outputting a first output signal corresponding to the image subjected to an extended dim effect, the first output signal representing the predetermined color when the video signal is identical to the matte signal; second mixing means for receiving a key signal and a fixed value signal having a constant value and for changing a mixing rate of the key signal and the fixed value signal according to the mix control signal and outputting a second output signal; and third mixing means for receiving a background signal showing a background and the first output signal and for changing a mixing rate of the background signal and the first output signal according to the second output signal to generate a mixed signal corresponding to a processed image subjected to the extended dim effect and an extended fade effect, the processed image being the background with an outline of the original image when the key signal is identical to the fixed value signal.
4. The video special effect apparatus according to claim 3, further comprising a switch for selectively supplying the mix control signal from the mix control generating means to one of the first mixing means and the second mixing means.