Video Special Effect Processor

1. Field of the Invention

This invention relates to a video special effect processor for performing video special effect processing on a digital video signal, and more particularly to a video special effect processor for performing video special effect processing on a digital video signal by using depth information.

2. Description of the Prior Art

In preparing television broadcasting programs or video software, etc., a video special effect processor, e.g., as shown in U.S. Pat. No. 4,954,898, is sometimes used. Further, in using video special effect processors of this kind, there are instances in which it is required to synthesize a plurality of images to form a single image. In order to provide such a special effect with synthesis of an image, there is carried out a process such that depth information is added, e.g., to each respective pixel to allow comparison between values of the depth information for pixels corresponding to a plurality of images to be synthesized so that only pixels toward the foreground are displayed and deeper pixels are concealed. In addition, for the purpose Of realizing various special effects, the above-mentioned depth information (which will hereinafter also be called z information) is used.

For example, FIG. 1A shows a display content of a first image, wherein a circle 1 is arranged at a depth position z.sub.1 closest to the screen, and a rectangle 2 is arranged at a depth position z.sub.2 remotest from the screen. On the other hand, FIG. 1B shows a display content of a second image, wherein a triangle 3 is arranged at an intermediate depth position z.sub.3. When such an arrangement of images is assumed, the dimensional relationship of respective depth positions is expressed as follows:

In order to synthesize these two images FIGS, 1A and 1B to provide an image as indicated by FIG. 1C, a hidden portion process corresponding to the respective depth positions z.sub.1, z.sub.2 and z.sub.3 is required. In actual terms, at the portion where the circle 1 of the image FIG. 1A and the triangle 3 of the image FIG. 1B overlap with each other, the circle 1 is displayed and the triangle 3 is concealed or masked because the relationship z.sub.1 <z.sub.3 holds. On the other hand, and at the portion where the rectangle 2 of the image FIG. 1A and the triangle 3 of the image FIG. 18 overlap with each other, the rectangle 2 is concealed or masked and the triangle 3 is displayed because the relationship z.sub.2 >z.sub.3 holds. It is to be noted that while, for brevity of explanation in FIGS. 1A to 1C, respective shapes 1, 2 and 3 are taken as plane figures in parallel to the screen, i.e., depth positions at all points within the respective shapes are assumed to be equal to each other, depth information is given in practice for each respective pixel of the images.

Meanwhile, although it is possible to transmit the depth information as a parallel digital signal, in such a case, because the depth information is, e.g., several tens of bits per pixel, an exclusive multicore cable is required. Further, an exclusive matrix switcher is required in order to carry out switching between such signals. As a result, the entire system configuration becomes undesirably complicated.

An object of this invention is to provide a video special effect processor in which the configuration of the transmitting means for transmitting depth information indicative of a position in a depth direction of a digital video signal is permitted to be simplified.

To attain the above-mentioned object of this invention, in accordance with this invention, there is provided a video special effect processor for performing video special effect processing on a digital video signal, which comprises first image processing means for outputting a first serial digital video signal in a predetermined format and data indicative of depth information for the first serial digital video signal in the form of serial data that conforms to the predetermined format, second image processing means for outputting a second serial digital video signal in the predetermined format and data indicative of depth information for the second serial digital video signal in the form of serial data that conforms to the predetermined format, and synthesis means supplied with an output signal from the first image processing means and an output signal from the second image processing means to synthesize the first and second serial digital video signals on the basis of the data indicative of depth information for the first digital video signal and the data indicative of depth information for the second serial digital video signal.

FIGS. 1A to 1C are schematic diagrams for explaining depth information for a video signal used in a video special effect processor.

FIG. 2 is a block diagram showing an embodiment of a video special effect processor in accordance with the invention.

FIG. 2 is a circuit diagram showing in a block form an embodiment of a video special effect processor according to this invention.

In FIG. 2, a plurality of image processing units, e.g., n image processing units 11a to 11n, are digital image processing units such as so called digital multieffectors, etc. These units serve to output the above-mentioned depth information (z information) along with respective digital video signals. More specifically, each of the image processing units 11a to 11n respectively outputs digital video signals that may be digital component video signals in the so-called D1 format, so-called key signals for switching images and the above-mentioned depth information. The digital video signal is such that the luminance (Y) signal has a data rate of 10 bits at a sampling frequency of 13.5 MHz and two color difference (B-Y, R-Y) signals each have a data rate of 10 bits at a sampling frequency of 6.75 MHz. The total data rate for serial transmission is therefore 270 Mbps. These serial video signals are transmitted through transmission lines 12V in accordance with predetermined standards. The key signal has the same sampling rate as that of the above-mentioned luminance signal. If one sample is, e.g., 10 bits, the serial transmission rate is 135 Mbps. Such key signals are transmitted through transmission lines 12K each using a coaxial cable according to the same standards as those for the video signal transmission cable. The above-mentioned depth information has a sampling rate of 13.5 MHz which is the same as that of the luminance signal. If one sample is, e.g., 20 bits (the original z information is 19 bits and 1 bit is added thereto), the serial transmission rate is 270 Mbps. This transmission rate is equal to the transmission rate of the video signal. This means that such depth information can be transmitted by way a video signal transmission line 12V. Accordingly, such depth information are transmitted by using transmission lines 12Z each using a coaxial cable according to the same standards as those for the transmission line 12V. Namely, three transmission lines 12V, 12K and 12Z connected each of the respective image processing units 11a to 11n, are constituted transmission cables, i.e. coaxial cables, meeting the same standards as those conventionally used for carrying out serial transmission of a video signal in the so-called D1 format.

Video signals, key signals and depth information transmitted through the transmission lines 12V, 12K and 12Z respectively connected to the image processing units 11a to 11n are delivered to, e.g., a digital matrix switcher 13, at which switching selection of the transmission route (so-called routing) is carried out. The routed signals are provided as outputs by matrix switcher 13. The matrix switcher 13 arbitrarily switches a plurality of inputs to output a plurality of outputs in a distributed manner. For this purpose, the conventional device for carrying out routing control of a video signal in the so-called D1 format may be used without modification Specifically, the matrix switcher 13 can be taken to be a switcher capable of effectively carrying out routing control of an input signal having a data rate up to the 270 Mbps without loss. As long as an input signal satisfies such a data rate, the matrix switcher is unaffected by whether that input signal is a video signal, a key signal or depth information. Accordingly, effective video signals, key signals and depth information are taken out from the respective output terminals of the matrix switcher 13, and are transmitted through transmission lines 14V, 14K and 14Z, respectively. Of course, coaxial cables which can be used for carrying out the serial transmission of a video signal in the so-called D1 format may be used for these transmission lines 14V, 14K and 14Z.

Then, several sets of video signals, key signals and depth information respectively transmitted through the transmission lines 14V, 14K and 14Z are sent to an image synthesizer (so-called combiner) 15, at which an image synthesis process as has been described with reference to FIG. 1 is executed on the basis of the depth information. The video signal for the synthesized image is taken out through a transmission line 16V, and the key signal is taken out through a transmission line 16K. Further, if depth information for each respective pixel of a synthesized image is required, such information may of course be taken out through a coaxial cable satisfying the standards for carrying out the serial transmission of a video signal in the so-called D1 format.

Accordingly, by employing such a configuration, it becomes unnecessary to provide a multi core cable exclusive for transmission of depth information, or the like. Further, equipment for a video signal in the so-called D1 format can be used without modification as a matrix switcher, etc. Thus, the system configuration can be significantly simplified. In addition, coaxial cables and/or equipment meeting the standards for the video signal used in this embodiment can be supplied at low cost based on mass-production.

It is to be noted that this invention is not limited to the above-described embodiment. For example, while an approach is adopted in the above-described embodiment to transmit the key signal and the depth information through individual transmission lines, if the key signal is assumed to be 8 bits and the depth information is assumed to be 12 bits (13.5 MHz in the both cases) so that the total bit rate falls within 270 Mbps, a single transmission line (coaxial cable meeting the so-called D1 format standards) may be used to transmit both the key signal and depth information. Further, while the above-described embodiment has been discussed only in connection with a digital video signal in the so-called D1 format, this invention is similarly applicable to the case of a digital composite video signal in the so-called D2 format. That is, in the latter case, there may be employed a system configuration in which a transmission line meeting the same standards as those for the line for serial transmission of a video signal is used to transmit depth information.

As is clear from the foregoing description, a video special effect processor according to this invention, a serial transmission line meeting the same standards as those for a serial transmission line through which a digital video signal is transmitted, e.g., a coaxial cable, is used to transmit depth information. Accordingly, it becomes unnecessary to provide e.g., a multi core exclusive cable or an exclusive matrix switcher, etc. for transmitting depth information. Thus, the entire signal transmission system is simplified, and relatively inexpensive cable and/or equipment can be used.