US 5,990,978 AGrant
Luminance/Chrominance Signal Separating Device
Issue Date:1999-11-23
•2 Claims
•3 Drawing Sheets
Abstract
A luminance/chrominance (Y/C) signal separating device utilizing motion estimation and compensation. According to the device, the image motion is detected in the unit of a 2.times.2 (sample.times.line) block to separate an NTSC television signal into the Y and C signals. As a result of the motion detection, a three-dimensional Y/C signal separation is performed with respect to a still image, while a three-dimensional Y/C signal separation with the motion estimation and compensation in the unit of the 2.times.2 (sample.times.line) block in a predetermined region of the previous frame is performed with respect to a moving image. A two-dimensional Y/C signal separation is performed with respect to the moving image whose motion is not compensated in the unit of a 2.times.1 (sample.times.line) block in the present frame.
Metadata
Assignee
- LG Electronics Inc.
Inventors
- Joo Won Kim
- Woo Jin Song
Application Information
Application Number:US 8223424
Filing Date:1997-03-20
Priority Date:1996-03-23
Art Unit:274
Classifications
IPC:
H04N 978
Field of Search:
348669;668;667;670;663;665;700;908
Patent Drawings (3 sheets)
Description
Background of the Invention
1. Field of the Invention
The present invention relates generally to image signal processing and specifically a luminance/chrominance signal separating technique utilizing motion estimation and compensation. In particular, the present invention relates to a three-dimensional (3-D) luminance/chrominance (Y/C) signal separating device which can provide a high quality image by selectively performing one of a 3-D Y/C signal separation, motion-compensated 3-D Y/C signal separation, and Y/C signal separation per block using a 2-D field comb filter in accordance with the detected image motion.
2. Description of the Prior Art
Conventionally, in the composite video signals of the National Television System Committee (NTSC) system which has been adopted in many countries in the world, the chrominance (C) signal is modulated into a chrominance subcarrier and then interleaved in spectral spaces existing between the frequency spectrums of the luminance signal so as to be compatible with black/white television signals.
In order to separate the luminance signal and the chrominance signal interleaved by the frequency multiplication in the NTSC system, a horizontal filter was first introduced, and subsequently a one-line vertical filter and a two-line vertical filter have been used as the Y/C signal separating device. Recently, a motion-compensated 3-D comb filter using frame memories has been commercialized as a large scale integrated circuit (LSI) and gradually applied to a high definition television.
The horizontal filter may be classified into a horizontal low-pass filter and a horizontal band-pass filter. In the Y/C signal separating device using the horizontal low-pass filter, the Y signal is first separated from the composite video signal through the low-pass filter to remove the low frequency band of the chrominance subcarrier, and then the separated luminance component is subtracted from the composite video signal to separate the chrominance signal.
In the Y/C signal separating device using the line vertical filter, the Y/C signal separation is performed utilizing the characteristic of the phase inversion for each line of the composite video signal.
In the Y/C signal separating device using the motion-compensated 3-D comb filter, the Y/C signal separation is performed by properly mixing the output of a 2-D Y/C signal separating filter and the output of a 3-D frame comb filter, based on the value of k which is determined by the output signal of a motion detector. For example, if the k value is "0" when no motion is detected, a 3-D Y/C signal separation is performed, while if the k value is "1" when the detected motion is great, a 2-D Y/C signal separation is performed. with respect to the intermediate values between the values "0" and "1", an adaptive Y/C signal separation is performed. In detecting the image motion, the Y component is detected by the one-frame difference value of the low frequency component of the Y signal, while the C component is detected by the difference values between the Y signal of a high frequency band and the C signals of two frames. Alternatively, the C component may be detected by the difference value between the Y signal of the high frequency band and the C signal of one frame.
According to the conventional Y/C signal separating device as described above, however, the horizontal band-pass filter provides a relatively good Y/C signal separation function in the event that a small change of image occurs in a horizontal direction, but has a drawback that the Y/C signal separation is not satisfactorily performed due to the color interference and luminance interference in the event that a large change of image occurs in the horizontal direction, thereby deteriorating a horizontal resolution of the image.
The vertical filter has a drawback that dot crawling and color interference may occur when a correlation in a vertical direction is lowered. Also, the motion-adaptive 3-D comb filter has a drawback that the motion estimation and compensation are not effectively performed, and thus the separation of the Y/C signal is inaccurately performed, thereby causing the luminance interference and color interference to occur.
Summary of the Invention
It is an object of the present invention to provide a Y/C signal separating device capable of providing a high quality image by performing the Y/C signal separation in accordance with the level of image motion which is detected in the unit of a block.
In the present invention, the image motion is detected in the unit of a block, and if no motion is detected, a 3-D Y/C signal separation is performed with respect to the still image signal using a frame comb filter, while if motion is detected, motion estimation is performed in a predetermined regions of the previous frame, being based on the position of the present frame. In estimating the motion, if a coincident block exists, the 3-D Y/C signal separation is performed, while if no coincident block exists, the 2-D Y/C signal separation is performed using the 2-D field comb filter.
According to the present invention, there is provided a Y/C signal separating device includes two frame memories, a motion detecting section, a 3-D Y/C signal separating section, a motion estimation section, a motion-compensated 3-D Y/C signal separating section, and a 2-D Y/C signal separating section.
The frame memories temporarily store a digital composite video signal per frame, and the motion detecting section detects motion of a previous frame and a present frame in the unit of a block, being based on the composite video signal outputted from the frame memories, respectively, and determines whether the present frame corresponds to a still image or an image in motion.
The 3-D Y/C signal separating section performs a 3-D Y/C signal separation with respect to the still image detected by and outputted from the motion detecting section, and the motion estimation section estimates whether the image in motion can be motion-compensated or not if the present frame is detected to correspond to the image in motion by the motion detecting section.
The motion-compensated 3-D Y/C signal separating section performs a motion-compensated 3-D Y/C signal separation with respect to the image in motion if the image in motion is estimated to be able to be motion-compensated by the motion estimation section, and the 2-D Y/C signal separating section performs a 2-D Y/C signal separation in the unit of a block with respect to the image in motion if the image in motion is estimated not to be able to be motion-compensated.
Brief Description of the Drawings
The above object, other features, and advantages of the present invention will become more apparent by describing the preferred embodiment thereof with reference to the accompanying drawings, in which:
FIG. 1 is a block diagram of the Y/C signal separating device according to the present invention.
FIGS. 2A and 2B illustrate the state of the N-th and (N-1)-th frames with a sampling rate of 4.times.fsc according to the present invention.
FIGS. 3A and 3B illustrate the state of the N-th and (N-1)-th frames for explaining the Y/C signal separating function with respect to a still image according to the present invention.
FIG. 4 illustrates the Y/C signal separation range of the (N-1)-th frame according to the present invention.
FIG. 5 illustrates the state of the field type 2-D Y/C signal separation according to the present invention.
Detailed Description of the Preferred Embodiment
FIG. 1 is a block diagram of the 3-D Y/C signal separating device according to the present invention. Referring to FIG. 1, the device according to the present invention includes an analog-to-digital (A/D) converter 1 for converting an analog composite video signal CVBS into a digital signal, and frame memories 2 and 3 for temporarily storing an (N-1)-th frame and an N-th frame of the digital composite video signal outputted from the A/D converter 1, respectively.
A motion detecting and estimation block 4 comprises a motion detecting section 4A and a motion estimating section 4B. The motion detecting section 4A detects the motion of the previous frame and the present frame respectively outputted from the frame memories 2 and 3 in the unit of a block, and determines whether the present frame corresponds to a still image or an image in motion. The motion estimation section 4B estimates whether the image in motion can be motion-compensated or not if the present frame is detected to correspond to the image in motion by the motion detecting section 4A.
A 3-D Y/C signal separating section 5 performs a 3-D Y/C signal separation with respect to the still image detected and outputted from the motion detecting section 4A. A motion-compensated 3-D Y/C signal separating section 6 performs a motion-compensated 3-D Y/C signal separation with respect to the image in motion if the image in motion is estimated to be able to be motion-compensated by the motion estimation section 4B, and the 2-D Y/C signal separating section 7 performs a 2-D Y/C signal separation in the unit of a block with respect to the image in motion if the image in motion is estimated by the motion estimation section 4B as being incapable of motion compensation.
A switch 8 selects one of Y and C signals separated by the 3-D Y/C signal separating section 5, the motion-compensated 3-D Y/C signal separating section 6, and the field type 2-D Y/C signal separating section 7, respectively, under the control of a motion detecting and estimation block 4, and outputs the selected Y and C signals to the circuits that follow.
The operation of the Y/C signal separating device according to the present invention will be explained in detail.
The input analog composite video signal CVBS is converted into the digital signal through the A/D converter 1, and then the digital composite video signal is stored in the frame memory 2. The composite video signal read out from the frame 2 is then stored in the frame memory 3, being delayed by one frame. As a result, the frame memory 3 stores the composite video signal of the current frame (i.e., N-th frame), and the frame memory 2 stores the composite video signal of the previous frame (i.e., (N-1)-th frame).
The motion detecting section 4A detects the image motion of the two adjacent frames, i.e., the N-th frame and the (N-1)-th frame respectively outputted from the frame memories 3 and 2 in the unit of a block, and determines whether the present frame corresponds to a still image or an image in motion.
If it is determined that the present frame corresponds to the still image, it is separated into a Y signal and a C signal through the 3-D Y/C signal separating section 5. Meanwhile, if it is determined that the present frame corresponds to the image in motion, it is outputted to the motion estimation section 4B so as to estimate the motion of the image. The image in motion, which is estimated to be able to be motion-compensated, is inputted to the 3-D Y/C signal separating section 6, so that 3-D Y/C signal separation with motion compensation is performed with respect to the image in motion. The image in motion, which cannot be motion-compensated, is inputted to the field type 2-D Y/C signal separating section 7, so that 2-D Y/C signal separation in the unit of a block is performed with respect to the input image in motion.
The Y and C signals separated by the 3-D Y/C signal separating section 5, the motion-compensated Y/C signal separating section 6, and the field 2-D Y/C signal separating section 7 are selected through the switch under the control of the motion detecting and estimation block 4, and then the selected Y and C signals are outputted to the circuits that follow.
First, the operation of the motion detecting section 4A will be explained in more detail.
Motion detection is essential for the motion-adaptive 3-D Y/C signal separation. In performing the motion detection, the Y/C signal separation is performed in the unit of a pixel in such a manner that the NTSC color signal, which is locked in the color burst signal with a frequency of 4.times.fsc (where fsc represents the frequency of subcarrier for the color difference signal), is quantized, high-pass-filtered, and then separated into the Y and C signals by 2 or 3 lines.
In the embodiment, the present frame and the previous frame are separated into the Y signals (Y) and C signals (I and Q), respectively, in the unit of a block which is composed of four samples sampled at a frequency of 4.times.fsc, and the respective Y signals Y and C signals I and Q are compared with each other. FIGS. 2A and 2B show the samples of the present frame and the previous frame, which are sampled at 4.times.fsc. As shown in FIGS. 2A and 2B, the phase of the sample is inverted by 180.degree. every line, every field, and every frame, and a unit block shown as a dotted line includes 4 sample pixels.
Referring to FIGS. 2A and 2B, if it is assumed that four samples surrounded by a dotted line are to be separated into Y and C signals, the Y signal of the N-th frame is first separated in accordance with the following expression:
The C signals I and Q of the N-th frame are separated in accordance with the following expressions:
Since the hue of the N-th frame is constant, it is calculated by the following expression: ##EQU1##
If the separated Y signal is within the range of the quantization level corresponding to 0-100 IRE (Institute Radio Engineer), that is, 64<Y<214, and if the separated C signal satisfies the following expression under the condition of 20.5<.vertline.C.sub.n .vertline.<22.5,
the corresponding block contains the C signal. Otherwise, the corresponding block contains the Y signal. By the same method, the Y and C signals Y, I, and Q of the block of the (N-1)-th frame are separated and then compared.
The condition of the motion detection may be classified into the three following kinds.
First, if it is assumed that p.times.1 and p.times.2 are luminance or chrominance variables of the blocks of the previous and present frames, respectively, the motion detection condition will be that the block signal of the N-th frame is the Y signal "2", and the block signal of the (N-1)-th frame is the C signal "1", in accordance with the following expression:
Second, the motion detection condition will be that the block of the N-th frame is the block of the C signal, and the block of the (N-1)-th frame is the block of the Y signal, in accordance with the following expression:
Third, the motion detection condition will be that the block N-th frame is the block of the C signal, the block of the (N-1)-th frame is the block of the C signal, and the variable values of the C signals I and Q are more than the value of k, in accordance with the following expression: ##EQU2##
Now, the operation of the 3-D Y/C signal separating section 5 for performing the 3-D Y/C signal separation with respect to the still image will be explained in more detail.
If no motion is detected, the image is deemed to be a still image, and the 3-D Y/C signal separation is performed using the four sample blocks of the N-th frame and those of the (N-1)-th frame. The condition for the still image will be that both the N-th frame and the (N-1)-th frame correspond to the Y signal, or if both the N-th frame and the (N-1)-th frame correspond to the C signal, then the value of k is less than "10".
In performing the 3-D Y/C signal separation, as shown in FIGS. 3A and 3B, if it is assumed that X0 is the composite video signal of the N-th frame, and X1 is the composite video signal of the (N-1)-th frame, the Y signal of the j-th line is separated from the present N-th frame and the previous (N-1)-th frame, in accordance with the following expression:
Also, the j-th C signal and the (i+1)-th C signal are separated in accordance with the following expressions;
By the same method, the Y and C signals of the (j+1)-th line are separated. The 3-D Y/C signal separation as described above can eliminate the color interference phenomenon.
Next, the operation of the motion-compensated 3-D Y/C signal separating section 6 will be explained in more detail.
The motion-compensated 3-D Y/C signal separating section 6 adopts the motion estimation technique which is one of the coding methods for effectively transmitting video signals. Specifically, the motion-compensated 3-D Y/C signal separating section 6 performs the 3-D Y/C signal separation with respect to the NTSC type composite video signal by motion estimation and motion compensation utilizing a block matching method which is a type of region matching method.
The size of a block is preferably determined so that a block is composed of two lines in a vertical direction and one pixel (one sample) in a horizontal direction. If the size of the block is determined to be larger than that as above, a blocking effect is generated. Also, the search for motion between frames for the motion estimation is generally performed in the range of about .+-.7 pixels in the horizontal direction and in the range of about .+-.4 lines in the vertical direction.
According to the simulation experiment according to the present invention, a full search method was adopted as the motion search method, and the search was made in the range of .+-.7 blocks in the horizontal direction and of .+-.7 blocks in the vertical direction. FIG. 4 shows the range of the motion estimation utilized in the experiment according to the present invention.
Referring to FIG. 4, the block composed of four samples (i, j), (i+1, j), (i, j+1), and (i+1, j+1) in the (N-1)-th frame has an inverted phase with respect to the corresponding block composed of four samples (i, j), (i+1, j), (i, j+1), and (i+1, j+1) of the N-th frame, but has the same phase as the adjacent block composed of four samples (i+2, j), (i+3, j), (i+2, j+1), and (i+3, j+1). Accordingly, with respect to the block having the same phase in the (N-1)-th frame, the absolute value of the color difference is obtained by the following expression:
With respect to the block having the inverted phase, the color difference is obtained by the following expression:
Also, the luminance difference is obtained by the following expression:
If the luminance difference and the color difference is less than 5 and 1, respectively, it is determined that the blocks are the same. Specifically, if the block of the previous (N-1)-th frame, which is determined to be the same block as the present N-th frame, has the inverted phase, the motion-compensated 3-D Y/C signal separation is performed in accordance with the expressions 9 to 11. If the block of the previous frame has the same phase, the motion-compensated Y/C signal separation is performed in accordance with the expressions 9-11, considering the j-th line of the present frame as the (j+1)-th line of the previous frame, and considering the (j+1)-th line of the present frame as the j-th line of the previous line.
Lastly, the operation of the 2-D Y/C signal separating section 7 for performing the 2-D Y/C signal separation using a field comb filter will be explained in more detail.
In the event that the 3-D Y/C signal separation cannot be performed by the motion estimation and the motion compensation, the 2-D Y/C signal separation is performed in accordance with the expressions 1 to 3, using a field correlation between the j-th and (j+1)-th lines of the present N-th frame, as shown in FIG. 5. Further, the 2-D Y/C signal separation may be performed by a correlation-adaptive 2-D Y/C signal separating filter.
In conclusion, according to the present invention, the image motion is detected in the unit of a 2.times.2 (sample.times.line) block to separate the NTSC type television signal into the Y and C signals. If no motion is detected, the 3-D Y/C signal separation is performed with the motion estimation and compensation in the unit of a 2.times.2 (sample.times.line) block in the predetermined region of the previous frame. With respect to the image portions whose motion has not been estimated, the field 2-D Y/C signal separation is performed in the unit of a 2.times.1 (sample.times.line) block in the present frame.
In implementing the prefered embodiment of the present invention, the increase in the memory has been given less consideration since price of the semiconductor memory employed therein decreases steadily according to advances in the semiconductor manufacturing techniques. The present invention may adopt a tree step search for motion in place of the full search for motion estimation as described above for practicality.
From the foregoing, it will be apparent that the present invention provides the advantages in that it can provide a high quality image by selectively performing one of the 3-D Y/C signal separation, motion-compensated 3-D Y/C signal separation, and 2-D Y/C signal separation in accordance with the image motion detected in the unit of a block.
While the present invention has been described and illustrated herein with reference to the preferred embodiment thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.
Claims
What is claimed is:
1. A luminance/chrominance (Y/C) signal separating device comprising: a memory for temporarily storing an input composite video signal; a motion detecting section for detecting a motion of a previous image and a present image in the unit of a predetermined block, based on the composite video signal outputted from the memory, and determining whether the present image corresponds to a still image or a moving image; a three-dimensional Y/C signal separating section for performing a three-dimensional Y/C signal separation with respect to the still image if the present image is detected to correspond to the still image by the motion detecting section, the three-dimensional Y/C signal separating section performing the three-dimensional Y/C signal separation utilizing a four-sample block of the present image and a corresponding four-sample block of the previous image; a motion estimation section for estimating whether or not the moving image can be motion-compensated if the present image is detected to correspond to the moving image by the motion detecting section; a motion-compensated three-dimensional Y/C signal separating section for performing a motion-compensated three-dimensional Y/C signal separation with respect to the moving image if the motion estimation section estimates that the moving image can be motion-compensated; and a two-dimensional Y/C signal separating section for performing a two-dimensional Y/C signal separation with respect to the moving image if the motion estimation section estimates that the moving image cannot be motion-compensated.
2. A luminance/chrominance (Y/C) signal separating device comprising: a memory for temporarily storing an input composite video signal; a motion detecting section for detecting a motion of a previous image and a present image in the unit of a predetermined block, based on the composite video signal outputted from the memory, and determining whether the present image corresponds to a still image or a moving image; a three-dimensional Y/C signal separating section for performing a three-dimensional Y/C signal separation with respect to the still image if the present image is detected to correspond to the still image by the motion detecting section, the motion-compensated three-dimensional Y/C signal separating section performing the three-dimensional Y/C signal separation by motion-estimating and motion-compensating the composite video signal utilizing a block matching method wherein the size of the block is determined so that it is composed of two lines in a vertical direction and one pixel in a horizontal direction; a motion estimation section for estimating whether or not the moving image can be motion-compensated if the present image is detected to correspond to the moving image by the motion detecting section; a motion-compensated three-dimensional Y/C signal separating section for performing a motion-compensated three-dimensional Y/C signal separation with respect to the moving image if the motion estimation section estimates that the moving image can be motion-compensated; and a two-dimensional Y/C signal separating section for performing a two-dimensional Y/C signal separation with respect to the moving image if the motion estimation section estimates that the moving image cannot be motion-compensated.
Patent Citations (33)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4107736 | 1978-08-01 | Lowry et al. | |
| US4498100 | 1985-02-01 | Bunting et al. | |
| US4608594 | 1986-08-01 | Nicholson | |
| US4646138 | 1987-02-01 | Willis | |
| US4692801 | 1987-09-01 | Ninomiya et al. | |
| US4853765 | 1989-08-01 | Katsumata et al. | |
| US4881125 | 1989-11-01 | Krause | |
| US4882625 | 1989-11-01 | Akiyama | |
| US4951129 | 1990-08-01 | Lang | |
| US5117287 | 1992-05-01 | Koike et al. | |
| US5144427 | 1992-09-01 | Kitaura et al. | |
| US5155582 | 1992-10-01 | Tokoi et al. | |
| US5161030 | 1992-11-01 | Song | |
| US5177609 | 1993-01-01 | Kawakami et al. | |
| US5202755 | 1993-04-01 | Yang et al. | |
| US5206723 | 1993-04-01 | Parke | |
| US5233421 | 1993-08-01 | Chrisopher | |
| US5235421 | 1993-08-01 | Yang | |
| US5285266 | 1994-02-01 | Jo | |
| US5311306 | 1994-05-01 | Tanaka et al. | |
| US5353118 | 1994-10-01 | Cho | |
| US5389965 | 1995-02-01 | Kuzma | |
| US5412436 | 1995-05-01 | Christopher | |
| US5430487 | 1995-07-01 | Naimpally | |
| US5469227 | 1995-11-01 | Misker et al. | |
| US5473389 | 1995-12-01 | Eto et al. | |
| US5502509 | 1996-03-01 | Kurashita et al. | |
| US5526054 | 1996-06-01 | Greenfield et al. | |
| US5579054 | 1996-11-01 | Sezan et al. | |
| US5585861 | 1996-12-01 | Taniguchi et al. | |
| US5589888 | 1996-12-01 | Iwasaki | |
| US5737020 | 1998-04-01 | Hall et al. | |
| WOXWO90/13979 | 1990-11-01 |
Non-Patent Literature (1)
- Derwent, Luminance-Chrominance Signal Separating Device for HDTV, Derwent Jan. 1997-438178.