US 4,668,975 AGrant
Color Solid State Image Pick-Up Device
Issue Date:1987-05-26
•28 Claims
•12 Drawing Sheets
Abstract
A color solid state image pick-up device in which a color filter array is arranged so as to correspond to each picture element of the solid state image pick-up elements and the output from the solid state image pick-up elements is processed so as to obtain a pseudo-brightness signal, wherein at least one of the brightness signals includes a high frequency band component used as the image signal, the brightness signal including a low frequency band component and the brightness signal used as the color difference signal is obtained on the basis of the different output signal from that connected with other brightness signal.
Metadata
Assignee
- Canon Kabushiki Kaisha
Inventors
- Tetsuro Kuwayama
- Nobuyoshi Tanaka
- Seiji Hashimoto
Application Information
Application Number:US 7929110
Filing Date:1985-10-30
Priority Date:1981-07-31
Art Unit:262
Classifications
IPC:
H04N 904
Field of Search:
35844;48;41;213
Patent Drawings (12 sheets)
Description
Background of the Invention
1. Field of the Invention
The present invention relates to a color solid state image pick-up device and a combination of color filters for obtaining the color picture signal making use of color image pick-up elements.
2. Description of the Prior Art
As color solid state image pick-up devices, one, two or three imagers of charge carrying image pick-up elements (hereinafter called CCD) are used, and a single imager type camera, a double imager type camera and a triple imager type camera can be thought therefore. However, the present invention particularly relates to the single imager image pick-up device in which one CCD is used.
In the case of the conventional single imager type solid state image pick-up devices in which solid image pick-up elements such as CCD are used, a color filter array is superposed on each image pick-up cell of the image pick-up elements one to one, so as to separate the color signals. In the color filter array used in such a single imager type solid state image pick-up device, the red, green and blue filter elements are arranged in the shape of a mosaic in order to economize the number of the image pick-up cells in CCD. Generally color filters called Bayer arrangement is used.
When the color filters arranged in the shape of mosaic are combined into CCD of the frame transfer type so as to constitute a single imager type color camera, a considerable leakage of signals takes place between the adjacent cells due to its construction, resulting in the colors being mixed, which leads to an insufficient color separation.
Although a method for overcoming the above difficulty has already been proposed by the present inventors (Jap. Pat. Pub. No. Sho 56-115085) and the problem has been largely resolved, the vertical image resolution power is low because the effective range of the sensitivity along the vertical direction is large, while the pseudo-color signals, or the contour, take place in the image not having a vertical correlation in which the bright and the dark part exist on both sides of a line parallel to the color filter array, so as to lower the quality of the image because it is hereby presumed that a correlation exists along the vertical direction.
Summary of the Invention
It is accordingly an object of the present invention to provide a color solid state image pick-up device free from the conventional shortcomings, in which the vertical resolution power is increased in combination with the frame transfer type CCD, while the pseudo-color signals and the contour are decreased so as to obtain superior color picture signals.
In accordance with an embodiment of the present invention, the output of the CCD combined with a certain determined pattern of color filters is obtained via a low-pass filter in order to obtain a high image resolution power of the low band brightness components.
Further, in accordance with another embodiment of the present invention, the brightness signals and the color signals are obtained by making use of the correlation among the three scanning line signals so that the pseudo-color signal at the edge of the object hardly takes place.
In accordance with further another embodiment of the present invention, signals for forming the low band brightness components are obtained from the secondary differentiated signals of the three scanning line signals so that the image resolution power of the low band brightness component is increased. Further, the coefficients of the three scanning lines are adjustable for forming the low band brightness component so that the edge emphasizing effect can optionally be adjusted.
In accordance with further another embodiment, the color difference signals can be adjusted in accordance with the vertical secondary differentiated signals of the CCD output so that the pseudo-color signals at the edge of the object hardly take place.
Other features of the present invention will be apparent from the descriptions to be made below with reference to the accompanying drawings.
Brief Description of the Drawings
FIGS. 1(a), (b) and (c) explain the structure and the efficiency of the frame transfer type CCD of the present invention.
FIGS. 2 and 3, respectively, show an arrangement of the color filter array of the present invention.
FIG. 4 shows a block diagram of an example of the signal processing circuit for the CCD in FIG. 1.
FIGS. 5(a), (b) and (c), respectively, show signal waveforms for explaining the growth of the pseudo contour.
FIG. 6 shows a two-dimensional distribution of the brightness of the pseudo-contour.
FIGS. 7, 8 and 9, respectively, show a block diagram of the first, the second and the third embodiments of the signal processing circuit.
FIGS. 10(a)-(g) and FIGS. 11(a)-(c), respectively, show signal outputs obtained with the first embodiment of the present invention.
FIGS. 12(a)-(d), respectively, show signal waveforms of the improved signal output obtained with the signal processing circuit in FIG. 9.
FIGS. 13(a)-(g), respectively, show color filter arrangements capable of being combined with the first, the second and the third embodiments of the signal processing circuit of the present embodiment.
FIG. 14 shows another embodiment of the color filter arrangement combined with the inter line type CCD of the present embodiment.
Detailed Description of the Preferred Embodiments
When, for example, each of the electrodes, consisting of .phi.1, .phi.2, .phi.3 and .phi.4, of the four phase driving type CCD as shown in FIG. 1(a), is driven, it is possible to form the potential 13, as shown in the drawing, by applying a direct bias voltage 12 to the driver. Namely, it is possible to form the bottom of the potential well in a staircase descending toward the carrying direction of charges. The shape 13' of the potential, shown in dotted line, shows the carrying pulse wave form for the given shape 13 with a phase difference of 180.degree.. Also, in case of the two phase driving type CCD as well as the single phase driving type CCD, the potential in the form of descending staircases, as shown in FIG. 1(a), is obtained. The present invention can naturally be applied to those types of CCD. However, the four phase driving type CCD will be explained herein.
The so far explained shape of potential is the one substantially necessary for carrying charges, whereby it is possible to make the shape of potential as is shown in FIG. 1(b) by applying a proper voltage to the carrying electrodes in the state the charge is stored. The then probability distribution for the charge capture is as shown in FIG. 1(c).
In this CCD, the color filters 15 of the color arrangement, as shown in FIG. 2, as an example, are provided so as to correspond to the respective light sensing element. Herein, as shown in the drawing, the color filter elements are arranged, being displaced by 1/2 pitch of one electrode along the vertical direction.
The sets of the filter elements are repeatedly provided along the horizontal and the vertical direction.
16, 17, 18 and 19 in FIG. 2 are, respectively, color filter elements allowing passage of light of the red color R, the green color G, the blue color B and the magenta color Ma, while 20 is a light shading layer of a non-transparent element Opaque and a channel stopper. As is shown, the color filter is characterized in that a cell, consisting of the electrodes .phi.1, .phi.2, .phi.3 and .phi.4, is made to correspond to the two different color filter elements.
Although In FIG. 2, .phi.1, .phi.1' and .phi.1" relate to the same respective electrode, for the sake of explanation, the electrode in the different cell is provided with dash.
When the shape of the potential, as shown in FIG. 1(b), exists in the color image pick-up element, in the potential well under the electrode .phi.2 in the line 23 in the n-th column, the signal charge, obtained by the light sensing element corresponding to the light component having passed through the R color filter element, is stored, while at the same time, as is presumed from the charge capture probability distribution in FIG. 1(c), charge produced by light components having passed through G above and below the R color filter element 15, is stored, whereby the mixed color components are produced. Now let the charge amount having passed through the respective color filter element 15, stored in the potential well directly under the element 15 and free from the mixed color components, be r, g, ma, opaque in small letters and let the coefficient of the mixed color component be .alpha.. So the charge amount stored in the potential well under the .phi.2 electrode in the n-th row is represented
In the same way, in the potential well under the .phi.4 electrode in the n-th row, the charge amount
is stored.
In the potential well under the .phi.2' electrode in the n-th row, the charge amount
is stored.
In the potential well under the .phi.4' electrode in the n-th row, the charge amount
is stored.
In the potential well under the .phi.2 electrode in the line 24 in the n-th row, the charge amount
is stored.
In the potential well under the .phi.4 electrode in the n+1th row, the charge amount
is stored.
In the potential well under the .phi.2' electrode in the n+1th row, the charge amount
is stored.
In the potential well under the .phi.4' electrode in the n+1th row, the charge amount
is stored.
So far, the charge amount stored in the potential well under the respective electrode in the store mode is shown. When the store mode is changed over into the carrying mode in which the signal flows out, the shape of the potential in FIG. 1(b) is changed into one of the descending staircases at 13' in FIG. 1(a) by changing the carrying pulse voltage to be applied to the respective electrode. At this time, the charge r' stored in the potential well under the .phi.2 electrode in the n-th row, is added to the charge g', stored in the potential well under the .phi.4 electrode in the n-th row, and this added sum is stored in a potential well newly formed under the .phi.4 electrode. Further, the electrode ma', stored in the potential well under the .phi.2 electrode in the n+1th row, is added to the charge g' stored in the potential well under the .phi.4 electrode in the n+1th row, and this added sum is stored in the potential well under the .phi.4 electrode.
FIG. 3 shows an example of the repeated arrangement of the color filters to be combined with the color solid image pick-up element shown in FIG. 2. A R(red) color filter element, a Ma(magenta) color filter element, a B(blue) color filter element and an Opaque color filter element are repeated along the right direction, while G(green) color filter elements are arranged on a straight line vertically.
When the color filter array is arranged as is shown in FIG. 3, (b'+g'), (opaque'+g'), (r'+g') and (ma'+g') are repeatedly read out from the vertical line 21 consisting of the .phi.1', .phi.2', .phi.3' and .phi.4' electrode in FIG. 2.
Consequently, the then output signal corresponds to the color lights having passed through the filters in the range shown with 31 in FIG. 3. In the same way (r'+g'), (ma'+g'), (b'+g') and (opaque'+g') are repeatedly read out from the vertical line 22 consisting of the .phi.1, .phi.2, .phi.3 and .phi.4 electrode so as to correspond to the range of the color filter shown with 32 in FIG. 3.
At the time of the interlace operation, the carrying pulse voltage is changed so as to assume the shape of the potential shown with 13 in FIG. 1, (g'+b'), (g'+opaque'), (g'+r'), (g'+ma') are repeatedly read out from the vertical line consisting of the .phi.3, .phi.4, .phi.1' and .phi.2' electrode so as to correspond to the range of the filter shown with 31 in FIG. 3.
FIG. 4 shows an example of the control block for obtaining a color signal from the thus read out output signal from the color image pick-up element.
In the drawing 35 is a signal generator for producing the electrode driving signals .phi.1-.phi.4.
36 is a switch circuit, which changes over the driving signals .phi.1-.phi.4 of the signal generator 35 and the driving signals biased with direct voltage 37 between the carrying mode and the store mode and applies them to the color image pick-up element 25. The output of the switch circuit 36 changes with the applied mode signal M.
26 is a delay line, which delays the signal for one horizontal scanning period so as to obtain the brightness signal Y, the red signal R and the blue signal B by making use of the correlation along the vertical direction. 25 corresponds to the color solid image pick-up element in FIG. 2, where as the mosaic shaped color filters are combined wih CCD. The output signal from the color image pick-up element 25 is applied to an input terminal of an adder 27, the delay line 26 and a subtractor 43.
The signal derived from the adder 27 is obtained from the above equations (1)-(4) for the n-th row. When now the signal levels, corresponding to the respective charge amount, are written in large letters, the signal is
while for the n+1th row from the above equations (5)-(8)
The above can be used as the brightness signal because Ma=R+B.
Further, also for the (n+2)th row and the (n+3)th row, the obtained signals are
and can be used as the brightness signal Y in the same way.
From the above result, it can be understood that the influence of the mixed color is not a big problem because it is the brightness signal (R+2G+B) simply multiplied with the coefficient (1+2.alpha.). Further, because the brightness signal is obtained for each clock, a sufficient resolution power can be obtained with a comparatively small number of CCDs as the number of picture elements along the horizontal direction.
On the other hand, the output signal of the subtractor is
for the n-th row,
for the n+1th row,
for the n+2th row, and
for the n+3th row.
The above signals are inverted by an invertor 44 in such a manner that the signals (R-B), (R+B), (R-B), (R+B) are repeated. The then mixed color components are all compensated with the subtraction process so that the obtained signals are completely free from the mixed color components.
The signals (R+B), (R-B), which can be obtained repeatedly as mentioned above, are repeated in a separating circuit 45, as a sample/hold circuit, and adjusted into (R+B), (R-B) with normal magnitude with amplifiers 46, 46' for adjusting the output level. These signals are added in adder 46 forming the R signal and subtracted in subtractor 48 forming the B signal.
The signals Y, R, B are then delivered to a processer 34, consisting of a low pass filter, a gamma compensating circuit, a matrix circuit and a color encoder circuit, whereby the processor 34 delivers an NTSC color signal.
As mentioned above, in accordance with the present invention, the frame carrying type CCD is combined with the mosaic filter so as to obtain the color picture signal free from the mixed colors, whereby the above-mentioned embodiment has the following shortcomings.
The first shortcoming is the low resolution power along the vertical direction. Because, as explained above, the signal (1H signal) delayed by one horizontal scanning time and the non-delayed signal (0H signal) are added to obtain the brightness signal Y, the effective range of the sensitivity along the vertical direction covers the four color filter adjacent along the vertical direction. This corresponds to four scanning lines out of 525 lines including the interlace operation in the final TV picture frame. For the resolution power along the vertical direction for a home color camera, a range of sensitivity of two scanning lines is sufficient, while the resolution power of the present system along the vertical direction is insufficient in comparison with the normal system.
The second shortcoming is the sawtooth shaped false contour for a picture with small vertical correlation, having a heavy change of the brightness distribution of the object along the vertical direction. Now let us suppose that the lower part (the upper part in TV picture frame) in FIG. 3 the range up to 31, corresponds to the bright part of the picture, while the upper part, above the range 32, corresponds to the dark part of the picture. The 1H signal (FIG. 5(a)) obtained from the range 31, the 0H signal (FIG. 5(b)) obtained from the range 32, and the brightness signal Y (FIG. 5(c)) obtained as the sum of the above, are as is shown in FIG. 5. Namely, the input picture has an even structure along the horizontal direction, while the obtained brightness signal Y has a fluctuation. As a result the figure observed in the TV picture frame is as is shown in FIG. 6. Namely, the object with an even structure along the horizontal direction has a bright and a dark structure in the TV frame.
Further, in FIG. 6 the brightness is indicated with the number of the oblique lines for the sake of representation. Further, the arrow X shows the scanning direction.
FIG. 7 shows an embodiment free from such shortcomings. In the drawing, the color solid image pick-up element 25, constructed as is shown in FIGS. 2 and 3 is driven with the driving circuit 38 producing, for example .phi.1, .phi.2, .phi.3 and .phi.4. Further, in case of the present embodiment, the output signal (0H signal) from the color solid image pick-up element 25 is applied to the delay line 26 for delaying the signal by one horizontal scanning line so as to obtain a 1H signal and further delayed in the delay line 26' to obtain a 2H signal. From the 2H signal and the 0H signal the mean value 1/2(0H+2H) is obtained with an adder 51. Further, in the adder 27 the 1H signal and the 1/2(0H+2H) signal are added forming the pseudo-brightness signal Yo. In this way, the false color signal to be explained later is hardly produced.
Further, the signal Yo may be expressed as
which can be considered the mean value of the pseudo-brightness signal and the signal before 1H.
On the other hand the difference between the 1H signal and the 1/2(0H+2H) is obtained in the subtractor 43, which difference is the repetition of (R-B), (R+B), -(R-B), -(R+B) . . . . After the sign of the signals are inverted in an inverter 49a, the signals are separated in the separating circuit 45, such as a sample/hold circuit, into (R+B) and (R-B). The signals (R+B), (R-B) are respectively amplified up to the normal signal level with the amplifier 46, 46'. Further, because the R signal and the B signal contain comparatively low frequency component as compared with the brightness signal Y, it is sufficient for the amplifiers 46, 46' to have a comparatively narrow frequency band, and those having a proper low pass filter or a sample/hold circuit can be used.
The signals (R+B), (R-B) are converted into the R signal with the adder 47 and further into the R' signal with the low-pass filter 49 and the gamma compensating circuit 50. Hereby, it is sufficient for the R' signal to have a bandwidth of approximately 0.5 MHz in case it is used as the NTSC signal.
From the subtractor 48, the B signal is obtained and converted into the B' signal with the low-pass filter circuit 49' and the gamma compensating circuit 50'.
Below, the method for forming various kinds of the brightness signals in accordance with the present invention, in order to obtain color difference signals by combining the R' signal with the B' signals, will be explained.
The color solid image pick-up element of the present invention obtains a pseudo-brightness signal by summing the four signal outputs continuous along the horizontal direction. Namely, from the results of the above equations (1)-(8). ##EQU1## can be calculated. Namely, the output from the color solid image pick-up element can be used as the pseudo-brightness signal via a proper low-pass filter circuit.
For example, in accordance with the present invention, the brightness signal YC' of the present invention, for obtaining the color difference signal by combining the R' signal with the B' signal, is obtained by making the Yo signal as the sum of 1/2(0H+2H) signal and 1H signal, pass through a low pass filter circuit 55 and the gamma compensation circuit 57'. The differences between the YC' signal, the R' signal and the B' signal are obtained with the subtractors 59 and 59', namely, the color difference signals (R'-YC') (B'-YC') are obtained and applied to a process circuit 60.
Thus, no false color takes place at the upper and the lower edges of a white and black body. In accordance with the present invention, the vertical sensitivity range of the R' and the B' color signals used for calculating the color difference signals (R'-YC'), (B'-YC'), is same as that for the brightness signal YC' and further, there is no positional difference along the vertical direction so that for a colorless body such as the white and black body, the values of the color differences (R'-YC'), (B'-YC') are zero and, therefore, there takes place no color. Further, although for the bright part of the edge image of the colored body, the magnitude of the color difference signals (R'-YC'), (B'-YC') is small as compared with the brightness signals Y', that is, the bright part is almost colorless and the false color signal is hardly recognized.
Further, in case of the embodiment in FIG. 7, the 1H signal and the Yo signal are, respectively, amplified with the amplifier 52 and 52' up to a proper magnitude and added or subtracted in the adder/subtractor so as to obtain the brightness signal YL' via the low-pass filter 56 and the gamma compensating circuit 57'. Consequently, by properly selecting the amplification factor of the amplifiers 52, 52' and applying the adder/subtractor 53, it is possible to adjust the vertical resolution power to a considerable extent.
Further, by subtracting the signal, adjusted up to a proper magnitude with the amplifier 52, it is possible to emphasize the edge along the horizontal and the vertical direction in an easy way.
Further, if the output of the amplifier 52 is not cut, or the amplifier 52 and the adder/subtractor 53 are not used, the vertical sensitivity range corresponds to that in which the 1H signal is read out, namely 2 scanning line, so that the effective vertical sensitivity range is narrow and the image resolution power can easily be improved.
On the other hand, in case of an embodiment of the present invention, the high band brightness component YH is taken out from the Yo signal corresponding to 1/2(0H)+1H+1/2(2H), amplified with the amplifier 61 and then added to the low band signal YL' in the adder 58 so as to obtain the brightness signal Y' to be applied to the process circuit 60.
Consequently, the high band component YH of the brightness signal is separated so that it is possible to adjust the degree for emphasizing the horizontal and the vertical edges freely by changing the amplifying factor of the amplifier 61 and the characteristics of the high pass filter 54.
Further, as compared with the embodiment in FIG. 4, the vertical sawtooth shaped contour of the image becomes hard to take place.
Namely, in accordance with the present invention, a mean value of the high band component of the Y signal in a wide vertical range is taken, the modulation amplitude of the signal in FIG. 5 is decreased down to the half.
A second embodiment of the signal processing circuit of the present invention is shown in FIG. 8. In the drawing members the same as those in FIG. 7 have the same numbers.
In the case of the present embodiment, by making the low band component of the brightness signal the vertical secondary differentiated signal obtained from 0H, 1H and 2H signals, the contour of the low band brightness component is emphasized. Further, the contour for the color signals is also emphasized.
In the same way as in case of the preceding embodiment, the output -1/2(0H)-(1H)-1/2(2H) is obtained from the subtractor 43 so as to obtain the color signal Ro via the inverter 49a, the separating circuit 45, the amplifiers 46, 46' and the adder 47, while, from the subtractor 48, the color signal Bo is obtained. On the other hand, in the case of the present embodiment, the output from the subtractor 43 is passed through a low pass filter 64 so as to obtain the vertical secondary differentiated signal Yd of the input image. Then, the signal is added to the output brightness signal Yo of the adder 27 in an adder 68 so as to obtain the brightness signal Y. Further, the color signals Ro, Bo are passed through the low-pass filter 49, 49' and then added to the Yd signal in the adders 67, 68 forming the R and the B signal.
The Y, the R, and the B signals obtained in this way are applied to the process circuit 62, consisting of the matrix circuit, the gamma compensating circuit and so on, so as to be converted into the NTSC signal. Hereby the processing circuit 62 may be either one which obtains the NTSC signal from the Y', the (R'-Y') and the (B'-Y') signals as is shown in FIG. 7, or one which obtains the NTSC signal from the Y, and R and the B signals from which the G signal is obtained with the matrix circuit and then submitted to normal gamma compensation. Due to the above construction in the case of the present embodiment, the image resolution power of the brightness signal in the low band component is improved, while, for the color signals the false color signals of the edge becomes hard to take place.
A third embodiment of the present invention will be explained in connection with the block diagram in FIG. 9. In the drawing members the same as those in FIG. 7 have the same numbers. The present embodiment is particularly intended to prevent the color spreading for a highly colored body along the vertical direction.
With almost the same circuit as is shown in FIG. 7, the color signals (R'-YC'), (B'-YC') are obtained as the output of the subtractors 59, 59'. On the other hand, the output from the subtractor 43 is made into the vertical secondary signal Yd via the low-pass filter circuit 64 and is applied to a limiter circuit 69. Amplifiers 70, 70', which receive the output of a proper amount from the limiter circuit 69, decrease the magnitude of the color signal (R'-YC'), (B'-YC') and at times down to zero. As result, not only for the colorless body but also the highly red body, the color spreading at the upper and lower edge can be prevented. Hereby, it is sufficient for the limiter circuit 69 to limit the output of the amplifiers 70 and 70' when the Yd signal is of a negative value or the absolute value of the Yd signal surpasses a certain determined level.
The effect of the third embodiment of the present invention as shown in FIG. 9 will be explained in connection with FIGS. 10-12.
FIG. 10(a) shows the input image with the black and the red edge. For the sake of explanation, the left side (A) corresponds to the upper side of the picture, while the right side (B) corresponds to the lower side of the picture. FIG. 10(b) shows the distribution of the YL' which acutely rises up because the upper and the lower image resolution power is high. FIG. 10(c) and FIG. 10(d), respectively, show the rise of the Yc' and the R' signal. Because the vertical image resolution power is low, there are two scanning lines for producing the output corresponding to 1/4 and 3/4 for the saturated output.
The output of the B' signal in FIG. 10(e) is zero because the input image has no B component.
From the differences among the Yc' signal in FIG. 10(c), the R' signal in FIG. 10(d) and the B' signal in FIG. 10(e), the signals (R'-Yc'), (B'-Yc') in FIG. 10(f) can be obtained. Although in order to make the explanation simple, the influence of gamma compensation is omitted in the above analysis, almost the same discussion can be made even if gamma compensation is taken into consideration.
FIG. 11 shows the light amount Rr, Gr, and Br of the red, the green and the blue in the image receiving device as in case of the first embodiment of the present invention in FIG. 7, in which the outputs of the amplifiers 70, 70' are not limited by the output of the low-pass filter 64.
In case of the ideal image pick-up, the light amount Rr of the red rises rapidly, while there exist no light amount Gr, Br of the green and the blue. However, as is clear from the drawing, in this case the Rr of the red exists where it is necessary to be black, while the Gr and Br of the green and the blue appear at the edges. Hereby, the green light and the blue light at the edges do not influence the image very much, while the red light in the dark position decreases the vertical image resolution power by a considerable extent. Hereby, the negative part of the Gr and the Br in the drawing are not displayed in the image receiving device.
FIG. 12 shows a result of the third embodiment of the present invention in FIG. 9, where the color difference signals are limited in accordance with the output of the low pass filter 64. The vertical secondary differenciated signal Yd of the brightness signal has a positive value and a negative value in the neighborhood of the edges as is indicated in FIG. 12(a). Now let us suppose that in case the value of the signal Yd is negative, the amplification factor of the color difference signals (R'-Yc'), (B'-Yc') is small or zero. When the value of the color difference signal is zero, the red light spreading in FIG. 11(a) disappears as is shown in FIG. 12(b), while the negative part of the Gr and the Br also disappears as is shown in FIGS. 12(c) and 12(d).
As explained above, it is possible to prevent the vertical color spreading by decreasing the amount of the color difference signal in the part in which the brightness changes largely along the vertical direction, which is quite effective for improving the synthetic picture quality,
FIG. 3 shows an example of the arrangement of the color filters used in the present invention. As the conditions necessary for the color filters of the present invention, any one which satisfies the following two will do:
(1) a signal is added to the signal delayed by one horizontal period so as to obtain a pseudo-brightness signal.
(2) more than two continuous outputs are added so as to obtain a pseudo-brightness signal.
FIGS. 13(a)-(g), respectively, show examples of the arrangements of the color filters to be used in the present invention. FIG. 13(a) shows the arrangement of the color filter in FIG. 3, whereby a part is altered. FIG. 13(b), (c), shows the arrangement of the color filter in FIG. 3, whereby a part is made complementary color filter so as to improve the sensitivity. In the drawing, Ye is the yellow filter, G the green filter with a different permeability, Cy the cyanic filter and W the transparent filter. FIG. 13(d) shows the arrangement of the color filter in FIG. 3, whereby a small window is provided in the light shading part and arranged with the magenta filter Ma2 so as to decrease the false contour. FIGS. 13(e) and (f), respectively, show arrangements of the filters in which a small window is provided with the green filter G' and the transparent filter W, respectively. Further, in FIG. 13(g), instead of providing the light shading part with a small window, a grey filter, having a relatively low permeability, or a filter N, having a polarization permeability for giving a green brightness signal, is provided.
In the above explanation for the solid image pick-up element the four phase, the two phase and the one phase driven from transfer type CCD is taken up as the example. However, it would be clear that the circuit and the filter arrangement mentioned above can be practiced also in case the interline transfer type CCD is driven in the field storage mode. In this case, each of the color filters corresponds to the light recording element, one to one, while at the time of reading out the outputs of the vertically adjacent light sensing elements are added so that the almost similar treatment is possible and the almost similar effects can be obtained with the present invention.
Further, the present invention can also be applied in case the interline transfer type CCD is used in the frame storage mode. FIG. 14 shows an embodiment of the arrangement of the color filters in this case. In the field with odd numbers, the outputs corresponding to the filters Ye, W, Cy and G are obtained in sequence from the first scanning line, the output corresponding to Cy, G. Ye and W from the second scanning line and the outputs corresponding to Ye, W. Cy and G from the third scanning line. These outputs satisfy the conditions of the present invention and the signal processing circuits of the present invention in FIGS. 7, 8 and 9 can be used without modification.
So far the embodiments of the present invention are explained in the case the four phase, the two phase or the one phase driven frame transfer type CCD and the interline transfer type CCD are used in the field storage mode and in the case the interline transfer type CCD is used in the frame storage mode, whereby, so far as the output obtained from the solid image pick-up element satisfies the principle of the present invention, it can be applied in any case. Further, as the high band component and the low band component in the brightness signal are explained as the pseudo-brightness signal, it is not always necessary that the polarization sensitivity characteristics strictly correspond to the shape of the brightness signal, whereby the high band components may be different from the low band components in the shape of the polarization characteristics.
Claims
What we claim:
1. An image pick-up device, comprising: (a) an image pick-up element for transducing an optical picture image into an image signal having horizontal scanning line signals, said image pick-up element having a front face; (b) filter means, at the front face of said image pick-up element, having a plurality of color filters; (c) first operation means for processing three of said horizontal scanning line signals of the image signal for forming a signal relating to color components of said image signal; (d) second operation means for processing said three horizontal scanning line signals of the image signal for forming a signal relating to a brightness of said image signal; and (e) means for forming mixed color image signals using at least an output of said first and second operation means.
2. An image pick-up device according to claim 1, wherein said filter means has repeated patterns of predefined colors in the horizontal direction and in the vertical direction.
3. An image pick-up device according to claim 1, wherein said first operation means includes a subtraction circuit.
4. An image pick-up device according to claim 1, wherein said second operation means includes an addition circuit for adding the three horizontal scanning line signals at a prescribed ratio.
5. An image pick-up device according to claim 1, further comprising edge emphasizing means for emphasizing edges of an image formed by the brightness related signal.
6. An image pick-up device according to claim 5, wherein said edge emphasizing means emphasizes vertical edge components of the brightness related signal formed image.
7. An image pick-up device according to claim 5, wherein said edge emphasizing means is of a secondary differentiated type.
8. An image pick-up device according to claim 7, wherein said edge emphasizing means includes third operation means for processing said brightness related signal and one of said three horizontal scanning line signals.
9. An image pick-up device according to claim 8, wherein said third operation means includes subtraction means.
10. An image pick-up device according to claim 8, further comprising means for adding an output of said third operation means to said brightness related signal.
11. An image pick-up device according to claim 5, wherein said second operation means includes means for separating high frequency band components and low frequency band components of the brightness related signal.
12. An image pick-up device according to claim 5, wherein said first operation means has at least two operation states and includes changeover means for changing the operation state of said first operation means for every horizontal line scanning signal period.
13. An image pick-up device according to claim 1, wherein said first operation means includes means for forming an edge emphasizing signal.
14. An image pick-up device, comprising: (a) an image pick-up element for transducing an optical picture image into an image signal having horizontal scanning line signal, said image pick-up element having a front face; (b) filter means, at the front face of said image pick-up element, having a plurality of color filters; (c) operation means for processing three of said horizontal scanning line signals of the image signal for forming a signal relating to a brightness of said image signal; and (d) edge emphasizing means for emphasizing vertical edge components of of an image formed by said brightness related signal.
15. An image pick-up device according to claim 14, wherein said filter means has repeated patterns of predefined colors a the horizontal direction and in a vertical direction.
16. An image pick-up device according to claim 14, wherein said operation means includes an addition circuit for adding the three horizontal scanning line signals with a prescribed ratio.
17. An image pick-up device according to claim 14, wherein said edge emphasizing means is of a secondary differentiated type.
18. An image pick-up device according to claim 17, wherein said edge emphasizing means includes further operation means for processing said brightness related signal and one of said three horizontal scanning line signals.
19. An image pick-up device according to claim 18, wherein said further operation means includes subtraction means.
20. An image pick-up device according to claim 18, further comprising means for adding an output of said further operation means to said brightness related signal.
21. An image pick-up device according to claim 14, further comprising: color component forming means to process the three horizontal scanning line signals of the image pick-up element for forming signals relating to color components of said image signal.
22. An image pick-up device according to claim 21, wherein said color component forming means has at least two processing states and includes changeover means for changing the processing state for every horizontal scanning line signal period.
23. An image pick-up device according to claim 14, wherein said image pick-up element is solid state image pick-up element comprising a plurality of picture elements.
24. A color image pick-up device, comprising: (a) a solid state image pick-up element which contains a plurality of picture elements arranged in rows and columns for transducing an optical image into an electrical signal; (b) color separating optical means for guiding a predefined color of light impinging said pick-up device to each one of said picture elements; (c) image pick-up element driving means for sequentially reading out signals at a predefined row of picture elements of the solid state image pick-up element; (d) color component signal forming means for forming a signal relating to a color component of said electrical signal out of three horizontal scanning line signals in said electrical signal which have been read out by said image pick-up element driving means; (e) brightness component signal forming means for forming a signal relating to a brightness component out of said three horizontal scanning line signals which have been read out by the image pick-up element driving means; and (f) mixed image signal forming means for forming a mixed image signal at least out of an output of said color component signal forming means and an output of the brightness component signal forming means.
25. An image pick-up device, comprising: (a) an image pick-up element for transducing an optical picture image into an image signal; (b) filter means provided at a front face of said image pick-up element and consisting of a plurality of color filters; (c) brightness signal forming means to operate with three horizontal scanning line signals of the image signal formed by the image pick-up element for, respectively, forming a low band brightness signal and a high band brightness signal; (d) image signal forming means for forming image signals at least out of said low band brightness signal and said high band brightness signal.
26. An image pick-up device, comprising: (a) an image pick-up element for transducing an optical picture image into an image signal said element having a front face; (b) filter means at the front face of said image pick-up element and having a plurality of color filters; (c) first operation means to operate with three horizontal scanning line signals of the image pick-up element for forming signals relating to color components; (d) detection means for detecting a contour signal out of an output of said image pick-up element; and (e) control means for controlling a quantity of signals relating to the color components formed by said first operation means according to an output of said detection means.
27. An image pick-up device according to claim 26, wherein said detection means detects a vertical contour signal.
28. An image pick-up device according to claim 26, wherein said detection means detects a quantity of a low frequency band component of the signal relating to a color component which is formed by the first operation means.