US 4,630,106 AGrant
Color Solid-State Imager With Color Filter Having an Overlapping Segmented Filter Arrangement
Issue Date:1986-12-16
•6 Claims
•14 Drawing Sheets
Abstract
A solid state color imaging apparatus includes a solid state image sensor having a plurality of picture elements regularly disposed in a two dimensional pattern along a plurality of horizontal lines. Each horizontal line includes a plurality of picture elements disposed in repetition at a predetermined pitch wherein light incident thereon is converted to a proportional electrical signal. A color filter placed over the picture elements has a plurality of filter elements disposed in regular repetition in horizontal rows and vertical columns. The filter elements are the same kind in each horizontal row scanned sequentially and only the combination is different. When the electric signals are read out from the imaging sensor, each horizontal row of filter elements spatially modulate at least two primary color lights. The mean value of the read out signals is equal and the modulated color signal is the color difference signal. The arrangement of the color filter elements are shown in three different alternative patterns, each for the purpose of attaining high-horizontal resolution, high S/N ratio and simplified signal processing.
Metadata
Assignee
- Matsushita Electric Industrial Co., Ltd.
Inventors
- Atsushi Morimura
- Hiromichi Tanaka
Application Information
Application Number:US 463666&
Filing Date:1983-02-04
Priority Date:1982-02-15
Art Unit:262
Classifications
IPC:
H04N 9077H04N 907
Field of Search:
35844;41;43
Patent Drawings (14 sheets)
Description
Background of the Invention
1. Field of the Invention
The present invention relates to an improvement in a solid state color imaging apparatus.
The present invention especially concerns a solid state color imaging apparatus comprising a solid state imaging sensor having a plurality of photoelectric elements disposed in a two-dimensional pattern and is a specially patterned color filter intended to attain high-horizontal resolution, high S/N ratio and simple signal processing.
2. Description of the Prior Art
A solid state image sensor is, as is well known, an apparatus for converting an objective image to an electric signal. A single chip solid state color camera is an apparatus comprising a solid state imaging sensor and color filter with elements of different colors in front of the solid state imaging sensor to obtain an objective image on the surface of the solid state image sensor, which produces a spatially modulated chrominance signal and luminance signal to enable the syntheses of a composite color signal.
On the other hand, the solid state image sensor is a kind of a large scale integrated circuit (LSI), and therefore in order to obtain a high production yield, the degree of the integration of the device should be preferably low. Therefore, the number of the photoelectric elements, disposed in a two dimensional pattern on a substrate, namely, the number of picture elements, should be as small as possible under a condition for attaining a required resolution of the image. Accordingly, the way of producing a chrominance signal should be that which does not lower the theoretical value of the resolution attainable for the number of picture elements. Many proposals have been made for the modes of the pattern combination between the picture elements and the color filter thereof, and the main stream thereof are those using a mosaic color filter.
The problems in the conventional type solid state color imaging apparatus are elucidated referring to FIGS. 1 to 3. FIG. 1 shows a fundamental type apparatus which uses a color filter having filter pattern of vertical color stripes comprising repetition of the three primary colors in a horizontal direction. The apparatus has a solid state image sensor having a number of photoelectric elements, i.e., picture elements 101 disposed forming vertical rows and horizontal lines, and a color filter having vertical color stripes of green filter stripes 102, red filter stripes 103 and blue filter stripes 104 disposed repeatedly in turn. In the signal produced based on sampling by the picture elements of the objective image which is spatially modulated by the color filter stripes, the chrominance signals for colors of the color filter are modulated by respective color filter stripes. In this example, since the spatial repetition period of the filter is for three picture elements length, the carrier frequency of the chrominance signal is one third (1/3) of the sampling frequency f.sub.S by the picture elements. In this case, the band-width of the signal of the objective image sampled by the picture elements is a half (1/2) of the sampling frequency of the picture elements. In order to avert the undesirable inclusion of the chrominance signal carrier frequency f.sub.C in the luminance signal band, the frequency range usable for the luminance signal band has to be limited to under 1/3f.sub.S (one third of the sampling frequency), resulting in a disadvantage of lowering of the horizontal resolution.
FIG. 2 shows another conventional example wherein green filter elements 202 are disposed in a staggered way with respect to the photoelectric picture elements 201 for other picture elements in the n-th line (for instance, odd number lines) R (red) filters 203 are disposed and for other picture elements in the (n+1)-th lines (for instance, even order lines), B (blue) filters 204 are disposed. In this conventional example, by utilizing a green signal for the luminance signal as an approximation and by utilizing vertical correlations of signals, the luminance signal is obtained with a high resolution without the problem as in the conventional example of FIG. 1 where the band width of the luminance signal was limited by the carrier of chrominance signal. However, in this example because the vertical correlation is used, a distortion is produced for an object without vertical correlation thereby lowering picture quality. Also, since the red component and green component signals are generated from the picture elements of the n-th lines and the green component and blue component signals are generated from the (n+1)-th lines, the sum of the signal components differs between even lines and odd lines, thereby vertical non-uniformity or undesirable horizontal stripes is produced when the luminance signal is separated by using only a low-pass filter. Accordingly, the circuit for separating the luminance signal becomes complicated.
Further, there are other conventional examples as shown in FIG. 3. In this example, for a picture element of an n-th line (e.g., odd number line), 2/3 of the area is covered by a red filter 303 and the remaining 1/3 area is covered by green filter 305 and in the next picture element in the same horizontal direction, 2/3 of the area is covered by blue filter 304 and the remaining 1/3 area is by a green filter, and the same pair repeats in the same order in that line. On the other hand, in the neighboring line of the picture element, i.e. (n+1)-th line (e.g. even number lines), in a picture element which is under a former one of the n-th line, 2/3 of the area is covered by a blue filter and 1/3 of the area is covered by a red filter, and in next picture element in the same horizontal line, 2/3 of the area is covered by G filter and the remaining 1/3 of the area by a red filter, and such pairs repeat in the horizontal direction in (n+1)-th lines. In this conventional example of FIG. 3(a), luminance signal S.sub.Yn for the n-th line and luminance signal S.sub.Y(n+1) for the (n+1)-th line are given by the following equations (1) and (2):
In this example, since the components of the luminance signals or n-th lines and (n+1)-th lines have the same contents, the luminance signal can be easily obtained only by taking out through a low-pass filter, without a complicated sampling process as shown in the example of FIG. 2.
However, this conventional example has the difficulty of making the filter so as to be registered with the picture elements in a manner to divide the picture element into 2/3 areas and 1/3 areas. Furthermore, in this conventional example, the chrominance signals which are spatially modulated for n-th lines and (n+1)-th lines are given by the following equations (3) and (4), respectively:
where K.sub.1 is a constant.
As shown in the equations (3) and (4), the modulated chrominance signals have components of primary color signals in the amounts of 2/3. Accordingly, the S/N ratio is low. As shown in equations (1) and (2), the luminance signals become in the amount of 2/3 of the primary color signals R, G and B. Accordingly the S/N ratios of the luminance signals also are not sufficiantly high.
Summary of the Invention
The present invention purposes to provide a solid state color imaging apparatus having improved luminance level differences between sequences of scanning lines, having improved S/N ratio of the chrominance signal without lowering resolution of the picture which is given by number of picture elements of the solid state image sensor.
According to the present invention, though chrominance signals of respective horizontal lines are read out in time sequence as a color difference signals, the luminance signal can be separated by a simple circuit comprising a low-pass filter without generation of luminance level differences between each sequence of scanning lines, thereby both the luminance signal and chrominance signal are easily processed.
Accordingly, the present invention is suitable for a small type color video camera apparatus having a high resolution and high chrominance S/N ratio.
Brief Explanation of the Drawings
FIG. 1(a) is a front view of a first conventional example of a solid state color imaging sensor.
FIG. 1(b) is the frequency spectrum diagram of the conventional example of FIG. 1(a).
FIG. 2(a) is the front view of the second conventional example of a solid state color imaging sensor.
FIG. 2(b) and FIG. 2(c) are time charts showing time sequential generations of respective primary color signals of the example of FIG. 2(a).
FIG. 3(a) shows the front view of the third conventional example of a solid state color imaging sensor.
FIG. 3(b) and FIG. 3(c) are wavelength spectrum diagrams of chrominance signals.
FIG. 4(a) is a front view of the picture elements disposition.
FIG. 4(b) is a front view showing a first example of color filter arrangements to be applied on the picture element disposition of FIG. 4(a).
FIG. 5(a) and FIG. 5(b) are time sequential diagrams showing time sequential generations of chrominance signals in the example of FIG. 4(b).
FIG. 6 is a frequency spectrum diagram of the example of FIG. 4(a) and FIG. 4(b).
FIG. 7(a) and FIG. 7(b) are schematic wavelength spectrum diagrams of output chrominance signals of the solid state color imaging sensor of FIG. 4(a) and FIG. 4(b).
FIG. 7(c) and FIG. 7(d) are wavelength spectrum diagrams of actual examples for the solid state color imaging sensor of FIG. 4(a) and FIG. 4(b).
FIG. 7(e) is an example of a spectral distribution diagram of an overall characteristic of combination of the solid state color imaging sensor of FIG. 4(b) and a representative infrared cut filter.
FIG. 8 is diagram showing modulation phase of the r-g/2 signal and b-g/2 signal in a color subscanier.
FIG. 9(a) is a schematical wavelength diagram of the luminance signal obtained by the chrominance output signals.
FIG. 9(b) is a spectral distribution diagram of an overall luminance output characteristic of a solid state color imaging sensor with a represenative infrared cut filter.
FIG. 10 is a circuit block diagram of an example of a signal processing circuit for producing NTSC output signals from the solid state imaging sensor of FIGS. 4(a)+4(b).
FIG. 11(a) is a front view of another example of a color filter pattern to be applied on a solid state color imaging sensor.
FIG. 11(b) and FIG. 11(c) are schematic spectral distribution diagrams of the example of FIG. 11(a).
FIG. 11(d) is a schematic frequency spectrum diagram of the example of FIG. 11(a).
FIG. 11(e) and FIG. 11(f) are schematic spectral distribution diagrams of the example of FIG. 11(a).
FIG. 12(a) is a front view of a further example of a filter pattern.
FIG. 12(b) and FIG. 12(c) are schematic spectral distribution diagrams of the example of FIG. 12(a).
FIG. 12(d) is a schematic frequency spectrum diagram of the example of FIG. 12(a).
FIG. 12(e) and FIG. 12(f) are schematic spectral distribution diagrams of the example of FIG. 12(a).
FIG. 13 is a circuit block diagram of one example for producing NTSC output signals from the chrominance signals of the solid state color imaging sensor of FIG. 11(a) or FIG. 12(a).
Detailed Description of the Preferred Embodiments
A solid state color imaging apparatus in accordance with the present invention comprises:
a solid state image sensor comprising a plurality of picture elements regularly disposed in two-dimensional patterns, the disposition comprising a plurality of horizontal lines, each having a plurality of picture elements disposed in repetition at a predetermined pitch,
a color filter comprising a plurality filter elements disposed in regular repetition in horizontal lines and in vertical rows, which comprises:
a first horizontal line of filter elements for spatially modulating a first color light and a second color light and
a second horizontal line of filter elements for spatial modulating the second color light and a third color light,
the first horizontal line and the second horizontal lines forming alternate vertical repetitions, and
sum of levels of low frequency components of the first line and the second lines being made equal.
For example, said first color light is blue and said second color light is green and said third light is red, and said first horizontal line is, for instance, an odd number of horizontal lines and said second horizontal line is an even number of horizontal lines.
In order to realize the above-mentioned spatial modulations of the chrominance signals, several patterns of filter color dispositions are possible. Hereinafter such filter color arrangements are elucidated in detail referring to embodiments shown in FIG. 4(a) and thereafter.
FIG. 4(a) shows a front view of the picture elements disposition of a solid state image sensor wherein the picture elements are disposed regularly in horizontal lines and vertical rows, and hereinafter every other line is referred as the n-th horizonal lines and the other lines, alternately disposed between the above lines, are referred to as the (n+1)-th lines.
Hereinafter, the following abbreviations in capital letters are used to represent intensities of light of colors and filters, and respective abbreviations in small letters are used to represent intensities of electric signals generated by the light of the color incident on the picture elements.
As shown in FIG. 4(b), in n-th line, for instance, odd number lines, a first picture element 401 is divided into two halves with the vertical line around at center. The left half is covered with an MG filter 402 and right half is covered with a CY filter 403. Next for the second picture element is also divided into two parts. The left part is covered with a G filter 403' and its right part is covered with a YE filter 404. The G filter is made by superposing an extended part of the CY filter 403 and the extended part of the YE filter 404. The above-mentioned filter color arrangement is repeated in the same order in the n-th horizontal lines.
In (n+1)-th lines, a left part of a first picture element is covered with an MG filter and its right part is covered with a YE filter, and left part of the second picture element is covered with a G filter and its right part is covered with a CY filter, respectively. This color filter arrangement is repeated in the (n+1)-th lines.
Accordingly, the MG filter and G filter are disposed in vertical stripes and the CY filter and the YE filter are disposed alternatively or staggerdly in vertical rows. A mosaic pattern filter 405 is thus constituted. Apart from the above-mentioned example, the G filters may be formed not by superposition of CY and YE filters but with proper G filters.
By forming the above-mentioned combinations of the picture elements of a solid state sensor and filter pattern, chrominance signals are produced in respective picture elements corresponding to filter color covering them as follows, provided that the photoelectric conversion characteristic of the photodiode in the solid state image sensor is flat for a wavelength range of 400 nm-700 nm: For n-th lines, the sum of the signal outputs (photodiode outputs) corresponding to respective incident light through respective color filters are: ##EQU1##
Also, for (n+1)-th lines, the sum of signal outputs (photodiode outputs) corresponding to respective incident light through respective color filters are as follows under the same premise as the n-th line on the spectrum characteristic of the photodiodes: ##EQU2## Accordingly, the signal output S.sub.nH for the n-th line and S.sub.(n+1)H for the (n+1)-th line are given as follows: ##EQU3## wherein the second terms represent time sequential change of chrominance signal part and first terms represent mean value, namely the luminance signal part. As is obvious from comparison of the above equations (7) and (8), the low frequency components S.sub.y of the signal is as follows: ##EQU4##
Accordingly, from the above signal, the luminance signal S.sub.y is obtainable without a luminance level difference between the sequence of scanning lines by simply taking it through a low-pass filter.
The modulated color difference signal is given as an alternating appearance of the belowmentioned components: ##EQU5## And the carrier frequency of the modulated chrominance signal is f.sub.C, which is 1/2 of the sampling frequency f.sub.S. Accordingly, the band width of the luminance signal S.sub.y can be extended to the theoretical limit of Nyquist's condition. In FIG. 5(a) and FIG. 5(b), the hatched parts show modulated color differential part S.sub.C, as shown in FIG. 6.
FIG. 7(a) and FIG. 7(b) schematically show spectrum distributions of the respective primary color components of the modulated color difference signals S.sub.C, respectively, for the n-th line and (n+1)-th line. In both diagrams, the spectral distributions based on the first picture element is shown by solid lines and the spectral distributions based on the second picture elements are shown by dotted lines.
For the n-th line, the signal level for the first picture element is given by ##EQU6## as shown by the solid line in FIG. 7(a), and the signal level for the second picture element is given by ##EQU7## as shown by the dotted line in FIG. 7(a). Accordingly, a component signal designated by a hatched region b and the other component signal designated by the other hatched region g/2 are modulated with the spatial frequency of the picture element dispositions. Therefore, the modulated signal is given by the term of ##EQU8##
For the (n+1)-th line, the signal level for the first picture element is given by ##EQU9## as shown by the solid line in FIG. 7(b ), and the signal level for the second picture element is given by ##EQU10## as shown by the dotted line in FIG. 7(b). Accordingly, a component signal designated by a hatched region r and the other component signal designated by the other hatched region g/2 are modulated with the spatial frequency of the picture element dispositions. Therefore, the modulated signal is given by the term of ##EQU11##
Though the above-mentioned explanation has been made under a condition that the spectral characteristic of the photoelectric device is flat for the range of 400 nm-700 nm, in an actual solid state imaging sensor, the photoelectric sensitivity extends to the infrared range, and in order to compensate for this, an infrared cut off filter is used. Accordingly, in an actual imaging apparatus provided with the infrared cut filter in front of the photodiode picture elements, the output from the picture elements has the spectral distributions of a product of the spectral characteristic of the solid state imaging sensor itself and the spectral characteristic of the infrared cut filter.
FIG. 7(e) shows one example of the spectral characteristic which is a product of a solid state imaging sensor and infrared cut filter. In the figure, the curve shows that resultant sensitivity decreases on both of red side (600-700 nm) and in blue side (400-500 nm). Accordingly, by obtaining a product of this spectral distribution and the spectral distributions of FIG. 7(a) and FIG. 7(b), the actual spectral distributions for the n-th line and (n+1)-th line are obtained as shown in FIG. 7(c) and FIG. 7(d), respectively, when hatched parts show modulated color differential component parts. In FIG. 7(c), which corresponds to ##EQU12## components of the blue part b and green part g are substantially of the same amount. In FIG. 7(d) which corresponds to ##EQU13## the component of red r is larger than that of green g. As has been shown, in the actual solid state color imaging apparatus, the output signal is given as a product of the spectral sensitivity of the solid state imaging sensor, the infrared cut filter spectral characteristic and spectral transparencies of the color mosaic filter. Since the detailed explanation of the present invention does not purpose to discuss in detail the spectral characteristics of the image sensor and infrared filter, for simplicity's sake, hereinafter we provide the product of these characteristics as simply 1 for the range of 400-700 nm. Another result of such an assumption is that the spectral transparency of the color filters are as such used for the output characteristics of the imaging sensor, and the explanation and understandings become easy. Therefore, hereinafter the elucidation is made with the above-mentioned assumption, except for the case where the spectral sensitive characteristic of the imaging sensor, as such, is of problem.
As has been elucidated, amplitudes of chrominance signals to be spatially modulated for an n-th line and (n+1)-th line are ##EQU14## respectively, which are different from the color difference signal r-y, b-y in an NTSC TV signal. However, when the obtained color difference signals ##EQU15## are balanced-modulated by the sub-carrier, the approximate signal of the modulated color signal of r-y and b-y of the NTSC signal is obtained by varying the phase of the sub-carrier.
FIG. 8, shows the phase on which the color difference signals ##EQU16## obtained from the solid color imaging sensor are balanced-modulated by the sub-carrier. The axis of the ordinate corresponds to the phase of the R-Y of the modulation color signal of the NTSC signal and the axis of the abscissa corresponds to the phase of the B-Y of the modulation color signal of the NTSC signal. Further, the reappearing positions (phase and amplitude) of the color difference signal are shown by r, g and b when the primary color object body of red, green and blue is photographed.
FIG. 9(a) schematically shows overall distribution of component signals of the luminance signal in an actual example, wherein the dotted curve shows the overall spectral characteristic and the hatched area shows component outputs. The sum of the total signal Y is ##EQU17## As shown in FIG. 9(a), the overall spectral distribution is low both in the short wavelength part and the long wavelength part, and the spectral distribution shown in FIG. 9(a) is fairly approximate to the actual components of the luminance signal Y' of NTSC standard which is given by:
FIG. 9(b) shows an actual overall spectral characteristic curve of the apparatus, obtained by multiplying the spectral characteristic of FIG. 7(e) for an infrared-cut filter, and the composite spectral characteristic of FIG. 9(a).
FIG. 10 shows a circuit diagram of one example for processing the above-mentioned signals. In FIG. 10, block 1001 designates the solid state imaging sensor shown in FIG. 4(a) and FIG. 4(b), and its output signal is given to a low-pass filter 1002 having a cut off frequency f.sub.C for separately outputting the luminance signal component Y. On the other hand, the output signal of the solid state imaging sensor 1001 is also given to a band-pass filter 1003 having a center frequency f.sub.C for separately issuing spatially modulated color difference signals and give it to a detection circuit 1004. Then, the detection circuit 1004 issues time sequential color difference signals ##EQU18## Then the time sequential signals are given to a timing adjusting circuit 1308 which comprises one-horizontal-line time delay circuit 1005 and switching circuit 1006 for selectively passing by alternatively switching every horizontal period. The output signals ##EQU19## given through the switching circuit 1006 are coupled to encoder 1007 to which the luminance signal Y is also coupled. The encoder 1007 composes a standard NTSC output by processing the three input signals and issues to the output terminal 1008. If the white balance is changed greatly, color difference signals do not become zero, even when a white object is photographed due to some inbalance or dispersion of spectral characteristics of the illumination source or filters. In such case, the inbalance can be compensated by adding or subtracting a part of the luminance signal Y to or from the color difference signals given to the encoder 1007.
As has been elucidated, according to the present invention, the spatial modulated component attributable to the mosaic filter is made in such a manner that
in n-th horizontal lines, the signal attributable to a part of the first primary color components (b) and a part of the second primary color components (g/2) are modulated,
and in (n+1)-th horizontal lines, the signal attributable to a part of the primary color component (r) and a part of the second primary color component (g/2) are modulated, and that the low frequency component or non-modulated part of the output of the n-th line and (n+1)-th line which comprise the spatially modulated components are made equal to each other. These are the gist of the present invention. In an actual mosaic filter, when it is realized with three color filter elements in the n-th line, (e.g. odd number line) one picture element or plural picture elements equivalent to one (hereinafter, "equivalent picture element" is used to mean both inclusive.) is divided into two segments covered by a first filter element (e.g., MG) and a second (CY) and the horizontally next equivalent picture element is divided into two segments covered with a second filter (e.g. CY) and a third filter (YE). In the second segment, the filter of one segment is made by superposing the two of them. And in the (n+1)-th line, the filter arrangement for the second segment is made opposite in horizontal direction to that of the n-th line.
In the above, the part of the second picture element constituted by superposing two kinds of filters can be replaced by a single filter which has an equivalent characteristic to the superposed filters. The apparatus in accordance with the present invention can provide a color imaging apparatus capable of producing luminance signals having a primary color signal component ratio considerably approximate to the standard NTSC system. And also, the spatial modulation of the color difference signal is large and accordingly, and S/N ratio of the chrominance signal becomes large.
Furthermore, since filter matrixes of horizontal lines are made by using the same kinds of the filter elements, the luminance signal obtained does not have luminance level differences between the sequence of scanning lines even when a correlation circuit is dispenced with.
Furthermore, since the repetition period of the filter arrangement is for two spatial periods of the picture elements, the band-width of luminance signal can be made to 1/2 of the sampling frequency, accordingly, a high horizontal resolution up to theoretical limit.
Further, since color difference signals having good balance which are close to the ideal spectral characteristic of the luminance signal are achieved, a picture of good color representation is obtainable by using rather simple circuit.
FIG. 11(a) shows a second example in accordance with the present invention having different color filter patterns.
In the example shown in FIG. 11(a), in the similar manner as that of the example of FIG. 4(b), every picture element is divided into two segments by a vertical dividing line and covered with different color filters. That is, in the example of FIG. 11(a) in the n-th line, for instance, odd number lines, a first picture element 1101 is divided into two parts with the vertical line around at center and the left half is covered with an MG filter 1102, and the right half is covered with an R filter 1104. Next, for the second picture element, for instance, the second picture element is also divided into two parts. The left part is covered with a CY filter 1103 and the right part is covered with a G filter 1106. The G filter can be made by superposing an extended part of the CY filter 1103 and the narrow YE filter 1107. The above-mentioned filter color arrangement is repeated in the same order in the n-th horizontal lines.
In (n+1)-th lines, a left part of a first picture element is covered with an MG filter and its right half part is covered with B filter. And the left part of the second picture element is covered with a YE filter while its right part is covered with a G filter, respectively. This filter arrangement is repeated in the (n+1)-th lines.
Accordingly, the MG filters and G filters are disposed in vertical stripes and the R filter and B filter, as well as the CY filter and YE filter, are arranged making vertically repeating dispositions. Thus a mosaic pattern filter 1100 is constituted. The B filter may be formed by superposing a MG filter and CY filter, and the G filter may be formed by superposing a YE filter and CY filter. Apart from the above-mentioned example, the G filters may be formed not by superposing the CY filter and YE filters, but with proper G filters.
By forming the above-mentioned combinations of the picture elements of a solid state imaging sensor and filter pattern, chrominance signals are produced in respective picture elements corresponding to filter colors covering them as follows, provided that the photoelectric conversion characteristic of the photodiode in the solid state image sensor is flat for a wavelength range of 400 nm-700 nm:
For n-th lines, the sum of signal outputs (photodiode outputs) corresponding to respective incident light through various color filters are: ##EQU20##
Also, for (n+1)-th lines, the sum of the signal outputs (photodiode outputs) corresponding to respective incident light through respective color filters are as follows under the same premise as the n-th line on the spectrum characteristic of the photodiodes: ##EQU21##
Accordingly, the mean chrominance output S.sub.YnH for the n-th line and S.sub.Y(n+1)H for the (n+1)-th line are given as follows:
where K.sub.15 and K.sub.11 are constants. The situation of this is shown in FIG. 11(b) and FIG. 11(c) for n-th lines and (n+1)-th lines, respectively.
That is, since the components of the n-th lines and (n+1)-th lines are equal as is obvious from the above equations, the luminance signal S.sub.Y without the luminance level differences between the sequence of scanning lines are obtainable by simply taking it through a low-pass filter.
Since the horizontal repetition period of color filters is of two picture elements, the carrier f.sub.C of the chrominance signal to be spatially modulated is at 1/2f.sub.S as shown in FIG. 11(d), and accordingly, the band width of the luminance signal S.sub.Y can be extended to the limit of Nyquist's condition, and a high resolution corresponding to the theoretical limit of the picture element density is attainable.
Next, elucidation is made on chrominance signals. For n-th lines the color difference signal S.sub.Ch is given as follows:
Also, for the (n+1)-th line the color difference signal S.sub.C(n+1) is given as follows:
wherein K.sub.15 and K.sub.11 are constants.
Spatially modulated color difference signals for the n-th line and (n+1)-th line are shown in FIG. 11(e) and FIG. 11(f), respectively. As shown in these figures, the spatially modulated color difference signals for the n-th line is r-g and for the (n+1)-th line is b-g, and therefore is larger by 50% than the conventional example of FIG. 3(b) and FIG. 3(c), as is obvious when equations (3) and (4) are compared, and therefore a good S/N ratio is attainable. FIG. 12 shows a further example. In this example, the similar effect as that of the preceding examples of FIG. 4(b) and FIG. 11(a) is obtainable. In FIG. 12(a) in n-th line, the left half part of the picture element is covered with a YE filter and the right part thereof is covered with an R filter, and in the second picture element, the left part is covered with a B filter and its right part is covered with a CY filter. And the same order is repeated in the n-th line. The R filter is constituted by superposing the YE filter and MG filter, and the B filter is constituted by superposing the CY filter and the MG filter.
Then, for (n+1)-th line, the whole part of the first picture element is covered with MG filter, and the whole part of the second picture element is covered with G filter. This pair of MG and G filter is repeated in the (n+1)-th line. The G filter is constituted by superposing the YE filter and CY filter. And the n-th and (n+1)-th line are alternately disposed in a vertical direction so that mosaic filter pattern as the FIG. 12(a) is constituted. In this mosaic filter pattern, in the similar way as shown in FIG. 11(a), the sum of the signal becomes substantially flat and equal for the n-th line and the (n+1)-th line as shown by FIG. 12(b) and FIG. 12(c), respectively. Accordingly, by using a further simple low-pass filter, the luminance signal can be separated without making luminance level differences between sequence of scanning lines, since there is no difference between the sum of the signal between the alternate horizontal lines. Furthermore, since the periods of horizontal repetition of the color filters is for two picture elements width, the carrier frequency f.sub.C of the chrominance signal generated by spatial modulation by the color filters become a half (1/2) of the sampling frequency f.sub.S by the picture elements. Accordingly, the band width of the luminance signal can be extended to the frequency of 1/2f.sub.S, and accordingly, the horizontal resolution can be raised to a theoretical value decided by the horizontal density of the picture elements.
For color difference signals, a large output is obtainable like the example of FIG. 11(a) as follows. That is for n-th line the color difference signal S.sub.Ch is given by
And for the (n+1)-th line, the color difference signal S.sub.C(n+1) is given by the following equation:
The above-mentioned color difference signals are represented in FIG. 12(e) for n-th lines, and in FIG. 12(f) for (n+1)-th lines, respectively.
That is, as shown in FIG. 12(e) and FIG. 12(f), the present example can produce a larger output signal in comparison with the conventional example shown in FIG. 3(a) and accordingly, an apparatus of good S/N ratio is obtainable.
FIG. 13 shows one example of a circuit diagram for processing signals for the solid state imaging sensor of FIG. 11(a) and FIG. 12(a). In FIG. 13, the output signal from the solid state imaging sensor 1001' is given to a first low-pass filter 1002, a second low-pass filter 1312 and a band-pass filter 1003. Then to the band-pass filter 1003, the modulated color difference signal is given to a detector 1004, which issues detected output signals to time adjusting circuit 1308 which comprises one horizontal period delay circuit 1005 and selection switch 1006. The output signal of the selection switch 1006 are given to white balancer 1309 to which output signal from the second low-pass filter 1312 is also given as a reference signal. Then output signals of the white balancer 1309 and luminance signal Y from the low-pass filter 1002 are given to an encoder 1007 which synthesizes a known standard NTSC signal and outputs it to the output terminal 1008.
As has been elucidated with reference to the preferred embodiments, the solid state color imaging apparatus in accordance with the present invention a can produce luminance signal which has information of high resolution as theoretically given corresponding to the number of picture elements. And further, only by employing a low-pass filter, the luminance signal is easily separated luminance level differences between sequence of scanning lines.
Furthermore, concerning the chrominance signal, the amount of color difference signal to be spatially modulated is larger than those of the conventional apparatus. Accordingly, the solid state color imaging apparatus in accordance with the present invention has a higher S/N ratio. Further, because the chrominance signal is given as color difference signals for every lines, the circuit configuration for processing the chrominance signal can be made simpler. Accordingly, the present apparatuses are suitable for small type solid state color imaging apparatus.
Claims
What is claimed is:
1. A solid-state color imaging apparatus comprising: a solid-state image sensor comprising a plurality of picture elements regularly disposed in a two-dimensional pattern comprising a plurality of horizontal lines, each line having a plurality of picture elements disposed in repetition at a predetermined pitch, said picture elements converting incident light into an output signal which corresponds to the amount of said incident light at a predetermined time and each of said elements outputting said output signal in order when scanned; and a color filter comprising a plurality of filter elements disposed in regular repetition in horizontal lines and in vertical columns, including first horizontal lines in which first equivalent filter elements for transmitting at least a first color light and second equivalent filter elements for transmitting at least a second color light are alternately and sequentially disposed, and second horizontal lines in which third equivalent filter elements for transmitting at least said second color light and fourth equivalent filter elements for transmitting at least a third color light are alternately and sequentially disposed; said first horizontal lines and said second horizontal lines being alternately and sequentially disposed in a vertical direction thereby forming a two-dimensional mosaic filter pattern; wherein said filter elements are selected such that the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said first horizontal lines of said color filter and the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said second horizontal lines of said color filter are substantially equal, said mean values of said output signals containing modulated color-difference components which are determined by the transmitting characteristics of said filter elements and which represent different combinations of at least two of said color lights; in said first horizontal lines, said first equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being divided into two segments wherein one of the segments is covered with a first type of filter element and the other segment is covered with a second type of filter element, thereby forming a plurality of first segmented filter elements, and said second equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with a third type of filter element and half of each of said second equivalent filter elements being further covered with said second type of filter element, thereby forming a plurality of second segmented filter elements, the above filter disposition being repeated in said first horizontal lines; and in said second horizontal lines, said third equivalent filter elements being disposed immediately adjacent to corresponding ones of said first equivalent picture elements in said first horizontal lines with each of said third equivalent filter elements covering one of said plurality of picture elements of said solid-state image sensor and each being divided into two segments wherein one of the segments is covered with said first type of filter element and the other segment is covered with said third type of filter element, thereby forming a plurality of third segmented filter elements, and said fourth equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with said second type of filter element and half of each of said fourth equivalent filter elements being further covered with said third type of filter element, thereby forming a plurality of fourth segmented filter elements, the above filter disposition being repeated in said second horizontal lines.
2. A solid-state color imaging apparatus in accordance with claim 1, wherein said first type of filter element is a magenta filter, said second type of filter element is a cyan filter, and said third type of filter element is a yellow filter.
3. A solid-state color imaging apparatus comprising: a solid-state image sensor comprising a plurality of picture elements regularly disposed in a two-dimensional pattern comprising a plurality of horizontal lines, each line having a plurality of picture elements disposed in repetition at a predetermined pitch, said picture elements converting incident light into an output signal which corresponds to the amount of said incident light at a predetermined time and each of said elements outputting said output signal in order when scanned; and a color filter comprising a plurality of filter elements disposed in regular repetition in horizontal lines and in vertical columns including first horizontal lines in which first equivalent filter elements for transmitting at least a first color light and second equivalent filter elements for transmitting at least a second color light are alternately and sequentially disposed, and second horizontal lines in which third equivalent filter elements for transmitting at least said second color light and fourth equivalent filter elements for transmitting at least a third color light are alternately and sequentially disposed; said first horizontal lines and said second horizontal lines being alternately and sequentially disposed in a vertical direction thereby forming a two-dimensional mosaic filter pattern; wherein said filter elements are selected such that the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said first horizontal lines of said color filter and the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said second horizontal lines of said color filter are substantially equal, said mean values of said output signals containing modulated color-difference components which are determined by transmitting characteristics of said filter elements and which represent different combinations of at least two of said color lights; in said first horizontal lines, said first equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with a first type of filter element and half of each of said first equivalent picture elements being further covered with a second type of filter element, thereby forming a plurality of first segmented filter elements, and said second equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with a third type of filter element and half of each of said second equivalent filter elements being further covered with said second type of filter element, thereby forming a plurality of second segmented filter elements, the above filter disposition being repeated in said first horizontal lines; and in said second horizontal lines, said third equivalent filter elements being disposed immediately adjacent to corresponding ones of said first equivalent filter elements in said first horizontal lines with each of said third equivalent filter elements covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with said first type of filter element and half of each of said third equivalent filter elements being further covered with said third type of filter element, thereby forming a plurality of third segmented filter elements, and said fourth equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with said second type of filter element and half of each of said fourth equivalent filter elements being further covered with said third type of filter element, thereby forming a plurality of fourth segmented filter elements, the above filter disposition being repeated in said second horizontal lines.
4. A solid-state color imaging apparatus in accordance with claim 3, wherein said first type of filter element is a magenta filter, said second type of filter element is a yellow filter, and said third type of filter element is a cyan filter.
5. A solid-state color imaging apparatus comprising: a solid-state image sensor comprising a plurality of picture elements regularly disposed in a two-dimensional pattern comprising a plurality of horizontal lines, each line having a plurality of picture elements disposed in repetition at a predetermined pitch, said picture elements converting incident light into an output signal which corresponds to the amount of said incident light at a predetermined time and each of said elements outputting said output signal in order when scanned; and a color filter comprising a plurality of filter elements disposed in regular repetition in horizontal lines and in vertical columns, including first horizontal lines in which first equivalent filter elements for transmitting at least a first color light and second equivalent filter elements for transmitting at least a second color light are alternately and sequentially disposed, and second horizontal lines in which third equivalent filter elements for transmitting at least said second color light and fourth equivalent filter elements for transmitting at least a third color light are alternately and sequentially disposed; said first horizontal lines and said second horizontal lines being alternately and sequentially disposed in a vertical direction thereby forming a two-dimensional mosaic filter pattern; wherein said filter elements are selected such that the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said first horizontal lines of said color filter and the mean value of the output signals of two neighboring picture elements in horizontal lines of said solid-state image sensor under said second horizontal lines of said color filter are substantially equal, said mean values of said output signals containing modulated color-difference components which are determined by the transmitting characteristics of said filter elements and which represent different combinations of at least two of said color lights; in said first horizontal lines, said first equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with a first type of filter element and half of each of said first equivalent filter elements being further covered with a second type of filter element, thereby forming a plurality of first segmented filter elements, and said second equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with a third type of filter element and half of each of said second equivalent filter elements being further covered with said second type of filter element, thereby forming a plurality of second segmented filter elements, the above filter disposition being repeated in said first horizontal lines; and in said second horizontal lines, said third equivalent filter elements being disposed immediately adjacent to corresponding ones of said first equivalent filter elements in said first horizontal lines with each of said third equivalent filter elements covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with said second type of filter element, and said fourth equivalent filter elements each covering one of said plurality of picture elements of said solid-state image sensor and each being wholly covered with said first type of filter element and said fourth equivalent filter elements each being further wholly covered by said third type of filter element, the above filter disposition being repeated in said second horizontal lines.
6. A solid-state color imaging apparatus in accordance with claim 5, wherein said first type of filter element is a yellow filter, said second type of filter element is a magenta filter, and said third type of filter element is a cyan filter.
Patent Citations (5)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| JPX52-52326 | 1977-04-01 | ||
| JPX55-92089 | 1980-07-01 | ||
| JPX56-84089 | 1981-07-01 | ||
| JPX57-4679 | 1982-01-01 | ||
| JPX58-75394 | 1983-05-01 |