Noise suppression devices and image capturing apparatuses having the same

[0001] 1. Technical Field

[0002] Example embodiments relate to image processing technology, and more particularly to noise suppression devices and image capturing apparatuses including noise suppression devices.

[0003] 2. Description of the Related Art

[0004] Generally, an image signal captured by a digital camera includes noise, herein referred to as noise elements. If the noise elements are not suppressed and/or eliminated before the image signal is displayed by a display apparatus, display quality will be degraded. In one example, if low frequency noise elements are not suppressed from the image signal prior to display, then low frequency luminance spots will be shown in the display.

[0005] As resolution of display apparatuses increases, noise suppression devices effectively suppressing and/or eliminating noise elements included in the image signal becomes more important.

[0006] At least some example embodiments provide noise suppression and/or elimination devices that effectively suppress and/or eliminate low frequency noise elements.

[0007] At least some other example embodiments provide image capturing apparatuses including noise suppression and/or elimination devices.

[0008] According to at least one example embodiment, a noise elimination device includes: a low pass filter unit, a high frequency separation unit, a noise filtering unit and a signal synthesis unit. The low pass filter unit is configured to generate a low frequency image signal by separating low frequency elements from an input image signal. The high frequency separation unit is configured to generate a high frequency image signal by separating high frequency elements from the input image signal using the low frequency image signal. The noise filtering unit is configured to generate a filtered image signal by performing noise elimination on the low frequency image signal in both a horizontal direction and a vertical direction. The signal synthesis unit is configured to generates an output image signal by combining the high frequency image signal and the filtered image signal.

[0009] In at least some example embodiments, the noise filtering unit may include: a decimation unit configured to generate a compressed image signal by decimating the low frequency image signal in the horizontal direction; a horizontal filtering unit configured to generate a first filtered image signal by performing noise elimination on the compressed image signal in the horizontal direction; a vertical filtering unit configured to generate a second filtered image signal by performing noise elimination on the first filtered image signal in the vertical direction; and an interpolation unit configured to generate the filtered image signal by interpolating the second filtered image signal in the horizontal direction.

[0010] The horizontal filtering unit may generate the first filtered image signal by averaging pixel values of adjacent pixels in the horizontal direction in the compressed image signal.

[0011] The vertical filtering unit may generate the second filtered image signal by averaging pixel values of adjacent pixels in the vertical direction in the first filtered image signal.

[0012] The vertical filtering unit may include an asymmetric infinite impulse response filter.

[0013] The noise filtering unit may further include a signal processing unit coupled between the horizontal filtering unit and the vertical filtering unit. The signal processing unit may be configured to correct the first filtered image signal based on the compressed image signal, and provide the corrected first filtered image signal to the vertical filtering unit.

[0014] The first signal processing unit may be configured to correct the first filtered image signal by replacing pixel values representing image elements in the first filtered image signal with pixel values representing image elements in the compressed image signal.

[0015] The noise filtering unit may further include a signal processing unit coupled between the vertical filtering unit and the interpolation unit. The signal processing unit may be configured to correct the second filtered image signal based on the compressed image signal, and provide the corrected second filtered image signal to the interpolation unit.

[0016] The second signal processing unit may correct the second filtered image signal by replacing pixel values representing image elements in the second filtered image signal with pixel values representing image elements in the compressed image signal.

[0017] According to at least some example embodiments, the high frequency separation unit may include a subtracter configured to generate the high frequency image signal by subtracting the low frequency image signal from the input image signal.

[0018] The signal synthesis unit may include an adder configured to generate the output image signal by adding the high frequency image signal and the filtered image signal.

[0019] The noise elimination device may further include: an RGB-YUV conversion unit configured to generate the input image signal by converting a format of an image signal having an RGB format into a YUV format; and a YUV-RGB conversion unit configured to generate an RGB output image signal by converting a format of the output image signal having a YUV format into an RGB format.

[0020] At least one other example embodiment provides an image capturing apparatus. According to at least this example embodiment, an image capturing apparatus includes: an image sensor; an analog-digital converter; and a noise elimination device. The image sensor is configured to detect incident light to generate an analog signal corresponding to the detected incident light. The analog-digital converter is configured to digitize the analog signal to generate input image data. The noise elimination device is configured to eliminate low frequency noise elements from the input image signal to generate an output image signal. The noise elimination device includes: a low pass filter unit configured to generate a low frequency image signal by separating low frequency elements from the input image signal; a high frequency separation unit configured to generate a high frequency image signal by separating high frequency elements from the input image signal using the low frequency image signal; a noise filtering unit configured to generate a filtered image signal by performing noise elimination on the low frequency image signal in both a horizontal direction and a vertical direction; and a signal synthesis unit configured to generate the output image signal by combining the high frequency image signal and the filtered image signal.

[0021] According to at least some example embodiments, the noise filtering unit may include: a decimation unit configured to generate a compressed image signal by decimating the low frequency image signal in the horizontal direction; a horizontal filtering unit configured to generate a first filtered image signal by performing noise elimination on the compressed image signal in the horizontal direction; a vertical filtering unit configured to generate a second filtered image signal by performing noise elimination on the first filtered image signal in the vertical direction; and an interpolation unit configured to generate the filtered image signal by interpolating the second filtered image signal in the horizontal direction.

[0022] The noise filtering unit may further include: a first signal processing unit coupled between the horizontal filtering unit and the vertical filtering unit; and a second signal processing unit coupled between the vertical filtering unit and the interpolation unit. The first signal processing unit may be configured to correct the first filtered image signal based on the compressed image signal, and provide the corrected first filtered image signal to the vertical filtering unit. The second signal processing unit may be configured to correct the second filtered image signal based on the compressed image signal, and provide the corrected second filtered image signal to the interpolation unit.

[0023] At least one other example embodiment provides a noise suppression device. According to at least this example embodiment, the noise suppression device includes: a low pass filter unit configured to generate a low frequency image signal by separating low frequency elements from an input image signal; a noise filtering unit configured to generate a filtered image signal by separately suppressing noise in the low frequency image signal in both horizontal and vertical directions; and a signal synthesis unit configured to generate an output image signal based on the filtered image signal.

[0024] According to at least some example embodiments, the noise suppression device may further include: a high frequency separation unit configured to generate a high frequency image signal by separating high frequency elements from the input image signal using the low frequency image signal; wherein the signal synthesis unit is configured to generate the output image signal by combining the high frequency image signal with the filtered image signal.

[0025] The noise filtering unit may further include: a decimation unit configured to generate a compressed image signal by decimating the low frequency image signal in the horizontal direction; a horizontal filtering unit configured to generate a first filtered image signal by suppressing noise from the compressed image signal in the horizontal direction; a vertical filtering unit configured to generate a second filtered image signal by suppressing noise from the first filtered image signal in the vertical direction; and an interpolation unit configured to generate the filtered image signal by interpolating the second filtered image signal in the horizontal direction. The horizontal filtering unit may be configured to generate the first filtered image signal by averaging pixel values of adjacent pixels in the horizontal direction. The vertical filtering unit may be configured to generate the second filtered image signal by averaging pixel values of adjacent pixels in the vertical direction.

[0026] According to at least one other example embodiment, an image capturing apparatus includes: an image sensor; an analog-digital converter; and a noise suppression device. The image sensor is configured to detect incident light to generate an analog signal corresponding to the detected incident light. The analog-digital converter is configured to digitize the analog signal to generate input image data. The noise suppression device is configured to suppress low frequency noise elements from the input image signal to generate an output image signal. The noise suppression device includes: a low pass filter unit configured to generate a low frequency image signal by separating low frequency elements from an input image signal; a noise filtering unit configured to generate a filtered image signal by separately suppressing noise in the low frequency image signal in both horizontal and vertical directions; and a signal synthesis unit configured to generate an output image signal based on the filtered image signal.

[0027] The noise filtering unit may be configured to sequentially suppress noise from the low frequency image signal in a first of the horizontal and vertical directions, and then in a second of the horizontal and vertical directions.

[0034] Various example embodiments will be described more fully with reference to the accompanying drawings, in which some example embodiments are shown. The present inventive concept may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present inventive concept to those skilled in the art. Like reference numerals refer to like elements throughout this application.

[0035] It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present inventive concept. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.

[0036] It will be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being “directly connected” or “directly coupled” to another element, there are no intervening elements present. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., “between” versus “directly between,” “adjacent” versus “directly adjacent,” etc.).

[0037] The terminology used herein is for the purpose of describing particular embodiments and is not intended to be limiting of the inventive concept. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes” and/or “including,” when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

[0038] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this inventive concept belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0039] Specific details are provided in the following description to provide a thorough understanding of example embodiments. However, it will be understood by one of ordinary skill in the art that example embodiments may be practiced without these specific details. For example, systems may be shown in block diagrams so as not to obscure the example embodiments in unnecessary detail. In other instances, well-known processes, structures and techniques may be shown without unnecessary detail in order to avoid obscuring example embodiments.

[0040] FIG. 1 is a block diagram illustrating a noise suppression and/or elimination device according to example embodiments.

[0041] Referring to FIG. 1, a noise suppression and/or elimination device 10a includes: a low pass filter unit LPF 100, a noise filtering unit 200, a high frequency separation unit 300 and a signal synthesis unit 400. Although discussed herein as units, it should be understood that these components, as well as components similar thereto, may be regarded as circuits implemented by suitable structure. Moreover, one or more of these components may be implemented by hardware including, for example, one or more Central Processing Units (CPUs), digital signal processors (DSPs), application-specific-integrated-circuits, field programmable gate arrays (FPGAs) computers or the like.

[0042] The low pass filter unit 100 receives an input image signal I_DATA. The input image signal I_DATA may have a YUV format including a luminance signal Y and chrominance signals Cb and Cr. The low pass filter unit 100 generates a low frequency image signal L_DATA by separating low frequency elements from the input image signal I_DATA. The low frequency image signal L_DATA may include both image elements representing a captured image and noise elements.

[0043] The noise filtering unit 200 generates a filtered image signal F_DATA by performing noise suppression and/or elimination on the low frequency image signal L_DATA in both a horizontal direction and a vertical direction. The noise filtering unit 200 may suppress (e.g., effectively eliminate) noise elements included in the low frequency image signal L_DATA since the noise filtering unit 200 separately suppresses and/or eliminates noise elements in the horizontal direction and the vertical direction. A detailed operation of the noise filtering unit 200 will be described below with reference to FIGS. 2 and 3.

[0044] The high frequency separation unit 300 generates a high frequency image signal H_DATA by separating high frequency elements from the input image signal I_DATA using the low frequency image signal L_DATA. In some example embodiments, the high frequency separation unit 300 may include a subtracter 310. The subtracter 310 may generate the high frequency image signal H_DATA by subtracting the low frequency image signal L_DATA from the input image signal I_DATA.

[0045] The signal synthesis unit 400 generates an output image signal O_DATA by combining the high frequency image signal H_DATA and the filtered image signal F_DATA. In some example embodiments, the signal synthesis unit 400 may include an adder 410. The adder 410 may generate the output image signal O_DATA by adding the high frequency image signal H_DATA and the filtered image signal F_DATA.

[0046] FIG. 2 is a block diagram illustrating an example embodiment of a noise filtering unit included in the noise suppression and/or elimination device of FIG. 1.

[0047] Referring to FIG. 2, a noise filtering unit 200a may include a decimation unit 210, a horizontal filtering unit 220, a vertical filtering unit 230 and an interpolation unit 240.

[0048] The decimation unit 210 receives the low frequency image signal L_DATA from the low pass filter unit 100, and generates a compressed image signal C_DATA by decimating the low frequency image signal L_DATA in the horizontal direction. For example, the decimation unit 210 may decrease a data size of the low frequency image signal L_DATA by sampling the low frequency image signal L_DATA in the horizontal direction to generate the compressed image signal C_DATA. Since the decimation unit 210 decreases a data size of the low frequency image signal L_DATA, operation speeds of the horizontal filtering unit 220 and the vertical filtering unit 230 may increase.

[0049] The horizontal filtering unit 220 may generate a first filtered image signal F1_DATA by performing noise suppression and/or elimination on the compressed image signal C_DATA in the horizontal direction. In some example embodiments, the horizontal filtering unit 220 may average pixel values of adjacent pixels in the horizontal direction in the compressed image signal C_DATA to generate the first filtered image signal F1_DATA. However, according to example embodiments, the horizontal filtering unit 220 may use various filtering methods.

[0050] The vertical filtering unit 230 may generate a second filtered image signal F2_DATA by performing noise suppression and/or elimination on the first filtered image signal F1_DATA in the vertical direction. In some example embodiments, the vertical filtering unit 230 may be an asymmetric infinite impulse response filter. In other example embodiments, the vertical filtering unit 230 may average pixel values of adjacent pixels in the vertical direction in the first filtered image signal F1_DATA to generate the second filtered image signal F2_DATA. However, according to example embodiments, the vertical filtering unit 230 may use various filtering methods.

[0051] As shown in FIG. 2, the noise filtering unit 200a is configured to sequentially suppress noise from the low frequency image signal in the horizontal direction, and then in the vertical direction. However, example embodiments are not limited to this example. The noise filtering unit 200a may be configured to sequentially suppress noise from the low frequency image signal in the vertical direction, and then in the horizontal direction.

[0052] In at least one example embodiment, the interpolation unit 240 generates the filtered image signal F_DATA by interpolating the second filtered image signal F2_DATA in the horizontal direction. An interpolation rate of the interpolation unit 240 may be the same or substantially the same as a decimation rate of the decimation unit 210. According to example embodiments, the interpolation unit 240 may use various interpolation methods such as a linear interpolation, an exponential interpolation, a polynomial interpolation, etc. to generate the filtered image signal F_DATA.

[0053] According to at least some example embodiments, the location of the horizontal filtering unit 220 and the vertical filtering unit 230 may be switched such that noise suppression and/or elimination in the vertical direction is performed prior to noise suppression and/or elimination in the horizontal direction.

[0054] FIG. 3 is a block diagram illustrating another example embodiment of a noise filtering unit included in the noise suppression and/or elimination device of FIG. 1.

[0055] Referring to FIG. 3, a noise filtering unit 200b includes: a decimation unit 210; a horizontal filtering unit 220; a vertical filtering unit 230; an interpolation unit 240; a first signal processing unit 250; and a second signal processing unit 260.

[0056] The noise filtering unit 200b of FIG. 3 is similar to the noise filtering unit 200a of FIG. 2, except that the noise filtering unit 200b further includes a first signal processing unit 250 and a second signal processing unit 260. Operation of the decimation unit 210, the horizontal filtering unit 220, the vertical filtering unit 230 and the interpolation unit 240 are the same or substantially the same as described above with reference to FIG. 2. Therefore, a detail description of the decimation unit 210, the horizontal filtering unit 220, the vertical filtering unit 230 and the interpolation unit 240 will be omitted here.

[0057] The first signal processing unit 250 is coupled between the horizontal filtering unit 220 and the vertical filtering unit 230. The compressed image signal C_DATA includes image elements representing a captured image and noise elements. After the horizontal filtering unit 220 performs noise suppression and/or elimination on the compressed image signal C_DATA in the horizontal direction, pixel values representing image elements as well as pixel values representing noise elements may be distorted. The first signal processing unit 250 corrects the first filtered image signal F1_DATA based on the compressed image signal C_DATA, and provides the corrected first filtered image signal to the vertical filtering unit 230. In one example, the first signal processing unit 250 replaces pixel values representing image elements in the first filtered image signal F1_DATA with pixel values representing image elements in the compressed image signal C_DATA to correct the first filtered image signal F1_DATA.

[0058] The second signal processing unit 260 is coupled between the vertical filtering unit 230 and the interpolation unit 240. The first filtered image signal F1_DATA includes both image elements representing a captured image and noise elements. After the vertical filtering unit 230 performs noise suppression and/or elimination on the first filtered image signal F1_DATA in the vertical direction, pixel values representing image elements as well as pixel values representing noise elements may be distorted. The second signal processing unit 260 corrects the second filtered image signal F2_DATA based on the compressed image signal C_DATA, and provides the corrected second filtered image signal to the interpolation unit 240. In one example, the second signal processing unit 260 replaces pixel values representing image elements in the second filtered image signal F2_DATA with pixel values representing image elements in the compressed image signal C_DATA to correct the second filtered image signal F2_DATA.

[0059] As with the example embodiment shown in FIG. 2, the noise filtering unit 200b shown in FIG. 3 is configured to sequentially suppress noise from the low frequency image signal in the horizontal direction, and then in the vertical direction. However, example embodiments are not limited to this example. The noise filtering unit 200b may be configured to sequentially suppress noise from the low frequency image signal in the vertical direction, and then in the horizontal direction.

[0060] As described above with reference to FIGS. 1, 2 and 3, the noise suppression and/or elimination device 10a of FIG. 1 divides the input image signal I_DATA into the low frequency image signal L_DATA and the high frequency image signal H_DATA, generate the filtered image signal F_DATA by suppressing and/or eliminating noise elements included in the low frequency image signal L_DATA using the noise filtering unit 200, and generate the output image signal O_DATA by combining the high frequency image signal H_DATA and the filtered image signal F_DATA. Therefore, the noise suppression and/or elimination device 10a may effectively suppress and/or eliminate low frequency noise elements included in the input image signal I_DATA without distorting high frequency elements of the input image signal I_DATA.

[0061] In addition, the noise filtering unit 200a and 200b may separately suppress and/or eliminate noise elements from the input image signal I_DATA in the horizontal direction and the vertical direction. Therefore, the noise filtering unit 200a and 200b may effectively suppress and/or eliminate low frequency noise elements included in the input image signal I_DATA.

[0062] Furthermore, since the noise filtering unit 200b includes the first signal processing unit 250 and/or the second signal processing unit 260, the noise filtering unit 200b may effectively suppress and/or eliminate low frequency noise elements included in the input image signal I_DATA without distorting a captured image.

[0063] FIG. 4 is a block diagram illustrating a noise suppression and/or elimination device according to other example embodiments.

[0064] Referring to FIG. 4, a noise suppression and/or elimination device 10b includes: a low pass filter unit LPF 100; a noise filtering unit 200; a high frequency separation unit 300; a signal synthesis unit 400; an RGB-YUV conversion unit 500; and a YUV-RGB conversion unit 600.

[0065] The noise suppression and/or elimination device 10b of FIG. 4 is similar to the noise suppression and/or elimination device 10a of FIG. 1 except that the noise suppression and/or elimination device 10b further includes a RGB-YUV conversion unit 500 and a YUV-RGB conversion unit 600. A structure and operation of the noise suppression and/or elimination device 10a of FIG. 1 are described above with reference to FIGS. 1, 2 and 3. Therefore, a detail description of the low pass filter unit 100, the noise filtering unit 200, the high frequency separation unit 300 and the signal synthesis unit 400 will be omitted here.

[0066] If an image signal RGB_I_DATA input to the noise suppression and/or elimination device 10b has an RGB format including a red pixel data, a green pixel data and a blue pixel data, then the RGB-YUV conversion unit 500 converts the image signal RGB_I_DATA into the YUV format to generate the input image signal I_DATA.

[0067] The YUV-RGB conversion unit 600 converts a format of the output image signal O_DATA having a YUV format into an RGB format to generate an image signal RGB_O_DATA.

[0068] The example embodiment of the noise suppression and/or elimination device 10b shown in FIG. 4 may be used if the image signal input to the noise suppression and/or elimination device 10b has an RGB format.

[0069] FIG. 5 is a block diagram illustrating an image capturing apparatus according to example embodiments.

[0070] Referring to FIG. 5, an image capturing apparatus 700 includes: an image sensor 710; an analog-digital converter ADC 730; and a noise suppression and/or elimination device 740.

[0071] The image sensor 710 detects incident light, and generates an analog signal A_DATA based on the detected incident light. The image sensor 710 may be, for example, a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. Noise elements may be included in the analog signal A_DATA while converting the detected incident light into an electric signal.

[0072] The analog-digital converter 730 digitizes the analog signal A_DATA to generate input image data I_DATA.

[0073] The noise suppression and/or elimination device 740 suppresses and/or eliminates low frequency noise elements from the input image signal I_DATA to generate an output image signal O_DATA.

[0074] In at least some example embodiments, if the input image signal I_DATA is in the YUV format, the noise suppression and/or elimination device 740 may be embodied as the noise elimination device 10a of FIG. 1. In other example embodiments, if the input image signal I_DATA is in the RGB format, then the noise suppression and/or elimination device 740 may be embodied as the noise suppression and/or elimination device 10b of FIG. 4. A structure and operation of the noise suppression and/or elimination device 10a and the noise suppression and/or elimination device 10b are described above with reference to FIGS. 1, 2, 3 and 4. Therefore, a detail description of the noise suppression and/or elimination device 740 will be omitted here.

[0075] Still referring to FIG. 5, the image capturing apparatus 700 further includes an automatic gain control circuit AGC 720 coupled between the image sensor 710 and the analog-digital converter 730. The automatic gain control circuit 720 amplifies the analog signal A_DATA to a given, desired or predefined level. Therefore, the image capturing apparatus 700 is able to generate an image signal having relatively high luminance using the automatic gain control circuit 720, even if an image is captured in relatively dark circumstances.

[0076] The image capturing apparatus 700 further includes a display device 750 to display the output image signal O_DATA.

[0077] As described above, although the analog signal A_DATA generated by the image sensor 710 includes noise elements, the noise suppression and/or elimination device 740 may effectively suppress and/or eliminate low frequency noise elements included in the input image signal I_DATA. Therefore, the image capturing apparatus 700 may provide image data having improved quality.

[0078] The image capturing apparatus 700 may be various electronic devices such as a smart phone, a digital camera, a personal computer, a laptop computer, a personal digital assistant, etc.

[0079] The foregoing is illustrative of the inventive concepts and is not to be construed as limiting thereof. Although a few example embodiments have been described, those skilled in the art will readily appreciate that many modifications are possible in the example embodiments without materially departing from the novel teachings and advantages of the present inventive concept. Accordingly, all such modifications are intended to be included within the scope of the present inventive concept as defined in the claims. Therefore, it is to be understood that the foregoing is illustrative of various example embodiments and is not to be construed as limited to the specific example embodiments disclosed, and that modifications to the disclosed example embodiments, as well as other example embodiments, are intended to be included within the scope of the appended claims.