US 8,049,892 B2Grant
Apparatus and method for camera-based color measurements
Issue Date:2011-11-01
•22 Claims
•5 Drawing Sheets
Abstract
A method includes receiving light from a material at a digital imaging device. The method also includes filtering the light into at least three spectral bands using a filter, where different regions of the filter pass different spectral bands. The method further includes measuring the light in each of the spectral bands and determining at least one color associated with the material using the measured light in the spectral bands. The different regions of the filter could include multiple masks (where each mask passes one of the spectral bands), different areas of a linear variable filter, and/or individual filters (where each individual filter passes one of the spectral bands). The digital imaging device could include a digital camera. The filter could be formed on a detector in the digital camera, and/or a component of the digital camera could be replaced with the filter.
Metadata
Assignee
- Honeywell International Inc.
Inventors
- Tarja T. Shakespeare
- John F. Shakespeare
Application Information
Application Number:US 12/017,469
Filing Date:2008-01-22
Priority Date:2008-01-22
Art Unit:2886
Classifications
IPC:
G01N21/25
Patent Drawings (5 sheets)
Description
Technical Field
[0001] This disclosure relates generally to measurement systems and more specifically to an apparatus and method for camera-based color measurements.
Background
[0002] Many different production and processing systems are used to produce paper products and other items having various colors. For example, paper production systems are often used to produce sheets of paper having different colors. As another example, printing systems are often used to print color graphics or other color content on sheets of paper. As yet another example, plastic film production systems are often used to produce sheets of plastic having different colors. It is often necessary or desirable to monitor the colors of items being produced or processed, such as to ensure that the items' colors are within standard or other specifications.
[0003] Spectrophotometers and calorimeters are often used to measure surface or transmittance colors of still or moving items. Spectrophotometers often use spectrometers that are based on diffraction gratings, and these spectrometers often have a low optical throughput. This optical throughput can be increased using transmission gratings, but even then only one signal or channel can be analyzed at a time with a spectrometer. Moreover, spectrometers are often quite expensive and large in size. Colorimeters typically utilize photodetectors having suitable filters so that each photodetector measures a weighted average of light in a range of wavelengths. However, these types of calorimeters typically lack the flexibility to change illuminants and observers as is often required in various industries.
[0004] Black/white and color cameras with different Bayer masks have also been used in conjunction with filter wheels to capture spectral images of still items such as paintings. However, cameras with moving filter wheels are often not suitable for analyzing moving objects, such as moving paper sheets (especially with printing or other applied markings).
Summary
[0005] This disclosure provides an apparatus and method for camera-based color measurements.
[0006] In a first embodiment, a method includes receiving light from a material at a digital imaging device. The method also includes filtering the light into at least three spectral bands using a filter, where different regions of the filter pass different spectral bands. The method further includes measuring the light in each of the spectral bands and determining at least one calorimetric quantity associated with the material using the measured light in the spectral bands.
[0007] In particular embodiments, measuring the light in each of the spectral bands includes taking multiple measurements of the light in each of the spectral bands.
[0008] In other particular embodiments, the different regions of the filter include multiple masks (where each mask passes one of the spectral bands), different areas of a linear variable filter, and/or individual filters (where each individual filter passes one of the spectral bands).
[0009] In yet other particular embodiments, the digital imaging device includes a digital camera. Also, the filter is formed on a detector in the digital camera, and/or a component of the digital camera is replaced with the filter.
[0010] In still other particular embodiments, the spectral bands include wavelength bands that are 20 nm in width and that include one or more of the following wavelengths: 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm.
[0011] In additional particular embodiments, the method also includes adjusting a process associated with the material based on the at least one determined color. The material could include a paper sheet, and the process could include a paper production process and/or a printing process.
[0012] In a second embodiment, an apparatus includes a filter configured to receive light associated with a material and to filter the light into at least three spectral bands, where different regions of the filter pass different spectral bands. The apparatus also includes a detector configured to generate a measurement of the light in each of the spectral bands. In addition, the apparatus includes an interface configured to output the measurements for use in determining at least one calorimetric quantity associated with the material.
[0013] In particular embodiments, the detector includes a plurality of pixels each configured to measure the light in one of the spectral bands. In other particular embodiments, the detector includes a charge-coupled device, a complimentary metal oxide semiconductor device, and/or a charge injection device in a digital camera.
[0014] In a third embodiment, a system includes an illumination source configured to illuminate a material. The system also includes a color sensor. The color sensor includes a filter configured to receive light associated with the material and to filter the light into at least three spectral bands, where different regions of the filter pass different spectral bands. The color sensor also includes a detector configured to generate measurements of the light in each of the spectral bands. In addition, the color sensor includes an interface configured to output the measurements for use in determining at least one calorimetric quantity associated with the material.
[0015] In particular embodiments, the system also includes one or more controllers configured to determine the at least one calorimetric quantity associated with the material and to control a processing or production system based on the at least one determined calorimetric quantity.
[0016] In other particular embodiments, the at least one calorimetric quantity includes a spatial calorimetric quantity based on an image of the material and/or an average color of the material.
[0017] Other technical features may be readily apparent to one skilled in the art from the following figures, descriptions, and claims.
Brief Description of the Drawings
[0018] For a more complete understanding of this disclosure, reference is now made to the following description, taken in conjunction with the accompanying drawings, in which:
[0019] FIG. 1 illustrates an example color measurement system according to this disclosure;
[0020] FIG. 2 illustrates an example camera-based color sensor according to this disclosure;
[0021] FIGS. 3A through 3F illustrate example wavelength selectable bandpass filters for use in a camera-based color sensor according to this disclosure; and
[0022] FIG. 4 illustrates an example method for camera-based color measurements according to this disclosure.
Detailed Description
[0023] FIGS. 1 through 4 , discussed below, and the various embodiments used to describe the principles of the present invention in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the invention. Those skilled in the art will understand that the principles of the invention may be implemented in any type of suitably arranged device or system.
[0024] FIG. 1 illustrates an example color measurement system 100 according to this disclosure. The embodiment of the color measurement system 100 shown in FIG. 1 is for illustration only. Other embodiments of the color measurement system 100 could be used without departing from the scope of this disclosure.
[0025] In this example, the system 100 generally includes a processing or production system 102 and a color monitor 104. The processing or production system 102 generally denotes any suitable processing or production system that can output at least one item having some form of color to be measured. In this example, the processing or production system 102 is used to produce a paper sheet 106 having some form of color in or on the sheet 106. For example, the processing or production system 102 could represent a paper machine capable of producing a colored paper sheet 106 (including white paper) or a film sheet. The processing or production system 102 could also represent a printing system capable of printing color content onto the paper sheet 106. The processing or production system 102 could represent any other or additional system capable of generating or processing a sheet 106 having at least some form of color or appearance to be measured (such as CIE L*, a*, b* or CIE whiteness). In this example, the processing or production system 102 includes multiple rollers 108, which can be used (among other things) to form the sheet 106 or to impart printing or other colored marks onto the sheet 106. The processing or production system 102 may include any other or additional components depending on the particular function(s) being performed by the system 102. Also, the processing or production system 102 could be used to produce or process any type of item having at least one color to be measured (such as plastic films) and is not limited to use with just paper sheets.
[0026] The color monitor 104 is capable of examining one or more items and to measure one or more color or other appearance properties associated with the items. For example, the color monitor 104 could measure the color of the paper sheet 106 or the color of printing placed on the paper sheet 106. In this way, the color monitor 104 can determine whether the processing or production system 102 is producing items with suitable colors, such as colors that satisfy certain color standards or specifications. This may allow the color monitor 104 to ensure that the processing or production system 102 is operating properly and allow identification of potential problems with the processing or production system 102.
[0027] In this example, the color monitor 104 includes one or more camera-based color sensors 110. As described in more detail below, each camera-based color sensor 110 includes a detector and a wavelength selectable bandpass filter. The wavelength selectable bandpass filter allows, for example, light within different narrow bandpass ranges to pass to different pixels of the detector. As a result, the detector can measure a broad spectrum of light coming from the sheet 106 or other item being analyzed. Moreover, this can be done very quickly, allowing the camera-based color sensors 110 to be used with still and moving items. As shown in FIG. 1 , one or more camera-based color sensors 110 are located on each side of the paper sheet 106. However, this is for illustration only, and one or more camera-based color sensors 110 could be used on a single side of the sheet 106.
[0028] The color monitor 104 also includes one or more illumination sources 112. The illumination sources 112 generate light that illuminates the paper sheet 106 or other item being examined. This helps to facilitate more accurate color measurements of the paper sheet 106 or other item. Each of the illumination sources 112 represents any suitable source of light, such as one or more light emitting diodes, bulbs, or other light source(s). The illumination sources 112 could also generate any suitable light, such as white light. Further, any suitable geometry could be used for illuminating the item being examined and for measuring light reflected from or transmitted through the item being examined. In addition, a camera-based color sensor 110 and an associated illumination source 112 could be used on the same side or on different sides of the item being examined.
[0029] As shown in FIG. 1 , the color monitor 104 may further include a controller 114. The controller 114 could use the measurements from one or more camera-based color sensors 110 to determine the color(s) associated with the sheet 106 or other item. The controller 114 could also use the measurements to determine if the item being examined suffers from various problems, such as when the item has a color that fails to meet specification or has excessive color variations. If problems are found, the controller 114 could take any suitable action, such as notifying an operator or making adjustments to the processing or production system 102. In other embodiments, the controller 114 could collect the measurements from the camera-based color sensors 110 and provide the measurements to an external controller 116, which makes color determinations using the measurements. In yet other embodiments, the measurements from the camera-based color sensors 110 could be provided directly to the external controller 116 without the use of a controller 114 in the color monitor 104. Each of the controllers 114, 116 includes any suitable hardware, software, firmware, or combination thereof for making color determinations using measurements from one or more camera-based color sensors 110. Each of the controllers 114, 116 could, for example, include one or more processors 118 and one or more memories 120 storing instructions and data used, generated, or collected by the processor(s) 118. Each of the controllers 114, 116 could also include one or more network interfaces 122 facilitating communication with external components over a wired or wireless network or communication link.
[0030] Although FIG. 1 illustrates one example of a color measurement system 100, various changes may be made to FIG. 1 . For example, the system 100 could include any number of processing or production systems 102, color monitors 104, and controllers. Also, FIG. 1 illustrates one example operational environment in which camera-based color measurements can be used. This functionality could be used in any suitable system to measure the color(s) of any suitable item(s).
[0031] FIG. 2 illustrates an example camera-based color sensor 110 according to this disclosure. The embodiment of the camera-based color sensor 110 shown in FIG. 2 is for illustration only. Other embodiments of the camera-based color sensor 110 could be used without departing from the scope of this disclosure.
[0032] As shown in FIG. 2 , light transmitted through, reflected from, and/or emitted by a paper sheet 106 or other item being examined can be received at optics 202. The optics 202 alter the light received at the color sensor 110, such as by focusing or diffusing the light. The optics 202 can perform any other or additional functions depending on the implementation. The optics 202 include any suitable structure(s), such as one or more lenses, mirrors, or diffusers.
[0033] Light from the item being examined passes through a wavelength selectable bandpass filter 204. The wavelength selectable bandpass filter 204 includes different regions that filter different wavelengths of light. This allows light in different wavelength bands to pass through the different regions of the filter 204. For example, different regions of the wavelength selectable bandpass filter 204 could filter the light into different bands that are 20 nanometers wide. As particular examples, regions in the wavelength selectable bandpass filter 204 could filter light into different 20 nanometer-wide bands centered at or including 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm. The wavelength selectable bandpass filter 204 includes any suitable structure(s) for filtering light into different wavelength bands. Example embodiments of the wavelength selectable bandpass filter 204 are shown in FIGS. 3A through 3F , which are described below.
[0034] The filtered wavelength bands are received at a detector 206. The detector 206 is capable of measuring an intensity of light in the various wavelength bands provided by the wavelength selectable bandpass filter 204. For example, the detector 206 could include an array or matrix of smaller detectors, such as an array or matrix of pixels. Each detector in the array or matrix could be used to measure the intensity of light provided in one of the wavelength bands. By using multiple detectors to measure light in multiple wavelength bands, spectral or calorimetric information about the item being examined can be obtained, allowing the color(s) of the item to be determined. For instance, multiple detectors in the array or matrix could simultaneously measure light in multiple wavelength bands, thereby enabling the use of the color sensor 110 with a moving item. The detector 110 includes any suitable structure(s) for measuring light in multiple wavelength bands. The detector 110 could, for example, represent a charge-coupled device (CCD), a complimentary metal oxide semiconductor (CMOS) device, or a charge injection device (CID).
[0035] Micro-optics 208 could be used to focus light from the wavelength selectable bandpass filter 204 onto individual pixels or other structures of the detector 206. The micro-optics 208 include any suitable structure(s), such as micro-lenses formed on the surface of the detector 206.
[0036] A detector controller 210 is coupled to and controls the operation of the detector 206. For example, the detector controller 210 could cause the detector 206 to begin measuring light and to stop measuring light in wavelength bands provided by the wavelength selectable bandpass filter 204. The detector controller 210 could also receive measurement data from the detector 206 and provide the measurement data to an external component, such as the controller 114 or 116. The detector controller 210 could perform any other or additional actions to facilitate operation of the detector 206. The detector controller 210 includes any suitable structure(s) for controlling the operation of one or more detectors.
[0037] An interface 212 can be used to facilitate communication between the color sensor 110 and an external component, such as the controller 114 or 116. The interface 212 could support communications over any suitable type of communication medium, such as a wired or wireless network or link. The interface 212 includes any suitable structure supporting communication with the color sensor 110. As particular examples, the interface 212 could support communications over a Universal Serial Bus (USB) link, a FireWire link, or a gigabit Ethernet link.
[0038] In some embodiments, the entire color sensor 110 could be implemented using a digital camera or other digital imaging device. In general, a “digital imaging device” represents any digital device designed to capture visual information using individual pixels or other image capturing elements. In these embodiments, a custom filter (the wavelength selectable bandpass filter 204) can be used in front of the camera's pixels or other image capturing elements (the detector 206) to enable the camera to be utilized as a color analyzer/sensor. Conventional digital cameras typically use red-green-blue (RGB) or cyan-magenta-yellow (CMY) filters, which are inappropriate for calorimetric measurements. The wavelength selectable bandpass filter 204 provides proper wavelength bands for spectral analysis and color determinations. In particular embodiments, at least four wavelength bands are provided by the wavelength selectable bandpass filter 204 for detection and analysis, although any other suitable number of wavelength bands could be used. The wavelength bands could represent any suitable wavelength bands, whether in the ultraviolet, visible, near infrared, infrared, or other spectrums.
[0039] Digital cameras may be less expensive than other color measurement techniques, such as those using expensive diffraction grating-based spectrometers. Also, the wavelength selectable bandpass filter 204 could be removable, allowing different wavelength selectable bandpass filters 204 to be inserted into and used in the color sensor 110. This would allow the same overall color sensor structure to be reused for various types of measurements, further reducing costs to users of the color sensors. Further, since narrow wavelength bands are measured in the color sensor 110, the color sensor 110 could reduce signal-to-noise ratios in the color measurements (such as by examining larger areas of the sheet 106 and averaging spatial pixel values). In addition, the color sensor 110 could be smaller than conventional color measuring devices, enabling the color sensor 110 to be used in space-confined applications.
[0040] In particular embodiments, a digital camera could be fabricated with the wavelength selectable bandpass filter 204. For example, the wavelength selectable bandpass filter 204 could be formed as part of the detector 206, such as during formation of a CCD, CMOS, or CID-based detector 206. In other particular embodiments, the wavelength selectable bandpass filter 204 could be retrofitted into an existing digital camera. For instance, the cover glass or infrared block on a digital camera could be replaced with the wavelength selectable bandpass filter 204. A digital camera incorporating the wavelength selectable bandpass filter 204 could be produced in any other suitable manner.
[0041] In some embodiments, the detector 206 can be calibrated to ensure proper operation of the color sensor 110. A photometric calibration could occur in any suitable manner, such as by using a calibration tile. The calibration tile could include different areas with known reflectances at specific wavelength bands. The calibration tile could be illuminated (such as by using an illumination source 112), and measurements of the calibration tile could be taken using the detector 206. In this way, a controller or other component can determine how the detector 206 operates given specific illumination of a surface with known reflectances. Also, a wavelength calibration could occur in any suitable manner, such as by using a mercury pen-ray lamp and/or wavelength calibration tiles. These types of calibrations are generally well known to one skilled in the art.
[0042] Although FIG. 2 illustrates one example of a camera-based color sensor 110, various changes may be made to FIG. 2 . For example, the color sensor 110 may or may not require optics 202, 208. Also, various embodiments of the wavelength selectable bandpass filter 204 could be used, and the different filtering regions of the wavelength selectable bandpass filter 204 may be arranged in a pattern or arranged randomly or pseudo-randomly.
[0043] FIGS. 3A through 3F illustrate example wavelength selectable bandpass filters 204 for use in a camera-based color sensor 110 according to this disclosure. The embodiments of the wavelength selectable bandpass filters shown in FIGS. 3A through 3F are for illustration only. Other embodiments of the wavelength selectable bandpass filter could be used without departing from the scope of this disclosure.
[0044] As shown in FIG. 3A , a wavelength selectable bandpass filter includes a single row of pixel masks 302a-302j, each of which is designed to pass a different wavelength band of light. For example, the pixel masks 302a-302j could be respectively designed to pass light in the following bands of the spectrum: ultraviolet (U) violet (V), blue (B), cyan (C), green (G), green-yellow (GY), yellow (Y), orange (O), red (R), and deep red (DR). Each of these pixel masks 302a-302j can filter light passing through it so that only light falling into one of these wavelength bands is passed. Various pixels or other detectors could then be used to measure the intensity of light in each of the wavelength bands, allowing the color of an item to be determined. In this example, each of the pixel masks 302a-302j is aligned with a single pixel or other detector. Also, while shown as a single row of pixel masks 302a-302j, this row could be replicated any number of times (whether the order of the pixel masks 302a-302j in the rows remains the same or changes).
[0045] As shown in FIG. 3B , a wavelength selectable bandpass filter includes blocks 304a-304j of pixel masks, each block representing a 2×2 block of pixel masks. The blocks 304a-304j are designed to pass different wavelength bands to multiple sets of pixels or other detectors (in this case, four pixels per block). This allows multiple measurements to be taken of light passing through each of the blocks 304a-304j, which may allow, for example, an average measurement value to be determined for each of the wavelength bands. Again, the structure in FIG. 3B could be replicated any number of times (whether the order of the pixel blocks 304a-304j remains the same or changes).
[0046] As shown in FIG. 3C , a wavelength selectable bandpass filter includes discrete masks 306a-306c. The discrete masks 306a-306c are designed to pass different wavelength bands to pixels or other detectors. In this example, the masks 306a-306c are not aligned with pixels or other individual detectors (the pixels are denoted with dashed lines), and light from each of the masks 306a-306c may fall completely or partially on a pixel. The pixels partially receiving light may or may not be used to generate measurement data. While only three discrete masks are shown in FIG. 3C , other discrete masks could be used for the other wavelength ranges described above. Also, multiple masks could be used for each wavelength band.
[0047] As shown in FIG. 3D , a wavelength selectable bandpass filter includes a linear variable filter 308, which can be placed over a number of pixels or other detectors. The linear variable filter 308 generally transitions in its filtering function, allowing light in one wavelength band to pass in one area of the filter 308 and allowing light in another wavelength band to pass in a different area of the filter 308. Although not shown, the linear variable filter 308 could transition and allow light to pass in all of the wavelength bands noted above. Also, one or multiple linear variable filters 308 could be used. In some embodiments, a linear variable filter 308 could be formed by applying a suitable coating on the surface of the detector 206 or on the surface of a glass cover of the detector 206. In particular embodiments, a linear variable filter 308 could be limited to use with visible light, and additional structures could be used to allow other narrow bands of light to pass (such as near infrared and infrared bands). For example, a glass doped with Holmium or Neodymium could be used to pass particular known groups of narrow wavelength bands for wavelength calibration or other purposes.
[0048] In FIG. 3E , a wavelength selectable bandpass filter includes multiple filters or regions 310a-310h, each of which may be aligned with or otherwise associated with one or multiple rows of pixels or other detectors. Each one of these regions 310a-310h could pass a different wavelength band of light, such as one of the wavelength bands discussed above. The regions 310a-310h could have any suitable size and shape, and the regions 310a-310h may or may not have the same size or shape.
[0049] In FIG. 3F , a wavelength selectable bandpass filter includes multiple filters or regions 312, each of which may be aligned or otherwise associated with one or multiple pixels or other individual detectors. Each of these regions 312 could pass a different wavelength band of light, such as one of the wavelength bands discussed above. The regions 312 could have any suitable size and shape, and the regions 312 may or may not have the same size or shape. The arrangement of the regions 312 could be periodic, random, or pseudo-random.
[0050] In these various embodiments, the wavelength selectable bandpass filter is used to allow light in different narrow wavelength bands to reach different pixels or other portions of the detector 206. This allows the detector 206 to measure the spectrum of light coming from the item being examined. The wavelength bands passed by the wavelength selectable bandpass filter could represent any suitable bands, such as different 20 nanometer-wide bands centered at or including 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm. However, any other or additional wavelength bands could be provided by the wavelength selectable bandpass filter and measured by the detector 206. Also, areas of pixels or other individual detectors within the detector 206 could be predefined prior to use, where the areas of pixels or other detectors correspond to the different filtering regions of the wavelength selectable bandpass filter 204.
[0051] In some embodiments, the signal-to-noise ratios in the wavelength bands passed from the wavelength selectable bandpass filter could be similar or equal. Also, the sensitivity of the detector 206 may or may not be the same at all wavelength bands. Further, the transmittance of the wavelength selectable bandpass filter may or may not vary as a function of wavelength. Beyond that, the total area of the wavelength selectable bandpass filter used to provide light at a particular wavelength band could be selected in any suitable manner, such as to optimize the signal-to-noise ratio for that wavelength band. In addition, the pattern of the regions used to provide light at particular wavelength bands could be selected based on any suitable criteria, such as the measurement task to be performed. In other embodiments, multiple bandpass filters may be provided, not all of which are simultaneously deployed in front of the detector. In these embodiments, the bandpass filter or set of filters deployed at any time can be selected according to the measurement task to be performed.
[0052] As shown in FIGS. 3E and 3F , in some embodiments, the wavelength selectable bandpass filter could be used in conjunction with one or more backings 314-316. For example, a paper sheet 106 or other item could be placed on the top of the backings 314-316 (between the backings and the wavelength selectable bandpass filter). The paper sheet 106 or other item could be illuminated, and the wavelength selectable bandpass filter could then filter light reflected from the paper sheet 106 or other item over the backings 314-316. In this way, color measurements associated with multiple backings can be captured at the same time. In particular embodiments, the backings 314-316 represent white and black backings, and color measurements taken using these backings 314-316 could be used to predict the color of the paper sheet 106 or other item with any other backing. The use of two backings is for illustration only. Any number of backings could be used here, such as when black and white (or other color) backings are arranged in a checkerboard pattern. Also, backings could be used with any of the wavelength selectable bandpass filters shown here or with other wavelength selectable bandpass filters.
[0053] As noted above, different types of optics can be used in the color sensor 110, and the use of optics in the color sensor 110 may be optional. If a defocused image of a paper sheet 106 or other item is received at the wavelength selectable bandpass filter, the light in the defocused image could represent the average light from the paper sheet 106 or other item (or a portion thereof). In this case, each filtering region of the wavelength selectable bandpass filter could output the portion of that average light falling within the narrow wavelength band of that region. The measured values produced by the detector 206 could then be used in any suitable manner, such as by summing the measurements for each individual wavelength band to produce improved measurement values.
[0054] If a focused image of the paper sheet 106 or other item is received at the wavelength selectable bandpass filter, the light in the image can vary depending on the color of the item in different areas of the focused image. In this case, at least some of the filtering regions of the wavelength selectable bandpass filter could receive light from different areas of the paper sheet 106 or other item. The filtering regions of the wavelength selectable bandpass filter could therefore output light in narrow wavelength bands from different areas of the paper sheet 106 or other item. In this way, the detector 206 could be used, for example, to detect color variations in different areas of the paper sheet 106 or other item. For measurements with different spatial resolutions, corresponding patterns of regions on the bandpass filter and suitable degrees of focusing sharpness (or de-focusing) can be chosen and used.
[0055] Although FIGS. 3A through 3F illustrate examples of wavelength selectable bandpass filters 204 for use in a camera-based color sensor 110, various changes may be made to FIGS. 3A through 3F . For example, a wavelength selectable bandpass filter 204 could include any suitable number of regions passing different wavelength bands, such as regions passing at least four different spectral bands. Also, each of the regions of the wavelength selectable bandpass filter 204 could have any suitable size and shape, and the regions could have any suitable arrangement. Furthermore, some of the regions of the bandpass filter may pass essentially all wavelength bands. In addition, the use of the backings 314-316 may or may not be needed, depending on the implementation.
[0056] FIG. 4 illustrates an example method 400 for camera-based color measurements according to this disclosure. The embodiment of the method 400 shown in FIG. 4 is for illustration only. Other embodiments of the method 400 could be used without departing from the scope of this disclosure.
[0057] A material to be analyzed is received at step 402. This may include, for example, placing a color monitor 104 near the surface of a still or moving item (or placing a still or moving item near the color monitor 104). As a particular example, this may include running a paper sheet 106 being formed or processed past the color monitor 104.
[0058] The material is illuminated at step 404. This may include, for example, using one or more illumination sources 112 to illuminate one or more surfaces of the material. As a particular example, this may include using one or more illumination sources 112 to illuminate one or more surfaces of the paper sheet 106. Any suitable light could be used here, such as white light. Illumination sources 112 could be used so that one or more spectral power distributions are used to irradiate the surface of the material, allowing one or more measurement to be utilized to form a final calorimetric quantity.
[0059] Light from the material is separated into multiple narrow spectral bands at step 406. This may include, for example, passing light reflected from or transmitted by the material through a wavelength selectable bandpass filter 204. The wavelength selectable bandpass filter 204 includes multiple regions, each of which can block all light except for light in narrow spectral bands. The wavelength selectable bandpass filter 204 may include at least one region for each of the narrow spectral bands to be analyzed.
[0060] The light in the narrow spectral bands is measured at step 408. This may include, for example, measuring the intensity of the light in each of the narrow spectral bands using one or more pixels in the detector 206. Any suitable number of pixels could be used to measure the light in each of the narrow spectral bands.
[0061] One or more colors of the material are determined at step 410. This may include, for example, the detector 206 outputting the measured values of light in each of the narrow spectral bands. This may also include the controller 114, 116 using the measured values to determine one or more colors associated with the material being analyzed. The measured color(s) could then be used in any suitable manner. For example, the measured color(s) may be used to adjust one or more processes at step 412. This could include, for example, altering one or more processes performed in the processing or production system 102. These alterations could be made to improve color uniformity or reduce color variation. These alterations could also be made to ensure that an item satisfies desired or required color specifications. The measured color(s) could be used in any other suitable manner.
[0062] Although FIG. 4 illustrates one example of a method 400 for camera-based color measurements, various changes may be made to FIG. 4 . For example, while shown as a series of steps, various steps in FIG. 4 could overlap, occur in parallel, or occur multiple times.
[0063] It may be advantageous to set forth definitions of certain words and phrases used throughout this patent document. The term “couple” and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another. The terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation. The term “or” is inclusive, meaning and/or. The phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like. The term “controller” means any device, system, or part thereof that controls at least one operation. A controller may be implemented in hardware, firmware, software, or some combination of at least two of the same. The functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.
[0064] While this disclosure has described certain embodiments and generally associated methods, alterations and permutations of these embodiments and methods will be apparent to those skilled in the art. Accordingly, the above description of example embodiments does not define or constrain this disclosure. Other changes, substitutions, and alterations are also possible without departing from the spirit and scope of this disclosure, as defined by the following claims.
Claims
What is claimed is:
1. A method comprising:
disposing a material between a filter and a plurality of backings, each backing comprising a different color;
receiving light from a plurality of sections of the material at a digital imaging device, each section disposed over a different one of the backings, the light comprising a defocused image of the material, the light in the defocused image comprising an average light from the material;
filtering the light into at least three spectral bands using the filter, wherein different regions of the filter pass different spectral bands, the different regions of the filter arranged in a matrix having a plurality of rows and a plurality of columns;
measuring the light in each of the spectral bands, wherein the light in each spectral band comprises a portion of the average light from the material falling within that spectral band; and
determining at least one colorimetric quantity associated with the material using the measured light in the spectral bands, the at least one colorimetric quantity comprising at least one CIE value.
2. The method of claim 1, wherein measuring the light in each of the spectral bands comprises taking multiple measurements of the light in each of the spectral bands.
3. The method of claim 1, wherein the different regions of the filter comprise multiple masks, each of the masks passing one of the spectral bands.
4. The method of claim 1, wherein the different regions of the filter comprise different areas of a linear variable filter.
5. The method of claim 1, wherein each of the spectral bands has a width of approximately 20 nm.
6. The method of claim 1, wherein the digital imaging device comprises a digital camera, the filter formed on a detector in the digital camera.
7. The method of claim 1, wherein at least one of the spectral bands includes at least one of: ultraviolet wavelengths and infrared wavelengths.
8. The method of claim 1, wherein the spectral bands comprise wavelength bands that are 20 nm in width and that include one or more of: 350 nm, 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, 700 nm, and 750 nm.
9. The method of claim 1, further comprising:
adjusting a process associated with the material based on the at least one determined colorimetric quantity.
10. The method of claim 9, wherein:
the material comprises a still or moving sheet; and
the process comprises one or more of: a paper production process, a plastic production process, and a paper or textile printing process.
11. An apparatus comprising:
a filter configured to receive light associated with a plurality of sections of a material and to filter the light into at least three spectral bands, different regions of the filter configured to pass different spectral bands, the different regions of the filter arranged in a matrix having a plurality of rows and a plurality of columns;
a plurality of backings disposed on a side of the material opposite the filter, each backing comprising a different color, each backing associated with a different one of the sections of the material;
a detector configured to generate a measurement of the light in each of the spectral bands;
and an interface configured to output the measurements for use in determining at least one colorimetric quantity associated with the material, the at least one colorimetric quantity comprising at least one CIE value;
wherein the filter is configured to receive light comprising a defocused image of the material, the light in the defocused image comprising an average light from the material; and
wherein the detector is configured to measure the light in each of the spectral bands, wherein the light in each spectral band comprises a portion of the average light from the material falling within that spectral band.
12. The apparatus of claim 11, wherein the detector is configured to generate multiple measurements of the light in each of the spectral bands.
13. The apparatus of claim 11, wherein the different regions of the filter comprise multiple masks, each of the masks passing one of the spectral bands.
14. The apparatus of claim 11, wherein the different regions of the filter comprise different areas of a linear variable filter.
15. The apparatus of claim 11, wherein each of the spectral bands has a width of approximately 20 nm.
16. The apparatus of claim 11, wherein the detector comprises a plurality of pixels each configured to measure the light in one of the spectral bands.
17. The apparatus of claim 11, wherein the detector comprises at least one of: a charge-coupled device, a complimentary metal oxide semiconductor device, and a charge injection device in a digital camera.
18. The apparatus of claim 11, wherein the filter is disposed on a surface of the detector.
19. A system comprising:
an illumination source configured to illuminate a material having a plurality of sections;
a plurality of backings disposed in proximity of a first side of the material, each backing comprising a different color, each backing associated with a different one of the sections of the material; and
a color sensor comprising:
a filter disposed on a second side of the material opposite the first side, the filter configured to receive light associated with each of the sections of the material and to filter the light into at least three spectral bands, different regions of the filter configured to pass different spectral bands, the different regions of the filter arranged in a matrix having a plurality of rows and a plurality of columns;
a detector configured to generate a measurement of the light in each of the spectral bands; and
an interface configured to output the measurements for use in determining at least one colorimetric quantity associated with the material, the at least one colorimetric quantity comprising at least one CIE value;
wherein the filter is configured to receive light comprising a defocused image of the material, the light in the defocused image comprising an average light from the material; and
wherein the detector is configured to measure the light in each of the spectral bands, wherein the light in each spectral band comprises a portion of the average light from the material falling within that spectral band.
20. The system of claim 19, further comprising:
one or more controllers configured to determine the at least one colorimetric quantity associated with the material and to control a processing or production system based on the at least one determined colorimetric quantity.
21. The system of claim 19, wherein the color sensor further comprises a plurality of micro-lenses configured to focus light from the filter onto individual pixels of the detector.
22. The system of claim 19, wherein the different regions of the filter comprise multiple masks, each of the masks passing one of the spectral bands.
Patent Citations (79)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3787206(A) | 1974-01-01 | Goffe | Examiner |
| US4006358(A) | 1977-02-01 | Howarth | Applicant |
| US4288691(A) | 1981-09-01 | Horton | Applicant |
| US4315279(A) | 1982-02-01 | Kuwayama et al. | Examiner |
| US4376946(A) | 1983-03-01 | Kaminow et al. | Applicant |
| US4439038(A) | 1984-03-01 | Mactaggart | Applicant |
| US4565444(A) | 1986-01-01 | Mactaggart | Applicant |
| US4592043(A) | 1986-05-01 | Williams | Applicant |
| US4634928(A) | 1987-01-01 | Figueroa et al. | Applicant |
| US4699510(A) | 1987-10-01 | Alguard | Applicant |
| US4786817(A) | 1988-11-01 | Boissevain et al. | Applicant |
| US4807630(A) | 1989-02-01 | Malinouskas | Applicant |
| US4856014(A) | 1989-08-01 | Figueroa et al. | Applicant |
| US4883963(A) | 1989-11-01 | Kemeny et al. | Applicant |
| US4928013(A) | 1990-05-01 | Howarth et al. | Applicant |
| US5015099(A) | 1991-05-01 | Nagai et al. | Applicant |
| US5047652(A) | 1991-09-01 | Lisnyansky et al. | Applicant |
| US5122974(A) | 1992-06-01 | Chance | Applicant |
| US5137364(A) | 1992-08-01 | McCarthy | Applicant |
| US5220172(A) | 1993-06-01 | Berthold et al. | Applicant |
| US5235192(A) | 1993-08-01 | Chase et al. | Applicant |
| US5272518(A) | 1993-12-01 | Vincent | Examiner |
| US5313187(A) | 1994-05-01 | Choi et al. | Applicant |
| US5338361(A) | 1994-08-01 | Anderson et al. | Applicant |
| US5374555(A) | 1994-12-01 | Pokora et al. | Applicant |
| US5400258(A) | 1995-03-01 | He | Applicant |
| US5642189(A) | 1997-06-01 | Alguard | Applicant |
| US5642192(A) | 1997-06-01 | Gordon et al. | Applicant |
| US5717605(A) | 1998-02-01 | Komiya et al. | Examiner |
| US5774213(A) | 1998-06-01 | Trebino et al. | Applicant |
| US5793486(A) | 1998-08-01 | Gordon et al. | Applicant |
| US5795394(A) | 1998-08-01 | Belotserkovsky et al. | Applicant |
| US5821536(A) | 1998-10-01 | Pettit | Applicant |
| US5933243(A) | 1999-08-01 | Hagen | Applicant |
| US5963333(A) | 1999-10-01 | Walowit et al. | Applicant |
| US5992318(A) | 1999-11-01 | DiBello et al. | Applicant |
| US6058201(A) | 2000-05-01 | Sikes et al. | Applicant |
| US6074483(A) | 2000-06-01 | Belotserkovsky et al. | Applicant |
| US6215962(B1) | 2001-04-01 | Cooper | Examiner |
| US6252663(B1) | 2001-06-01 | Cooper | Examiner |
| US6263291(B1) | 2001-07-01 | Shakespeare et al. | Applicant |
| US6272440(B1) | 2001-08-01 | Shakespeare et al. | Applicant |
| US6466839(B1) | 2002-10-01 | Heaven et al. | Applicant |
| US6499402(B1) | 2002-12-01 | Sikes et al. | Applicant |
| US6556305(B1) | 2003-04-01 | Aziz et al. | Applicant |
| US6584435(B2) | 2003-06-01 | Mestha et al. | Applicant |
| US6603551(B2) | 2003-08-01 | Mestha et al. | Applicant |
| US6724473(B2) | 2004-04-01 | Leong et al. | Applicant |
| US6743337(B1) | 2004-06-01 | Ischdonat | Applicant |
| US6760103(B2) | 2004-07-01 | Shakespeare et al. | Applicant |
| US6763322(B2) | 2004-07-01 | Potyrailo et al. | Applicant |
| US6805899(B2) | 2004-10-01 | MacHattie et al. | Applicant |
| US6856436(B2) | 2005-02-01 | Brukilacchio et al. | Applicant |
| US6949734(B2) | 2005-09-01 | Neff et al. | Applicant |
| US7199884(B2) | 2007-04-01 | Jasinski et al. | Applicant |
| US7291856(B2) | 2007-11-01 | Haran et al. | Applicant |
| US7573575(B2) | 2009-08-01 | Shakespeare et al. | Examiner |
| US7675620(B2) | 2010-03-01 | Imura | Examiner |
| US2002/0001066(A1) | 2002-01-01 | Kobayashi | Examiner |
| US2002/0140832(A1) | 2002-10-01 | Summa | Examiner |
| US2003/0058441(A1) | 2003-03-01 | Shakespeare et al. | Applicant |
| US2004/0119781(A1) | 2004-06-01 | Szumla | Applicant |
| US2004/0212804(A1) | 2004-10-01 | Neff et al. | Applicant |
| US2004/0260520(A1) | 2004-12-01 | Braendle et al. | Applicant |
| US2005/0065400(A1) | 2005-03-01 | Banik et al. | Applicant |
| US2006/0132796(A1) | 2006-06-01 | Haran | Applicant |
| US2006/0243931(A1) | 2006-11-01 | Haran et al. | Applicant |
| US2007/0139735(A1) | 2007-06-01 | Shakespeare et al. | Applicant |
| US2007/0144388(A1) | 2007-06-01 | Shakespeare et al. | Applicant |
| US2007/0153277(A1) | 2007-07-01 | Shakespeare et al. | Applicant |
| US2007/0153278(A1) | 2007-07-01 | Shakespeare et al. | Applicant |
| DE3148076(A1) | 1983-06-01 | Applicant | |
| DE19515499(A1) | 1996-10-01 | Applicant | |
| EP319158(A1) | 1989-06-01 | Applicant | |
| EP1437222(A1) | 2004-07-01 | Applicant | |
| EP1457335(A1) | 2004-09-01 | Applicant | |
| EP1491877(A1) | 2004-12-01 | Applicant | |
| WO84/00181(A1) | 1984-01-01 | Applicant | |
| WO3/037111(A1) | 2003-05-01 | Applicant |
Non-Patent Literature (13)
- Robert L. Feller, “Comments on the Measurement of “Yellowness” in Pulp and Paper,” The Book and Paper Group Annual, vol. Six 1987, The American Institute for Conservation, May 1987, 9 pages.Applicant
- M. K. Ramasubramanian et al., “Optical Sensor for Noncontact Measurement of Lignin Content in High-Speed Moving Paper Surfaces,” IEEE Sensors Journal, vol. 5, No. 5, Oct. 2005, pp. 1132-1139.Applicant
- C. I. Thomson et al., “Excitation Energy Transfer in Lignin: Fluorescence of Kraft Residual Lignin,” 2004, 1 page.Applicant
- S. Katuscak et al., “The Effect of Paper Degradation on Uncertainty of Determination of Initial Lignin Content,” 2006, 3, pp. 69-72.Applicant
- D.P. Koullas et al., “Fluorescence Spectroscopy for the Characterisation of Lignocellulosics—An Overview of the Recent Research,” National Technical University of Athens, Bioresource Technology Unit, 2004, 57 pages.Applicant
- Bo Albinsson et al., “The Origin of Lignin Fluorescence,” Journal of Molecular Structure 508 (1999), pp. 19-27.Applicant
- Tarja Shakespeare et al., “Problems in Colour Measurement of Fluorescent Paper Grades”, Analytica Chimica Acta 380 (1999), pp. 227-242.Applicant
- Tarja Shakespeare et al., “Advanced Colour Control Through Reflectance Optimization”, Proceedings 2nd EcoPaperTech Conference, Helsinki Finland, Jun. 1998, pp. 183-194.Applicant
- Custom Optics, “Filter, Color Sensor”, 2008 JDS Uniphase Corporation, 6 pages.Applicant
- Stokman et al., “Color Measurement by Imaging Spectrometry”, Computer Vision & Image Understanding, San Diego, CA, US, vol. 79, No. 2, Aug. 2000, pp. 236-249.Applicant
- Wandell, “Color Measurement and Discrimination”, Journal of the Optical Society of America, USA, vol. 2, No. 1, Jan. 1985, pp. 62-71.Applicant
- Tarja T. Shakespeare et al., “Apparatus and Method for Measuring and/or Controlling Paper Pulp Properties”, U.S. Appl. No. 12/017,092, filed Jan. 21, 2008.Applicant
- Tarja T. Shakespeare et al., “Apparatus and Method for Measuring and/or Controlling Ultraviolet-Activated Materials in a Paper-Making Process”, U.S. Appl. No. 12/017,497, filed Jan. 22, 2008.Applicant