Image processing apparatus and method, and transfer medium

[0002] 1. Field of the Invention

[0003] The present invention relates to image processing apparatuses and methods, and transfer media, and more particularly, to an image processing apparatus, an image processing method, and a transfer medium which match the appearance of an image on a hard copy to be output from a first image output apparatus to the appearance of an image on a hard copy to be output from a second image output apparatus to allow the appearance of the image obtained from the second image output apparatus to be adjusted without actually outputting the image from the second image output apparatus.

[0004] 2. Description of the Related Art

[0005] FIG. 13 shows a processing flow in conventional printing. As shown in the figure, the original to be printed by a printer is prepared. This original is read by a scanner, a digital camera, or others, and edited by an editing apparatus such as a personal computer. The edited image data is printed on a sheet by a printer which is simpler than a printing machine used for final printing and output as a comp output. The editor checks the layout of characters and a picture by this comp output. When the desired layout is achieved, the image is output on a film. Then, a proof lithographic plate is created from the film and the image is printed on a sheet by a flatbed proof machine with the use of the proof lithographic plate. Color-matching check is performed by the image printed on the sheet by the flatbed proof machine. If the desired color is not obtained, the processing flow returns to editing. Comp output, film output, printing with a proof lithographic plate, and color-matching check are again performed for the edited image.

[0006] When the image printed by the flatbed proof machine has the desired color, a final lithographic plate is created from the output film and printing is performed by the printing machine used for final printing with the use of the final lithographic plate.

[0007] With the use of this printing flow, since it takes a long time from editing to color-matching check, quick printing is difficult. Therefore, for example, a printing flow shown in FIG. 14 is considered.

[0008] In the processing shown in FIG. 14, the original is read by a scanner, a digital camera, or others and input to an editing apparatus such as a personal computer. After the original is edited by the editing apparatus, image data thereof is printed on a sheet as digital proofs by a simple digital printer. Not only the layout of characters and a picture is checked but also color-matching check is performed with the use of the digital proofs. Until the desired layout and the desired color are obtained, the processing of editing and outputting digital proofs is repeated.

[0009] When the desired layout and the desired color are obtained, the image is output on a film, a lithographic plate is created based on the film, and printing is performed by a printing machine with the use of the lithographic plate.

[0010] With this printing flow, quicker printing can be performed. In addition, a flatbed proof machine, which is conventionally required for color-matching check, becomes unnecessary.

[0011] To implement the above printing processing, however, it is necessary to match the color on the digital proofs to the color of the image to be printed by the printing machine. To this end, the principle of a color management system (CMS) can be used.

[0012] FIG. 15 shows the principle of this conventional CMS. As shown in the figure, each device has a device profile. With this device profile, data dependent on the characteristics of the device, device dependent color (DDC) data or device dependent data (DDD)(hereinafter collectively called DDC data), is converted to data independent from the device, device independent color (DIC) data or device independent data (DID) (hereinafter collectively called DIC data), or vice versa.

[0013] When an image on the original is read by a scanner, the image data is obtained as DDC data dependent on the scanner. This DDC data is edited by an editing apparatus to obtain image data which is indicated by an input image color signal D11 in FIG. 16.

[0014] This input image color signal D11 is converted to a color signal D12 independent from a printing machine by the use of the device profile corresponding to the characteristics of the printing machine.

[0015] This color signal D12, which is independent from the printing machine, is converted, for example, to an output image color signal D13 which is DDC data dependent on a digital printer by the use of the device profile of the digital printer and printed on a print sheet by the printer.

[0016] As described above, the color of the image read by the scanner, edited, and to be printed on a print sheet by the printing machine and the color of the image (digital proofs) printed on another print sheet by the printer come to have the corresponding (matched) measured color value. Therefore, color-matching check can be achieved by the color of the digital proofs, which is used as the color of the image to be printed by the printing machine.

[0017] If the color of a print sheet used for printing by the printing machine or the color of an observation light source used therefor differs from the color of another print sheet used for printing by the printer or the color of an observation light source used therefor, the appearances of both images vary. Therefore, it is difficult to achieve correct color-matching check of a printed image by the digital proofs.

[0018] Accordingly, it is an object of the present invention to provide an image processing apparatus which allows simple and quick color-matching check.

[0019] Another object of the present invention is to provide an image processing method which allows simple and quick color-matching check.

[0020] Yet another object of the present invention is to provide a transfer medium for transferring a computer program which allows simple and quick color-matching check.

[0021] One of the foregoing objects is achieved in one aspect of the present invention through the provision of an image processing apparatus for matching the appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an image on a second hard copy to be output from a second image output apparatus, including: first obtaining means for obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means for obtaining the color of the paper of the second hard copy and luminous-environment data; first conversion means for converting the DDC data of the image to be output on the second hard copy into DIC data; compensation means for compensating the DIC data according to the luminous-environment data obtained by the first obtaining means and the luminous-environment data obtained by the second obtaining means; and second conversion means for converting the DIC data compensated by the compensation means to DDC data.

[0022] One of the foregoing objects is achieved in another aspect of the present invention through the provision of an image processing method for matching the appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an image on a second hard copy to be output from a second image output apparatus, including: a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; a second obtaining step for obtaining the color of the paper of the second hard copy and luminous-environment data; a first conversion step for converting the DDC data of the image to be output on the second hard copy into DIC data; a compensation step for compensating the DIC data according to the luminous-environment data obtained in the first obtaining step and the luminous-environment data obtained in the second obtaining step; and a second conversion step for converting the DIC data compensated in the compensation step to DDC data.

[0023] One of the foregoing objects is achieved in yet another aspect of the present invention through the provision of a transfer medium for transferring a computer program used for an image processing apparatus which matches the appearance of an image on a first hard copy to be output from a first image output apparatus to the appearance of an image on a second hard copy to be output from a second image output apparatus, the computer program including: a first obtaining step for obtaining the color of the paper of the first hard copy and luminous-environment data; a second obtaining step for obtaining the color of the paper of the second hard copy and luminous-environment data; a first conversion step for converting the DDC data of the image to be output on the second hard copy into DIC data; a compensation step for compensating the DIC data according to the luminous-environment data obtained in the first obtaining step and the luminous-environment data obtained in the second obtaining step; and a second conversion step for converting the DIC data compensated in the compensation step to DDC data.

[0024] According to the present invention, based on the luminous-environment data for the first hard copy and that for the second hard copy, the DIC data output on the second hard copy is compensated. The compensated DIC data is converted to DDC data.

[0025] As described above, according to the present invention, since compensation is performed with the paper color and the luminous environments being taken into account, the appearances of two hard copies can be matched. Therefore, when the present invention is applied to printing, quick color-matching check is allowed and printing can be finished within a short period.

[0026] FIG. 1 is a block diagram of a configuration example of an image processing apparatus to which the present invention is applied.

[0027] FIG. 2 is a view used for describing an operation of the configuration example shown in FIG. 1.

[0028] FIG. 3 is a flowchart describing a procedure for generating a look-up table.

[0029] FIG. 4 is a block diagram of another configuration example of an image processing apparatus to which the present invention is applied.

[0030] FIG. 5 is a view used for describing an operation of the configuration example shown in FIG. 4.

[0031] FIG. 6 is a block diagram of yet another configuration example of an image processing apparatus to which the present invention is applied.

[0032] FIG. 7 is a view used for describing an operation of the configuration example shown in FIG. 6.

[0033] FIG. 8 is a block diagram of still another configuration example of an image processing apparatus to which the present invention is applied.

[0034] FIG. 9 is a view used for describing an operation of the configuration example shown in FIG. 8.

[0035] FIG. 10 is a block diagram of a further configuration example of an image processing apparatus to which the present invention is applied.

[0036] FIG. 11 is a view used for describing an operation of the configuration example shown in FIG. 10.

[0037] FIG. 12 is a block diagram of a specific configuration example of an image processing apparatus 1 shown in FIG. 1.

[0038] FIG. 13 is a view used for describing a printing flow.

[0039] FIG. 14 is a view used for describing another printing flow.

[0040] FIG. 15 is a view used for describing a color management system (CMS).

[0041] FIG. 16 is a view used for describing the printing flow shown in FIG. 14.

[0042] Embodiments of the present invention will be described below. To clarify the correspondence between each means of the present invention described in claims and the following embodiments, the features of the present invention will be described below with an embodiment (one example only) corresponding to each means being added in parentheses after each means. It is a matter of course that each means is not limited to that described below.

[0043] An image processing apparatus according to the present invention, which matches the appearance of an image on a first hard copy (for example, a print sheet P_outshown in FIG. 1) to be output from a first image output apparatus (for example, a printer 30 shown in FIG. 1) to the appearance of an image on a second hard copy (for example, a print sheet P_inshown in FIG. 1) to be output from a second image output apparatus (for example, a printing machine 13 shown in FIG. 1), includes: first obtaining means (for example, sensors S₃and S₄shown in FIG. 1) for obtaining the color of the paper of the first hard copy and luminous-environment data; second obtaining means (for example, sensors S₁and S₂shown in FIG. 1) for obtaining the color of the paper of the second hard copy and luminous-environment data; first conversion means (for example, a converter 11 shown in FIG. 1) for converting the DDC data of the image to be output on the second hard copy into DIC data; compensation means (luminous-environment conversion circuits 12 and 15) for compensating the DIC data according to the luminous-environment data obtained by the first obtaining means and the luminous-environment data obtained by the second obtaining means; and second conversion means (for example, a converter 16 shown in FIG. 1) for converting the DIC data compensated by the compensation means to DDC data.

[0044] FIG. 1 shows a configuration example of an image processing apparatus to which the present invention is applied. In this image processing apparatus, a printing machine 13 serves as an input device and a printer 30 serves as an output device. Specifically, a scanner 20 reads an image of the original to be printed by the printing machine 13 and an image processing apparatus 1 performs image processing. The image data to which the image processing has been applied is output by the printer 30 on a print sheet P_out. When the color of the image printed on the print sheet P_outis compensated and the desired color is obtained, the image data edited by the image processing apparatus 1 is output by the printing machine 13 on a print sheet P_in. Of course, the image data is first output on a film, a lithographic plate is then created from this film, and printing is performed with the use of this lithographic plate. In FIG. 1, for the convenience of description, the output of the image processing apparatus 1 is directly supplied to the printing machine 13.

[0045] The scanner 20 reads an image on the original to be printed by the printing machine 13. The image color signal is an RGB (red, green, and blue) signal dependent on the device (scanner) or a CMYK (cyan, magenta, yellow, and black, sometimes K is missing) signal dependent on the device. For example, CMY data is sent to the image processing apparatus 1.

[0046] The image processing apparatus 1 configured, for example, by a personal computer, is formed of an editing section 10, a converter 11 luminous-environment conversion circuits 12 and 15, and a converter 16. The editing section 10 edits the CMY data input from the scanner 20, according to the input of the user (editor). The converter 11 stores a profile P₁for the printing machine 13 generated in advance. The converter 11 converts the CMY data serving as DDC data sent from the editing section 10 into XYZ data serving as DIC data by referencing the profile P₁and sends it to the luminous-environment conversion circuit 12.

[0047] In addition to the XYZ data sent from the converter 11, the outputs of a sensor S₁and a sensor S₂are also sent to the luminous-environment conversion circuit 12. The sensor S₁is configured, for example, by a radiation color luminance meter. The sensor S₁measures the chromaticity of surrounding light L (for example, light of a fluorescent lamp) in the environment where the printing machine 13 is installed, and sends it as a luminous-environment parameter to the luminous-environment conversion circuit 12. The sensor S₂is formed, for example, of a contact-type sensor. The sensor S₂measures the chromaticity of a white point on the print sheet P_inof the printing machine 13 and outputs the measured chromaticity to the luminous-environment conversion circuit 12.

[0048] The luminous-environment conversion circuit 12 applies compensation processing corresponding to the appearance of color in the luminous environment for the print sheet P_into the XYZ data sent from the converter 11 according to the luminous-environment parameters sent from the sensors S₁and S₂, and outputs as data (X_nin, Y_nin, Z_nin) (details thereof will be described later) to the luminous-environment conversion circuit 15.

[0049] The luminous-environment conversion circuit 15 receives data from the luminous-environment conversion circuit 12, and the output signals of sensors S₃and S₄. The sensor S₃measures the chromaticity of a white point on the print sheet P_outof the printer 30 and outputs the measured chromaticity to the luminous-environment conversion circuit 15. The sensor S₄measures, for example, the chromaticity of surrounding light L₂(for example, light of a fluorescent lamp) in the environment where the printer 30 is installed, and sends it as a luminous-environment parameter to the luminous-environment conversion circuit 15.

[0050] The luminous-environment conversion circuit 15 handles the data sent from the luminous-environment conversion circuit 12 according to the luminous-environment parameters sent from the sensors S₃and S₄such that the appearance of color in the luminous environment of the printer 30 matches the appearance of color in the luminous environment of the printing machine 13. The resultant data is sent to the converter 16.

[0051] The converter 16 stores a profile P₂created in advance for the printer 30. The XYZ data sent from the luminous-environment conversion circuit 15 is converted, for example, to CMY data serving as DDC data for the printer 30 with the profile P₂being referenced and sent to the printer 30.

[0052] With these functions, the printer 30 prints on the print sheet P_outan image which has substantially the same color appearance as the image printed on the print sheet P_in. Color-matching check can thus be achieved.

[0053] An operation thereof will be described next. The scanner 20 reads an image on the original (not shown) and outputs an image color signal as DDC data. The editing section 10 in the image processing apparatus 1 edits the output of the scanner 20 and generates an input image color signal D1 shown in FIG. 2. This input image color signal D1, which is expressed as (C_in, M_in, Y_in), is sent to the converter 11 and converted to a color signal D2 which is independent from the device according to the profile P₁of the printing machine 13. In other words, the converter 11 performs calculation according to the following expression to output (X_in, Y_in, Z_in). $\begin{array}{cc}\left(\begin{array}{c}{X}_{\mathrm{in}}\\ Y_{\mathrm{in}}\\ Z_{\mathrm{in}}\end{array}\right)={\mathrm{LUT}}_N\left(\begin{array}{c}{C}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ Y_{\mathrm{in}}\end{array}\right)& \left(1\right)\end{array}$

[0054] In the present specification, a look-up table (LUT) used for converting a color signal dependent on a device to a color signal independent from the device is called a forward-direction table. Conversely, an LUT used for converting a color signal independent from a device to a color signal dependent on the device is called a backward-direction table.

[0055] The data (X_in, Y_in, Z_in), which is the color signal D2 independent from the device and generated by the converter 11, is input to the luminous-environment conversion circuit 12. Adaptive compensation processing is applied to the data and the data is converted to a color signal D3 with adaptation being considered. In other words, the luminous-environment conversion circuit 12 applies an adaptation rate R_adp, indicating the degree at which the sense of human sight adapts to paper color, to three stimulus values (X_illin, Y_illin, Z_illin) of the surrounding light L₁input from the sensor S₁and three stimulus values (X_paperin, Y_paperin, Z_paperin) of the paper color of the print sheet P_ininput from the sensor S₂to calculate a white point which the sense of human sight actually adapts to, by the following expressions.

[0056] X_nin=R_adp·X_paperin+(1−R_adp)·X_illin

[0057] Y_nin=R_adp·Y_paperin+(1−R_adp)·Y_illin

[0058] Z_nin=R_adp·Z_paperin+(1−R_adp)·Z_illin  (2)

[0059] Namely, in the present embodiment, it is assumed that the sense of human sight partially adapts to both the paper color and the color temperature of the surrounding light source, and the white point to which the sense of human sight actually adapts is located at the middle of the paper color and the color temperature of the surrounding light source.

[0060] In the expression (2), an adaptation rate R_adpof 1.0 indicates that the sense of human sight 100% adapts to paper color, and an adaptation rate R_adpof 0.0 indicates that the sense of human sight 100% adapts to an observation light source.

[0061] An adaptation rate R_adpof 0.5 indicates that the sense of human sight adapts to just the middle of the paper color and the observation light source. Image processing in which both the paper color and the observation light source are taken into account is applied to achieve best color compensation. It is found from an experiment that the best adaptation rate Radp ranges from 0.25 to 0.75.

[0062] The luminous-environment conversion circuit 12 outputs the data (X_in, Y_in, Z_in) input from the converter 11 as well as the color-signal data (X_nin, Y_nin, Z_nin) in which adaptation has been considered, to the luminous-environment conversion circuit 15.

[0063] The luminous-environment conversion circuit 15 applies adaptation compensation processing for the printer 30 to the input color signal D3, in which adaptation has been considered, to generate a color signal D4 independent from the device.

[0064] In other words, the luminous-environment conversion circuit 15 applies an adaptation rate R_adpto three stimulus values (X_paperout, Y_paperout, Z_paperout) of the paper color of the print sheet P_outoutput from the sensor S₃and three stimulus values (X_illout, Y_illout, Z_illout) of the surrounding light source L₂output from the sensor S₄to perform calculation according to the following expressions.

[0065] X_nout=R_adp·X_paperout+(1−R_adp)·X_illout

[0066] Y_nout=R_adp·Y_paperout+(1−R_adp)·Y_illout

[0067] Z_nout=R_adp·Z_paperout+(1−R_adp)·Z_illout  (3)

[0068] In addition, the luminous-environment conversion circuit 15 calculates by the following expressions data (X_out, Y_out, Z_out), which is a color signal independent from the device, from the data (X_in, Y_in, Z_in) and the data (X_nin, Y_nin, Z_nin) input from the luminous-environment conversion circuit 12 and the data (X_nout, Y_nout, Z_nout) calculated according to the expression (3).

[0069] X_out=X_in(X_nout/X_nin)

[0070] Y_out=Y_in(Y_nout/Y_nin)

[0071] Z_out=Z_in(Z_nout/Z_nin)  (4)

[0072] The converter 16 applies the profile P₂of the printer 30 to the color signal D4, independent from the device and input from the luminous-environment conversion circuit 15, to generate an output image color signal D5 dependent on the printer 30. The signal is sent to the printer 30 and printed on the print sheet P_out.

[0073] In other words, the converter 16 applies the profile P₂of the printer 30 to the data (X_out, Y_out, Z_out), which is the color signal D4, independent from the device and input from the luminous-environment conversion circuit 15, to generate data (C_out, M_out, Y_out) dependent on the printer 30. Namely, the converter 16 performs calculation according to the following expression. $\begin{array}{cc}\left(\begin{array}{c}{C}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ Y_{\mathrm{out}}\end{array}\right)={\mathrm{LUT}}_I\left(\begin{array}{c}{X}_{\mathrm{out}}\\ Y_{\mathrm{out}}\\ Z_{\mathrm{out}}\end{array}\right)& \left(5\right)\end{array}$

[0074] Since input and output are performed as described above with both the luminous environment and the paper color being taken into consideration, the appearances of the color images on the print sheet P_inand the print sheet P_outare matched.

[0075] FIG. 3 shows processing for generating a forward-direction table for the converter 11 and a backward-direction table for the converter 16. In a first step S1, color patches are measured. Namely, the original having N³color patches each of which has, for example, one of N levels of C, M, or Y color is prepared as the original printed by the printing machine 13 and the chromatic values (XYZ values) thereof are measured by a spectrometer. A device signal (C, M, Y) input to the printing machine 13 when each color-patch image is printed by the printing machine 13 is also measured.

[0076] In a step S2, it is determined whether a sufficient number of data items have been measured. When it is determined that a sufficient number of data items have been measured, processing such as internal interpolation is not applied in a step S3 and the procedure proceeds to a step S5. A forward-direction table is generated from the relationship between both.

[0077] On the other hand, if it is determined in the step S2 that the number of the data items is insufficient, a pseudo measured value is obtained by internal interpolation. In this case, high-order interpolation is usually used as the internal interpolation, which has higher interpolation precision than linear interpolation. When the internal interpolation is finished in a step S4, the procedure proceeds to the step S5 and a forward-direction table is generated.

[0078] When the forward-direction table is generated, the procedure proceeds to a step S6, and a reverse mapping table is generated from the forward-direction table. In other words, the value of each point in the forward-direction table, which is expressed in a CMY coordinate system, is placed in an XYZ coordinate system. In a step S7, it is determined whether each placed point is located within a color area. When it is within the color area, it is determined in a step S8 that the sampled values are used as is, and a backward-direction table is created in a step S10. If it is determined in the step S7 that each placed point is located out of the color area, the procedure proceeds to a step S9 and color-area compression processing is applied. Then, the procedure proceeds to the step S10 and a backward-direction table is generated. Namely, a backward-direction table (table expressed by XYZ coordinates) in a color area in which the printer can expresses the color is generated.

[0079] FIG. 4 shows another embodiment of the present invention. In this embodiment, a profile P₁₁for the printing machine 13 used in the converter 11 in the image processing apparatus 1 is generated with adaptation compensation in the printing machine 13 being taken into account. Therefore, the luminous-environment conversion circuit 12 in the embodiment shown in FIG. 1 is omitted. In the same way, a profile P₂₁for the printer 30 used in the converter 16 is also generated with adaptation compensation in the printer 30 being taken into consideration. Therefore, the luminous-environment conversion circuit 15 in the embodiment shown in FIG. 1 is omitted. The other configurations are the same as those in the embodiment shown in FIG. 1.

[0080] In the embodiment shown in FIG. 4, an input image color signal D1 is converted to a color signal D3 in which adaptation is considered, according to the profile P₁₁in the converter 11 as shown in FIG. 5.

[0081] In the embodiment shown in FIG. 1, the LUT is generated from the relationship between the device color signals and the measured values. In the embodiment shown in FIG. 4, a measured value is converted to a perception amount in which an appearance is considered and an LUT is generated from the relationship between the perception amount and a device color signal.

[0082] In other words, a perception amount (X_rel, Y_rel, Z_rel) in the sense of human sight is expressed by the following expressions when a color having a measured value of (X_mesure, Y_mesure, Z_mesure) is observed in adaptation to a white point (X_n, Y_n, Z_n).

[0083] X_rel=X_mesure/X_n

[0084] Y_rel=Y_mesure/Y_n

[0085] Z_rel=Z_mesure/Z_n  (6)

[0086] The white point (X_n, Y_n, Z_n) is defined as follows, where paper color is indicated by (Y_paper, Y_paper, Z_paper) and an observation light source is expressed by (X_ill, Y_ill, Z_ill).

[0087] X_n=R_adp·X_paper+(1−R_adp)·X_ill

[0088] Y_n=R_adp·Y_paper+(1−R_adp)·Y_ill

[0089] Z_n=R_adp·Z_paper+(1−R_adp)·Z_ill  (7)

[0090] Therefore, an LUT needs to be generated from the perception amount in the expressions (6) and a device color signal.

[0091] An LUT serving as the profile P₂₁in the converter 16 needs to be made as the backward-direction table of the LUT serving as the profile P₁₁in the converter 11.

[0092] Therefore, in the embodiment shown in FIG. 4, the converter 11 performs the calculation indicated by the following expression to output data (X_rel, Y_rel, Z_rel). $\begin{array}{cc}\left(\begin{array}{c}{X}_{\mathrm{rel}}\\ Y_{\mathrm{rel}}\\ Z_{\mathrm{rel}}\end{array}\right)={\mathrm{LUT}}_N\left(\begin{array}{c}{C}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ Y_{\mathrm{in}}\end{array}\right)& \left(8\right)\end{array}$

[0093] The converter 16 performs the calculation indicated by the following expression. $\begin{array}{cc}\left(\begin{array}{c}{C}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ Y_{\mathrm{out}}\end{array}\right)={\mathrm{LUT}}_I\left(\begin{array}{c}{X}_{\mathrm{rel}}\\ Y_{\mathrm{rel}}\\ Z_{\mathrm{rel}}\end{array}\right)& \left(9\right)\end{array}$

[0094] As described above, the device profile is generated with the appearance being taken into account. Just by conversion with the device profile, the appearance can be matched.

[0095] In FIG. 5, the color signal D3, in which adaptation has been considered, is converted to an output image color signal D5, which depends on the printer 30, with the use of the profile P₂₁in the converter 16.

[0096] FIG. 6 shows still another embodiment. In this embodiment, data output from the converter 11 is converted to a color signal LMS at a human pyramidal level by a conversion circuit 51, and input to the luminous-environment conversion circuit 12. In the same way, a color signal LMS at the human pyramidal level output from the luminous-environment conversion circuit 15 is converted to a color signal XYZ which is not dependent on a device by a conversion circuit 52, and input to the converter 16. The other configurations are the same as those in the case shown in FIG. 1.

[0097] In other words, in this embodiment, an input image color signal D1 is converted to a color signal D2 independent from the device by the use of the profile P₁in the converter 11 as shown in FIG. 7. Namely, calculation is performed according to the following expression. $\begin{array}{cc}\left(\begin{array}{c}{X}_{\mathrm{in}}\\ Y_{\mathrm{in}}\\ Z_{\mathrm{in}}\end{array}\right)={\mathrm{LUT}}_N\left(\begin{array}{c}{C}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ Y_{\mathrm{in}}\end{array}\right)& \left(10\right)\end{array}$

[0098] The color signal D2, which is independent from the device, is converted to a color signal D31 at the pyramidal level by the conversion circuit 51.

[0099] In other words, the conversion circuit 51 performs the Hunt-Pointer-Estevez conversion, shown below, to generate the color signal (L_in, M_in, S_in) at the human pyramidal level. $\begin{array}{cc}\left(\begin{array}{c}{L}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ S_{\mathrm{in}}\end{array}\right)=\left(\begin{array}{ccc}0.38971& 0.68898& -0.07868\\ -0.22981& 1.18340& 0.04641\\ 0.0& 0.0& 1.0\end{array}\right)\left(\begin{array}{c}{X}_{\mathrm{in}}\\ Y_{\mathrm{in}}\\ Z_{\mathrm{in}}\end{array}\right)& \left(11\right)\end{array}$

[0100] The luminous-environment conversion circuit 12 performs adaptation compensation at the input side to generate a color signal D32 at the pyramidal level, in which adaptation is considered.

[0101] In other words, the luminous-environment conversion circuit 12 performs the calculation indicated by the following expressions with the use of the data (X_illin, Y_illin, Z_illin) output from the sensor S₁, the data (X_paperin, Y_paperin, Z_paperin) output from the sensor S₂, and the adaptation rate R_adp.

[0102] L_nin=R_adp·L_paperin+(1−R_adp)·L_illin

[0103] M_nin=R_adp·M_paperin+(1−R_adp)·M_illin

[0104] S_nin=R_adp·S_paperin+(1−R_adp)·S_illin  (12)

[0105] (L_paperin, M_paperin, S_paperin) and (L_illin, M_illin, S_illin) are obtained by applying the Hunt-Pinter-Estevez conversion, shown in the expression (11), to the data (X_paperin, Y_paperin, Z_paperin) output from the sensor S₂and the data (X_illin, Y_illin, Z_illin) output from the sensor S₁, respectively.

[0106] A white point (L_nin, M_nin, S_nin) obtained from the expression (12) is substituted into the Von Kries adaptation rule to perform the calculation indicated by the following expressions.

[0107] L_rel=L_in/L_nin

[0108] M_rel=M_in/M_nin

[0109] S_rel=S_in/S_nin  (13)

[0110] With this operation, data (L_rel, M_rel, S_rel) which is not dependent on the luminous environment is obtained.

[0111] The luminous-environment conversion circuit 15 applies adaptation compensation to this data to convert to a color signal D33 at the pyramidal level.

[0112] In other words, the luminous-environment conversion circuit 15 applies the following expressions to the data (L_rel, M_rel, S_rel), which is not dependent on the input luminous environment, to generate data (L_out, M_out, S_out).

[0113] L_out=L_nout·L_rel

[0114] M_out=M_nout·M_rel

[0115] S_out=S_nout·S_rel  (14)

[0116] Data (L_nout, M_nout, S_nout) in the expression (14) is obtained from expressions (15). (L_paperout, M_paperout, S_paperout) in the expressions (15) is obtained by applying the Hunt-Pinter-Estevez conversion, shown in the expression (11), to the data (X_paperout, Y_paperout, Z_paperout) output from the sensor S₃. In the same way, (L_illout, M_illout, S_illout) is obtained by applying the Hunt-Pinter-Estevez conversion to the data (X_illout, Y_illout, Z_illout) output from the sensor S₄.

[0117] L_nout=R_adp·L_paperout+(1−R_adp)·L_illout

[0118] M_nout=R_adp·M_paperout+(1−R_adp)·M_illout

[0119] S_nout=R_adp·S_paperout+(1−R_adp)·S_illout  (15)

[0120] The color signal D33 at the pyramidal level shown in FIG. 7 is converted to a color signal D4 which is not dependent on the device by the conversion circuit 52.

[0121] In other words, in this case, the conversion circuit 52 performs the conversion reverse to that in the case shown in the expression (11) to generate data (X_out, Y_out, Z_out) from the data (L_out, M_out, S_out) input from the luminous-environment conversion circuit 15. $\begin{array}{cc}\left(\begin{array}{c}{X}_{\mathrm{out}}\\ Y_{\mathrm{out}}\\ Z_{\mathrm{out}}\end{array}\right)=\left(\begin{array}{ccc}1.91019& -1.11214& 0.20195\\ 0.37095& 0.62905& 0\\ 0& 0& 1.00000\end{array}\right)\left(\begin{array}{c}{L}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ S_{\mathrm{out}}\end{array}\right)& \left(16\right)\end{array}$

[0122] Next, the color signal D4 shown in FIG. 7, which is not dependent on the device, is converted to an output image color signal D5 with the use of the profile P₂in the converter 16.

[0123] In other words, the converter 16 performs the calculation indicated by the following expression. $\begin{array}{cc}\left(\begin{array}{c}{C}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ Y_{\mathrm{out}}\end{array}\right)={\mathrm{LUT}}_I\left(\begin{array}{c}{X}_{\mathrm{out}}\\ Y_{\mathrm{out}}\\ Z_{\mathrm{out}}\end{array}\right)& \left(17\right)\end{array}$

[0124] FIG. 8 shows yet another embodiment. In this embodiment, the luminous-environment conversion circuit 12 and the luminous-environment conversion circuit 15 are omitted from the embodiment shown in FIG. 6. The other configurations are the same as those in the case shown in FIG. 6.

[0125] In other words, in the embodiment shown in FIG. 8, an input image color signal D1 is converted to a color signal D301 in which adaptation is considered, by the use of the profile P₁₂in the converter 11. Namely, the converter 11 performs the calculation indicated by the following expression. $\begin{array}{cc}\left(\begin{array}{c}{X}_{\mathrm{rel}}\\ Y_{\mathrm{rel}}\\ Z_{\mathrm{rel}}\end{array}\right)={\mathrm{LUT}}_{\mathrm{IN}}\left(\begin{array}{c}{C}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ Y_{\mathrm{in}}\end{array}\right)& \left(18\right)\end{array}$

[0126] The conversion circuit 51 applies the Hunt-Pointer-Estevez conversion to the data (X_rel, Y_rel, Z_rel) input from the converter 11 and serving as the color signal D301, in which adaptation is considered, to convert to data (L_rel, M_rel, S_rel) serving as a color signal D302 at the pyramidal level in which adaptation is considered, as shown in FIG. 9.

[0127] The conversion circuit 52 applies the conversion reverse to that in the conversion circuit 51 to the input data (L_rel, M_rel, S_rel) to convert to data (X_rel, Y_rel, Z_rel). In other words, the color signal D302 at the pyramidal level shown in FIG. 9, in which adaptation is considered, is converted to a color signal D303 in which adaptation is considered.

[0128] The converter 16 then converts the color signal D303, in which adaptation is considered, to an output image color signal D5.

[0129] Namely, the converter 16 generates data (C_out, M_out, Y_out) from the data (X_rel, Y_rel, Z_rel) input from the conversion circuit 52, with the profile P₂₂being referenced. In other words, the converter 16 performs the calculation indicated by the following expression. $\begin{array}{cc}\left(\begin{array}{c}{C}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ Y_{\mathrm{out}}\end{array}\right)={\mathrm{LUT}}_I\left(\begin{array}{c}{X}_{\mathrm{rel}}\\ Y_{\mathrm{rel}}\\ Z_{\mathrm{rel}}\end{array}\right)& \left(19\right)\end{array}$

[0130] An embodiment shown in FIG. 10 is obtained by further simplifying the configuration of the embodiment shown in FIG. 8. In the embodiment shown in FIG. 10, the conversion circuit 51 and the conversion circuit 52 shown in FIG. 8 are omitted and the functions thereof are substantially included in a profile P₁₃in the converter 11 and a profile P₂₃in the converter 16. The other configurations are the same as those shown in FIG. 8.

[0131] In other words, in the present embodiment, as shown in FIG. 11, an input image color signal D1 output from the editing section 10 is converted by the use of the profile P₁₃to a color signal D302 at the pyramidal level in which adaptation is considered. Namely, the converter 11 performs calculation according to the following expression. $\begin{array}{cc}\left(\begin{array}{c}{L}_{\mathrm{rel}}\\ M_{\mathrm{rel}}\\ S_{\mathrm{rel}}\end{array}\right)={\mathrm{LUT}}_N\left(\begin{array}{c}{C}_{\mathrm{in}}\\ M_{\mathrm{in}}\\ Y_{\mathrm{in}}\end{array}\right)& \left(20\right)\end{array}$

[0132] On the other hand, the converter 16 converts the received color signal D302 at the pyramidal level, in which adaptation is considered, to an output image color signal D5 with the use of the profile P₂₃. Namely, the converter 16 performs calculation according to the following expression. $\begin{array}{cc}\left(\begin{array}{c}{C}_{\mathrm{out}}\\ M_{\mathrm{out}}\\ Y_{\mathrm{out}}\end{array}\right)={\mathrm{LUT}}_I\left(\begin{array}{c}{L}_{\mathrm{rel}}\\ M_{\mathrm{rel}}\\ S_{\mathrm{rel}}\end{array}\right)& \left(21\right)\end{array}$

[0133] The above-described image processing apparatus 1 is formed of a computer, such as a personal computer. FIG. 12 shows a configuration example of a computer 2000 which constitutes such an image processing apparatus 1. This computer 2000 is obtained by adding a sensor, a communication unit, etc., as required, to a personal computer currently available.

[0134] A CPU 201 has functions for controlling the whole apparatus and for calculation, and is formed, for example, of a Pentium (trademark) of Intel Corporation. A cache 202 is a high-speed storage section for storing information stored in a memory and frequently accessed by the CPU 201. With direct information transfer between the CPU 201 and the cache 202, the system can perform high-speed processing.

[0135] A system controller 203 is a circuit section for adjusting timing among the CPU 201, the cache 202, a memory 204, a computer bus 209, and a PCI bus 210, and is formed, for example, of TRITON (430FX) (trademark) of Intel Corporation.

[0136] The memory 204 is a storage section for information write and read according an instruction of the CPU 201 or the system controller 203, and is formed, for example, of a DRAM (dynamic random access memory). The memory 204 is connected to the CPU 201 and various resources on the computer bus 209 through the system controller 203 and stores information. Of course, the memory 204 can store the above-described image data.

[0137] The computer bus 209 is information transfer means directly connected to the CPU 201 and can transfer information with the cache 202 and the system controller 203 at a high speed. The PCI bus 210 is information transfer means separated from the computer bus 209, and is connected to the system controller 203. The CPU 201 can access through the system controller 203 various resources connected to the PCI bus 210.

[0138] An external storage control section 211 is connected to the PCI bus 210 and a hard disk 212 and a CD-ROM drive 213, and controls information write and read operations to and from a certain area in a disk mounted on the hard disk 212 or the CD-ROM drive 213 according to an information access request sent through the PCI bus 210. For example, these connections are performed by SCSI or IEEE 1394. An external storage unit is not limited to the hard disk 212 or the CD-ROM 213, and can be a unit which uses a writable and removable recording medium, such as a floppy disk and a magneto-optical disk. In that case, the data required for the present invention, such as image data for which the above-described conversion is performed, a luminous-environment parameter, and appearance index data, is stored in the recording medium and transferred, instead of being transmitted and received.

[0139] A keyboard and mouse control section 214 connects a keyboard 215 and a mouse 216 serving as a pointing device to the PCI bus 210, and transfers to the CPU according to a certain sequence a character, a numeral, and a symbol which the user inputs or the movement of the mouse and the operation of a mouse button which the user performs. With this function, the CPU 201 receives the user input information while the CPU 201 relatively moves a pointer displayed together with an image displayed on a CRT (cathode ray tube) monitor 226 through a video controller 225. Of course, an input on the above-described setting screen is also possible in the same way.

[0140] A scanner and printer control section 217 is connected to the PCI bus 210 and a scanner 218 and a printer 219, and controls image-information write and read operations according to an information access request sent through the PCI bus 210. These connections are usually performed by SCSI or IEEE 1394. Information to be transferred includes information read or input optically, information to be printed or output, and in addition, device characteristic information stored in the scanner 218 or the printer 219 and used for the above-described DIC and DDC conversion.

[0141] A communication control section 220 is connected to a telephone line 222 through a modem 221 or connected to a network 224, such as IEEE 802.3 (Ethernet), FDDI, ATM, or IEEE 1394, through a network communication unit 223, such as a transceiver or a hub, and controls information transmission and receiving according to an information access request through the PCI bus 210 or an information access request from a communication destination. Of course, the data required for the present invention, such as image data for which the above-described conversion is performed, a luminous-environment parameter, and appearance index data, can be transmitted and received.

[0142] The video controller 225 is connected to the PCI bus 210, and draws information such as an image, a figure, or a character on a video memory (not shown) of the video controller 225 and displays the contents on the CRT monitor 226. Of course, the above-described image data can be stored in the video memory of the video controller 225. Device characteristic information, such as the VESA DDC (display data channel) specification, stored in the CRT monitor 226 can also be transferred between the video controller 225 and the CRT monitor 226.

[0143] The CRT 226 is connected to the above video controller 225, and displays an image which the video controller draws, according to an instruction of the CPU 201. Of course, instead of the CRT monitor, other display devices such as a PDP (plasma display panel) and a liquid-crystal display can be used. In the present invention, the CRT monitor 226 also displays a soft copy image in cooperation with the video controller 225, and achieves an input device function for an image which a user observes at the transmission end and an output device function for an image which another user observes at the receiving end.

[0144] A sensor control section 227 is connected to the PCI bus 210 and various sensors 228, and detects a physical amount such as a voltage, a temperature, or brightness, according to an instruction of the CPU 201. In the embodiments of the present invention, the sensor control section plays a role as a sensor for measuring a luminous-environment parameter, and detects the chromaticity of surrounding light, the chromaticity of the CRT monitor 226, and the absolute luminance.

[0145] In the above descriptions, an observation light source is taken into account as a luminous environment. Other luminous environments can be taken into consideration.

[0146] As a transfer medium for transferring a computer program that performs the above-described processing to the user, a recording medium such as a magnetic disk, a CD-ROM, and a solid-state memory, and a communication medium such as a network and satellite can be used.