Image processing method and device

[0002] The present invention relates to an image processing method and device, more specifically to an image processing method and device for generating the fog effect.

[0003] In the field of the computer graphics the fog effect generating art for generating in images fog and mist of vapor, and fog of, e.g., smoke, dust, etc., is noted for the purpose of providing more realistic images.

[0004] The conventional fog effect generating technique will be explained. In the conventional fog effect generating technique, when fog is generated, a distance between a view point and a point on a polygon is computed, and based on the distance, a fog density at the point is set. For example, when a distance between a view point and a point on the polygon is large, a fog density corresponding to the point on the polygon is made higher, and when a distance between a view point and a point on a polygon is small, a fog density corresponding to the point on the polygon is made low.

[0005] However, according to such conventional fog effect generating technique, higher fog densities are provided as a distance from a view point increases. Accordingly, it is impossible to provide realistic images in which, for example, fog is dense near the ground and is thinner upward.

[0006] Furthermore, according to the conventional fog effect generating technique, when varying a fog density, the variation of the fog density is uniform. It is impossible to provide realistic images in which fog is hazy.

[0007] An object of the present invention is to provide an image processing method and device which can provide realistic images.

[0008] The above-described object is achieved by an image processing method for fogging an object in a three-dimensional space, which is observed at a view point, a fog density of the object observed at the view point being computed based on a distance between a fog base plane set in the three-dimensional space and the object.

[0009] Fog densities are set corresponding to densities between a fog base plane and an object, whereby realistic images that dense fog hangs over the ground can be provided.

[0010] The above-described object is achieved by an image processing method for fogging an object in a three-dimensional space, which is observed at a view point, a fog density of the object observed at the view point being computed based on a distance between a fog base plane set in the three-dimensional space and the object and on a distance between the view point and the object.

[0011] Even when objects are spaced equidistantly from a fog base plane, a lower fog density is given for that of the objects which is nearer of the objects, and a higher fog density is given to that of the objects which is remote. Realistic images can be provided.

[0012] In the above-described image processing method it is preferable that for an object belonging to one side of the fog base plane, the fog density thereof is computed by a first function and, for an object belonging to the other side of the fog base plane, the fog density thereof is computed by a second function which is different from the first function. More realistic images can be provided.

[0013] In the above-described image processing method it is preferable that the fog density is varied at random to perform haze processing. Haze states can be expressed. Realistic images can be provided.

[0014] In the above-described image processing method it is preferable that a plurality of the fog base planes are provided, and the fog densities given with respect to said plurality of the fog base planes are synthesized with each other. More realistic images can be provided.

[0015] The above-described object is achieved by an image processing device for fogging an object in a three-dimensional space, which is observed at a view point, comprising fog density computing means for computing a fog density of the object observed at the view point, based on a distance between a fog base plane set in the three-dimensional space and the object.

[0016] Fog densities are set corresponding to densities between a fog base plane and an object, whereby realistic images that dense fog hangs over the ground can be provided.

[0017] The above-described object is achieved by an image processing device for fogging an object in a three-dimensional space, which is observed at a view point, comprising fog density computing means for computing a fog density of the object observed at the view point, based on a distance between a fog base plane set in the three-dimensional space and the object and on a distance between the view point and the object.

[0018] Even when objects are spaced equidistantly from a fog base plane, a lower fog density is given for that of the objects which is nearer of the objects, and a higher fog density is given to that of the objects which is remote. Realistic images can be provided.

[0019] In the above-described image processing device it is preferable that the fog density computing means, for an object belonging to one side of the fog base plane, computes the fog density thereof by a first function and, for an object belonging to the other side of the fog base plane, computes the fog density thereof by a second function which is different form the first function. More realistic images can be provided.

[0020] In the above-described image processing device it is preferable that haze processing unit for varying the fog density at random to perform haze processing. Hazy states can be expressed. Realistic images can be provided.

[0021] In the above-described image processing device it is preferable that a plurality of the fog base planes are provided, and the fog density computing means synthesizes the fog densities given with respect to said plurality of fog base planes. More realistic images can be provided.

[0022] FIG. 1 is a conceptual view showing a principle of the image processing method according to a first embodiment of the present invention.

[0023] FIG. 2 is a block diagram of the image processing device according to the first embodiment of the present invention.

[0024] FIG. 3 is a graph of relationships between a distance d and a fog density α.

[0025] FIG. 4 is a block diagram of a haze processing unit.

[0026] FIG. 5 is a graph showing a principle of a space random component generator.

[0027] FIG. 6 is a graph of fog densities subjected to the haze processing.

[0028] FIG. 7 is a conceptual view of a principle of the image processing method according to a modification of the first embodiment of the present invention.

[0029] FIGS. 8A-8C are conceptual views showing a principle of the image processing method according to a second embodiment of the present invention.

[0030] FIGS. 9A and 9B are views of images displayed on the screen of the second embodiment of the present invention.

[0031] The image processing method and device according to a first embodiment of the present invention will be explained with reference to FIGS. 1 to 6. FIG. 1 is a conceptual view showing the principle of the image processing method according to the present embodiment. FIG. 2 is a block diagram of the image processing device according to the present embodiment. FIG. 3 is a graph showing relationships between distances and fog densities. FIG. 4 is a block diagram of a haze processing unit. FIG. 5 is a graph showing a principle of a space random component generator. FIG. 6 is a graph of fog densities after the haze processing has been performed.

[0032] As shown in FIG. 1, a fog base plane 10 is given in a three-dimensional space. In FIG. 1, the vertical axis indicates the direction of height in the three-dimensional space, the horizontal axis indicates the direction of depth, and the direction perpendicular to the drawing sheet indicates the left-to-right direction in the three-dimensional space.

[0033] A polygon 12, for example, is positioned on the fog base plane 10. A plurality of polygons are present in the actual image processing, but for simplicity of the explanation, one polygon alone is shown in FIG. 1.

[0034] The image processing device according to the present embodiment is characterized mainly in that a distance d between the fog base plane 10 and a point on the polygon 12 is computed, and a fog density is set corresponding to the distance d. That is, in the conventional image processing device a fog density is set corresponding to a distance between a view point and a point on a polygon, whereby it is impossible to express a state that fog hangs over the surface of the ground. In contrast to this, in the present embodiment, a fog density can be set corresponding to a distance between the fog base plane 10 and a point on the polygon 12, whereby it is possible to express a state that fog hangs over the surface of the ground. The present embodiment can provide realistic images.

[0035] A function exemplified in FIG. 3 which makes a fog density α less dense as a distance d from the fog base plane 10 is used, whereby an image in which fog is dense near the ground and becomes less dense away from the ground can be provided.

[0036] Next, the image processing method and device according to the present embodiment will be explained with reference to FIG. 2.

[0037] As shown in FIG. 2, a host CPU 14 has a function of generally controlling the image processing device according to the present embodiment. The host CPU 12 inputs to a geometric computing unit 16 data of an object to be displayed on a screen.

[0038] The geometric computing unit 16 has a function of converting the data of the object to data of the polygon. Specifically, the geometric computing unit 16 gives three-dimensional coordinates of the vertices of the polygon so as to arrange the polygon on a three-dimensional view point coordinate system. Data of three-dimensional coordinates of the vertices of the polygon given by the operation are inputted to a rasterizer 18.

[0039] The rasterizer 18 has a function of rasterizing the three-dimensional coordinates of the polygon to two-dimensional coordinates so as to display the object on the two-dimensional screen. Specifically, the object is broken into a plurality of lines to be defined by two-dimensional coordinates. Thus, the vertices of the polygon are defined by the two-dimensional coordinates.

[0040] The two-dimensional coordinate data given by the rasterizer 18 are inputted to an interpolation computing unit 28 incorporated in a fog generator 22. The fog generator 22 includes, in addition to the interpolation computing unit 28, a fog base plane data register 24, a distance computing unit 26, a fog density computing unit 30 and a fog color register 32.

[0041] The interpolation computing unit 28 has a function of interpolating two-dimensional coordinates inputted by the rasterizer 18 to thereby give three-dimensional coordinates (x,y,z) corresponding to respective picture elements on the screen. The three-dimensional coordinates (x,y,z) are inputted to the distance computing unit 26.

[0042] The fog base plane data register 24 stores data of the fog base plane 10. When the fog base plane 10 is, e.g., flat, the fog base plane 10 is expressed by the formula

[0043] 1x+my

[0044] (l, m, n and p are arbitrary actual numbers). In this case, the fog base plane data register 24 stores data, such as l, m, n and p, etc. The data stored by the fog base plane data register 24 are inputted to the distance computing unit 26.

[0045] The distance computing unit 26 has a function of giving, corresponding to one picture element on the display screen, a distance between the fog base plane 10 and a point on the polygon. When the fog base plane 10 is flat, a distance d between the fog base plane 10 and the point on the polygon 12 is given by

[0046] d=|1x+my+nz−p|/(1²+m²+n²)^0.5.

[0047] The thus given distance d is inputted to the fog density computing unit 30. The fog density computing unit 30 is for giving a fog density α at the point on the polygon. The fog density computing unit 30 gives a fog density α by using an arbitrary function α=f(d). To express a state that fog hangs over the surface of the ground, for example, the function is used as shown in FIG. 3 so that a fog density α decreases as a distance d increases. The thus given fog density α is inputted to the haze processing unit 34. A distance d is given by the distance computing unit 26 is inputted to the haze processing unit 34.

[0048] The haze processing unit 34 is for expressing a hazy state which will be described later. The data of the fog density α′ given by the haze processing unit 34 is inputted to the fog synthesizer 36.

[0049] The fog color register 32 is for storing a fog color C_fog. The data of the fog color C_fogstored by the fog color register 32 is inputted to the fog synthesizer 36.

[0050] The data of the two-dimensional coordinates given by the rasterizer 18 is inputted to the polygon color generator 20 as well as the fog generator 22. The polygon color generator 20 has a function of generating a color of the point on the polygon 12, i.e., a polygon color C_poly. The polygon color C_polyis given corresponding to one picture element on the screen. The data of the polygon color C_polygiven by the polygon color generator 20 is inputted to the fog synthesizer 36.

[0051] The fog synthesizer 36 has a function of synthesizing the data of the fog density α′, the fog color C_fogand the polygon color poly to give data of a display color C_disat the point on the polygon 12. The data of the display color C_disis given corresponding to one picture element on the screen. The display color C_disat the point on the polygon 12 is given by

[0052] C_dis=(1−α′)·C_poly+α′·C_fog.

[0053] The thus given display color C_dison the polygon 12 is outputted to the display device 38 to be displayed on the screen of the display device 38.

[0054] Then, the haze processing device 34 will be detailed with reference to FIGS. 4 to 6. The haze processing device 34 is for expressing hazy states, and includes a space random component generator 100 and a density random component generator 120.

[0055] The space random component generator 100 has a function of generating a space component for expressing a hazy state. An updating frequency register 102 stores updating frequency data D_upd1which indicates an updating frequency of a space random component. The updating frequency data D_upd1has a value which is integer times one updating time (1 int). The updating frequency data D_upd1stored by the updating frequency register 102 is inputted to a random number generator 104. The random number generator 104 generates random number data D_ran1at a frequency based on the updating frequency data D_upd1. Random number data D_ran1generated by the random number generator 104 is inputted to a range comparator 106. An off-period width register 108 is for setting a space width in which a fog density changes. The off-period width register 108 stores off-period width data D_off1. The off-period width data D_off1contains a sectional distance component, and an off-period appearing frequency component in plane of a prescribed distance. It is preferable that a value of the off-period width data D_off1is suitably set so that a hazy state is visible to the human eye on the screen.

[0056] A distance d, random number data D_ran1and an off-period width data D_off1are inputted to the range comparator 106. The range comparator 106 compares the random data Dran1 with the distance d. When both agrees with each other, a control signal CTL is turned off in accordance with a value of the off-period width data D_off1. The control signal CTL is inputted to a mask 132. The control signal CTL is normally ON, and is turned OFF in accordance with a value of the off-period width data D_off1when values of the random data D_ran1and of the distance d agree with each other.

[0057] A state of space random components generated by such space random component generator 100 will be explained with reference to FIG. 5. As indicated by the solid lines in FIG. 5, a fog density α is determined based on a distance d from the fog base plane 10. A fog density α in a region spaced by a distance d_nfrom the fog from the fog base plane 10 is α_n. Here, when the control signal CTL of the range comparator 106 of the space random component generator 100 is turned OFF, fog densities change in the regions circled in FIG. 5.

[0058] The density random component generator 120 includes a updating frequency register 122 which stores a frequency of changing a fog density. Updating frequency data D_upd2stored by the updating frequency register 122 is inputted to a random number generator 124. The updating frequency data D_upd2has a value which is integer times one updating period on the screen. The random number generator 124 outputs random number data D_ran2to the mask 132 at a frequency based on the updating frequency data D_upd2.

[0059] The random number data Dran2 inputted to the mask 132 is outputted to a subtracter 134 only when the control signal CTL is OFF. The subtracter 134 subtracts the random number data D_ran2from the fog density α to output a fog density α′. Thus, as shown in FIG. 6, a fog density α′ changes at random corresponding to a distance d.

[0060] As described above, according to the present embodiment, a fog density is set corresponding to a distance between the fog base plane and a polygon, whereby images in which dense fog realistically hangs over the surface of the ground can be provided.

[0061] According to the present embodiment, the haze processing for changing a fog density at random is performed, whereby hazy states can be expressed, and realistic images can be provided.

[0062] (A Modification)

[0063] Then, a modification of the image processing method according to the present embodiment will be explained with reference to FIG. 7. FIG. 7 is a conceptual view explaining a principle of the image processing method according to the present embodiment.

[0064] The image processing method according to the present modification is characterized in that a fog density α at a point on a polygon 12 is given based on a line component interconnecting a view point and the point on the polygon 12, and an integrated value given with respect to the fog base plane 10.

[0065] Accordingly, higher fog densities are given to polygons at farther positions, and lower fog densities are given to polygons at nearer positions.

[0066] Thus, according to the present modification, even when objects are spaced from the fog base plane by the same distance, that of the objects which is nearer has a lower fog density, and that of the objects which is farther has a higher fog density. The present modification can provide realistic images.

[0067] The image processing method according to a second embodiment of the present invention will be explained with reference to FIGS. 8 and 9. FIG. 8 is conceptual views explaining a principle of the image processing method according to the present embodiment. FIG. 9 is views exemplifying image displays by the image processing method according to the present embodiment. The same members of the image processing method and device according to the present embodiment as those of the image processing method and device according to the first embodiment shown in FIGS. 1 to 7 are represented by the same reference numbers not to repeat or to simplify their explanation.

[0068] The image processing method according to the present embodiment is characterized in that a space above a fog base plane 10 is a front space, and a space below the fog base plane 10 is a back space, and different fog densities α are given as functions and a constant respectively for the front space and the back space.

[0069] In the front space, for example, fog densities α are given as functions α=f(d), and fog densities α as exemplified in FIG. 8B are given. As in the first embodiment, the haze processing is performed, and fog densities α′ are used, whereby more realistic images can be provided. On the other hand, in the back space, for example, a fog density α is given as a constant, and a fog density α as exemplified in FIG. 8C is given.

[0070] Thus, functions and a constant are used respectively for the front space and the back space which are divided with respect to the fog base plane 10 to determine fog densities, whereby more realistic images can be provided.

[0071] Examples of images provided by the image processing method according to the present embodiment will be explained with reference to FIG. 9.

[0072] FIG. 9A shows a state that a sea of clouds is on the foot of mountains 150, and fog hangs above the cloud sea. The fog base plane 10 is set at the foot of the mountains 160. The front space is above the fog base plane 10, and functions as shown in FIG. 8B are used. Accordingly, fog becomes less dense toward the sky from the fog base plane 10. On the other hand, the back space is below the fog base plane 10, and a constant as shown in FIG. 8C is used. Accordingly, in FIG. 9A, a fog density is constant in the diagonal line portion, and a sea of clouds is expressed.

[0073] FIG. 9B expresses the earth 152. Because the earth 152 is round, a fog base plane 10ais curved. The outside of the fog base plane 10ais the front space, and the inside of the fog base plane 10ais the back space. In the front space functions as shown in FIG. 8B are used, and a fog density α becomes less dense away from the earth. On the other hand, in the back space inside of the fog base plane 10, a constant is used as a fog density α. The fog density α is constant inside of the fog base plane, i.e., in the back space. Accordingly, according to the present embodiment, a state that clouds surround the earth and become less dense gradually away from the earth can be expressed.

[0074] As described above, according to the present embodiment, functions and a constant are used respectively for the front space and the back space divided with respect to a fog base plane so as to determine fog densities, whereby more realistic images can be provided.

[0075] The present invention is not limited to the above-described embodiments and covers other various modifications.

[0076] For example, in the first and the second embodiments, only one fog base plane is provided, but a plurality of fog base planes may be provided. In this case, a fog density is given synthesizing fog densities with respect to the respective fog base planes. In a case, for example, that a flat fog base plane and a curved fog base plane are provided, a state that fog resides in the cavity can be expressed. In a case that a fog base plane opposed to a ground surface, and a fog base plane opposed to the screen are provided, different fog densities corresponding to distances from the ground surfaces and depths can be provided.

[0077] In the first and the second embodiments, fog, haze, etc. are used, but the present invention is not limited to fog and clouds. The present invention is applicable to all things, such as steam, haze, dust, tornadoes, smoke, etc.

[0078] In a case that a fog base plane is a curved plane, it is possible that the curved plane is divided into a plurality of flat planes to be approximated, and distances from the flat planes are used.

[0079] In the first and the second embodiments, fog densities of polygons are set, but the present invention is applicable to setting fog densities of all objects.