Texture rendering method, entertainment apparatus and storage medium

[00002] The present invention relates to computer graphics (CG) and, more particularly, to an art for projecting a texture in real time onto a three-dimensional (3D) model.

[00003] Due to the recent improvement in hardware performance, the home-use entertainment apparatus has made possible to render real time three-dimensional CG, thus realizing practical three-dimensional CG animations.

[00004] In such real-time three-dimensional CG, the shadow volume method is known as an art to render, real time, a shadow of another object onto an arbitrary position in a surface of an object represented as a 3D model.

[00005] The shadow volume method determines, concerning the light from a light source, a region undergoing an effect from another object and then represents a shadow by decrease of luminance in that region.

[00006] However, the shadow volume method, although suited for representing a shadow onto a region undergoing an effect by another object, is not proper in forming a texture-projected image to this region.

[00007] FIG. 10A is a view for representing an image in forming a shadow of another object 660 on an object 600 by the shadow volume method. FIG. 10B is a view for representing an image when the shadow formed by the shadow volume method is used as a rendering region 610 to paste a texture 650 to the rendering region 610 on an object 600. Properly, as shown in FIG. 10C it is desired to represent in a manner deforming along the surface of the three-dimensional object 600. However, the texture 650 is represented as if it were pasted on a flat plane, as shown in FIG. 10B.

[00008] The present invention has been made in order to overcome such a problem with representation, and it is an object thereof to provide an art for forming an image by projecting a texture at an arbitrary angle to an arbitrary position on a surface of an object represented as a 3D model.

[00009] In order to solve the problem, according to the present invention there is provided the following process in order to render a texture onto a surface of an object represented as a three-dimensional model.

[00010] First, texture data is divided into image data (hereinafter, referred to as “texture lines”) having a width of one dot and a length equal to the number of dots in one side of the texture. Next, supposed is a stereoscopic object based on one texture line that the texture line is extended in a direction of light travel while possessing color information from an arrangement relationship between a texture line, an object model and a virtual light source in a three-dimensional space, so that an intersecting part between the stereoscopic object and the object model is defined as a region for rendering the texture line to carry out a process to render a stereoscopic object.

[00021] An embodiment of the invention will be explained in detail, with reference to the drawings,

[00022] First, explained is a hardware configuration of an entertainment apparatus 10 on which the invention can be carried out, with reference to FIG. 1. It is, however, noted that the apparatus the invention can be carried out is not limited to the entertainment apparatus 10. The invention can be carried out on an information processing apparatus in various kinds, such as a personal computer, a game apparatus and a graphics-exclusive computer.

[00023] In the figure, the entertainment apparatus 10 has a main CPU 100, a graphics processor 110, an I/O processor (IOP) 120, a CD/DVD decoder 130, a sound-reproducing processor. (SPU) 140, a sound buffer 141, an OS-ROM 150, a main memory 160 and an IOP memory 170.

[00024] The main CPU 100 and the graphics processor 110 are connected together by an exclusive bus 101. Meanwhile, the main CPU 100 and the IOP 120 are connected together by a bus 102. Also, the IOP 120, the CD/DVD decoder 130, the SPU 140 and the OS-ROM 150 are connected to a bus 103.

[00025] The main CPU 100 is connected with the main memory 160, and the IOP 120 is connected with an IOP memory 170. Furthermore, the IOP 120 is connected with a controller 180.

[00026] The main CPU 100 executes a program stored in the OS-ROM 150 or a program transferred from the CD/DVD-ROM or the like to the main memory 160, thereby carrying out a predetermined process.

[00027] The graphics processor 110, although its detailed function will be explained hereinafter, is a rendering processor administering a rendering function of the entertainment apparatus, to carry out a rendering process according to an instruction from the main CPU 100.

[00028] The IOP 120 is an input/output sub-processor to control the exchange of data between the main CPU 100 and the peripheral unit, e.g. the CD/DVD reading section 130, the SPU 140 or the like.

[00029] The CD/DVD decoder 130 reads data out of a CD-ROM or DVD-ROM loaded on the CD/DVD drive, to transfer the data to a buffer area 161 provided in the main memory 160.

[00030] The SPU 140 reproduces the compressed waveform data or the like stored in the sound buffer 141, with a predetermined sampling frequency on the basis of a sound-producing command from the main CPU 100 or the like.

[00031] The OS-ROM 150 is a non-volatile memory storing a program and the like to be executed, at a start-up, by the main CPU 100 and IOP 120.

[00032] The main memory 160 is a main storage unit of the main CPU 100 and stores the commands the main CPU 100 is to execute, the data the main CPU 100 is to utilize and so on. Meanwhile, the main memory 160 is provided with a buffer area to temporarily store the data read out of the storage medium, such as a CD-ROM, DVD-ROM or the like.

[00033] The IOP memory 170 is a main storage unit for the IOP 120 and stores the commands the IOP 120 is to execute and the data, etc. the main CPU 100 is to utilize.

[00034] The controller 180 is an interface for accepting an instruction by an operator.

[00035] FIG. 2 is a diagram showing an internal configuration of the graphics processor 110. As shown in the figure, the graphics processor 110 has a host interface section 200, a rendering function block 210, a local memory 220 and a CRTC section 230.

[00036] The host interface section 200 is an interface section for exchanging data with the main CPU 100.

[00037] The rendering function block 210 is a logic circuit section for carrying out a rendering process on the basis of an instruction from the main CPU 100. The rendering function block 210 has digital differential analyzers (DDAs) and pixel engines respectively 16 in the number, to parallel-process at most 16 pixel data pieces, each having 64 bits (32 bits in color information and 32 bits in Z value). The DDA computes RGB values, Z values, texture values and the like, on the basis of the apex information received from the main CPU 100. On the basis of these values, the pixel engine performs the processes of texture mapping, α blending, shadow volume, etc., thereby preparing the final pixel data.

[00038] The local memory 220 stores the pixel data created by the rendering function block 210, the texture data transferred from the main CPU 100 and the like.

[00039] The CRTC section 230 outputs, as a video signal, the content in the frame buffer area (see FIG. 3) of the local memory 220, according to a designated output format (NTSC, PAL, VESA format or the like).

[00040] FIG. 3 is a diagram showing a configuration of the local memory 220. As shown in the figure, the local memory 220 has the frame buffer area 250, a Z buffer area 260, a texture buffer area 270 and a texture CLUT 280.

[00041] The frame buffer area 250 and the Z buffer area 270 are the areas for a subject of rendering. The frame buffer area 250 stores the pixels as a result of rendering, while the Z buffer area 270 stores a Z value of the rendering result.

[00042] The texture buffer area 270 stores the image data of texture, while the texture CLUT area 280 stores a color look-up table (CLUT) to be used where a texture is represented by an index color.

[00043] Note that the areas 250-280 can be arranged on the local memory 220 in an arbitrary order and at arbitrary addresses by setting a proper value to a predetermined control register.

[00044] FIG. 4 is a view for explaining a use state of the entertainment apparatus 10. In the figure, a controller 180 is connected to a connector part 12 of an entertainment apparatus body 11. Also, an image/sound output cable 14 is connected to an image/sound output terminal 13 of the entertainment apparatus body 11. This cable 14 at the other end is connected to an image/sound output unit 15, such as a television receiver unit. An operator of the entertainment apparatus uses the controller 180 to instruct for operation. The entertainment apparatus 10 accepts the instruction from the operator through the controller 180, and outputs the image data and sound data corresponding to the instruction to the image/sound output unit 15. Then, the image/sound output apparatus 15 outputs images and sound.

[00045] Next, explanation is made on the 3D model rendering process to be executed by the entertainment apparatus 10 having the above configuration. Application software carries out rendering of an image as required, on the basis of a 3D model stored in a CD/DVD.

[00046] First, explained is the rendering function to be utilized for realizing the present rendering method. The present rendering method utilizes a texture mapping function and rendering region creating function to be realized by the graphics processor 110 and main CPU 100.

[00047] Note that the texture mapping function can be on/off-controlled by setting a proper value to a predetermined control register.

[00048] The texture mapping function refers to a function of image rendering that a texture (image data) stored in the texture buffer area 270 of the local memory 220 is pasted onto a surface of a polygon.

[00049] FIG. 5 is a view for explaining the texture mapping function by the graphics processor 110. As shown in the figure, if utilizing the texture mapping function, the entire or a part of the texture prepared in the texture buffer area 270 can be properly magnified, reduced, deformed or so to be pasted onto a surface of a polygon. Where instructing the graphics processor 110 to render a textured polygon, the main CPU 100 designates, in addition to the coordinate values of polygon apexes, the texture coordinate values corresponding to the apexes, thus instructing for rendering.

[00050] The graphics processor 110, when the texture mapping function is turned on and instructed for polygon rendering, makes reference to the image data placed in the texture buffer area 270 as a texture and carries out texture mapping with proper interpolation, on the basis of a texture coordinate value designated for each polygon apex.

[00051] Next, the rendering region creating function is explained. The present embodiment uses, as a rendering region creating method, a technique called a shadow volume method. In the frame buffer of the graphics processor 110, there is a data area capable of designating to allow or prohibit the writing to each pixel in the frame. Herein, this area is referred to as an S buffer, wherein it is assumed that the pixel having an S buffer value of 1 allows writing while the pixel having an S buffer value of 0 prohibits writing.

[00052] FIG. 6 is a view for explaining the shadow volume method. Herein, explanation is made on an example illustrating that the shadow of an object A shown in FIG. 6A is rendered onto an object B.

[00053] At first, an object C is created by moving the object A in a parallel and horizontal way to a direction of a light source L (FIG. 6B). Then, assumed is a triangular prism T defined by the object A and object C. The S buffer corresponding to a front-surface side (on the side seen in the figure) of the triangular prism T is assumably a value of 1. Thereupon, the S buffer corresponding to the region shown by hatching in FIG. 6C is provided a value 1. Next, the S buffer corresponding to a back-surface side of the triangular prism T is assumably a value of 0. Thereupon, only the S buffer corresponding to a part G fallen to a shadow of the object A shown by hatching in FIG. 6D is provided a value of 1. Due to this, the part having the S buffer value of 1 can be given as a rendering region.

[00054] Then, if a black semitransparent object, for example, is written to the part having an S buffer value of 1, the shadow of the object A can be rendered onto the object B.

[00055] In the present rendering method, these functions are utilized to form an image by projecting a texture to an arbitrary position of an object having an arbitrary shape.

[00056] Next, explanation is made on a flow of the present rendering process. FIGS. 7A to 7E are views for explaining an example of rendering in the present embodiment. FIG. 8 is a flowchart for explaining a flow of the present rendering process. Note that this embodiment explains an example illustrating that a texture 520 is projected onto an object 500 as shown in FIG. 7A. FIG. 8 is the flowchart for explaining the process in that case.

[00057] The program for realizing the present rendering process is stored, for example, from a CD/DVD-ROM through the CD/DVD decoder 130 to the main memory 160. The main CPU 100 carries out operation according to this program, thereby executing the present rendering process.

[00058] The apexes of the object 500 and texture 520 are provided with coordinates on a three-dimensional virtual space and stored in the main memory 160.

[00059] FIG. 9 is a view for explaining an image of the texture 520. In this example, the texture 520 assumably has a size having horizontally X dots and vertically Y dots (X<Y). When the smaller one of the vertical and horizontal dots of the texture 520 (horizontal in this example) is divided on a dot-by-dot basis, a pixel line having a 1-dot width formed along the greater in the number of dots is referred to as a texture line.

[00060] First, in a process S100, the texture 520 is divided into texture lines as above (FIG. 7B), This results in formation with texture lines of X in the number. Note that, although this example divided the smaller of the horizontal and vertical number of dots on a dot-by-dot basis, the greater in the number of dots may be divided on a dot-by-dot basis. However, the division of the smaller in the number of dots is preferred because of the reduction in processing amount.

[00061] Next, N=1 is given (S101). Then, a shadow volume method is used for a texture line 530 of N-th line, to form a rendering region 510 on an S buffer (S102), to allow writing to a region corresponding to the texture line 530 of the texture 520 on the object 500 (FIG. 7C).

[00062] Then, the texture line 530 of N-th line is rendered onto the write-allowed region 510 of the object 500 (S103). The concrete process in this case is performed as in the following. Namely, when using the shadow volume method, to a side surface 540a (on a side of forming by line movement) of a rectangular parallelepiped object 540 formed by horizontal and parallel movement of the texture line 530, pasted is a texture in a manner of directly extending a dot color constituting the texture line 530. Also, to an upper surface 540b and lower surface 540c of the rectangular parallelepiped object 540, a texture is pasted in a manner of directly extending the dot colors respectively at an upper and lower ends of the texture line 530. Only to the write-allowed region 510 as an intersect part between the rectangular parallelepiped object 540 and the surface of the object 500, a rectangular parallelepiped object 540 is rendered thereby rendering a texture line 530 (FIG. 7D). Note that the object to be formed by a texture line 530 is not limited to a rectangular parallelepiped. For example, variation is possible by the kind of a light source.

[00063] Next, N=N+1 is given (S104), to examine whether N exceeds X or not, thereby determining whether there exists a texture line of N-th line or not (S105).

[00064] In the case that there is no texture line of the N-th line, the rendering process is ended (FIG. 7E). Then, other required processes are made to output an image to the image/sound output unit 15 (S106).

[00065] Where there exists a texture line of the N-th line, the process of S102 and the following are repeated.

[00066] In this manner, by processing a texture on a 1-dot-line basis, it is possible to carry out mapping in a manner of extending the texture line to the side surface, upper surface and lower surface of the rectangular parallelepiped object 540 without undergoing an effect by the other lines. Consequently, by using this rectangular parallelepiped object 540, it is possible to paste, on real time, a texture to an arbitrary position of an object having an arbitrary three-dimensional shape, along the concave/convex of the object.

[00067] By the above process, it is possible to form an image by projecting a texture at an arbitrary angle to an arbitrary position in the surface of a three-dimensional object. Because this process is made for the already-rendered object data, the process time can be shortened, making possible to real-time rendering for three-dimensional CG.