Image display control method, apparatus thereof, recording media on which the image display control is recorded, and game device

[0001] 1. Technical Field of the Invention

[0002] The present invention generally relates to an information processing device and system for processing information of image data or the like, and in particular relates to a display control method of images in which an object visually changes in a 3D image based on a prescribed game program determined in advance, an image processing method and device thereof, and a recording medium and game device having recorded thereon such image display control method.

[0003] 2. Description of the Related Art

[0004] Pursuant to the development of computer graphics technology in recent years, simulation devices and game devices have become widely popular for both business use and domestic use.

[0005] The screen thereof is composed such that a background screen and objects in such background screen move pursuant to a computer program or controller instructions, and changes and operations in accordance with the game are executed thereby.

[0006] Here, depending on the game content, it is necessary to display information with various texts or symbols regarding the explanation of the rules, explanation of the operation, the progress and the result of the scores, and the life gauge if the object has operational limitations. In such a case, a display area is provided to the upper or corner section, for example, of the screen. This prevents the objects displayed on the screen from becoming overlapped as much as possible, and enables the clear display of information by precisely distinguishing the background screen.

[0007] Nevertheless, depending on the game content, when a display of text or the like is made on the screen as though a telop, there is a possibility that the realistic sensation will decrease when the player plays the game, and the balance of the image may deteriorate.

[0008] For instance, in a screen envisioning outer space, when a display such as text is made on the part of a screen while the player is enjoying the game feeling as though he/she is in outer space, the amusement of the game may decrease and the realistic sensation may be lost.

[0009] This is not limited to the display of text, and, for example, applies similarly to the case of a life gauge or the like which represents the life volume of an object with the length of a strip-shaped graph.

[0010] Although the foregoing examples refer to those which are, in principal, displayed constantly, there are those which are displayed on the screen in a prescribed timing. As a representative example thereof, there are cases of displaying a text such as game start or game over, and such text is overlapped and displayed irrespective of the game screen. This type of sporadic text display also lacks the sense of unity with the game screen, and may cause the deterioration of the game amusement.

[0011] Moreover, a life gauge or the like is information which must be watched from point to point, and if the object position and the life gauge position are apart from each other, the player is required to move his/her viewpoint. Not only is this a complicated task, but this may also cause the player to fatigue easily.

[0012] Meanwhile, in general an object in a game scores points or wins/loses pursuant to some types of action, and, among such actions, there are ordinary actions, and special actions (the so-called finishing blows or secret moves) used in particular circumstances. Since the operations for using the special actions are complex, the player usually wishes to concentrate on such operations. Nevertheless, in a game, the player must concentrate on the position of the object, position of the opponent, operational timing and so on, and in actuality it is difficult for the player to concentrate on the operation of the special actions. Further, it is possible that the player will only operate in one of the actions; that is, either in the standard action or the special action. It is therefore necessary to establish some kind of merit/demerit when implementing the special actions.

[0013] Next, as a means for reinforcing the object as the main character, there is a technique of generating an aura around this object. An aura is an image processing which expresses the object in the center of the background to be conspicuous, and there is a mode where lines are radially emanated from the center of the object, and a mode where a gradational screen is provided around the object.

[0014] Conventionally, a circular plate polygon was generated from the center (for example, near the bellybutton) of an object (mainly of a human shape), and the normal vector thereof was set to constantly face the camera viewpoint. It is thereby possible to form a circular aura around the object no matter which position such object is facing. This, however, appears strange since the aura is not emanated along the contour of the object.

[0015] Moreover, as another method of generating an aura, there is a method of forming an aura with plate polygons around the skeletal polygons of the respective parts structuring the object.

[0016] According to this method, the contour of the object and the contour of the outermost periphery of the aura will have the same shape (similar figure), and would not appear unnatural.

[0017] Nevertheless, although this method is capable of being compatible with a certain degree of motion of the object, when the object faces abeam against the camera viewpoint, for instance, since the plate polygons will lose its third dimension, there is an instant where the aura disappears. In addition, there are also cases where the aura disappears when the skeletal polygons overlap.

[0018] In order to accurately generate an aura coinciding with the contour of the object, it is most preferable to extract the contour of the object. This, however, requires a commeasurable processing capacity of the CPU in addition to the processing time becoming significantly long, and there are cases where this is not able to keep up with the game progress.

[0019] Moreover, with a conventional image processing device, the movement of the character and a controller display area for displaying the operational status of the controller for instructing the movement of such object were displayed on the screen. Thus, the player was required to pay particular attention to both the movement of the character and the display of the operational status of the controller. This generates cases where the player is not able to make appropriate operations since his/her attention is diverted.

[0020] Japanese Patent Publication No. 2998086 therefore provided a controller display area overlapping with the character. In this conventional art, however, the player is not able to determine the controller display area from the back of the character, nor able to determine the moving direction of the character from the controller display area.

[0021] The present invention was devised in view of the foregoing facts, and a first object thereof is to provide an image display control method in a 3D image and the device thereof, as well as a recording medium and game device having recorded thereon such image display control method, which enables the player to maintain the virtual feeling in the game without losing the balance of the image by displaying text or the like as though a telop on the screen, and which is capable of preventing the deterioration in game amusement by yielding a sense of unity with the game screen even in a sporadic text display.

[0022] Moreover, the second object of the present invention is to obtain with certainty two or more types of information upon suppressing the shifting of the player's viewpoint as much as possible.

[0023] The third object of the present invention is to enable the player, when complex operations are necessary, to concentrate on such complex operation by simplifying other elements which ordinarily require consideration.

[0024] The fourth object of the present invention is to enable the generation of aura, which is means for reinforcing an object of a main character class, with simple image processing capable of matching the contour of such object and accommodating even complex movements.

[0025] Yet another object of the present invention is to provide a program for making a computer execute the image processing method or image processing means described later, or a storage medium storing such a program.

[0026] (Invention Relating to the Display of Background Image and Text, Etc.)

[0027] An image display control method in a 3D image whereby an object in a 3D image visually changes based on a predetermined prescribed game program, wherein a display character representing the game status is structured of an aggregate of polygons, and displayed as apart of the background in the screen of the game in progress.

[0028] Gradation is performed to the polygons.

[0029] An image display control method in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, wherein the 3D image comprises a life indicator for expressing a prescribed life volume of the object, and displaying the life indicator is controlled, such that the rate of decrease of the life indicator becomes higher in comparison to a standard movement when a special movement is designated.

[0030] The object is displayed at least in its contour, and the life indicator is provided within the object and moves together with the motion of the character.

[0031] An image display control method in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, wherein text information having significance in the game is displayable in the 3D image, and displaying the text information is controlled, such that the text information is displayed in a state where a plurality of fragments are dispersed in the displayed image, and the fragments gradually assemble to create the text.

[0032] An image display control device in a 3D image whereby an object in a 3D image visually changes based on a predetermined prescribed game program, comprising: background image display means for displaying a background 3D image of the game in progress; a display character structured of an aggregate of polygons and which represents the game status; and mounting means for mounting the display character as a part of the background image within the screen.

[0033] A gradation means is further provided for performing gradation such that the display character mounted with the mounting means stands out from the background 3D image.

[0034] An image display control device in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, comprising: life volume calculation means for calculating a prescribed life volume of the object; a life indicator for displaying the life volume calculated with the life volume calculation means on the 3D image; designation means for designating the movement of the object; and life volume correction means for correcting the rate of decrease of the life volume to be higher in comparison to a standard movement by controlling the calculation means when a special movement is designated to the object with the designation means.

[0035] The life indicator is disposed within the object displayed in 3D.

[0036] An image display control device in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, comprising: a plurality of fragments dispersed in the 3D image in the initial state and which becomes text information significant in the game by being aggregated in a prescribed combination; floatation movement means for floating and moving the fragments in the 3D screen; and positioning control means for performing control of positioning the fragments in their respective final coordinate positions in the 3D screen preset for each of the plurality of fragments, and structuring an aggregate with the plurality of fragments.

[0037] According to the foregoing invention, a sense of unity can be yielded between the display character representing the game status, and the three-dimensional background image. Further, by performing the gradation thereto, three-dimensionality is yielded, and it is thereby possible to clarify the display contents.

[0038] Since a life indicator representing the life volume is disposed within (inside the body of) the main character object, the viewpoint for the object and life indicator will match for the player, thereby improving visibility. Moreover, since the rate of decrease of the life volume is made higher during a special movement of the object in comparison to a standard movement, it is possible to prevent a player from leaning only toward the special movement, which is advantageous in the game progress.

[0039] Further, as a representation for representing text to be displayed sporadically, the text is made to be an aggregate of a plurality of fragments and, in the initial screen, these fragments are dispersed within the screen and gradually move to their respective predetermined positions in order to ultimately form the text. This yields a sense of unity with the screen and will not hinder the game progress.

[0040] (Invention Relating to Operability)

[0041] The movement of the object is a swing motion of a racket counter-stroking a spherical body, and a display control is made such that the contact point position of counter-stroking the spherical body with the racket is locked on at the time of the special movement, and the spherical body is counter-stroked at the contact point, for example, at a probability of 100% in synchronization with the swing motion.

[0042] A display control means is further provided for displaying the movement of the object as a swing motion of a racket counter-stroking a spherical body; wherein the display control means has lock-on means for locking on the spherical body to the counterstroke contact point position of the racket upon the special movement, and synchronization control means for synchronizing the swing motion and the movement of the spherical body such that the spherical body is counter-stroked at the contact point with a probability of 100%.

[0043] According to the foregoing invention, when the object holds a racket and is to swing the racket based on the player's operation, ordinarily, it is necessary to coincide the spherical body to be counter-stroked with the racket with an appropriate contact point position of the racket. Nevertheless, when implementing the special movement as described above, complex operations will become necessary for such special movement, and, since matching of the spherical body and the contact point position may become neglected, the player will feel displeasure. Thus, the spherical body and the contact point position are made to lock on when implementing the special movement, and even though in reality such point is somewhat deviant when the movement is commenced, this is automatically corrected in order to enable the counterstroke of the spherical body at an appropriate contact point position. The player is thereby able to concentrate on the complex operations accompanying the special movement.

[0044] (Invention Relating to the Reinforced Display of the Object)

[0045] An image display control method in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, irrespective of the display viewpoint of the object, a special image processing is constantly performed around the object.

[0046] The special image processing is at least of the following an image processing for displaying a plurality of radial lines from the contour of the object beginning at a predetermined center within the object to a position separated a prescribed distance; or an image processing for displaying a gradation within the area connecting the tips of radial lines in which the gradation sequence changes gradually from the center of the object.

[0047] A collision ball is set to the respective parts of the object, and the special image processing area is set based on the collision ball.

[0048] A projection plane is provided between the object and an object display viewpoint, a reference circle is set among the projection circles of the respective collision balls displayed on the projection plane, radial lines are generated for dividing around the center of the reference circle in N (N is an integral number larger than the number of collision ball projection circles excluding the reference circle) segments, an intersecting point is sought for the respective N number of radial lines and the farthermost position against the center of the reference circle of the respective collision ball projection circles, and the area surrounded by the lines connecting the adjacent intersecting points is set as the special image processing area.

[0049] An image display control device in a 3D image whereby an object in a 3D image visually changes based on a predetermined game program, comprising: viewpoint movement control means for displaying the object moving in a 3D screen by moving the viewpoint; and special image processing means for performing special image processing around the object in all viewpoints set with the viewpoint movement control means.

[0050] The special image processing means performs at least one of the following: an image processing for displaying a plurality of radial lines from the contour of the object beginning at a predetermined center within the object to a position separated a prescribed distance, or an image processing for displaying a gradation within the area connecting the tips of radial lines in which the gradation sequence changes gradually from the center of the object.

[0051] The special image processing means comprises a plurality of collision balls set to the respective parts of the object, and the special image processing area is set based on the collision balls.

[0052] The special image processing means comprises: reference circle setting means for setting a reference circle among a projection plane provided between the object and an object display viewpoint, and the projection circles of the respective collision balls displayed on the projection plane; radial line generation means for generating radial lines which divide around the center of the reference circle in N (N is an integral number larger than the number of collision ball projection circles excluding the reference circle) segments; intersecting point calculation means for calculating the intersecting point for the respective N number of radial lines and the farthermost position against the center of the reference circle of the respective collision ball projection circles; and special image processing area setting means for setting the area surrounded by the lines connecting the adjacent intersecting points as the special image processing area in the intersecting points calculated with the intersecting point calculation means.

[0053] According to the foregoing invention, irrespective of the display viewpoint of the object, an object can be reinforced and the vigor of the screen can be increased by constantly performing special image processing to the periphery of such object.

[0054] The special image processing is either a case of displaying a plurality of radial lines from the contour of the object beginning at a predetermined center within the object to a position separated a prescribed distance, or a case of not displaying the radial lines (i.e., making them transparent) and displaying a gradation within the area connecting the tips of radial lines in which the gradation sequence changes gradually from the center of the object. These may be represented alternately, or together.

[0055] As the procedure for generating the special image described above, a projection plane is provided between the object and an object display viewpoint, a reference circle is set among the projection circles of the respective collision balls displayed on the projection plane, radial lines are generated for dividing around the center of the reference circle in N (N is an integral number larger than the number of collision ball projection circles excluding the reference circle) segments, an intersecting point is sought for the respective N number of radial lines and the farthermost position against the center of the reference circle of the respective collision ball projection circles, and the area surrounded by the lines connecting the adjacent intersecting points is set as the special image processing area. Thereby, a representation corresponding to the contour of the object is constantly possible in accordance with the complex movement of the object.

[0056] FIG. 1 is a block diagram of the game device according to an embodiment of the present invention;

[0057] FIG. 2 is a front view showing a screen of the game device according to the present embodiment;

[0058] FIG. 3 is a front view of a screen showing the flow where the scattered fragments gradually form a text;

[0059] FIG. 4 is an enlarged front view of the floor and the wall portion of the background image;

[0060] FIG. 5 is an exploded view of a character structured with plate polygons provided to the floor and the wall;

[0061] FIG. 6 is a front view of the object;

[0062] FIG. 7 is a control block diagram of the action movement;

[0063] FIG. 8 is a control flowchart of the action movement;

[0064] FIG. 9 is a perspective view showing the relationship between the polygons and projection screen and camera viewpoint;

[0065] FIG. 10 is a front view on the projection screen of the object when radial lines are formed thereto;

[0066] FIG. 11 is a control flowchart showing the procedures for generating an aura;

[0067] FIG. 12 is a diagram showing a game screen of another embodiment;

[0068] FIG. 13 is a diagram showing another game screen;

[0069] FIG. 14 is a functional block diagram to be implemented by the image processing means according to the present embodiment; and

[0070] FIG. 15 is a flowchart to be implemented by this image means.

[0071] FIG. 1 shows a structure of the game device having the image display control in a 3D image according to the present invention programmed therein. In FIG. 1, the game device comprises a control unit 1 structured mainly with a CPU 101 and the like, an input device 2 for a player to input operational signals into the control unit 1, an external storage device 3 storing an operating system (hereinafter referred to as OS) and application programs (game programs) and which inputs such programs in the control unit 1 when necessary, and an output device 4 structured of a display device 4a and speaker 4b among others for providing images and sounds to the player. Further provided is a communication device 5 for transmitting and receiving data to and from other computers or game devices via a telephone line or the like. Without limitation to the CD-ROM or the like illustrated in the diagram, this may also be a recording medium capable of writing and retaining data from the control unit 1.

[0072] When the power is turned on to start the game, a boot program loader not shown loads the boot program (also referred to as an initial program) stored in the ROM 102 into the CPU 101, and the CPU 101 executes this boot program. In accordance with this boot program, the CPU 101 loads all or the necessary portion of the OS stored in the CD-ROM or the like into the main memory 103, and executes the OS.

[0073] Under the control of this OS, the CPU 101 loads all or the necessary portion of the application program (hereinafter sometimes simply referred to as program) stored in the CD-ROM or the like into the main memory 103, and, as required, loads the drawing data or image data stored in the CD-ROM or the like into the graphic memory 104, and loads the sound data into the sound memory 105.

[0074] The CPU 101 executes the application program stored in the main memory 104 under the control of the OS. Data accompanying the execution of the application program is written in the main memory 104 and backup memory as necessary, and referred to thereby. The backup memory 106 stores data in order to retain the pending status of the game even if the power source is cutoff due to the discontinuance of the game.

[0075] Moreover, in the present embodiment, although the OS and application program and the like are structured to be provided from a CD-ROM, for example, these may be structured to be supplied from a ROM or another computer via a network.

[0076] A video display processor (VDP) 107 reads the drawing data necessary for displaying the image stored in the graphic memory 104, performs various information processing (image processing) based on orders or data from the CPU 101 pursuant to the execution of the application program, and generates image data thereby. Various types of image processing are, for example, texture mapping, light source processing, display priority processing, and so on.

[0077] In order to display the generated image data on the display device 4a, the VDP 107 outputs this to the encoder 108. Further, the generated image data, for example, is written in the frame buffer memory or the like, and may be read in a prescribed timing from this frame buffer memory.

[0078] A sound processor 109 reads sound data stored in the sound memory 105, and performs various information processing (sound processing) based on orders and data from the CPU 101 pursuant to the execution of the application program. Various types of sound processing are, for example, effects processing, mixing processing, and so on. Sound data to which various sound processing has been performed thereto is converted into analog data with the D/A converter 110 and output to the speaker.

[0079] A bus arbiter 111 performs control between the various units connected with the data transmission channel (via the bus 9 or the like). For example, in order to determine the unit to occupy the bus, the bus arbiter 111 determines the priority between the respective units and allocates a bus occupancy time for the occupying unit.

[0080] The game device of the present invention structured as described above realizes the prescribed functions according to the present invention by executing the program read by the CPU 101 from the external recording medium such as a CD-ROM or the like.

[0081] (Summary of Game Contents)

[0082] As shown in FIG. 2, the present game device displays a 3D image on the screen 200, and such 3D image can be broadly classified into a background image 202 and an object image (hereinafter simply referred to as object) 204 which shifts and moves pursuant to the operation of the player.

[0083] The background image 202 corresponds to outer space, and the recreation room (room for playing squash) entirely surrounded by walls (8 faces) corresponds to a room capable of displaying various viewpoints. Now referring to FIG. 4, the wall 206 viewed from the outside is controlled to be transparent. In other words, when viewing the room three-dimensionally from the front, the front wall and the ceiling are transparent. Further, when viewing this room from the lower oblique direction (from below), the ceiling will become opaque, and the floor will thereby become transparent.

[0084] The content of this game is where an object 204 as the main character enters into this recreation room, counter-strokes the ball 212 bouncing back from all the walls by swinging the racket 210 (refer to FIG. 6) held by the object 204, in order to destroy the plurality of blocks 214 provided to the rearmost wall 206D.

[0085] (Characteristic Items in this Game Device)

[0086] (1) Text representing the start and end is sporadically displayed at the start and end of the game.

[0087] (2) Displays of scores corresponding to the number of destroyed blocks and countdown of the time limit are displayed constantly during the game progress.

[0088] (3) A life volume is provided for the object 204, and the object 204 will not function if the game is not finished within a prescribed time. This life volume is displayed constantly.

[0089] (4) The object 204 is capable of performing a special action (so-called finishing blows or secret moves) pursuant to the operation of the player in contrast to a standard action. The rate of reduction is set to become higher when implementing this special action.

[0090] (5) An aura 216 is provided to the periphery of this object, and the object is displayed most conspicuously on the screen. Since this object 204 is in outer space, not only is it able to move freely across the floor and wall, it can also move along the left and right walls or the ceiling, and the image control is made so that the feet of the object 204 touches the nearest wall. An aura is image processing or image representation for making the object stand out from the background portion with fire, light or the like surrounding the object.

[0091] (6) The movement (swinging of the racket 210) of the object 204 is made to differ depending on the position of the approaching ball 212.

[0092] Each of the foregoing paragraphs (1) to (6) is described in detail below.

[0093] ((1) Sporadic Text Display Control)

[0094] As shown in FIG. 3(A), the display shows a state where fragments (218) are dispersed throughout the screen 200. Here, since the situation is outer space, these fragments can be considered as stardust.

[0095] As shown in FIG. 3(B), each of such plurality of fragments 218 is structured of small polygons and provided with coordinates in advance, and gradually moves to the coordinate position of the ultimate position. Nevertheless, among the fragments 218, some move to their coordinate positions at the shortest distance possible, whereas others move while creating a circular or spiral shape. Therefore, they do not arrive at their respective coordinate positions at the same time.

[0096] As shown in FIG. 3(C), the fragments 218 connect with each other at the determined position of each coordinate, and the aggregate 218A thereof gradually forms some type of shape. Moreover, the fragments 218 which have not yet arrived at the coordinate position are floating around such shape.

[0097] As shown in FIG. 3(D), when all of the fragments 218 gather at a determined position of the coordinate position, they respectively form a text, and here, GAME OVER is displayed in a state it is recognizable by the player.

[0098] As described above, since stardust in the outer space gradually gathers, becomes connected, and forms an aggregate in order to represent a text, there is a sense of unity with the background image 202, and the player will not feel a sense of displeasure when such text is to be displayed sporadically.

[0099] Next, the detailed description of the image processing relating to the fragments is explained below. The game device shown in FIG. 1 executes the image processing described in paragraphs (1) to (6) above mainly by the CPU. The image processing means realized mainly by the CPU realizes the image processing to a three-dimensional image publicly known prior to the filing of the present application. In other words, the image processing means of the present invention is an image display control method which sets a three-dimensional spatial coordinate system and a three-dimensional viewpoint coordinate system for following the viewpoint movement, converts the coordinates of a first display body operated by a player belonging to the spatial coordinate system and a second display body other than the first display body belonging to the spatial coordinate system into the viewpoint coordinate system by employing a projection emitted from the viewpoint, and displays the display body disposed in a virtual three-dimensional space on a display screen.

[0100] The CPU loads necessary programs and data from a storage medium such as a CD-ROM storing game programs and game data into the main memory. And, with the support of the VDP and the like, the CPU foremost disposes the fragments in their initial positions. Next, the coordinate position of each fragment is read and stored in the main memory. Thereafter, the CPU reads the aggregate data table of the fragments among the data stored in the main memory, reads the final position of the fragments upon such fragments forming the aggregate, and stores this in a prescribed storage area of the main memory. The fragments are thereafter moved to their final positions.

[0101] The movement path of fragments is not particularly limited, and may be a preprogrammed path, the shortest linear distance sought from the current position of the fragments and the final position, and so on. The aggregate is a completed form of the image, text or the like upon executing the game. Text is information of letters or symbols significant in the game progress, and is the notification of game start or game over, game score, game time, and other explanations which are necessary during the game progress. One characteristic of the present embodiment is that the fragments which structure the aggregatethat is, the portion that forms the aggregateis assimilated into the background image of the game. The fragments are assimilated as stardust into the background image of the outer space.

[0102] ((2) Display Control of Constantly Displayed Text)

[0103] As shown in FIG. 4, text 220 requiring constant display (here, an example of the countdown display of the time limit is used) is displayed on the floor/wall in the background image 202.

[0104] This text (number) 220, as shown in FIG. 5, is structured of an aggregate of plate polygons 222, which are a plurality of polygons. These polygons are disposed as a part of the object structuring the background. For example, the plate polygons are placed on the polygons structuring the background. Each of these plate polygons 222 is capable of being subject to gradation in accordance with the camera viewpoint, and, as a result, as shown in FIG. 4, is displayed in a three-dimensional state having concavities and convexities against the floor/wall 206C. Here, the method of displaying the text is as follows. Models and textures from 0 to 9 are prepared as data in the ROM for drawing per frame. These texts are formed with polygons, and structured from a bottom face and side face. A texture having the same shape as the polygon is affixed to the bottom face (for example, red is attached, and textures graded in proportion to the superimposed polygons are attached to the polygons on the side face).

[0105] Moreover, these plate polygons 222 cannot become the counterstroke face of the ball 212, and the floor/wall is judged as being planar. Next, the image processing in this case is described in detail. Gradation is semi-transparent processing, and an example of such gradation is to place the polygons On the background and perform gradation processing thereto, whereby the polygon color data and background color data are mixed in a prescribed ratio, and the polygons are colored lightly such that the player is able to see through such polygons to view the background in the rear. One reason for performing this type of processing is to assimilate the polygons into the background. When text such as points and remaining time are displayed in the background, there is a problem in that such text display stands out from the background. Thus, by performing gradation processing to the polygons structuring the text display, such text display becomes assimilated into the background.

[0106] In the foregoing embodiment, the floor area (background) to which the text display is placed and the angle formed with the virtual camera are calculated with the CPU. The virtual camera is placed in the vicinity of the main character, and moves in accordance with the movement of the main character. Gradation processing is performed when the camera angle is of a prescribed angle requiring such gradation processing, or when it is within a prescribed angle range. Pursuant to this gradation processing, the gradation of the area to be graded may be gradually changed.

[0107] ((3) Establishment Place of Life Gauge)

[0108] As shown in FIG. 6, the object 204 is basically transparent or semi-transparent, and only the contour thereof is displayed, and gradation is otherwise provided as necessary.

[0109] In the body of this object 204 near the heart, a heart-shaped life gauge 224 is displayed. The player is able to look through this. To summarize, this gauge corresponds to the display image reflecting the status in the game progress of the object processed in accordance with the instruction provided to the image processing device via the input device of the player. The aforementioned image processing means (CPU 101) detects or calculates the status of the object, and reflects this in the form, shape or movement of the gauge. The gauge is displayed overlapping on the object. The gauge moves simultaneously with the movement of the object as a part of such object. Here, a gauge is a part of the display image representing information on the object. The display image includes, in addition to the foregoing life gauge, other types of various display information such as symbols, text and graphics representing the game score, countdown of the time limit and so on.

[0110] The exemplified life gauge 224 is constantly positioned at the heart of the object 204, and, as a result, is controlled to move together with the movement of the object 204. Further, the life gauge can be, in addition to the heart shape and as also illustrated in FIG. 6, that which a number 224A, or it can be an indicator 224B.

[0111] Further, since the life gauge 224 is also a 3D image, this is displayed with slightly differing shapes depending on the direction of the object 204.

[0112] The scale of the life gauge 224 is represented by the speed of the contraction/expansion of the life gauge 224 itself. In other words, when the contraction/expansion of the life gauge 224 is slow, this implies that the heart is beating normally, and represents that sufficient life volume remains. Meanwhile, if the contraction/expansion of the life gauge 224 becomes fast, this is judged as an increased heartbeat, and represents that the life volume is beginning to decrease. For example, when the life volume becomes completely 0, the life gauge 224 may be destroyed.

[0113] Here, the number of objects to be displayed on the screen is not limited to one body, and a plurality of bodies may be displayed. In the latter case of a competition game, each player that becomes a participant in the competition game is able to operate an object, respectively. The foregoing display information can correspond to the game results of each object; that is, each player. The image processing device (CPU) of the game device can be made to be one of the opponents instead of a player. Since the display information representing the game result is displayed overlapping on the object, each player is able to instantly recognize the game result or game information of the object which he/she is operating. As a result, this is effective when a plurality of objects move around in the screen. The image processing means of the game device constantly monitors, calculates or determines the movement position of the object and overlaps such display information on this moving object in order to enable this processing. Here, if the display information is formed in a heart shape, the display information itself will become a part of the human organ, and the player will sense a prescribed reality.

[0114] Next, a modified example is described below. In other words, the CPU executes image processing of placing a second display body (life gauge) inside the first display body (object) such that the player is able to view the second display body through the first display body. Here, the second display body performs a rotational or oscillation movement, or periodic motion such as a reciprocating movement. This periodic motion varies depending on the motion property such as the movement speed of the first display body, or on the characteristics of the first display body. In other words, the periodic motion is controlled in correspondence with the game status of the character (parameters for determining the movement (status) of the character during the game progress such as the energy or physical strength of the character).

[0115] For example, when the motion speed of the first display body is fast, the periodic motion becomes fast. The CPU calculates the movement speed of the first display body. This calculation can be realized from the movement distance of the first display body and the number of frames required for such movement with respect to the movement speed of the display body. Further, the CPU may also read from the main memory the movement speed based on the series of motion data of the first display body.

[0116] ((4) Movement Control of Special Action)

[0117] FIG. 7 shows a functional block diagram for executing the movements of the special action and standard action.

[0118] The movement mode distinction unit 226 distinguishes whether a special action is being designated or a standard action is being designated based on the operational condition of the player, and sends the distinction result to the function selecting unit 228.

[0119] At the function selecting unit 228, a special action signal or a standard action signal is output based on the signal input from the movement mode distinction unit 226.

[0120] A standard action signal is sent to the operational status determination unit 230, and the operational status of the player of a standard action is determined, whereby such determination result is sent to the relative position control unit 232. At the relative position control unit 232, the relative position of the contact point of the racket 210 and the ball 212 is controlled as per the operation of the player, and sent to the processing execution unit 234. At this processing execution unit 234, images of the object 204 and the like are controlled based on the calculated movement.

[0121] Meanwhile, the special action signal in the function selecting unit 228 is sent to the lock-on setting unit 236. The lock-on setting unit 236 commences the movement pursuant to the input of this special action signal, and locks on the relative position of the contact point position of the racket 210 and the ball 212.

[0122] A lock-on is a movement where the ball 212 automatically follows the contact point of the racket 210 in accordance with the movement of the racket 210.

[0123] The lock-on setting unit 236 is connected to the operational status determination unit 238, and corrects the relative position of the contact point position of the racket 210 and the ball 212 by recognizing the player's operation and sending such operational status to the correction unit 240. In other words, the correction unit 240 corrects the position of the contact point of the racket 210 and the ball 212 in a state with a reduced sense of unnaturalness on the image display, and the processing execution unit 242 controls images of the object 204 or the like based on the calculated (corrected) movement.

[0124] The movement control including the swing of the racket 210 of the object 204 is explained in accordance with the flowchart of FIG. 8.

[0125] At step 250, the operational status (standard or special) is determined, and, when determined as being a standard action, the routine proceeds to step 252. The operational designation status by the player is thereby recognized, and, at the subsequent step 254, the swing motion of the racket 210 is commenced based on such recognized operational designation.

[0126] Here, a standard movement is an ordinary motion provided to the character during the game progress, and, for example, is a frequently used command such as the walking, running or jumping of the character. These motions correspond to the button or pad on the controller. A special movement (particular movement) is a motion used less frequently, but aims at an extraordinary movement of the character in comparison to the standard movement. For instance, this would be the object counter-stroking the ball while performing a back flip, or returning the ball while running backwards, and so on. This special movement, for example, corresponds to the operation of a plurality of buttons, and, when there are three types of buttons A, B and C, this special movement occurs to the character when the A button and B button are pressed simultaneously. Moreover, during such special movement, since it is difficult for the player to counter-stroke the ball accurately while giving the character such special movement, the movement path or speed of the ball is adjusted, controlled or interpolated toward the racket.

[0127] Next, at step 256, the relative positional relationship of the contact point of the racket 210 and the ball 212 is calculated, and at the subsequent step 258, the counterstroke direction of the ball 212 is calculated based on such calculation result. The routine then proceeds to step 260. At step 260, the movement of the ball 212 is display controlled based on the result calculated at step 258.

[0128] Here, there are cases where the ball 212 is hit toward an unexpected direction in accordance with the variance in the relative position of the contact point of the racket 210 and the ball 212. When the ball is miss-hit, the ball 212 flies toward a direction different from the direction intended by the player. Thus, it is not possible to hit the block 214 accurately, and the subsequent counterstroke may become difficult.

[0129] Meanwhile, when a special action is determined at step 250, the routine proceeds to step 262 in order to recognize the operational designation status of the player. Next, at step 264, the swing motion is commenced, and, at the subsequent step 266, the position of the ball 212 is corrected based on such recognized operational designation. The routine then proceeds to step 256. In other words, the ball 212 is moved so as to follow the contact point position of the racket 210.

[0130] Next, at the subsequent step 256, the relative positional relationship of the contact point of the racket 210 and the ball 212 is calculated, and at the subsequent step 258, the counterstroke direction of the ball 212 is calculated based on such calculation result. The routine then proceeds to step 260. At step 260, the display of the movement of the ball 212 is controlled based on the result calculated at step 258.

[0131] Here, since the position of the ball 212 is corrected (made to follow) in accordance with the movement of the racket 210, the ball 212 is counter-stroked accurately each time. It is thereby possible to hit the block 214 with accuracy.

[0132] As described above, in the case of a special action requiring difficult operations in comparison to a standard action, the player is able to concentrate on the operation of the special action by locking on the position of the contact point of the racket 210 and the ball 212.

[0133] ((5) Aura on the Object)

[0134] As shown in FIG. 9, a plurality of collision balls 270 are provided to the object 204 in advance.

[0135] The collision balls 270 are structured of a first collision ball 270A provided at the waist position of the object and used as a reference; a second collision ball 270B provided to the chest position of the object 204; a third collision ball 270C provided to the face position of the object 204; fourth and fifth collision balls 270D and 270E provided to the upper arm portions of the object 204; sixth and seventh collision balls 270F and 270G provided to the lower arm portions of the object 204; eighth and ninth collision balls 270H and 270I provided to the wrist portions of the object 204; tenth and eleventh collision balls 270J and 270K provided to the thigh portions of the object 204; twelfth and thirteenth collision balls 270L and 270M provided to the knee portions of the object 204; fourteenth and fifteenth collision balls 270N and 270O provided to the ankle portions of the object 204; and sixteenth and seventeenth collision balls 270P and 270Q provided to the toes of the object 204.

[0136] Here, although the camera viewpoint for displaying this object 204 is able to move freely in the three-dimensional space, a two-dimensional projection screen 272 (transparent) is always provided on the line connecting this viewpoint and the object 204. The face of this projection screen (projection face) 272 is maintained perpendicular to the line connecting the viewpoint and the object 204. This projection face is placed as close as possible to the camera viewpoint. Thus, the aura described later can constantly be displayed even when there is an obstacle existing between the object 204 and the camera viewpoint. The player will be able to recognize the existence (aura) of the object via the obstacle.

[0137] Here, as shown in FIG. 10, when displaying the object 204 with a prescribed camera viewpoint, a projection circle 274 of the collision balls 270 provided to the respective parts of the object 204 is formed on the projection screen 272.

[0138] In this case, radial lines 276 divided into 64 segments are formed from the center of the first collision 270A as the reference. In other words, each of the angles between the radial lines 276 is approximately 5.

[0139] Here, the point (intersecting point X) farthest from the reference point in each of the radial lines 276 and the intersecting point with each collision 270 is sought, and, when connecting the adjacent intersecting points X adjacent to each other, the connected line will form a shape approximately coinciding with the contour of the object 204.

[0140] In the present embodiment, a final contour point Y is set as the position in which a prescribed length a is extended on the radial lines 276 farther than the intersecting point X, and the area set by connecting the adjacent final contour points Y is made to be the aura generation area 278.

[0141] Since a multiangular outermost contour will be formed when connecting the final contour points as is, correction processing is performed in order to correct such multiangles into a smooth curve (spline curve) by performing derivative processing to the adjacent final contour points.

[0142] This aura 216 may be displayed by using the radial lines 276, or represented by performing gradation within the aura generation area 178.

[0143] Next, the aura generation procedure is explained in accordance with the flowchart of FIG. 11. At step 300, it is judged whether it is an aura forming timing or not and, when the answer is judged as positive, the routine proceeds to step 302 in order to recognize the camera viewpoint. When this is judged as negative at step 300, the routine proceeds to step 304 and advances to the subsequent step while omitting the aura display processing.

[0144] When the camera viewpoint is recognized at step 302, the routine proceeds to step 306 in order to project the respective collisions 270 on the projection screen 272. At the subsequent step 308, the center of the projection circle 274 of the first collision 270, which is the reference collision, is fixed.

[0145] At the subsequent step 312, the intersecting point X of the farther most point in the intersecting point of the projection circle 274 of the aforementioned radial lines 276 and each collision 270 is calculated, and, at subsequent step 314, a final contour point Y is set as the position in which a prescribed length is extended on the radial lines 276 farther than the intersecting point X.

[0146] At the subsequent step 316, the adjacent final contour points Y are connected in order to form the aura generation area. Here, the aforementioned correction processing is performed. At the subsequent step 318, an aura is displayed on the aura generation area 278, and this routine is thereby completed.

[0147] As described above, since the respective collisions 270 provided to the object 204 are projected on the projection screen 272 provided between such collisions and the camera viewpoint, numerous radial lines 276 (64 in this example) are formed with the center of the projection circle 274 of the first collision 270A as the reference, and the aura is formed thereby based on the projection circle 274 of each of the projected collisions 270, it becomes possible to display an outer circle aura along the contour of the object 204 with approximate certainty no matter which direction the object 204 is facing. In this case, since calculation is performed with the two-dimensional projection circle projected on the projection screen 272, the processing time and load are minimal and are sufficiently compatible with the movement of the game.

[0148] ((6) Racket Swing Motion)

[0149] There are various swings of the racket; for instance, forehand stroke, backstroke, over throw, under throw, and so forth. Thus, the correlation of the object 204 position, the racket 210 position and the ball 212 position is prepared in a plurality of conditions in advance in the likes of an LUT, and the optimum swing mode is read on a case-by-case basis pursuant to the position of the approaching ball 212 in order to realize a realistic movement by setting the automatic movements of the object (swinging of the racket 210) to be different.

[0150] Another embodiment of the present invention is now explained. This embodiment is a modified example of the foregoing example of FIG. 6. With the embodiment of FIG. 6, a life gauge is housed in a transparent character, and the movement status (rotational speed of the heart-shaped life gauge) is made to change in accordance with the movement status of the character (a state of the character possessing much game life or a state of the character possessing little game life). In the embodiment described later, a monkey-shaped character in a transparent spherical body (ball) shows a behavior toward the moving direction of the ball.

[0151] This embodiment is structured and operated as follows. FIG. 12 and FIG. 13 are representative game screens relating to the present embodiment. A game screen based on various data including data obtained by the CPU or VDP described in FIG. 1 pursuant to the operation of the controller pad by the player or a game program is displayed on the monitor.

[0152] The game content is where a character 502 (second display body) simulating a monkey enters a transparent ball 500 (first display body), and both the ball and monkey (synthesized display body) aim for the goal by the ball rolling along a determined path. In comparison to FIG. 6, the first display body is the object, and the second display body corresponds to the display information. During the course of the ball arriving at the goal, the character scores game points if the character is in the vicinity of a banana 506, which is a source of points. Game points correspond to the numerical value displayed as SCORE.

[0153] The game progresses pursuant to the operation of a game application against the image data structured from three-dimensional coordinate data with a well-known method. The character rolls on a rectangular plate face 503 floating in the air. By moving the operation lever (control pad) provided in the front of the industry-use game device body, the player is able to decide the inclination direction of the plate 503 in the air. Gravity is defined in the virtual space referred to as the game space. Thus, the ball will roll on the plate face inclined toward the gravitational direction.

[0154] The front of the character in the ball is made to face the direction in which the ball is rolling. FIG. 12 shows that the ball is rolling in an upper-left oblique direction in the diagram, and FIG. 13 shows that the ball is rolling toward the backside in the diagram.

[0155] In either case, the front of the character in the ball is facing the direction in which the ball is rolling. In order for the game device to recognize the front of the character, the front of the character is defined with a vector. By the processing means of the CPU or VDP recognizing the rolling direction of the ball, the front of the character can be aligned with the rolling direction of the ball.

[0156] In order to enable the player to recognize the character in the ball, the ball is an empty or solid spherical body, and the color data thereof is transparent data or data corresponding to a hypochromic color in which the inside can be observed. The ball may also be displayed semi-transparently, or processing may be performed so as to alternately thin out the pixels. Further, in order to make the player recognize the contour of the ball, a line is provided to the area of the ball. Thus, this is also a display body in which only the contour of the display body corresponding to the ball is displayed. As described above, the player is able to determine the rolling direction of the ball (direction in which the plate is inclined) by the direction (front direction of the character) to which the character inside the ball is facing.

[0157] When the ball is rolling along a straight line, a scene of the character inside the ball strolling along is provided to the player. When the ball is being prevented from falling off the plate, a representation of a behavior where the character inside the ball is on its hands and knees showing resistance or haste in order to keep the ball from falling is adopted in the game machine. Since the area outside the plate is set as a space where gravity exists in the real world, if the ball falls off the plate, the ball drops toward the bottom of the screen.

[0158] The processing means (CPU, VDP) of the image processing device of the game machine described in FIG. 1 exhibits the functions described with the following functional blocks in order to realize the foregoing movements. Please refer to FIG. 14.

[0159] When the game is started with the game start means, the game is executed based on the player's input orders of the input means. The game execution means comprises plate face inclination means; rolling means for rolling the ball in the gravitational direction on the inclined plate face; orientation direction for detecting the rolling direction of the ball and making the front of the character face such direction; ball rolling status detection means for detecting the rolling status of the ball (rolling in a straight line, rolling in a curve, the ball swaying and rolling as though about to fall off the plate face, and so on); and means for selecting the movement of the character matching the rolling status of the ball (mode of the character strolling along when the ball is rolling in a straight line, mode of the character in a haste when the ball is about to fall off, and so on), and the image processing means comprises means for judging whether the game is over.

[0160] This is now explained in detail based on the flowchart of FIG. 15. When the game is started, the image processing means reads the image data and application software in the memory, and realizes the aforementioned game processing based on this program, image data, and the data input from the input means of the game device (1500).

[0161] Foremost, when the game is started, the course is displayed on the screen. Next, the character inside the ball is disposed at the starting point of the course. A prescribed time limit is provided. The operational signal from the operation means operated by the player is read. The plate face structuring the course is inclined toward a prescribed direction based on the operational signal (1502). The ball is rolled in this direction.

[0162] The character is displayed to match the mode of the rolling of the ball. The character behavior described above arises during the process of such processing (1504). In other words, a behavior of the character that is strolling along or flapping its hands and feet so as to resist falling from the course, is adopted.

[0163] Next, the rolling direction of the ball is detected, and the front direction of the character is set to this direction (1506). Then, the collision of the ball and plate surface, i.e., whether there is an overlap or contact of coordinates, is determined. When there is a contact, the ball has not fallen from the plate face and it is still on the plate face. When the ball is not on the plate face, the ball is made to drop from the course (1508).

[0164] Then, it is decided whether it is within the time limit, and the ball is mandatorily returned to the starting point when exceeding the time limit. As a modified example, the ball may be returned to the starting point of the previous stage. When within the time limit, it is determined whether the goal has been reached, and the game proceeds to the subsequent stage when the goal has been reached. Thereafter, it is judged whether it is game over or not, and the game over is judged in accordance with the game results.

[0165] In this embodiment, the aforementioned collision determination is implemented between the ball (spherical body) and the plate face. Since the spherical body is defined pursuant to a certain radius from the center point thereof, the collision determination of the floor area and the spherical body can be calculated simply. By housing a monkey, which cannot be approximated with a simple shape, in the spherical body, only the collision between the spherical body (subject of collision determination) and the floor area (other subject of collision determination) needs to be determined, and the determination result is accurate.

[0166] Moreover, since the player is able to see through to the character (second display body) in the ball (first display body), the player is able to recognize the character inside of the ball from every direction. Although the front of the character (monkey) inside the ball was made to face the moving direction of the ball, the behavior or form of the monkey-shaped character may be modified or adjusted in correspondence with the movement of the ball. As a modified example of the above, the following example may be adopted. The behavior of the monkey may be changed in accordance with the speed of the ball. Or, the display body on the outside may be changed in accordance with the movement of the monkey.

[0167] Further, in this embodiment also, a plurality of synthesized display bodies may be provided for each participating player. In addition, information of the game result or the like may be overlapped on the first display body and/or second display body as the third display body.

[0168] Effect of the Invention

[0169] The image display control method in a 3D image and the device thereof, as well as a recording medium and game device having recorded thereon such image display control method according to the present as described above yield a superior effect enabling the player to maintain the virtual feeling in the game without losing the balance of the image by displaying text or the like as though a telop on the screen, and preventing the deterioration in game amusement by yielding a sense of unity with the game screen even in a sporadic text display.

[0170] Moreover, in addition to the foregoing effect, two or more types of information are obtained upon suppressing the shifting of the player's viewpoint as much as possible.

[0171] Further, when complex operations are necessary by the player, he/she may concentrate on such complex operation by the other elements, which ordinarily require consideration, being simplified.

[0172] In addition, upon generating an aura, which is a means for reinforcing an object of a main character class, only a simple image processing is required to match the aura with the contour of such object and accommodate even complex movements.

[0173] FIG. 1

[0174] 2 CONTROLLER PAD

[0175] 3 CD-ROM DRIVE

[0176] 5 COMMUNICATION DEVICE

[0177] 103 MAIN MEMORY

[0178] 104 GRAPHIC MEMORY

[0179] 105 SOUND MEMORY

[0180] 106 BACKUP MEMORY

[0181] 108 VIDEO ENCODER

[0182] 109 SOUND PROCESSOR

[0183] 110 D/A CONVERTER

[0184] 111 BUS ARBITER

[0185] FIG. 7

[0186] 226 MOVEMENT MODE DISTINCTION UNIT

[0187] 228 FUNCTION SELECTING UNIT OPERATIONAL SIGNAL

[0188] 230 STANDARD OPERATIONAL STATUS DETERMINATION

[0189] 232 RELATIVE POSITION CONTROL UNIT OF CONTACT POINT AND BALL

[0190] 234 PROCESSING EXECUTION UNIT

[0191] 236 LOCK-ON SELECTION UNIT OPERATIONAL SIGNAL

[0192] 238 SPECIAL OPERATIONAL STATUS DETERMINATION

[0193] 240 RELATIVE POSITION CORRECTION UNIT OF CONTACT POINT AND BALL

[0194] 242 PROCESSING EXECUTION UNIT

[0195] FIG. 8

[0196] SWING ACTION CONTROL ROUTINE

[0197] WHAT IS OPERATION MODE

[0198] STANDARD MOVEMENT

[0199] 252 OPERATIONAL STATUS DETERMINATION OF PLAYER

[0200] 254 SWING MOTION 256 RELATIVE POSITION CALCULATION OF CONTACT POINT POSITION AND BALL

[0201] 258 MOVEMENT DIRECTION CALCULATION OF BALL

[0202] 260 BALL DISPLAY CONTROL SPECIAL MOVEMENT

[0203] 262 AURA DISPLAY ELIMINATION

[0204] 264 SWING MOTION

[0205] 266 BALL POSITION CORRECTION RETURN

[0206] FIG. 11

[0207] AURA GENERATION CONTROL ROUTINE

[0208] 300 TIME FOR AURA GENERATION

[0209] 302 CAMERA VIEWPOINT POSITION RECOGNITION

[0210] 304 AURA DISPLAY OMITTED

[0211] 306 DISPLAY RESPECTIVE COLLISION BALLS ON PROJECTION SCREEN

[0212] 308 DECIDE CENTER OF PROJECTION CIRCLE OF REFERENCE COLLISION BALL

[0213] 312 POSITION CALCULATION OF FARTHERMOST PORTION OF RADIAL LINES AND PROJECTION CIRCLE OF RESPECTIVE COLLISION BALLS

[0214] 314 EXTEND TOWARD RADIAL LINES

[0215] 316 CONNECT FINAL CONTOUR POINT AND SET AURA GENERATION AREA

[0216] 318 AURA DISPLAY CONTROL RETURN

[0217] FIG. 14

[0218] START MEANS

[0219] GAME IMPLEMENTATION MEANS

[0220] INCLINATION MEANS

[0221] ROLLING MEANS

[0222] ORIENTATION MEANS

[0223] BALL ROLLING STATUS DETECTION MEANS

[0224] CHARACTER MOVEMENT SELECTION MEANS

[0225] GAME OVER DETERMINATION MEANS

[0226] FIG. 15

[0227] GAME START

[0228] 1500 GAME PROCESSING

[0229] 1502 BALL ROLLING ON INCLINED PLATE FACE

[0230] 1504 GENERATION OF CHARACTER BEHAVIOUR SELECTION

[0231] 1506 CHARACTER FRONT FACE SETTING

[0232] 1508 COLLISION DETERMINATION AGAINST BALL RETURN