Three-Dimensional Display Apparatus

1. Field of the Invention

The present invention relates to a three-dimensional display device, and more particularly to a three-dimensional display device having a cursor which can be arbitrarily moved in a three-dimensional space by being driven by a two-dimensional input device.

2. Description of the Related Art

In a recent pattern processing system, it is a general trend to use three-dimensional coordinates. A displayed pattern may be edited by addition, correction or movement, for example, or a view point of the displayed pattern may be changed. In order to achieve those functions, it is convenient to designate a position by using a cursor on a three-dimensional space. Usually, it is necessary to display a pattern as well as a cursor on a display device having a two-dimensional spread such as a CRT. In the past, a cursor position on the three-dimensional space is designated by three-dimensional coordinates entered by, for example, a keyboard. This involves a problem in operability.

It is an object of the present invention to provide a three-dimensional display device having a movable three-dimensional cursor.

It is another object of the present invention to provide a method for controlling the movement of a cursor displayed in a three-dimensional space in accordance with a two-dimensional input device and displaying the moved cursor in the displayed three-dimensional space.

FIG. 1 shows a schematic view of a display screen and an input device for illustrating the present invention,

FIG. 2 shows a diagram of a vector cursor of the present invention,

FIG. 3 shows a block diagram of one embodiment of a display device of the present invention,

FIG. 4 shows a table of content of a storage 307 for vector cursor parameters in the display device shown in FIG. 3,

FIG. 5 shows a flow chart of a basic operation of a vector cursor control in the embodiment of the present invention, and

FIG. 6 shows a locus of movement of a vector cursor under a simple condition.

Embodiments of the present invention are now explained with reference to the drawings.

FIG. 1 illustrates a general concept of the present invention.

A three-dimensional space is displayed on a display screen 100 of a display device. In FIG. 1, it is shown by three-dimensional orthogonal coordinates (x, y, z) 101. A cursor 102 is virtually located in the three-dimensional space and moves in the space like an airplane. It is a cursor having a velocity vector as an attribute. (It is hereinafter referred to as a vector cursor.) It is initially oriented in certain direction 103, but when an operator manipulates an input device 105, its direction is changed and it moves to 102' through a locus 104.

The input device 105 has direction component input means 106 and velocity component input means 107. The direction component input means 106 produces a signal to designate a direction of the cursor 102. It designates two variables for determining the amount of rotation around axes represented by two supporting vector cursors in the plane normal to the direction of a vector cursor. The velocity component input means produces a signal for designating the velocity of the cursor 102. If the direction component input means 106 is left unmanipulated, the cursor keeps its direction 103. If the velocity component input means 107 is left unmanipulated, the cursor moves at a constant velocity. If the velocity is set to zero, the cursor 102 stops. The operator moves the vector cursor to a desired position by using those means, and enters the coordinate designated by the cursor through an input switch 108. In order to display the three dimensional space to be displayed including the vector cursor on a two-dimensional screen 100, the three dimensional information is converted to a two-dimensional image and displayed on the two-dimensional screen.

FIG. 2 shows a simple appearance of the vector cursor. A vector cursor can be displayed in a manner similar to an airplane, but the minimum requirement is to show the direction of movement (vector F), an axis of horizontal rotation (vector V) and an axis of vertical rotation (vector H). The velocity vector of the vector cursor is represented by F. Forward and backward angle information of the direction component input means 106 designates a rotation angle .theta..sub.H around the rotation axis vector H, and leftward and rightward angle information of the direction component input means 106 designates a rotation angle .theta..sub.V around the rotation axis vector V. Vectors F, V and H are orthogonal to one another. Thus, the direction of the vector F can be changed as required. The magnitude of F is controlled by the velocity component input means 107. Regarding the rotation axis vectors V and H, only the directions are the necessary information as axes; however, they should have different appearance for operators to distinguish them easily. In FIG. 2, the length is different. Other differences such as thickness, double-line or broken/solid line or suffixes, also may be used for discrimination.

A coordinate of the point P of the vector cursor is represented by a vector coordinate P=(Px, Py, Pz). Coordinates of the other points of the vector cursor of FIG. 2 can be calculated as follows.

The direction input means 106 designates the rotation angles .theta..sub.H, .theta..sub.V of the vector cursor by inclination angles, and the relationship between the inclination angles and the rotation angle may be arbitrary (either linear or non-linear). In case of a linear relationship, the direction of the vector F is changed by .theta.=.alpha./.beta..phi. when a joy stick 106 is inclined by .phi., where .alpha. is a maximum change of direction of the vector F and .beta. is a maximum inclination angle of the joy stick 106. In case of a non-linear relationship, changes of .theta..sub.H and .theta..sub.V may be small when the joy stick 106 is inclined within certain angle range, and changes of .theta..sub.H and .theta..sub.V are large when the joy stick 106 is inclined by more than a predetermined angle. In this case, fine positioning as well as coarse positioning are facilitated. The input means 106 is not limited to the illustrated joy stick but any other means which can designate angles in two directions (two parameters). Continuous direction change is preferable, an example is a mouse.

FIG. 3 shows a block diagram of a configuration of one embodiment. A three-dimensional pattern to be displayed is sent from a host device such as a computer in a form of a graphic command prior development of pixels. The graphic command is supplied from the host device through a communication interface 301 and stored into a graphic command storage 304 under control of a control/processing unit 302, which performs shading processing and perspective conversion (three-dimension for two-dimension conversion) processing to the information in the graphic command storage 304 and stores the processing result, that is, image command development information into an image buffer 305.

On the other hand the control information from the input device 105 is supplied through an input device interface 303 and processed by the control/processing unit 302. The angle information from the direction input means 106 is converted to the conversion matrices R.sub.H and R.sub.V through processing to be described later and they are stored in a horizontal rotation conversion matrix (R.sub.H) storage 308 and a vertical rotation conversion matrix (R.sub.V) storage 309. The velocity information from the velocity input means 107 is converted to a magnitude of the velocity vector F which is stored into a vector cursor parameter storage 307.

The control/processing unit 302 perspectively converts the content of the vector cursor parameter storage 307 to two-dimensional information for the two-dimensional display device and stores it into the image buffer 306. The contents of the image buffers 305 and 306 are read out by display controls 310 and 311 and they are combined by a display controller 312 and converted to a form which is acceptable by a display device 313, and it is supplied to the display device 313. In this manner, the three-dimensional image is displayed on the two-dimensional screen.

FIG. 4 shows the content of the vector cursor parameter storage 307. The coordinate (Px, Py, Pz) of the vector cursor and the coordinates of the three vectors F, H and V of the vector cursor are stored therein. (At the start of the system, appropriate initial values are set to those coordinates.)

The vector cursor continues to move in accordance with the preset F even if no direction is given from the input device 105. The control/processing unit 302 periodically updates the coordinate of P in the vector cursor parameter storage 307 and updates the content of the image buffer 306. If there is an input from the input device 105, the information in the storages 307-309 are updated and the vector cursor moves at a velocity and a direction determined by F.

In order for the cursor to be viewed to move smoothly, it is preferable that a unit time is shorter than 1/30 second. While the velocity vector F itself has a magnitude which is proportional to the velocity, it may be displayed to be no smaller than a predetermined magnitude or may have a subsidiary arrow to show a direction. Then, it becomes easy to determine the direction of the vector F, when the velocity is small.

FIG. 5 shows a flow chart for moving the vector cursor. It shows how the vector cursor control information from the input device 105 is developed to produce P, F, H and V and how they are stored in the vector cursor parameter storage 307.

When a vector cursor is to be newly drawn (at an initial state or when the position after the movement is to be drawn a time T after the drawing of the vector cursor), the controller 302 checks the input from the input device 105.

First, whether or not there is a velocity update input from the velocity control 107 is checked (501), and if there is, the magnitude of F in the storage 307 is updated (502). If the velocity is a times as large as the previous one, the new vector F' is represented by

Then, the input from the direction control 106 is checked (503). If there is forward/backward input (h), .theta..sub.H is determined, and if there is leftward/rightward input, .theta..sub.V is determined by using the linear or non-linear relationship described above.

where fh and fv are relationships.

In order to obtain the rotation conversion matrices R.sub.H and R.sub.V from .theta..sub.H and .theta..sub.V, the following processing based on the following formulas may be carried out.

(In the following discussion, the isomorphic or homogeneous coordinate is used and each vector coordinate consists of four elements.)

When a rotation axis passes through a point (l, m, n, 1) and has a direction parallel to a vector N=(n.sub.x, n.sub.y, n.sub.z), the coordinate (X, Y, Z, H) of a point (x, y, z, 1) rotated by .theta. is represented as follows. ##EQU1## where R is a rotation conversion matrix which is represented as follows. ##EQU2## In the formula (5), for R.sub.H,

and for R.sub.V,

R.sub.H and R.sub.V thus obtained are stored in the storages 308 and 309, respectively (504).

The direction of the vector cursor (the direction of F) is determined from the formulas (4) and (5) by rotating F by .theta..sub.H around H (by using R.sub.H), and rotating it by .theta..sub.V around V (by using R.sub.V) (505). For other elements of the vector cursor,

In the formula (4), l, m and n are coordinates of the point P, that is, l=P.sub.x, m=P.sub.y and n=P.sub.z, where P.sub.x, P.sub.y and P.sub.z are components.

The P, F, H and V are stored in the parameter storage 307 shown in FIG. 4 (509).

Since the new vector cursor parameters have been determined, the control/processing unit 302 develops the vector cursor for two dimensional display to store it into the vector cursor image buffer 306. Because it is the development of the three-dimensional image to the two-dimensional plane, the perspective conversion is carried out as is done when the data in the image command storage 304 are developed into the image buffer 305 (510).

Thereafter, the presence or absence of the coordinate input request from the input device 105 by the switch 108 is checked (511), and if it is present, the coordinate P of the vector cursor is reported to the host device (512).

Then, the control/processing unit 302 repeats the steps 511 and 512 until the time to calculate and display the next position of the vector cursor comes (513).

The technique of perspective conversion and rotation referred to above have been known, for example, by the article "Mathematical Elements for Computer Graphics" D. F. Rogers and J. A. Adams, McGraw-Hill, 1976.

FIG. 6 shows a locus of a vector cursor when the above processing is carried out under the following condition from t=0 to t=9T.

.circle.1 At t=0, F is parallel to the y-axis (directions are equal).

.circle.2 At t=0, H is parallel to the x-axis (directions are opposite).

.circle.3 An operator continuously inclines the joy stick 106 of the input device 105 to attain .theta..sub.V =-5.degree.. No other operation is carried out.

.circle.4 Unit time for processing and drawing is equal to T.

In the present embodiment, the vector cursor to be displayed is represented by the mathematical attributes P, F, H and V, although they are not always necessary but any spatial image which allows easy estimation of relationship with P, F, H and V, for example, representation of an aircraft, may be used.

The velocity control 107 is provided to enhance the operability but it is not necessary for the purpose of the present invention. (Even if the vector cursor velocity is fixed, the vector cursor can reach any point in the three-dimensional space.)

Application of this invention is not limited in the use of two-dimensional screen. The present invention is also applicable to the three-dimensional display which utilizes hologram or polarization. In this case, the perspective conversion from the three-dimensional space data (in the storages 304, 307) to the two-dimensional display data (in the storages 305, 306) of the above embodiment, is not necessary.

In accordance with the present invention, designation of a position in three dimensional space displayed in a display apparatus can be done only by controlling two parameters. Thus, the operability for the operator can be improved.