US 4,179,823 AGrant
Real-Time Simulation of a Polygon Face Object System as Viewed by a Moving Observer
Issue Date:1979-12-25
•12 Claims
•13 Drawing Sheets
Abstract
The visual system within an aircraft flight simulation system receives flight data from a flight simulation computer, and terrain data from a gaming area data base. A computer within the visual system organizes this image data in a buffer memory according to a particular format, and forwards the image data to an image processor. The following types of data are formatted and processed: Position vectors, defining the changing position of the aircraft with respect to the origin of the terrain coordinate system. Rotational data, defining the changing attitude of the aircraft with respect to the terrain coordinate system. Initialization vectors, defining the position of the landmark points within the terrain coordinate system. The landmark points are translated into the aircraft coordinate system to form translated vectors. Delta data, defining the position of other points, lines, and faces with respect to the landmark points. CIF data, defining color, intensity, defocus, etc. of individual lines and points and the texture within each face. Transfer data, which is coded to identify the data thereafter. The image processor translates delta data into face vertex vectors, defining the position relationship between the vertices of each terrain object and the aircraft. The image processor then rotates the face vertex vectors into channel vectors and clips the data outside the field of vision. The image processor then projects each three-dimensional channel vector into a two-dimensional display vector. Finally, the image processor generates raster scanlines and a display generator receives the display vector faces, and other image data to provide analog inputs to CRT devices which provide the window displays for the simulated aircraft.
Metadata
Assignee
- The Singer Company
Inventors
- John B. Sullivan
- David R. Marsh
- Raymond C. Osofsky
- Steven R. Bryan
- William D. Fahey
- David E. Manners
Application Information
Application Number:US 8692106
Filing Date:1978-01-13
Priority Date:1978-01-13
Art Unit:236
Classifications
IPC:
G09B 908H04N 718
Field of Search:
3535836410.2;12 N103;104515;522
Patent Drawings (13 sheets)
Description
BACKGROUND OF THE INVENTION
This invention relates to real-time digital image processing and display system of a gaming area as viewed from a maneuverable viewpoint, and more particularly to such an image system involving two-dimensional and three-dimensional structures displayed as faces.
Heretofore, digital image generation (DIG) has been used in architecture and mathematics to display three-dimensional objects. The viewer could maneuver the display to obtain different perspective views, helpful in building the objects or understanding the geometric relationship between parts thereof. However, these systems were basically nondynamic and lacked the realism of realtime maneuvering.
DIG has been employed in real-time flight simulation applications as taught in the following patents:
U.S. Pat. No. 3,996,672 to Osofsky et al concerning a DIG point system for displaying the night runway lights etc. of a landing field.
U.S. Pat. No. 3,999,308 to Peters concerning the point system of U.S. Pat. No. 3,996,672 with special texturing of the runway surface horizon, and illumination by the aircraft landing lights.
U.S. Pat. No. 4,027,403 to Marsh et al concerning the point system of U.S. Pat. No. 3,996,672 with directional runway lights.
SUMMARY OF THE INVENTION
It is therefore an object of this invention to provide a real time simulation visual system requiring a minimum of memory and circuitry.
It is another object of this invention to provide a polygon face visual system in which the data concerning each face is processed as a unit.
It is yet another object of this invention to provide a polygon face visual system in which the adjacent vertices of each frame are processed by the system and stored within the memory thereof in sequence.
It is still another object of this invention to provide a polygon face visual system in which each face is displayed by caligraphically painting within the polygon face outline as defined by the vertices thereof.
It is another object of this invention to provide a polygon face visual system in which adjacent faces of three dimensional structures are precisely displayed with respect to each other.
It is a further object of this invention to provide a polygon face visual system employing data compression by format techniques.
It is yet a further object of this invention to provide a polygon face visual system in which the image data is rapidly processed through hardwired circuitry.
DESCRIPTION OF THE FIGURES
Further objects and advantages of the present invention, and the operation of the visual system, will become apparent from the following detailed description taken in conjunction with the drawings, in which:
FIG. 1 is a block diagram of DIG visual system 10 and peripheral flight simulation equipment showing data flow relationships;
FIG. 2a is a pictorial representation of an aircraft and several terrain features illustrating the image vectors;
FIG. 2b is a diagram showing outcoding regions;
FIG. 3 is a block diagram of translation stage 60 wherein the delta data is translated into face vertex vectors Vf;
FIG. 4 is a block diagram of rotation stage 62 wherein each Vf is multiplied by an H matrix in response to the aircraft attitude to provide channel vector Vc(Xc, Yc, Zc);
FIG. 5 is a block diagram of clipping stage 63 which eliminates image data outside the field of vision;
FIG. 6 is a block diagram of projection stage 64 wherein Xc and Yc are divided by Zc to project Vc into the X-Y plane to form deflection vector (Vd);
FIG. 7 is a block diagram of edge stage 65 which identifies the edges of each polygon face and the slopes thereof;
FIGS. 8A to 8E are a logic diagram of processor control logic 70; and
FIG. 9 is a block diagram of miniraster calculator 72 which provides the starting points and widths of each scan line of the polygon face rasters.
GENERAL DESCRIPTION OF FLIGHT SIMULATION SYSTEM 10
FIG. 1 shows a flight simulation system 10 with visual capabilities provided by a digital visual system 12. A simulated aircraft 14 is linked to flight simulation computer 16 and visual system 12 through computer linkage 18. Flight computer 16 controls motion system 20 and instrument system 22 of aircraft 14 in response to the pilot's maneuvering action at aircraft controls 24. Visual system 12 is formed by general purpose computer 40 (such as Digital Equipment Corporation PDP 11/35) plus image processor 42, display generator 44, and interface controller 46. Interface controller 46 is provided to process flight data from aircraft 14 to image processor 42 and to control image data flow from GP computer 40 to image processor 42 via a data buffer.
GP computer 40 receives flight data, such as aircraft position Vp, aircraft roll, pitch, and yaw attitude (H matrix), etc. from computer 16. GP computer 40 additionally receives terrain data (both natural formations and cultural structures) from data base 48 such as runways, towers, hangers, roads, rivers, fields, moving objects, etc. In general visual system 12 may process and display terrain features consisting of points, lines, closed convex polygons, or combinations thereof. Preferably the aircraft position data is an aircraft position vector Vp extending from the simulated position of aircraft 14 to the origin of the terrain coordinate system (see FIG. 2). In order to simplify conception and data organization, the terrain origin is preferably located proximate the touchdown area of the runway, and the x axis of the terrain coordinate system from data base 48 is coincident to the runway centerline. An updated Vp is supplied each frame period by flight simulation computer 16 as the flight parameters of aircraft 14 change. The earth data also includes the position of certain landmark points (Vo) such as the first vertex of each face, and the relative position of the points forming other terrain features (delta data). Translation stage 60 subtracts Vp from each Vo to form translated vectors (Vt=Vo=Vp). Translation stage 60 combines the delta with the appropriate Vt to provide the remaining face vertex vector Vf for each face (Vf=Vt+delta data). Rotation stage 62 provides channel vectors Vc to projection stage 64 which project the three-dimensional Vc into two-dimensional display coordinates or vectors Vd. Edge stage 65 provides a list of visible edges defined by the end points and the slope. The data flow through image processor 42 and the mode of operation thereof is controlled by processor control logic 70.
Texture stage 72 within display generator 44 receives the visible edge list for coordination with the display raster. Deflection stage 74 provides the required analog deflection voltages to CRT display devices 82. Video stage 76 receives the color, intrinsic intensity and size portion of the data for controlling the CRT beam voltage, current and focus. The CRT in device 82 is preferably a beam penetration, random deflection tube which allows precise control of spot position, continuous control of spot focus and diameter.
DETAILED DESCRIPTION OF INTERFACE CONTROLLER 46 AND THE DATA FORMAT
GP computer 40 has an in-core, buffer memory which accumulates blocks of image data required to form each display frame. The incore buffer contains initialization points (Vo) and delta data from data base 48 plus each new position vector Vp and rotational matrix (H) as they are computed by flight computer 16.
The image data accumulating in the in-core buffer is periodically transferred as a data block to hardware RAM buffer 304 in interface controller 46. Controller 46 processes the data words sequentially to image processor 42 while GP computer 40 simultaneously assembles the next data block in the in-core buffer for the next data handshake with RAM 304. The accumulation of data blocks in GP computer 16 and the handshake data transfer to RAM 304 is outlined in the following four operations:
Operation I--Perflight Load--Data Base 48 to Core Memory
Prior to each training flight, the content of data base 48 is loaded into computer 40 core-memory. Image data from data base 40 includes sixteen control words (0000-1111) having bit formats as described hereinafter, initialization data Vo, delta data, etc.
Operation II--Aircraft Orientation Update
The in-core memory is updated periodically with the most recent aircraft orientation angles roll, pitch and yaw (H matrix data) from flight computer 16. Preferrably, this aircraft update occurs once each frame. The H matrix data is received by computer 40 as the sine and cosine of each of the three orientation angles--six items of data. The software of computer 40 responds to the orientation data to form the rotational matrix H described in the specification (Section IX). The software merely calculates the proper sine-cosine products to form a 3.times.3 matrix for each angle, and multiplies the three 3.times.3 matrices together to generate the nine elements of the rotational matrix H. These nine elements are generated each frame and inserted into RAM 304 at the proper place. The nine elements of rotational matrix H preferrably occupy the lead position in the core-memory because the rotational perspective must be developed by rotation stage 62 each frame prior to displaying any of the object faces on display 82.
Operation III--Aircraft Position Update
The core-memory update also includes the most recent aircraft position vector Vp which latter forms a series of initialization vectors Vo in translation stage 60.
Operation IV--Handshake Between Core-Memory and RAM 304
As required the contents of the core-memory matrix are serially transferred to RAM 304 in interface controller 46, starting with the nine rotational elements.
The four above described operations involve simple software steps. Operations I, III, and IV are merely data transfer steps. Operation II involves forming a triple 3.times.3 matrix product, a mathematical operation which is well understood. Subroutines are available to execute this systematic multiplication.
FORMAT SUMMARY
The data format is formed by groups of data words which describe the nature and position of each object feature, and spaced instruction words for identifying the type of data in the immediately subsequent group of data words. The MSB bits of each instruction word are coded to define the particular instruction contained in the word, and the remaining bits concern the subsequent data. In the embodiment shown, a sixteen bit format is employed. The four MSB define the instruction and are decoded by processor control logic 70 to control the flow of data through image processor 42. The four LSB of each instruction word reveal the number of subsequent data words in the data word group to be processed under that instruction word. Each instruction word is loaded into registers 310A and 310B by control logic 70 in due course, and the immediately subsequent group of data words in loaded into RAM 350.
FIVE LOAD INSTRUCTIONS (0-4)
Each load instruction transfers point coordinates from buffer 306 into RAM 350 as follows: ##EQU1##
Load All instruction causes the subsequent group of B sets of X, Y, Z coordinates to be stored in RAM's 350X, 350Y, and 350Z, beginning at address A. The first coordinate (one of two sixteen bit words) is stored in the RAM 350X, the second in the RAM 350Y, and the third in the RAM 350Z. This sequence is repeated until B sets of coordinates have been loaded starting at address A. R specifies the significance of the bits in the subsequent sixteen bit data words for coordinating the distribution thereof across the 24 bits of RAM's 350.
Normal 24 bit resolution (R=3) requires two subsequent data words. The first word provides the sixteen LSB to RAM's 350 and the second word provides the 8MSB to RAM's 350. Vp and Vo data require the full 24 bits and therefore are preceded by an LDA instruction word with R=3. The LSB of Vp preferably corresponds to 3/8 of an inch to eliminate detectable jitter of the scene from frame to frame. A new Vp is calculated by FS computer 16 each frame, and the round-off error in the LSB of Vp causes the entire earth coordinate system to jump a ground distance equal to the LSB. This interframe displacement (motion resolution) is minimized and rendered indetectable to the pilot trainee by providing aircraft position vector (Vp) resolution at the 3/8 inch level. The LSB of Vo is preferably small in order to accurately position detailed structure within a terrain feature (positional resolution). In the embodiment shown, Vo LSB also equals 3/8 inch because image processor 42 is already required to handle the 3/8 inch bit in order to prevent interframe displacement. That is, the position resolution may have the same value as the motion resolution as in the embodiment shown; but it is not required that the two resolutions be equal. However, a 3/8 inch Vo position resolution permits moving objects such as other airplanes and ground vehicles to be viewed without interframe displacement. The MSB of both Vp and Vo is 262,144 feet forming a cubic gaming volume in data base 48 which is 262,144 feet on an edge.
Fine 16 bit resolution (R=1) requires a single subsequent 16 bit data word of delta data which is entered into the 16LSB of 24 bit RAM's 350 (bits 16-23 are loaded with the sign bit 15). The MSB corresponds to 1024 feet (when LSB=3/8 inch). The fine 16 bit resolution may be used to process the vertices of small terrain faces (largest dimension less than 1024 feet) which is associated with high resolution detailed structure.
Coarse 16 bit resolution (R=2) requires a single 16 bit subsequent data word of delta data which is entered into the 16 MSB of 24 bit RAM's 350 (bits 0-7 are loaded with "0"s). The MSB=262,144 feet and LSB=8 feet. The coarse 16 bit resolution may be used to process the vertices of large terrain faces in which the dimensions have been rounded off to multiples of eight feet. While the size resolution of these faces is eight feet, they are positioned with the same resolution as the associated Vo. ##EQU2##
Load XY instruction causes the subsequent group of B pairs of X and Y coordinates to be stored in the RAM 350X and RAM 350Y, beginning at address A. "0"s are stored in the corresponding addresses of the RAM 350Z. The data format is one or two 16 bit words of X data followed by one or two words of Y data. This sequence is repeated until B pairs of X-Y coordinates have been loaded into RAM's 350X and 350Y. The R codes are the same as for LDA. ##EQU3##
Load X instruction causes the subsequent of B X coordinates to be stored in the XT RAM 350X beginning at address A. Zeros are stored in the corresponding addresses of RAM's 350Y and 350Z. ##EQU4##
Load Y instruction is the same as LDX except that the data is stored in RAM 350Y and "0"s are stored in the corresponding addresses in RAM 350X and RAM 350Z. ##EQU5##
Load Z instruction is the same as LDX except that the data is stored in the RAM 350Z and "0"s are stored in corresponding addresses of RAM's 350X and 350Y.
FIVE RECALL INSTRUCTIONS (5-9)
Recall instructions load the first vertice Vo of each face into RAM's 350 and initiates generation of the associated face. ##STR1##
Recall All instruction causes the single subsequent set of coordinates for the first vertice of a face, which typically is also an initialization vector Vo, to be loaded into the first location of RAM 350X, RAM 350Y, and 350Z. The other vertices of the current face have already been entered into RAM's 350 in CCW order as 16 bit coarse or fine data under one of the load instructions (0-4). These other vertices B are now recalled in CCW order from RAM's 350 beginning with address A of RCA. Normal 24 bit resolution (R=3) and coarse 16 bit resolution (R=2) have been previously described. S is a scale factor. When S=7, the current face is displayed full size. As S decreases the size of the current face is reduced by factors of 2. ##EQU6##
Recall XY instruction causes the single subsequent set of first vertice Vo coordinates to be loaded into the first address of RAM 350X and then the first address of RAM 310Y. RAM 350Z is unaffected. The face generation then proceeds as described under RCA. ##EQU7##
Recall X instruction causes the signal subsequent X coordinate of the first vertice Vo to be loaded into the first address of RAM 350X. RAM's 350Y and 350Z are unaffected. ##EQU8##
Recall Y instruction causes the single subsequent Y coordinate of the first vertice Vo to be loaded into the first address of RAM 350Y; RAM's 350X and 350Y are unaffected. ##EQU9##
Recall Z instruction causes the single subsequent Z coordinate of the first vertice Vo to be loaded into the first address of RAM 310Z; RAM's 350X and 350Y are unaffected. ##EQU10##
Recall Load instruction does not load any new data into RAM's 350 but is the same as RCX in other respects. RCL is used to hold the previous Vo in order to construct another face contiguous with or proximate to the previous face using the previous Vo as the first vertice or a landmark point for establishing the position of the vertices of the contiguous face.
OTHER INSTRUCTIONS ##EQU11##
Color Intensity Flag instruction is followed by B additional words, i.e., ##EQU12## which define the visual characteristics of each data base feature (face, line, or point). The visual characteristic of certain cultural objects such as signal beacons and runway lamps are a function of viewing direction and require directional data. SEL AXIS identifies the viewing axis to which the CIF data pertains:
SEL AXIS=00: the color and intensity of the object is uniform in all directions--ordinary object.
SEL AXIS=01: the color of the object depends on the direction of viewing along the X axis--bidirectional object.
SEL AXIS=10: bidirectional along Y axis.
SEL AXIS=11: bidirectional along Z axis.
S.+-.(SIGN.+-.) identifies the direction of view of the object along the axis identified by SEL AXIS. COLOR+ identifies the color of the object when viewed from the S+ direction, and COLOR- identifies the color of the object when viewed from the S- direction. COL SEL permits ordinary non-direction features to be displayed in a color from COLOR+ (COL SEL=0) or from COLOR- (COL SEL=1). I (INTENSITY) determines the intensity of the data base feature. When only an intensity change is required to display the current object, only CIFO (B=0) is employed. OBJ CODE identifies the type of object to be recalled:
The use of Recall instruction as illustrated in FIG. 2a is different for two dimensional faces on the X-Y ground plane (which always face the observer) and faces of a 3 dimensional object (which are sometimes occluded), as illustrated in FIG. 2. Two dimensional faces are identified by a 2D face object code in the previously loaded CIFI data. RCX computes the vertices of each face by starting with the X, Y, Z coordinates of Vo stored in the first address of RAM's 350 and combining additional vector coordinates from RAM's 350 starting at address A. B is the number of vertices in the face, and, since Vo is the first vertex, B-1 additional vectors (Delta V1, Delta V2, . . . Delta VB-1) are required to generate the other vertices. The vertices are always stored and retrieved in counter-clockwise order. Three dimensional faces are identified by a 3D object code. Vo is not used as a vertex for 3D faces, so that B additional vectors (Delta V1, Delta V2, . . . Delta VB) are required to display a face having B vertices. The RAM addresses containing the additional vector coordinates for 3D faces are provided by one or two data words 3DV1 and 3DV2 following the X data word or words. Each additional vector in 3D recall describes the position of a vertex with respect to Vo as opposed to a 2D recall, in which each additional vector describes the position of a vertex with respect to the previous vertex. The address format for additional 3D vectors in RAM 350 is ##STR2## If the face has four or fewer vertices, only the first word is used. The order in which the RAM 350 addresses are used is reverse alphabetical. For example, when recalling a face having five vertices, the first vertex will be computed using the vector stored at E. The last vertex is always stored at A. A in the RCX instruction is also the address of the normal vector stored in normal RAM 440N. The normal vector is used to test the visibility of a face and must have been previously loaded in normal RAM 440N using a LDN instruction (described hereinafter). Scale factor is the same for a 3D face as for a 2D face.
FB identifies data fed back for CRT correction to eliminate ballistic nonlinearities and provide a true display.
IOS identifies data displayed on the instructor's monitor 28 only.
VER RES determines the scan line density (vertical display resolution in horizontal lines per vertical scan).
Load Correct Data instruction enters C vertices with corrected CRT coordinates. ##STR4##
Control String instruction causes the display of string of C equally spaced lights or four-sided two dimensional faces, depending on the CIFl OBJ CODE. The first light of a string is displayed at the Vo+A position and a spacing vector stored at A+1 is used to fix the position of the second light and all successive lights until C lights have been displayed. The first vertex of the first face of a string of faces is displayed at the Vi+A position and the other three vertices are found successively adding the vectors stored at RAM's 350 addresses A+1, A+2, and A+3. The vector stored at A+4 locates the first vertex of the next face with respect to the last vertex of the current face. ##STR5##
Control Load H instruction loads the H rotation matrix on data bus 307 into RAM 410H in rotation stage 62. The elements of the rotation matrix are in 16 bit 2's complement form, and each address of RAM 410H will store three elements. The rotation matrix multiplies the translated X, Y, and Z coordinates in the following form: ##STR6## The element data follows the LDH instruction in the following order:
h31, h32, h33, h21, h22, h23, h11, h12, h13.
The matrix is always stored in the first three addresses of RAM 410H, so A=0, the initial address and B=3, the number of matrix rows. C is the channel number associated with rotation matrix. ##STR7##
Control Load N instruction loads B face normal vectors on data bus 307 into normal vector RAM 440N in rotation stage 62, starting at address A. Each vector consists of three 16 bit data words in order Nx, Ny, Nz. The Control Load N will therefore always be followed by three B words of data. Each address in normal RAM 410N is associated with a three dimensional face of identical address in RAM's 350. Both RAM's are addressed during the Control Recall of a 3D face.
DETAILED DESCRIPTION OF DIGITAL VISUAL COMPUTER 12
Each stage of digital visual system 12 is shown in detail in FIGS. 3 through 9. Preferred embodiments are disclosured at the detailed logic level. Each component is described by function, input-output characters, or conventional nomenclature to enable one skilled in the arts of simulation, digital design, and computer programming to practice the invention. The components are additionally designated by the manufacturer's IC type number from the following integrated circuits data books:
Texas Instruments Incorporated "The TTL Data Book of Design Engineers" First Edition, Copyright 1973
National Semiconductor Corporation "Digital Integrated Circuits" January 1974
Advanced Micro Devices Inc. "Advanced Micro Devices Data Book" Copyright 1974
unless otherwise specified. Further, many inverters are employed throughout CDIG system 10 for buffering signals with multiple loads. These buffer inverters are type 74S04 unless otherwise stated.
TRANSLATION STAGE 60
GENERAL OPERATION
FIG. 3 shows translation stage 60 of image processor 42 and a portion of controller 46. Controller 46 receives image data in sequential order from computer 40 at input 302 of random access memory 304. The image data is arranged in data blocks M bits wide and N words long, which in the embodiment shown is 16.times.1024. RAM 304 periodically handshakes with a core memory in GP computer 40 to reproduce each block of data. Image data is sequentially transferred from RAM 304 through a buffer register 306 to image data bus 307 in response to load pulses from interface controller 46.
Each instruction word on bus 307 is loaded into instruction registers 310 A and B which forwards the code bits (four MSB's) to control logic 70. Control logic 70 then selectively activates the remaining blocks of translation stage 60 for processing the subsequent B words of data appropriately. Load instructions (0-4) cause control logic 70 to send WRITE to RAM's 350, which then writes the subsequent B data words starting at ADDRESS A. Counter 320A increments ADDRESS A while counter 320B decrements down from B. When the B count expires, B=0 is forwarded to logic 70 and the next instruction is loaded into instruction registers 310.
Vp is loaded into RAM's 350 by a Load A instruction (R=3) immediately after each handshake, and Vp is always positioned at the same address (address 1). Next, B words of delta data vectors is entered by another load instruction.
Recall instructions (5-9) load the Vo associated with the previously loaded B words of delta data. Each Vo is positioned at the same address in RAM 350 (address 0). The recall instruction causes control logic 70 to forward READ to RAM's 350, and the B words of delta delta are recalled from RAM's 350 and processed through the remainder of translation stage 60.
CIF instruction causes control logic 70 to forward LOAD to CIF register 330 to receive SEL AXIS, SIGN.+-., and Intensity data from instruction registers 310. B subsequent data words are entered into CIF-1 register 331 and CIF-2 register 332 where the CIF data is temporarily held. The CIF data is advanced into corresponding CIF registers 460 in rotation stage 62 as Vf data enters rotation stage 62 from normalization register 380.
Three dimensional vertex registers 341 and 342 receive the addresses of vertices of 3D faces in RAM 350. The addresses in registers 341 and 342 address RAM's 350 via address counter 320A.
RAM's 350 write image data from interface controller 46 after load instructions and read image data after recall instructions. RAM's 350 temporarily store Vp and delta V's until the associated Vo is entered permitting the faces to be generated.
Scalers 360 (X, Y, and Z) control the size of the displayed image by expanding or contracting the X, Y, and Z position coordinates by factors of two. S data from register 310B shifts the binary decimal point to effect the scaling.
Accumulators 370 receive the X, Y, and Z position coordinates and perform the following translation computations (illustrated in FIG. 2):
Normalization registers 380 (X, Y, and Z) loads the translated vertices Vt, and left shifts leading zeros (or ones for negative Vt's) in response to control logic 70. The first difference between the MSB and the second MSB in any of the normalization registers 380 generates a normalization complete signal, (NCS), back to control logic 70. Normalization complete in any of the normalization registers 380 stops the normalization process of all the registers insuring that the normalized points maintain consistent dimension units and remain on the same line of vision as viewed on display 82. Normalization has the advantage of reducing the 24 bit input image data into bits of normalized image data by eliminating either leading zeros (or ones for negative numbers). The data load is reduced to 66% with negligible loss in position resolution.
DETAILED DESCRIPTION
RAM 304 may be formed by a 16 bit.times.24 word RAM (sixteen 93415's, Fairchild) for holding the block of image data from GP computer 40.
Buffer register 306 may be formed by a 16 bit register (four 74S175's) followed by buffer inventers as required (74S04).
Register 310A may be an eight bit register (two 74S175's) for receiving four bits of code (4MSB) and four bits of RAM address (4LSB).
Register 310B and word counter 320B may be formed together by an eight bit down counter (two 74S163) for receiving the compliment of B and counting to 15. At B compliment=15, B=0 appears on the carry out terminal.
Address counter 320 A may be a 2:1 inverting multiplexer (74S158) followed by a four bit up counter (one 74S163). During load and recall instructions, counter 320A increments the start address AAAA to RAM's 350. While processing three dimensional faces counter 320 A processes the face vertex addresses in three D registers 341 and 342.
CIF register 330 may be an eight bit register (two 74S175) for receiving eight bits of SEL AXIS, S.+-. and Intensity Data from the CIF Load instruction.
CIF-1 and CIF-2 registers 331 and 332 may be 16 bit registers (four 74S174) for receiving two 16 bit words of CIF data immediately following the CIF instruction.
Three dimensional registers 341 and 342 may be eight 4 bit tristate registers (eight 8551) preceded by a 3 line to 8 line decoder (one half 74S139) which enables one of the eight tristate registers in response to the three LSB's of B from word counter 320B.
RAM 350X may be a 24 bit RAM (six 74S189's) to accomodate the 24 bits of X coordinate image data. The 24 bit RAM is preceded by a 2:1 8 bit multiplexer (two 74S158) between a pair of true compliment zero one elements (two 74H87's each). During 16 bit fine resolution (R=1) the right hand zero one element forwards the 8LSB's of the image data to the 24 bit RAM, and the righthand zero one element enters all zeros (or all ones depending on the sign of the image data). During 16 bit coarse resolution (R=2) the right hand zero one element enters all zeros and the lefthand zero one element forwards the 8 MSB's.
Scaler 360x may be formed by a flow through right shifter device (twelve 25S10's AMD) in response to S data from register 310B counter.
Accumulator 370x may be a 24 bit adder (six 74283's) for receiving data at the A input, followed by a 24 bit return register (six 74S175's) which outputs to the B input. Vp is processed through the adder and return register, and returned to the B input. Vo is loaded at the A input and added to Vp to form Vt and returned to the B input. Delta data is then loaded at the A input and added to Vt to form the remaining vertice vectors Vfl-Vfn, which are advanced through the return register to a 24 bit buffer register (four 74S174's) where the Vf's are held until normalizer 380x is free.
Normalizer 380x may be formed by a 24 bit shift register (three 74199) plus a Buffer register (four 74S174's) which holds the normalized Vf's until rotation stage 62 is free to handle the next Vf.
ROTATION STAGE 62
GENERAL-H MATRIX
FIG. 4 shows rotation stage 62 of image processor 42 which multiplies the translated point vectors Vfl-Vfn from translation stage 60 by the rotation matrix H provided on data bus 307 to produce a rotated or channel vectors Vc (XcYcZc):
Each channel corresponds to the perspective view from one window of aircraft 14.
The rotation matrix H is developed from yaw (Y, left), pitch (P, down), and roll (R, right) motions by flight simulator 16 using conventional software. The order of rotation is Y followed by P, and the matrices for the separate rotations from translated to rotated pilot eye or channel coordinates are as follows:
The composite matrix H describing this rotation is given by the matrix product:
The aircraft attitude H is constant for each frame and is therefore computed only once per frame for each channel.
The three elements of the first column of the H matrix are entered into H RAM 410x by WRITE from control logic 70 immediately subsequent to the Load H instruction. The first column is then multiplied by the Xf coordinate of each of the translated vector series Vfl-Vfn in turn within column multiplier 420X. The three elements of the second and third columns of [H] are similarly entered into H RAM 410Y and 410Z (not shown). The nine products generated above are combined into Xc, Yc, and Zc by row multiplexer 424 and adder 430. The resulting Vc is forwarded to clipping stage 63.
GENERAL-VISIBILITY TEST
The rotation circuitry also provides the multiplication for the dot product visibility test for the faces which form three dimensional structures such as buildings:
Vt dot Vn=M cos P
where:
Vt is the translated vector extending from aircraft 14 to the first vertex of the face being tested; and Vn is the vector normal to the face being tested.
When cos P is negative, P is greater than 90.degree. and the face is visible--on the front or exposed side of the building. When cos P is positive, P is less than 90.degree. and the face is invisible--on the back side of the building. The sign bit of the dot product is employed for back side elimination--a simple occulting technique.
The Xn, Yn, and Zn coordinates of Vn are entered into N RAM's 410X, Y, and Z respectively immediately subsequent to the Load N instruction. Each coordinate is multiplied by the corresponding coordinate Xt, Yt, and Zt of Vt in multipliers 420 and the sign bit of the resulting quantity is forwarded to control logic 70.
DETAILED DESCRIPTION
H RAM 410x may be a 16 word by 16 bit sequential access memory (four 74S189's) for holding the three words in the first column of the 3.times.3 H matrix and providing 13 spare 16 bit addresses. WRITE and ADDRESS are provided by control logic 70.
N RAM 410x may be a 16 word by 16 bit random access memory (four 74S189's) for holding up to sixteen words of Xn which accomodates a three dimensional complex structure with up to sixteen faces.
Multiplicand register 414x may be a 16 bit buffer register (four 74S175's) for holding the current output of H and N RAM's 410x available to multiplexer 420x while the next address in RAM's 410x are accessed.
MUX 416x may be a 16 bit dual 4-1 multiplexer (three 74S153's) for providing four bits of output plus carry over bit.
Multiplier register 418x may be a 5 bit buffer register (one 74S174) for holding the output of MUX 416x available to multiplier 420x.
Column multiplier 420x may be formed by eight AM 25S05's (Advanced Micro Devices in 16 bit.times.4 bit configuration) followed by a buffer product register (three 74S175's) and operates as described in connection with Multiplier 330 in U.S. Pat. No. 3,996,672 which issued December 14, 1976.
Row Multiplexer 424 may be a 20 bit 4 to 1 multiplexer (ten 74157's connected in parallel) which sequentially select the first row elements of each column for summing in row adder 430 to form Xc. The second and third row elements are likewise summed to provide Yc and Zc.
Row adder 430 may be a 20 bit adder (five 74783's) for summing the row products of the H matrix.
Accumulator 440 (three 74174's) returns intermediate sums to multiplexer 440 which are required in forming Vc.
Buffer registers 450 may be 18 bit registers (four 74175's) for holding Vc (Vx, Vy, Vz) prior to clipping.
CIF register 460 may be a 40 bit register for holding the CIF data from CIF registers 330, 331, and 332.
CLIPPING STAGE 63
GENERAL
FIG. 5 shows clipping stage 63 which eliminates points outside the viewing volume or pyramid of vision 250 shown in FIG. 2a. Pyramid of vision 250 has its vertex at the eye of the pilot (origin 220). The viewing volume in the embodiment shown is four sided, bounded by four planes defined by the four sides of the aircraft window.
Clipping is accomplished at the object face level. Vertices defining each face edge are processed in sequence through clipping stage 63 to determine whether the face is:
Case A--face completely within view,
Case B--face partially within view, or
Case C--face completely out of view.
Faces which are only partially in view (Case B) are intercepted by the sides of pyramid of vision 250. In the process of clipping, Case B faces are modified by the addition of new edges. The result is a modified closed polygon face that is completely within pyramid 250.
The position of any point or vertex relative to pyramid of vision 250 is defined by the distance of that vertex from each of the four sides of pyramid of vision 250. Referring to FIG. 2a point 254 forming the top of the flag pole 256 is positionally defined by the four window coordinates vl, vr, vb, vt in Zc plane 260. These window coordinates are calculated as follows:
vl=Kl Z+X
vr=Kr Z-X
vb=Kb Z+Y
vt=Kt Z-Y where the K's are constants associated with the vertex angles of pyramid 250. For a square pyramid of vision having equal vertex angles A, Kl=Kr=Kb=Kt=Tan (A/2). A point is inside the truncated pyramid of vision 250 if vl.gtoreq.0, vr.gtoreq.0, vb.gtoreq.0, vt.gtoreq.0, and Zc>0.
The above window coordinates are calculated from Vc by window logic circuits 510-l, 510-r, 510-b, 510-t, and 510-z shown in FIG. 5 (only 510-l is shown in detail). Window circuit 510-l receives Xc and Zc from l:r multiplexer 520 for temporary storage in interior working registers 530. Adder 540 and inverter 544 cooperate to perform the required addition. Window coordinates vl and vt are forwarded to projection stage 64 to become display coordinates Xd and Yd, and Zc is forwarded for range attenuation effects.
The signs of the window coordinates are combined in a single five-bit out-code (OC):
OC=sign l, sign r, sign b, sign t (and sign Z)
where the sign of each window coordinate is "0" for positive and "1" for negative. The origin of each window coordinate is the corresponding boundary of image window 262 with the negative direction extending away from image window 262 (see FIG. 2b, left for vl, right for vr, down for vb, and up for vt). The positive direction for each window coordinate is toward the center of image window 262. The four boundaries of pyramid 250 subdivide the positive half-space in front of aircraft 14 into nine regions. The out-code of each Vc identifies the region in which the point or vertex is located. The out-code for each region of the two-dimensional projection of pyramid 250 is shown in the following table:
The relative position of any face edge to pyramid 250 can be found by examining the outcodes of the end points of the edge. If both vertices are behind the Zc=0 plane (that is behind the pilot's eye where Zc is negative), then sign Z(1)=sign Z(2)=1 and the face edge is not visible and can be rejected. If both vertices are in front of the Zc=0 plane (in front of the pilot's eye where Zc is positive), then sign Z(1)=sign Z(2)=0. If the face edge intersects the Zc=0 plane, then sign Z1.noteq.sign Z2. The intersection is found and only the portion of the edge extending in front of the pilot's eye need be considered.
(A) Let the window coordinates of the vertex inside image window 260 be Vin and the outside coordinates be Vout.
(B) The midpoint between Vin and Vout is calculated.
(C) If the midpoint is within pyramid 250, Vin is replaced by the midpoint.
(D) If the midpoint is outside, Vout is replaced by the midpoint.
(E) The process continues until the distance of the midpoint from one side of pyramid 250 is less than the termination tolerance.
There remains the problem of modifying the edges of clipped faces. In some situations the intersections of the face edges and pyramid of vision 250 define the new face edge. In other situations one or more corners of the window must be inserted into the sequence of vertices to complete the closed polygon face.
In a special case all vertices are outside pyramid 250 and the edges do not intersect pyramid 250. There remains ambiguity as to whether the face is within view. Referring to FIG. 2b showing image window 262, 4 rays (R1, R2, R3, and R4) extend from the four corners (C1, C2, C3, and C4) of window 260. If a ray is intersected an odd number of times by the edges of the polygon face, then the corresponding corner is surrounded by the polygon. This technique can be implemented by inspecting the out-codes of the adjacent vertices defining each edge. The criterion for crossing the rays is very similar to the rejection criterion and is obtained by logical operations. As an example, R1 is crossed if sign t(1)=sign t(2)=1 and sign 1(1).noteq.sign 1(2).
Three further possibilities for the relative position of a face edge with respect to pyramid 250:
Case 1: Both ends of the face edge are within view. No clipping is necessary: OC(1)=0000(0), OC(2)=0000(0).
Case 2: One end of the face edge is within view and the other end is outside. The face edge intersects pyramid 250: OC(1)=0000(0) and OC(2).noteq.0000(0) or OC (1).noteq.0000(0) and OC(2)=0000(0).
Case 3: Both ends are outside pyramid of vision 250: OC(1).noteq.0000(0) and OC(2).noteq.0000(0).
In Case 3, definite decisions can be made only if the end points of the edge are either both to the right or both to the left (sign 1(1)=sign 1(2)=1(negative) or sign r(1)=sign r(2)=1(negative)). Furthermore, if OC(1)=OC(2).noteq.0000, both ends are outside, in the same region. In all these cases the face edge can be rejected. The rejection criteria can be expressed as a Boolean function (R) of the two out-codes. If R=0, none of the above rejection criteria are satisfied, and a part of the face edge boundary may go through image window 260.
Whenever Case 2 is found in the clipping process, the intersection of each face edge and pyramid of vision 250 is determined by window circuits 510 and the clipping portion of control 70 using a binary search technique. The algorithm for the search is as follows:
PROJECTION STAGE 64
GENERAL
FIG. 6 shows projection and clipping stage 64 of image processor 42 which projects three-dimensional window coordinates vl, vt, and Vz from clipping stage 63 into a two-dimensional vector Vd (Xd, Yd). The projected vectors Vd define the end points of each face edge for face generation stage 65. The projection is accomplished by dividing vl and vt by Zc through a binary division nonrestoring technique (described in "Digital Arithmetic-I" by Y. Chu pages 39-43). Z/2 registers 610-l and 610-t load the divisor Zc/2, and MUX/Register 620-l and 620-t select and load the dividend vl/2 and vt/2 in response to control logic 70. The inputs to registers 610 and 620 are right-shifted by one digit to establish the division by two. Arithmetic logic unit ALU 630-l and 630-t then receive the dividends through shift return loops 623-l and 623-t, or subtract Zc/2 thereto in response to a .+-. function from logic 70. The dividend .+-.Zc/2 term is loaded into MUX's 620, returned to ALU's 630, and then combined with another .+-.Z/2. The output of ALU's is slew wired with respect to the input to MUX's 620 causing a division by two right shift. The vl/Vz and vt/Vz quotients are generated one bit at a time, MSB first, by comparing the sign bit (MSB) of Zc with the sign bit of the partial remainders with MUX 620 through sign gates 636-l and 636-t. The quotient bits individually enter quotient registers 640-l and 640-t, and are left-shifted by control logic 70. Zc on line 592 from range register 590 is loaded into renormalization register 650 and right-shifted by control logic 708 the same number of places as were left-shifted in normalizer 370 in translation stage 60. Color, intensity, and flag data on line 592 from CIF register 590 is loaded into CIF register 660 in response to control logic 70.
DETAILED DESCRIPTION
Z/2 register 610 may be a 24 bit register (four 74S174's).
MUX/Registers 620 may be 24 bit 2:1 multiplexers (five 74S298's) with storage.
ALU's 630 may be 16 bit flowthrough arithmetic logic units (four 74S181's + one 74S182).
Sign gates 636 may be exclusive OR gates (74S86).
Quotient registers 640 may be 12 bit shift registers (three 74164's) for receiving the projected data Xd and Yd one bit at a time as it is generated by ALU's 630.
Zc register 650 may be a 24 bit shift register (six 74S195's).
CIF register 660 may be a series of 74Sl74's.
EDGE STAGE 65
GENERAL
FIG. 7 shows edge stage 65 having Xd processor 706X and Yd processor 706Y which receive projected face vertex coordinates (Xd and Yd) from projection stage 64 and provides face edge lists to display generator 44. Each edge is defined by edge data including a starting point (Xds, Yds), the Y coordinate of the termination point (Ydt), plus the slope of the edge (delta X/delta Y).
The Y coordinates of each set of face vertices (Xd and Yd) are loaded into current Y mux-register 710 and advanced to previous Y register 716 in CCW order as defined in data base 48. Each current Y coordinate (Ydc) and previous Y coordinate (Ydp) are forwarded to added 720 for calculating a delta Y for each face edge or pair of points (delts Y=Ydc-Ydp). Simultaneously, each Ydc and Ydp are entered into Y start multiplexer 730s and Y terminate multiplexer 730t. The starting Y coordinate Yds is the end point of each face edge that is scanned first on CRT 82; and the terminate Y coordinate Ydt is scanned last. In the embodiment shown, the conventional top to bottom scan is employed. Therefrom, the start point Yds is always the smaller of the two adjacent points Ydc and Ydp. The sign bit of delta Y (SIGN .DELTA.Y) defines which is smaller, Ydc or Ydp, as follows:
and activates multiplexers 730s and 730t accordingly. Slope divider 740 provides the slope of each edge face by computing delta X/delta Y for the corresponding pair of vertices.
The face edges are arranged in scan order by Yds sorter 750 according to the smallest Yds. Each edge data set is loaded into sorter 750 in CCW order and forwarded to image generator 44 in order of smallest Yds for accomodating the top to bottom scan.
DETAILED DESCRIPTION
Xd processor 706X has the same hardware as Yd processor 706Y, and is therefore not shown in detail.
Current Y mux-register 710 may be a 12 bit 2:1 multiplexer-register (three 74298's) for the current vertex of each face as the vertices are received in CCW order from quotient registers 640-l and 640-t.
Previous Y register 716 may be a 12 bit storage register (two 74174's) for holding the vertex just preceding the current vertex.
First vertex Y register 718 may be a 12 bit storage register (two 74174's) for holding the first vertex while the intermediate vertices are processed. The first vertex is loaded into current mux-register 710 as the last vertex is advanced to previous vertex status to form the last edge of the face.
Adder 720 may be a 12 bit adder (three 74283's) for calculating delta Y=Ydc-Ydp, and forwarding SIGN Y to Y and X multiplexers-registers 730s and 730t.
Inverter 722 may be a 12 bit inverting buffer (two 74S04's) for inverting Ydp into -Ydp. The carry in on adder 720 is forced to 1 to complete the complement of Ydp.
Start point and terminate point multiplexer-register 730 may be 12 bit 2:1 multiplexer-registers (three 74298's each) for simultaneously holding both Ydc and Ydp available for selection as either Yds or Ydt.
Delta Y register 724 may be a 12 bit storage register (three 74S175's) for holding delta Yc while divider 740 forms the slope (delta Xp/delta Yp) for the previous edge. Additionally register 724 may include a zero detect circuit (one 74S30) for providing delta Y=0 to control 70 when the slope is horizontal and the edge may be omitted from further processing.
Divider 740 may be a 12 input bit-20 output bit binary division nonrestoring divider as described in projection stage 64, for calculating slope=delta X/delta Y. The dividend delta X may be right shifted into additional shift register (one 74166) for scaling down the resulting slope to accomodate a Y increment of one raster line. In the embodiment shown the right shift is nine places to accomodate a 1024 scan line, interlaced display (2 to the 9th=512).
Sorter 750 may be a 12 bit key-96 bit non key sorter for output edge data in order ascending of Yds, formed by:
(a) a 16 word 12 bit key data RAM (three 74S189's) for receiving and storing the key data (Yds) in input order.
(b) a 16 word 5 bit pointer RAM (two 74S189's) for storing the RAM pointers.
(c) a three level pointer pushdown stock (two mux-registers 74298's--first level, one 74S174--second level, and one 74S174--third level) for manipulating pointers into sorted order each time a new key is received by the key data RAM.
(d) address counter (one 74161) and smallest key pointer register (one 74S174) for generating RAM addresses and storing the current smallest key RAM address.
(e) RAM address multiplexer (two 74S153's) and a pointer RAM input multiplexer (three 74S153's) which cooperates with the three level stack and address counter for selecting RAM addresses and the pointer RAM input.
(f) an existing key register (three 74S175's) and comparator (three 74S85's) for determining where to insert the input key among the existing key in the key data RAM. The existing key register also stores key data to be advanced to image generator 44.
(g) non key data output register (twenty-four 74S175's) for storing non key data (Xds, slope, Ydt, Zc, and CIF) to be advanced to image generator 44.
CONTROL LOGIC
Processor control logic 70 responds to instruction code and data flags contained in the data flow from data base 48 for processing the coordinate data through image processor 42. The flow tables described below disclose the logic involved in controlling each stage of image processor 42. Various hardware circuit configurations could incorporate this logic.
XII. COLOR INTENSITY FLAG--CIF (11)
In this instruction the CIF registers are loaded with CIF data from bus 307. Word counter 320B is decremented after each load until B=0.
XIV. STRING INSTRUCTION--STG (12)
In this instruction the initial face of a string of faces is processed from RAM 350 through translation stage 60 into rotation stage 62 as a string of light points or four sided faces. The vertices of the four sided faces are retrieved from RAM 350 in CCW order as described in "XI. RECALL A--RCA (9)."
XV. LOAD H--LDH (13) AND LOAD N--LDN (14)
In this instruction data is loaded into H/N address register 3 from data bus 307, and then into H/N RAM 410 as described in Section VI. H/N Ram 410 receives the data during an idle portion of its cycle.
ROTATION STAGE 62
FIG. 8A shows the logic-diagram for the processing of translated point coordinates (Vt) from translation stage 62. Each new Vt is loaded into multiplexers 416X, Y, and Z (Step I). The object code in CIF register 460 which accompanies each new Vt is examined to determine if the new Vt is associated with a 3D face requiring visibility testing (Decision A). If so, the dot product of Vt.Vn (from N RAMs 410X, Y, and Z) is calculated (Step II). The sign bit of the dot product reveals whether the 3D face is visible or not (Decision B). The vertex of visible 3D faces (Decision B-yes) and the remaining non-3D face vertices (Decision A--no) are multiplied by the three x three H matrix in H RAMs 410X, Y, and Z to provide the rotated vector Vc-Zc first, Yc second, and Xc last (Step III). Each coordinate is loaded into registers 450X, Y, and Z as they are calculated (Decision C and D, Steps IV, V, and VI).
CLIPPING STAGE 63
FIGS. 8 B and C show the logic diagram for the control of clipping stage 63. The first point coordinates are loaded into multiplexers 520 (Step 2) and the outcode (OC) for each point is determined by window circuits 510. The object code in CIF register 590 is examined to determine whether the first coordinate is really a polygon vertex (or line end point) or merely a single light point (Decision A). In the case of vertices (and end points), the next vertex (or other end point) is loaded and outcode (OC) determined (Step 4). The OC's are examined to determine if the edge defined by the two vertices crosses the Z=0 plane (Decision C). If the edge crosses the Z=0 plane, then the intersection point is determined by a binary search (Step 5). If the edges do not cross the Z=0 plane, then the OC's of both points are examined to determine if they both are in front of pilot's eye 220 (Z=0 plane) or behind pilot's eye 220 and therefore definitely not visible (Decision D). The endpoints of edges which intersect the Z=0 plane or which are completely in front thereof, are examined via their OC for visibility (Decision F, G, and H, and step 8). If both endpoints are out of view (Case 3) the OC's are examined to determine if clipping is required (Decision I). If both endpoints are in view (Case 1) or otherwise do not require clipping, the next vertex coordinates are loaded. If only one vertex is in view (Case 2) or clipping is otherwise required (Case 3), the edge is processed through the appropriate series of binary search routines based on the OC's (Decision J). The binary search routines determine the interception points of the edge with the left, right, bottom or top boundaries of image plane 262. Each interception point becomes a new vertex of a new polygon formed by the visible portion of the original polygon face.
EDGE STAGE 65
FIG. 8D shows the logic diagram for the control of projection stage 64, processor 706X and Y, and slope divider 740. The clipped points from clipping stage 63 are loaded into registers 610 for projection division (Step 1). The quotients (projected points) are forwarded from registers 640 to edge stage 65, where it is examined for face data (Decision A). Non face data such as points and line segments are forwarded immediately to FIFO memory 910. Each face data point is examined for a first vertex (Decision B), which are loaded in V1 register 718 and current Yd multiplier register 710 (Step 2). Each non first vertex is loaded into register 710 as the current Yd and the previous Yd is advanced to register 716 (Step 3). Xd is similarly processed through processor 706X. Delta X and delta Y are calculated from their current and previous values, and loaded into registers 724 (Step 4). When the last vertex becomes the previous vertex in register 716 (Decision C), the face is closed by advancing V1 from register 718 to register 710 as the current vertex (Step 5). The last slope is calculated from the previous vertex (Vlast) and the current vertex (V1) and entered into register 724. The slopes are calculated by slope divider 740 as the delta X's and delta Y's are provided (Step 6).
TEXTURE STAGE 72
FIG. 8E shows the logic diagram for the control of Yds sorter 750. Input face edges are loaded into sorter 750 and examined for horizontal edges--delta Y=0 (Decision D). Horizontal edges are forwarded to FIFO memory 910 (Step 7). The non horizontal edges are examined for a first edge (Decision E). The first edge is entered at the start of the sort list (Step 8). Non first edges are examined to determine whether the input Yds is less than the last or output Yds in sorter 750 (Decision F). Smaller input Yds are entered at the start of the sort list (Step 9). Larger Yds are examined for a last edge (Decision G). Last edge is entered in last place of sort list (Step 10). The second edge is loaded (Step 11) and examined for input Yds less than the last Yds in sorter 750 (Decision H). Smaller Yds are inserted in the sort list (Step 12). Larger Yds are examined for last edge (Decision I). Last edges are entered into the sort list (Step 13). If the input edge is not the last edge, the next edge is loaded (Step 14). The input edge is again examined for a last edge (Decision J)--return to Decision D of flow chart for non last edge, and output sorter 750 to FIFO memory 910 for last edge.
DISPLAY GENERATOR 44
TEXTURE STAGE 72
Texture Stage 72, shown in FIG. 9, provides miniraster data for the set of horizontal scan lines forming each face. The miniscan lines progressively increase and/or decrease in response to the face edge list (Xds, Yds, Xslope, and Ydt for each edge) from face generation stage 65. The miniraster data for each miniscan line includes the Xd coordinate of the left hand end point (XdL), the width of the miniscan line (W), the Yd coordinate (Yd scan), Zc and CIF.
The edge list is loaded into memory 910 in ascending Yd order by face order once each frame, and extracted in the same order twice each frame--once for the field of even miniscan lines, and once for the field of odd miniscan lines. X coordinate generators 920L and 920R provide XdLc and XdRc respectively for each miniscan line by combining Xds with the Xslopes of the two opposed edges of the face which contain the end points of the scan line. XdLs is incremented by the left hand slope (XL slope) to form each XdL, and XdRs is incremented by the right hand slope (XR slope) to form each XdR. Only generator 920 is shown in detail. Slope multiplexer 928 divides the XL slope by two (select START) for the first scan line of the even field, to accomodate the one half scan height displacement between the interlaced odd and even fields on display 82. During the remainder of the display cycle, the XL slope is passed through slope multiplexer 928 without division (select ACC) to accomodate the proper height spacing between adjacent miniscan lines in the same field. Adder 930 combines the X coordinate of the previous scan line (XdLp) with the current XL slope to provide the current X coordinate (XdLc). Output multiplexer register 940 provides either XdLs (select START) or XdLc (select ACC) to miniraster data register 950. Subtractor 952 provides the width W of each scan line by subtracting XdLc from XdRc (output of generator 920R). The Y coordinate of the miniscan lines (Yd scan) is similarly formed by incrementing Yds with Yslope from Yslope generator 960. At the end of each edge, Yd scan equals or exceeds the Ydt on the left edge (YdLt) or right edge (YdRt). The signals Yd scan.gtoreq.YdLt and Yd scan.gtoreq.YdRt indicate to control logic 70 that the next XL slope or XR slope is required in Xd generators 920.
DETAILED DESCRIPTION
FIFO memory 210 may be a 2048 words.times.100 bits memory (two hundred 82S11's) for sequentially outputting the complete edge list twice each cycle. Memory 210 interfaces with the remainder of miniraster calculator 72 through a 100 bit register (twenty five 74S175's).
XL slope register 924 may be a 20 bit storage register (five 74S175's) for holding each new Xslope as they are provided by memory 910.
XL slope multiplexer 928 may be a 20 bit 2:1 multiplexer (five 74S157's) with the START input right shifted to provide a division by two. The START and ACC select are provided by control logic 70.
XL Adder 930 may be a 20 bit adder (five 74283's) for incrementing each previous X left coordinate (XdLp) by the current XL slope.
Limit multiplexer 934 may be a 20 bit 4:1 multiplexer (ten 74S153's) for preventing underflow and overflow when an edge approaches the display boundary. The four inputs are XdLc (twice), all ones (overflow), and all zeros (underflow). The two select inputs are the sign bits of XdLc and XL slope. Underflow occurs when both sign XdLc and sign XL slope are negative. Overflow occurs when sign XdLc is negative and sign XL slope is positive.
XdLs register 938 may be a 12 bit register (three 74S175's) for holding the X coordinate of the starting end point of the current edge (Xds) as it is provided by FIFO memory 910.
Output multiplexer register 940 may be a 20 bit 2:1 multiplexer register (five 25S09's) for accumulating XdLc and outputting either XdLs or XdLc. The output is returned to adder 930 and forwarded to miniraster data register 950.
Miniraster data register 950 may be a 76 bit register (nineteen 74S175's) for holding the miniraster data (XdLc 12 bits, W 12 bits, Yd scan 12 bits, CIF 24 bits, and Z 16 bits.
Subtractor 952 may be a 12 bit subtractor (three 74283's and two 74S04's) for providing the width of each miniscan line (W=XdRc-XdLc) to register 950.
Yslope generator 960 may be a 12 bit register (three 74S175's) hardwired to specify the maximum number of miniraster scan lines per frame. This number defines the scan density or Yslope.
Yslope multiplexer 964 may be a 12 bit multiplexer (two 74S157's) similar in function to Xslope multiplexer 928.
Y Adder 968 may be a 12 bit adder (three 74283's) for combining the 12 bits of Yslope with the 12 bits of Y coordinate of the previous scan line (Ydp) to form the Y coordinate of the current scan line (Yd scan).
Multiplexer register 970 may be a 12 bit multiplexer register (three 25S09's) similar in function to output multiplexer register 940.
Ydt register 974 may be a pair of 12 bit registers (six 74S175's) for holding the Yd coordinates of the left hand edge termination point (YdLt) and the right hand edge termination point (YdRt) which are periodically forwarded by FIFO memory 910.
Comparator 978 may be a pair of 12 bit comparators (six 74S85's) for comparing Yd scan with YdLt and YdRt to determine the end of each edge.
DEFLECTION CONTROL 74
Deflection stage 74 receives Yd scan accompanied by a series of XdLc's and W's for generating the sweep voltages which provide the series of horizontal scan lines outlining each polygon face. Yd scan identifies vertical position of the first vertex. XdL identifies the left hand start of each scan line thereafter. W determines the length of each scan line. Conventional integrator techniques may be employed to provide the appropriate X and Y ramp deflection voltages. The Y ramp changes at a uniform rate starting at Yd scan to move the CRT beam vertically across the face being displayed. The X ramps change at a much faster rate starting from an XdL to move the beam horizontally a distance indicated by the associated W. Suitable deflection techniques are disclosed in detail in U.S. Pat. No. 3,999,308 entitled "Real-Time Simulation of a Point System Having Textured Areas as Viewed by a Moving Observer" issued on Dec. 28, 1976 to Robert Louis Peters.
VIDEO CONTROL 76
Video control 76 receives color and intensity data from CIF 660 in projection stage 64 for each face being displayed to control the color and display brightness of the scan lines forming that face. If desired, the display intensity may be attenuated by Zc data for range simulation. Suitable video control techniques are also disclosed in detail in U.S. Pat. No. 3,999,308.
FULL RASTER EMBODIMENT
If desired, the edge list from register 760 may be displayed on a full raster in the conventional frame manner across the entire screen of display device 82. The vertices of all visible polygon faces (or visible portions thereof) for each frame are sorted by Yds to arrange the vertices in display order by raster. Next, the contents of each scan line are sorted by Xds to arrange the vertices in order of display within each scan line. The resulting Yds-Xds sorted edge list with accompanying slope and Ydt data is processed through a conventional full raster display generator which provides the necessary vertical and horizontal sweep voltage waveforms.
CONCLUSION
The objects of this invention are accomplished by providing a simulation visual system in which the object data is retrieved and processed on a face by face basis. Position data is provided for the first vertex of each face, and the number and position of the remaining vertices of that face is defined in CCW order relative to the first vertex. Nonpositional data concerning each face is provided in CIF words which accompany the face vertices throughout the processing, and is drawn on as required. The data format reserves certain words and bit locations for each type of data, effecting data compression and increased processing speed. The CCW vertex technique is particularly significant in reducing the hardware and throughput time. The vertices of each face are sequentially located in memory and are retrieved in the proper order by an address counter.
Partially visible faces are reconstructed for display by calculating the lines of intersection between the face and the window boundaries. Special window coordinates are generated to assist in identifying which boundaries are intersected by which edges, and in determining the location of the point of intersection along the edge. This point becomes a new vertex in reconstructing the partially visible faces.
Three dimensional data is treated with particular accuracy to maintain a smooth line of intersection between adjacent faces. The faces are displayed by separate minirasters, and therefore each miniraster must be precisely positioned caligraphically with respect to the other faces of the structure. To accomplish this precision, each vertex of the many faces three dimensional structures is defined relative to an initial common point, rather than relative to the first vertex of its own face. This common point technique avoids cumulative error in positioning the vertices.
It will be apparent to those skilled in the art that various changes may be made in the apparatus and techniques described without departing from the scope of the invention. The display generator may be a conventional full raster device or may display each face on a separate miniraster caligraphically. Accordingly the scope of the invention should be determined only by the wording of the following claims and their legal equivalents.
Claims
We claim as our invention:
1. An image data system responsive to observer position data and observer orientation data provided by a motion simulation computer, for providing raster display data to a raster type display device defining a bounded two dimensional perspective view of a three dimensional object system formed by polygon faces of that portion of an object coordinate system within the volume of vision of an observer in an observer coordinate system, comprising: an object system data means for providing object position data defining the position within the object coordinate system of each of the vertices of the polygon faces, and for providing other object data which defines physical properties of the objects within the object system represented by the polygon faces; an image data computer means for receiving the object data and adapted to receive at least the observer position data from the motion simulation computer, and for combining the data to form digital image data having a predetermined format with predetermined code bits for identifying the object position data and the other object data; decoding means for receiving the formatted image data and decoding the code bits and storing object position data in a predetermined order; translation means responsive to the observer position data for redefining the object position data relative to the observer coordinate system origin instead of the object coordinate system origin; rotation means responsive to the observer orientation data for redefining the object position relative to a particular axis of vision within the observer coordinate system; projection means responsive to the redefined object position data for converting the three dimensional position coordinates of each vertex of the polygon faces into two dimensional display coordinates to provide the bounded two dimensional view of the three dimensional object system; slope determining means responsive to the two dimensional display coordinates for determining the slope of the polygon edges extending between adjacent vertices; vertex sorting means responsive to the two dimensional display coordinates for determining the order in which the vertices appear within each display raster; display generator means responsive to the display coordinates and to the slope of the polygon edges and to the other object data for providing the deflection and video signals required by the display device to provide the two dimensional perspective view of the three dimensional object system.
2. The system of claim 1, wherein the object position data for the vertices of each polygon face is stored within the decoding means in sequential order.
3. The system of claim 2, wherein the vertices of each polygon have sequential addresses within the decoding means.
4. The system of claim 3, wherein the other object data indicates whether each polygon face is a two dimensional polygon feature of the object system or one face of a three dimensional feature of the object system.
5. The system of claim 4, wherein the position of one vertex of two dimensional polygon features is defined in the object system data means by object system coordinates, and each successive vertex of that polygon feature is defined relative to the preceding vertex.
6. The system of claim 4, wherein the position of one vertex of one polygon face of three dimensional features is defined in the object system data means by object system coordinates and each remaining vertex of that polygon face and the other polygon face of that feature is defined relative to the one vertex.
7. The visual data system of claim 3, wherein the rasters are fixed in shape and position within the display device screen, and display a plurality of polygon faces which are defined within the rasters by modulating the video signal from the display generator to the raster type display device.
8. The visual data system of claim 3, wherein each polygon face is displayed on the raster type display device by an individual and correspondingly shaped and positioned raster.
9. The visual data system of claim 8, wherein the vertex sorting means sequentially examines all of the vertices of a single polygon face to determine display order of the vertices of that face.
10. The system of claim 9, wherein the display generator means provides a raster of scan lines parallel to one of the two display dimensions, and incrementally spaced along the other of the two display dimensions, which scan lines progressively change in length to form the outline of the polygon face displayed by that raster.
11. The system of claim 10, wherein the vertex sorting means arranges the vertices of each polygon face in numerical order of the other of the two display dimensions, which is the order of display of the vertices.
12. The system of claim 11, wherein the vertices of each polygon face are sorted into ascending order of the other of the two display dimensions.