US 4,179,824 AGrant
Simulation of an Object System Formed by Polygon Faces Having a Series of Fundamental Shapes and Dimension
Issue Date:1979-12-25
•16 Claims
•15 Drawing Sheets
Abstract
The terrain data within an aircraft flight simulation system includes two and three dimensional object items formed by polygon faces having shapes orientations and dimensions selected from a series of fundamental shapes orientations and dimensions. The image data is coordinated in a buffer memory according to a particular format, and forwarded to an image processor. Instruction words appear throughout the format for identifying the type of data in the data words following each instruction word, and for controlling the flow of data through the image processor. The image data formatted and processed includes: Initial position data (Vo), defining the position of initial points or landmark points (i.e., the first vertex of each polygon face) within the terrain coordinate system. Shape data (delta data) defining the relative position of other points, (i.e., the remaining vertices of the fundamental shape incorporated in each polygon face) with respect to the landmark points of each Vo. Scale data for defining the dimensions of each face to be formed from the fundamental object shapes. The image processor translates initial position data into the aircraft coordinate system; then rotates, clips, and projects each three-dimensional position vector to form two-dimensional display vectors. Raster scanlines are generated from the display vectors Vd of each face for display on a CRT.
Metadata
Assignee
- The Singer Company
Inventor
- David R. Marsh
Application Information
Application Number:US 9026223
Filing Date:1978-05-04
Priority Date:1978-05-04
Art Unit:236
Classifications
IPC:
G09B 908H04N 718
Field of Search:
36435358515-52210.2;12 N103;104
Patent Drawings (15 sheets)
Description
BACKGROUND OF THE INVENTION
This invention relates to an imaging system for displaying objects formed of polygon faces as viewed from a maneuverable viewpoint, and more particularly to such an imaging system involving two-dimensional and three-dimensional objects formed from faces having shapes and sizes selected from a series of fundamental shapes and sizes.
DISCUSSION OF THE PRIOR ART
Heretofore, CRT polygon face display systems have employed faces having a variety of shapes and sizes. Each item in the scene required a complete and individual face description in the data base; that is, each vertex of each face must be positionally defined. The vertex position data for each face was processed together as a unit as disclosed in U.S. patent application Ser. No. 869,210, entitled "Real Time Simulation of a Face Object System as Viewed by a Moving Observer," filed Jan. 13, 1978 by the present assignee. Sections VI-XIII and FIGS. 2-9 of this application are identical to the corresponding Sections and Figures of the above application Ser. No. 869,210.
SUMMARY OF THE INVENTION
It is therefore an object of this invention to provide a visual system for simulating a polygon face object system requiring less hardware and data processing time.
It is another object of this invention to provide a polygon face visual system in which the vertex position data for each face is recalled from previously stored data.
It is yet another object of this invention to provide a high capacity-low cost polygon face visual system.
It is still another object of this invention to provide a polygon face visual system in which each face incorporates a fundamental shape from a series of fundamental shapes in the data base.
It is another object of this invention to provide a polygon face visual system in which the edges of each face have fundamental dimensions from a series of fundamental dimensions.
It is a further object of this invention to provide a polygon face visual system employing data compression by format techniques.
DESCRIPTION OF THE FIGURES
Further objects and advantages of the present invention, and the operation of the visual system, will become apparent from the following detailed description taken in conjunction with the drawings, in which:
FIG. 1 is a block diagram of DIG visual system 10 and peripheral flight simulation equipment showing shape memory and scaling control;
FIG. 2a is a pictorial representation of an aircraft and several terrain features illustrating the image vectors;
FIG. 2b is a diagram showing outcoding regions;
FIG. 3 is a block diagram of translation stage 60 wherein the delta data is translated into face vertex vectors Vf;
FIG. 4 is a block diagram of rotation stage 62 wherein each Vf is multiplied by an H matrix in;
FIG. 5 is a block diagram of clipping stage 63 which eliminates image data outside the field of vision;
FIG. 6 is a block diagram of projection stage 64 wherein Xc and Yc are divided by Zc to project Vc into the X-Y plane;
FIG. 7 is a block diagram of edge stage 65 which identifies the edges of each polygon face and the slopes thereof;
FIGS. 8A to 8E are a logic diagram of processor control logic 70;
FIG. 9 is a block diagram of miniraster calculator 72 which provides the starting points and widths of each scan line;
FIG. 10 is the layout of a display scene formed by two dimensional objects of various fundamental shapes and sizes; and
FIG. 11 is the layout of a display scene formed by a three dimensional object.
GENERAL DESCRIPTION OF FLIGHT SIMULATION SYSTEM 10
FIG. 1. shows a flight simulation system 10 with visual capabilities provided by a digital visual system 12. A simulated aircraft 14 is linked to flight simulation computer 16 and visual system 12 through computer linkage 18. Flight computer 16 controls motion system 20 and instrument system 22 of aircraft 14 in response to the pilot's maneuvering action at aircraft controls 24. Visual system 12 is formed by image processor 42 and display generator 44. General purpose computer 40 (i.e., a PDP 11/35 from Digital Equipment Corporation) coordinates flight data and terrain data through interface controller 46 into translation stage 60 via a data buffer.
GP computer 40 receives flight data, such as aircraft position Vp, aircraft roll, pitch, and yaw attitude (H matrix), etc. from computer 16. GP computer 40 additionally receives terrain data (both natural formations and cultural structures) from data base 48 such as runaways, towers, hangers, roads, rivers, fields, moving objects, etc. In general visual system 12 may process and display terrain features consisting of points, lines, closed convex polygons, or combinations thereof. Preferably the aircraft position data is an aircraft position vector Vp extending from the simulated position of aircraft 14 to the origin of the terrain coordinate system (see FIG. 2). In order to simplify conception and data organization, the terrain origin is preferably located proximate the touchdown area of the runway, and the x axis of the terrain coordinate system from data base 48 is coincident to the runway centerline. An updated Vp is supplied each frame period of flight simulation computer 16 as the flight parameters of aircraft 14 change. The earth data also includes initial positional data for certain landmark points or initial objects points (Vo) such as the first vertex of each face, and the relative position of the points forming other terrain features (delta data). Translation stage 60 subtracts Vp from each Vo to form translated vectors (Vt=Vo-Vp). Translation stage 60 then combines the delta with the appropriate Vt to provide the remaining face vertex vector Vf for each face (Vf=Vt+delta data). Shape memory 60M contains the vertices of a series of fundamental shapes which may be adjusted in size by scaling control 60C to any dimension of a series of fundamental dimensions. The data associated with each face includes the position of the initial object point for that face, the address locations of the vertices of the fundamental shape for that face, and scaling data. The desired shape is retrieved from shape memory 60M and scaled to the desired size by scaling control 60C. Rotation stage 62 provides channel vectors Vc to clipping stage 63 which truncates vectors to the pyramid of vision. Data is then passed to projection stage 64 which projects the three-dimensional Vc into two-dimensional display coordinates or vectors Vd. Edge stage 65 provides a list of visible edges defined by the end points and the slope. The data flow through image processor 42 and the mode of operation thereof is controlled by processor control logic 70.
Texture stage 72 within display generator 44 receives the visible edge list for coordination with the display raster. Deflection stage 74 provides the required analog deflection voltages to CRT display devices 82. Video stage 76 receives the color, intrinsic intensity and size portion of the data for controlling the CRT beam voltage, current and focus. The CRT in device 82 is preferably a beam penetration, random deflection tube which allows precise control of spot position, continuous control of spot focus and diameter.
DETAILED DESCRIPTION OF INTERFACE CONTROLLER 46 AND THE DATA FORMAT
GP computer 40 has an in-core, buffer memory which accumulates blocks of image data required to form each display frame. The incore buffer contains initialization points (Vo) and delta data from data base 48 plus each new position vector Vp and rotational matrix (H) as they are computed by flight computer 16.
The image data accumulating in the in-core buffer is periodically transferred as a data block to hardware RAM buffer 304 in interface controller 46. Controller 46 processes the data words sequentially to image processor 42 while GP computer 40 simultaneously assembles the next data block in the in-core buffer for the next data handshake with RAM 304. The accumulation of data blocks in GP computer 16 and the handshake data transfer to RAM 304 is outlined in the following four operations:
Operation I--Preflight Load-Data Base 48 to Core Memory
Prior to each training flight, the content of data base 48 is loaded into computer 40 core-memory. Image data from data base 40 includes sixteen control words (0000-1111) having bit formats as described hereinafter, initialization data Vo, delta data, etc.
Operation II--Aircraft Orientation Update
The in-core memory is updated periodically with the most recent aircraft orientation angles roll, pitch and yaw (H matrix data) from flight computer 16. Preferably, this aircraft update occurs once each frame. The H matrix data is received by computer 40 as the sine and cosine of each of the three orientation angles--six items of data. The software of computer 40 responds to the orientation data to form the rotational matrix H described in the specification (Section IX). The software merely calculates the proper sine-cosine products to form a 3.times.3 matrix for each angle, and multiplies the three 3.times.3 matrices together to generate the nine elements of the rotational matrix H. These nine elements are generated each frame and inserted into RAM 304 at the proper place. The nine elements of rotational matrix H preferably occupy the lead position in the core-memory because the rotational perspective must be developed by rotation stage 62 each frame prior to displaying any of the object faces on display 82.
Operation III--Aircraft Position Update
The core-memory update also includes the most recent aircraft postion vector Vp which latter forms a series of translated vectors Vo in translation stage 60.
Operation IV-Handshake Between Core-Memory and RAM 304
As required the contents of the core-memory matrix are serially transferred to RAM 304 in interface controller 46, starting with the nine rotational elements.
The four above described operations involve simple software steps. Operations I, III, and IV are merely data transfer steps. Operation II involves forming a triple 3.times.3 matrix product, a mathematical operation which is well understood. Subroutines are available to execute this systematic multiplication.
FORMAT SUMMARY
The data format is formed by groups of data words which describe the nature and position of each object feature, and spaced instruction words for identifying the type of data in the immediately subsequent group of data words. The MSB bits of each instruction word are coded to define the particular instruction contained in the word, and the remaining bits concern the subsequent data. In the embodiment shown, a sixteen bit format is employed. The four MSB define the instruction and are decoded by processor control logic 70 to control the flow of data through image processor 42. The four LSB of each instruction word reveal the number of subsequent data words in the data word group to be processed under that instruction word. Each instruction word is loaded into registers 310A and 310B by control logic 70 in due course, and the immediately subsequent group of data words is loaded into RAM 350.
FIVE LOAD INSTRUCTIONS (0-4)
Each load instruction transfers point coordinates from buffer 306 into RAM 350 as follows: ##STR1##
Load A11 instruction causes the subsequent group of B sets of X, Y, Z coordinates to be stored in RAM's 350X, 350Y, and 350Z, beginning at address A. The first coordinate (one of two sixteen bit words) is stored in the RAM 350X, the second in the RAM 350Y, and the third in the RAM 350Z. This sequence is repeated until B sets of coordinates have been loaded starting at address A. R specifies the significance of the bits in the subsequent sixteen bit data words for coordinating the distribution thereof across the 24 bits of RAM's 350.
Normal 24 bit resolution (R=3) requires two subsequent data words. The first word provides the sixteen LSB to RAM's 350 and the second word provides the 8MSB to RAM's 350. Vp and Vo data require the full 24 bits and therefore are preceded by an LDA instruction word with R=3. The LSB of Vp preferably corresponds to 3/8 of an inch to eliminate detectable jitter of the scene from frame to frame. A new Vp is calculated by FS computer 16 each frame, and the round-off error in the LSB of Vp causes the entire earth coordinate system to jump a ground distance equal to the LSB. This interframe displacement (motion resolution) is minimized and rendered indetectable to the pilot trainee by providing aircraft position vector (Vp) resolution at the 3/8 inch level. The LSB of Vo is preferably small in order to accurately position detailed structure within a terrain feature (positional resolution). In the embodiment shown, Vo LSB also equals 3/8 inch because image processor 42 is already required to handle the 3/8 inch bit in order to prevent interframe displacement. That is, the position resolution may have the same value as the motion resolution as in the embodiment shown; but it is not required that the two resolutions be equal. However, a 3/8 inch Vo position resolution permits moving objects such as other airplanes and ground vehicles to be viewed without interframe displacement. The MSB of both Vp and Vo is 262,144 feet forming a cubic gaming volume in data base 48 which is 262,144 feet on an edge.
Fine 16 bit resolution (R=1) requires a single subsequent 16 bit data word of delta data which is entered into the 16LSB of 24 bit RAM's 350 (bits 16-23 are loaded with the sign bit 15). The MSB corresponds to 1024 feet (when LSB=3/8 inch). The fine 16 bit resolution may be used to process the vertices of small terrain faces (largest dimension less than 1024 feet) which is associated with high resolution detailed structure.
Coarse 16 bit resolution (R=2) requires a single 16 bit subsequent data word of delta data which is entered into the 16 MSB of 24 bit RAM's 350 (bits 0-7 are loaded with "0"s). The MSB=262,144 feet and LSB=8 feet. The coarse 16 bit resolution may be used to process the vertices of large terrain faces in which the dimensions have been rounded off to miltiples of eight feet. While the size resolution of these faces is eight feet, they are positioned with the same resolution as the associated Vo. ##STR2##
Load XY instruction causes the subsequent group of B pairs of X and Y coordinates to be stored in the RAM 350X and RAM 350Y, beginning at address A. "0" are stored in the corresponding addresses of the RAM 350Z. The data format is one or two 16 bit words of X data followed by one or two words of Y data. This sequence is repeated until B pairs of X-Y coordinates have been loaded into RAM's 350X and 350Y. The R codes are the same as for LDA. ##STR3##
Load X instruction causes the subsequent group of B X coordinates to be stored in the XT RAM 350X beginning at address A. Zeros are stored in the corresponding addresses of RAM's 350Y and 350Z. ##STR4##
Load Y instruction is the same as LDX except that the data is stored in RAM 350Y and "0" are stored in the corresponding addresses in RAM 350X and RAM 350Z. ##STR5##
Load Z instructiion is the same as LDX except that the data is stored in the RAM 350Z and "0" are stored in corresponding addresses of RAM's 350X and 350Y.
FIVE RECALL INSTRUCTIONS (5-9)
Recall instructions load the first vertice Vo of each face into RAM's 350 and initiates generation of the associated face. ##STR6##
Recall A11 instruction causes the single subsequent set of coordinates for the first vertice of a face, which typically is also an initialization vector Vo, to be loaded into the first location of RAM 350X, RAM 350Y, and 350Z. The other vertices of the current face have already been entered into RAM's 350 in CCW order as 16 bit coarse or fine data under one of the load instructions (0-4). These other vertices B are now recalled in CCW order from RAM's 350 beginning with address A of RCA. Normal 24 bit resolution (R=3) and coarse 16 bit resolution (R=2) have been previously described. S is a scale factor. When S=7, the current face is displayed full size. As S decreases the size of the current face is reduced by factors of 2. ##STR7##
Recall XY instruction causes the single subsequent set of first vertice Vo coordinates to be loaded into the first address of RAM 350X and then the first address of RAM 310Y. RAM 350Z is unaffected. The face generation then proceeds as described under RCA. ##STR8##
Recall X instruction causes the single subsequent X coordinate of the first vertice Vo to be loaded into the first address of RAM 350X. RAM's 350Y and 350Z are unaffected. ##STR9##
Recall Y instruction causes the single subsequent Y coordinate of the first vertice Vo to be loaded into the first address of RAM 350Y; RAM's 350X and 350Y are unaffected. ##STR10##
Recall Z instruction causes the single subsequent Z coordinate of the first vertice Vo to be loaded into the first address of RAM 310Z; RAM's 350X and 350Y are unaffected. ##STR11##
Recall Load instruction does not load any new data into RAM's 350 but is the same as RCX in other respects. RCL is used to hold the previous Vo in order to construct another face contiguous with or proximate to the previous face using the previous Vo as the first vertice or a landmark point for establishing the position of the vertices of the contiguous face.
OTHER INSTRUCTIONS ##STR12##
Color Intensity Flag instruction is followed by B additional words, i.e., ##STR13## which define the visual characteristics of each data base feature (face, line, or point). The visual characteristic of certain cultural objects such as signal beacons and runway lamps are a function of viewing direction and require directional data. SEL AXIS identifies the viewing axis to which the CIF data pertains:
SEL AXIS=00: the color and intensity of the object is uniform in all directions--ordinary object.
SEL AXIS=01: the color of the object depends on the direction of viewing along the X axis--bidirectional object.
SEL AXIS=10: bidirectional along Y axis.
SEL AXIS=11: birdirectional along Z axis.
S.+-. (SIGN.+-.) identifies the direction of view of the object along the axis identified by SEL AXIS. COLOR+ identifies the color of the object when viewed from the S+ direction, and COLOR- identifies the color of the object when viewed from the S- direction. COL SEL permits ordinary non-direction features to be displayed in a color from COLOR+ (COL SEL=0) or from COLOR- (COL SEL=1). I (INTENSITY) determines the intensity of the data base feature. When only an intensity change is required to display the current object, only CIFO (B=0) is employed. OBJ CODE identifies the type of object to be recalled:
The use of Recall instruction as illustrated in FIG. 2a is different for two dimensional faces on the X-Y ground plane (which always face the observer) and faces of a 3 dimensional object (which are sometimes occluded), as illustrated in FIG. 2. Two dimensional faces are identified by a 2D face object code in the previously loaded CIFI data. RCX computes the vertices of each face by starting with the X, Y, Z coordinates of Vo stored in the first address of RAM's 350 and combining additional vector coordinates from RAM's 350 starting at address A. B is the number of vertices in the face, and, since Vo is the first vertex, B-1 additional vectors (Delta V1, Delta V2, . . . Delta VB-1) are required to generate the other vertices. The vertices are always stored and retrieved in counter-clockwise order. Three dimensional faces are identified by a 3D object code. Vo is not used as a vertex for 3D faces, so that B additional vectors (Delta V1, Delta V2, . . . Delta VB) are required to display a face having B vertices. The RAM addresses containing the additional vector coordinates for 3D faces are provided by one or two data words 3DV1 and 3DV2 following the X data word or words. Each additional vector in 3D recall describes the position of a vertex with respect to Vo as opposed to a 2D recall, in which each additional vector describes the position of a vertex with respect to the previous vertex. The address format for additional 3D vectors in RAM 350 is ##STR14## If the face has four or fewer vertices, only the first word is used. The order in which the RAM 350 addresses are used is reverse alphabetical. For example, when recalling a face having five vertices, the first vertex will be computed using the vector stored at E. The last vertex is always stored at A. A in the RCX instruction is also the address of the normal vector stored in normal RAM 440N. The normal vector is used to test the visibility of a face and must have been previously loaded in normal RAM 440N using a LDN instruction (described hereinafter). Scale factor is the same for a 3D face as for a 2D face.
FB identifies data fed back for CRT correction to eliminate ballistic nonlinearities and provide a true display.
IOS identifies data displayed on the instructor's monitor 28 only.
VER RES determines the scan line density (vertical display resolution in horizontal lines per vertical scan).
Load Correct Data instruction enters C vertices with corrected CRT coordinates. ##STR16##
Control String instruction causes the display of string of C equally spaced lights or four-sided two dimensional faces, depending on the CIF1 OBJ CODE. The first light of a string is displayed at the Vo+A position and a spacing vector stored at A+1 is used to fix the position of the second light and all successive lights until C lights have been displayed. The first vertex of the first face of a string of faces is displayed at the Vi+A position and the other three vertices are found successively adding the vectors stored at RAM's 350 addresses A+1, A+2, and A+3. The vector stored at A+4 locates the first vertex of the next face with respect to the last vertex of the current face. ##STR17##
Control Load H instruction loads the H rotation matrix on data bus 307 into RAM 410H in rotation stage 62. The elements of the rotation matrix are in 16 bit 2's complement form, and each address of RAM 410H will store three elements. The rotation matrix multiplies the translated X, Y, and Z coordinates in the following form: ##STR18## The element data follows the LDH instruction in the following order:
h31, h32, h33, h21, h22, h23, h11, h12, h13. The matrix is always stored in the first three addresses of RAM 410H, so A=0, the initial address and B=3, the number of matrix rows. C is the channel number associated with rotation matrix. ##STR19##
Control Load N instruction loads B face normal vectors on data bus 307 into normal vector RAM 440N in rotation stage 62, starting at address A. Each vector consists of three 16 bit data words in order Nx, Ny, Nz. The Control Load N will therefore always be followed by three B words of data. Each address in normal RAM 410N is associated with a three dimensional face of identical address in RAM's 350. Both RAM's are addressed during the Control Recall of a 3D face.
DETAILED DESCRIPTION OF DIGITAL VISUAL COMPUTER 12
Each stage of digital visual system 12 is shown in detail in FIGS. 3 through 9. Preferred embodiments are disclosured at the detailed logic level. Each component is described by function, input-output characters, or conventional nomenclature to enable one skilled in the arts of simulation, digital design, and computer programming to practice the invention. The components are additionally designated by the manufacturer's IC type number from the following integrated circuits data books:
Texas Instruments Incorporated "The TTL Data Book of Design Engineers" First Edition, Copyright 1973.
National Semiconductor Corporation "Digital Integrated Circuits" January 1974.
Advanced Micro Devices Inc. "Advanced Micro Devices Data Book" Copyright 1974.
unless otherwise specified. Further, many inverters are employed throughout CDIG system 10 for buffering signals with multiple loads. These buffer inverters are type 74S04 unless otherwise stated.
TRANSLATION STAGE 60
GENERAL OPERATION
FIG. 3 shows translation stage 60 of image processor 42 and a portion of controller 46. Controller 46 receives image data in sequential order from computer 40 at input 302 of random access memory 304. The image data is arranged in data blocks M bits wide and N words long, which in the embodiment shown is 16.times.1024. RAM 304 periodically handshakes with a core memory in GP computer 40 to reproduce each block of data. Image data is sequentially transferred from RAM 304 through a buffer register 306 to image data bus 307 in response to load pulses from interface controller 46.
Each instruction word on bus 307 is loaded into instruction registers 310 A and B which forwards the code bits (four MSB's) to control logic 70. Control logic 70 then selectively activates the remaining blocks of translation stage 60 for processing the subsequent B words of data appropriately. Load instructions (0-4) cause control logic 70 to send WRITE to RAM's 350, which then writes the subsequent B data words starting at ADDRESS A. Counter 320A increments ADDRESS A while counter 320B decrements down from B. When the B count expires, B=0 is forwarded to logic 70 and the next instruction is loaded into instruction registers 310.
Vp is loaded into RAM's 350 by a Load A instruction (R=3) immediately after each handshake, and Vp is always positioned at the same address (address 1). Next, B words of delta data vectors is entered by another load instruction.
Recall instructions (5-9) load the Vo associated with the previously loaded B words of delta data. Each Vo is positioned at the same address in RAM 350 (address 0). The recall instruction causes control logic 70 to forward READ to RAM's 350, and the B words of delta delta are recalled from RAM's 350 and processed through the remainder of translation stage 60.
CIF instruction causes control logic 70 to forward LOAD to CIF register 330 to receive SEL AXIS, SIGN.+-., and Intensity data from instruction registers 310. B subsequent data words are entered into CIF-1 register 331 and CIF-2 register 332 where the CIF data is temporarily held. The CIF data is advanced into corresponding CIF registers 460 in rotation stage 62 as Vf data enters rotation stage 62 from normalization register 380.
Three dimensional vertex registers 341 and 342 receive the addresses of vertices of 3D faces in RAM 350. The addresses in registers 341 and 342 address RAM's 350 via address counter 320A.
RAM's 350 write image data from interface controller 46 after load instructions and read image data after recall instructions. RAM's 350 temporarily store Vp and delta V's until the associated Vo is entered permitting the faces to be generated.
Scalers 360 (X, Y, and Z) control the size of the displayed image by expanding or contracting the X, Y, and Z position coordinates by factors of two. S data from register 310B shifts the binary decimal point to effect the scaling.
Accumulators 370 receive the X, Y, and Z position coordinates and perform the following translation computations (illustrated in FIG. 2):
Normalization registers 380 (X, Y, and Z) loads the translated vertices Vt, and left shifts leading zeros (or ones for negative Vt's) in response to control logic 70. The first difference between the MSB and the second MSB in any of the normalization registers 380 generates a normalization complete signal, (NCS), back to control logic 70. Normalization complete in any of the normalization registers 380 stops the normalization process of all the registers insuring that the normalized points maintain consistent dimension units and remain on the same line of vision as viewed on display 82. Normalization has the advantage of reducing the 24 bit input image data into bits of normalized image data by eliminating either leading zeros (or ones for negative numbers). The data load is reduced to 66% with negligible loss in position resolution.
DETAILED DESCRIPTION
RAM 304 may be formed by a 16 bit.times.24 word RAM (sixteen 93415's, Fairchild) for holding the block of image data from GP computer 40.
Buffer register 306 may be formed by a 16 bit register (four 74S175's) followed by buffer inverters as required (74S04).
Register 310A may be an eight bit register (two 74S175's) for receiving four bits of code (4MSB) and four bits of RAM address (4LSB).
Register 310B and word counter 320B may be formed together by an eight bit down counter (two 74S163) for receiving the compliment of B and counting to 15. At B compliment=15, B=0 appears on the carry out terminal.
Address counter 320A may be a 2:1 inverting multiplexer (74S158) followed by a four bit up counter (one 74S163). During load and recall instructions, counter 320A increments the start address AAAA to RAM's 350. While processing three dimensional faces counter 320A processes the face vertex addresses in three D registers 341 and 342.
CIF register 330 may be an eight bit register (two 74S175) for receiving eight bits of SEL AXIS, S.+-. and Intensity Data from the CIF Load instruction.
CIF-1 and CIF-2 registers 331 and 332 may be 16 bit registers (four 74S174) for receiving two 16 bit words of CIF data immediately following the CIF instruction.
Three dimensional registers 341 and 342 may be eight 4 bit tristate registers (eight 8551) preceded by a 3 line to 8 line decoder (one half 74S139) which enables one of the eight tristate registers in response to the three LSB's of B from word counter 320B.
RAM 350X may be a 24 bit RAM (six 74S189's) to accomodate the 24 bits of X coordinate image data. The 24 bit RAM is preceded by a 2:1 8 bit multiplexer (two 74S158) between a pair of true compliment zero one elements (two 74H87's each). During 16 bit fine resolution (R=1) the right hand zero one element forwards the 8LSB's of the image data to the 24 bit RAM, and the righthand zero one element enters all zeros (or all ones depending on the sign of the image data). During 16 bit coarse resolution (R=2) the right hand zero one element enters all zeros and the lefthand zero one element forwards the 8 MSB's.
Scaler 360x may be formed by a flow through right shifter device (twelve 25S10's AMD) in response to S data from register 310B counter.
Accumulator 370x may be a 24 bit adder (six 74283's) for receiving data at the A input, followed by a 24 bit return register (six 74S175's) which outputs to the B input. Vp is processed through the adder and return register, and returned to the B input. Vo is loaded at the A input and added to Vp to form Vt and returned to the B input. Delta data is then loaded at the A input and added to Vt to form the remaining vertice vectors Vfl-Vfn, which are advanced through the return register to a 24 bit buffer register (four 74S174's) where the Vf's are held until normalizer 380x is free.
Normalizer 380x may be formed by a 24 bit shift register (three 74199) plus a Buffer register (four 74S174's) which holds the normalized Vf's until rotation stage 62 is free to handle the next Vf.
ROTATION STAGE 62
GENERAL-H MATRIX
FIG. 4 shows rotation stage 62 of image processor 42 which multiplies the translated point vectors Vfl-Vfn from translation stage 60 by the rotation matrix H provided on data bus 307 to produce a rotated or channel vectors Vc (XcYcZc):
Each channel corresponds to the perspective view of one window of aircraft 14.
The rotation matrix H is developed from yaw (Y, left), pitch (P, down), and roll (R, right) motions by flight simulator 16 using conventional software. The order of rotation is Y followed by P, and the matrices for the separate rotations from translated to rotated pilot eye or channel coordinates are as follows:
The composite matrix H describing this rotation is given by the matrix product:
The aircraft attitude matrix H is constant for each frame and is therefore computed only once per frame for each channel.
The three elements of the first column of the H matrix are entered into H RAM 410x by WRITE from control logic 70 immediately subsequent to the Load H instruction. The first column is then multiplied by the Xf coordinate of each of the translated vector series Vfl-Vfn in turn within column multiplier 420X. The three elements of the second and third columns of [H] are similarly entered into H RAM 410Y and 410Z (not shown). The nine products generated above are combined into Xc, Yc, and Zc by row multiplexer 424 and adder 430. The resulting Vc is forwarded to clipping stage 63.
GENERAL-VISIBILITY TEST
The rotation circuitry also provides the multiplication for the dot product visibility test for the faces which form three dimensional structures such as buildings:
where: Vt is the translated vector extending from aircraft 14 to the first vertex of the face being tested; and Vn is the vector normal to the face being tested.
When cosP is negative, P is greater than 90.degree. and the face is visible because the face is on the front or exposed side of the building. When cosP is positive, P is less than 90.degree. and the face is invisible because the face is on the back side of the building. The sign bit of the dot product is employed for back side elimination, a simple occulting technique.
The Xn, Yn, and Zn coordinates of Vn are entered into N RAM's 410X, Y, and Z respectively immediately subsequent to the Load N instruction. Each coordinate is multiplied by the corresponding coordinate Xt, Yt, and Zt of Vt in multipliers 420 and the sign bit of the resulting quantity is forwarded to control logic 70.
DETAILED DESCRIPTION
H RAM 410x may be a 16 word by 16 bit sequential access memory (four 74S189's) for holding the three words in the first column of the 3.times.3 H matrix and providing 13 spare 16 bit addresses. WRITE and ADDRESS are provided by control logic 70.
N RAM 410x may be a 16 word by 16 bit random access memory (four 74S189's) for holding up to sixteen words of Xn which accomodates a three dimensional complex structure with up to sixteen faces.
Multiplicand register 414x may be a 16 bit buffer register (four 74S175's) for holding the current output of H and N RAM's 410x available to multiplexer 420x while the next address in RAM's 410x are accessed.
MUX 416x may be a 16 bit dual 4-1 multiplexer (three 74S153's) for providing four bits of output plus carry over bit.
Multiplier register 418x may be a 5 bit buffer register (one 74S174) for holding the output of MUX 416x available to multiplier 420x.
Column multiplier 420x may be formed by eight AM 25S05's (Advanced Micro Devices in 16 bit.times.4 bit configuration) followed by a buffer product register (three 74S175's) and operates as described in connection with Multiplier 330 in U.S. Pat. No. 3,996,672 which issued Dec. 14, 1976.
Row Multiplexer 424 may be a 20 bit 4 to 1 multiplexer (ten 74157's connected in parallel) which sequentially select the first row elements of each column for summing in row adder 430 to form Xc. The second and third row elements are likewise summed to provide Yc and Zc.
Row adder 430 may be a 20 bit adder (five 74783's) for summing the row products of the H matrix.
Accumulator 440 (three 74174's) returns intermediate sums to multiplexer 440 which are required in forming Vc.
Buffer registers 450 may be 18 bit registers (four 74175's) for holding Vc (Vx, Vy, Vz) prior to clipping.
CIF register 460 may be a 40 bit register for holding the CIF data from CIF registers 330, 331, and 332.
CLIPPING STAGE 63
GENERAL
FIG. 5 shows clipping stage 63 which eliminates points outside the viewing volume or pyramid of vision 250 shown in FIG. 2a. Pyramid of vision 250 has its vertex at the eye of the pilot (origin 220). The viewing volume in the embodiment shown is four sided, bounded by four planes defined by the four sides of the aircraft window.
Clipping is accomplished at the object face level. Vertices defining each face edge are processed in sequence through clipping stage 63 to determine whether the face is:
Case A--face completely within view,
Case B--face partially within view, or
Case C--face completely out of view.
Faces which are only partially in view (Case B) are intercepted by the sides of pyramid of vision 250. In the process of clipping, Case B faces are modified by the addition of new edges. The result is a modified closed polygon face that is completely within pyramid 250.
The position of any point or vertex relative to pyramid of vision 250 is defined by the distance of that vertex from each of the four sides of pyramid of vision 250. Referring to FIG. 2a point 254 forming the top of the flag pole 256 is positionally defined by the four window coordinates vl, vr, vb, vt in Zc plane 260. These window coordinates are calculated as follows:
vl=Kl Z+X
vr=Kr Z-X
vb=Kb Z+Y
vt=Kt Z-Y
where the K's are constants associated with the vertex angles of pyramid 250. For a square pyramid of vision having equal vertex angles A, Kl=Kr=Kb=Kt=Tan (A/2). A point is inside the truncated pyramid of vision 250 if vl.gtoreq.0, vr.gtoreq.0, vb.gtoreq.0, vt.gtoreq.0, and Zc>0.
The above window coordinates are calculated from Vc by window logic circuits 510-l, 510-r, 510-b, 510-t, and 510-z shown in FIG. 5 (only 510-l is shown in detail). Window circuit 510-l receives Xc and Zc from l:r multiplexer 520 for temporary storage in interior working registers 530. Adder 540 and inverter 544 cooperate to perform the required addition. Window coordinates vl and vt are forwarded to projection stage 64 to become display coordinates Xd and Yd, and Zc is forwarded for range attenuation effects.
The signs of the window coordinates are combined in a single five-bit out-code (OC):
OC=sign l, sign r, sign b, sign t (and sign Z) where the sign of each window coordinate is "0" for positive and "1" for negative. The origin of each window coordinate is the corresponding boundary of image window 262 with the negative direction extending away from image window 262 (see FIG. 2b, left for vl, right for vr, down for vb, and up for vt). The positive direction for each window coordinate is toward the center of image window 262. The four boundaries of pyramid 250 subdivide the positive half-space in front of aircraft 14 into nine regions. The out-code of each Vc identifies the region in which the point or vertex is located. The out-code for each region of the two-dimensional projection of pyramid 250 is shown in the following table:
The relative position of any face edge to pyramid 250 can be found by examining the outcodes of the end points of the edge. If both vertices are behind the Zc=0 plane (that is behind the pilot's eye where Zc is negative), then sign Z(1)=sign Z(2)=1 and the face edge is not visible and can be rejected. If both vertices are in front of the Zc=0 plane (in front of the pilot's eye where Zc is positive), then sign Z(1)=sign Z(2)=0. If the face edge intersects the Zc=0 plane, then sign Z1.noteq.sign Z2. The intersection is found and only the portion of the edge extending in front of the pilot's eye need be considered.
Three further possibilities for the relative position of a face edge with respect to pyramid 250:
Case 1: Both ends of the face edge are within view. No clipping is necessary: OC(1)=0000(0), OC(2)=0000(0).
Case 2: One end of the face edge is within view and the other end is outside. The face edge intersects pyramid 250: OC(1)=0000(0) and OC(2).noteq.0000(0) or OC(1).noteq.0000(0) and OC(2)=0000(0).
Case 3: Both ends are outside pyramid of vision 250: OC(1).noteq.0000(0) and OC(2).noteq.0000(0).
In Case 3, definite decisions can be made only if the end points of the edge are either both to the right or both to the left (sign l(1)=sign l(2)=1(negative) or sign r(1)=sign r(2)=1(negative)). Furthermore, if OC(1)=OC(2) .noteq.0000, both ends are outside, in the same region. In all these cases the face edge can be rejected. The rejection criteria can be expressed as a Boolean function (R) of the two out-codes. If R=0, none of the above rejection criteria are satisfied, and a part of the face edge boundary may go through image window 260.
Whenever Case 2 is found in the clipping process, the intersection of each face edge and pyramid of vision 250 is determined by window circuits 510 and the clipping portion of control 70 using a binary search technique. The algorithm for the search is as follows:
(A) Let the window coordinates of the vertex inside image window 260 be Vin and the outside coordinates be Vout.
(B) The midpoint between Vin and Vout is calculated.
(C) If the midpoint is within pyramid 250, Vin is replaced by the midpoint.
(D) If the midpoint is outside, Vout is replaced by the midpoint.
(E) The process continues until the distance of the midpoint from one side of pyramid 250 is less than the termination tolerance.
There remains the problem of modifying the edges of clipped faces. In some situations the intersections of the face edges and pyramid of vision 250 define the new face edge. In other situations one or more corners of the window must be inserted into the sequence of vertices to complete the closed polygon face.
In a special case all vertices are outside pyramid 250 and the edges do not intersect pyramid 250. There remains ambiguity as to whether the face is within view. Referring to FIG. 2b showing image window 262, 4 rays (R1, R2, R3, and R4) extend from the four corners (C1, C2, C3, and C4) of window 260. If a ray is intersected an odd number of times by the edges of the polygon face, then the corresponding corner is surrounded by the polygon. This technique can be implemented by inspecting the out-codes of the adjacent vertices defining each edge. The criterion for crossing the rays is very similar to the rejection criterion and is obtained by logical operations. As an example, R1 is crossed if sign t(1)=sign t(2)=1 and sign l(1).noteq.sign l(2).
PROJECTION STAGE 64
GENERAL
FIG. 6 shows projection and clipping stage 64 of image processor 42 which projects three-dimensional window coordinates vl, vt, and Vz from clipping stage 63 into a two-dimensional vector Vd (Xd, Yd). The projected vectors Vd define the end points of each face edge for face generation stage 65. The projection is accomplished by dividing vl and vt by Zc through a binary division nonrestoring technique (described in "Digital Arithmetic-I" by Y. Chu pages 39-43). Z/2 registers 610-l and 610-t load the divisor Zc/2, and MUX/Register 620-l and 620-t select and load the dividend vl/2 and vt/2 in response to control logic 70. The inputs to register 610 and 620 are right-shifted by one digit to establish the division by two. Arithmetic logic unit ALU 630-l and 630-t then receive the dividends through shift return loops 623-l and 623-t, or subtract Zc/2 thereto in response to a .+-. function from logic 70. The dividend .+-.Zc/2 term is loaded into MUX's 620, returned to ALU's 630, and then combined with another .+-.Z/2. The output of ALU's is slew wired with respect to the input to MUX's 620 causing a division by two right shift. The vl/Vz and vt/Vz quotients are generated one bit at a time, MSB first, by comparing the sign bit (MSB) of Zc with the sign bit of the partial remainders with MUX 620 through sign gates 636-l and 636-t. The quotient bits individually enter quotient registers 640-l and 640-t, and are left-shifted by control logic 70. Zc on line 592 from range register 590 is loaded into renormalizaton register 650 and right-shifted by control logic 708 the same number of places as were left-shifted in normalizer 370 in translation stage 60. Color, intensity, and flag data on line 592 from CIF register 590 is loaded into CIF register 660 in response to control logic 70.
DETAILED DESCRIPTION
z/2 register 610 may be a 24 bit register (four 74S174's).
MUX/Registers 620 may be 24 bit 2:1 multiplexers (five 74S298's) with storage.
ALU's 630 may be 16 bit flowthrough arithmetic logic units (four 74S181's+one 74S182).
Sign gates 636 may be exclusive OR gates (74S86).
Quotient registers 640 may be 12 bit shift registers (three 74164's) for receiving the projected data Xd and Yd one bit at a time as it is generated by ALU's 630.
Zc register 650 may be a 24 bit shift register (six 74S195's).
CIF register 660 may be a series of 74S174's.
EDGE STAGE 65
GENERAL
FIG. 7 shows edge stage 65 having Xd processor 706X and Yd processor 706Y which receive projected face vertex coordinates (Xd and Yd) from projection stage 64 and provides face edge lists to display generator 44. Each edge is defined by edge data including a starting point (Xds, Yds), the Y coordinate of the termination point (Ydt), plus the slope of the edge (delta X/delta Y).
The Y coordinates of each set of face vertices (Xd and Yd) are loaded into current Y mux-register 710 and advanced to previous Y register 716 in CCW order as defined in data base 48. Each current Y coordinate (Ydc) and previous Y coordinate (Ydp) are forwarded to adder 720 for calculating a delta Y for each face edge or pair of points (delta Y=Ydc-Ydp). Simultaneously, each Ydc and Ydp are entered into Y start multiplexer 730s and Y terminate multiplexer 730t. The starting Y coordinate Yds is the end point of each face edge that is scanned first on CRT 82; and the terminate Y coordinate Ydt is scanned last. In the embodiment shown, the conventional top to bottom scan is employed. Therefore, the start point Yds is always the smaller of the two adjacent points Ydc and Ydp. The sign bit of delta Y (SIGN .DELTA.Y) defines which is smaller, Ydc or Ydp, as follows:
and activates multiplexers 730s and 730t accordingly. Slope divider 740 provides the slope of each edge face by computing delta X/delta Y for the corresponding pair of vertices.
The face edges are arranged in scan order by Yds sorter 750 according to the smallest Yds. Each edge data set is loaded into sorter 750 in CCW order and forwarded to image generator 44 in order of smallest Yds for accomodating the top to bottom scan.
DETAILED DESCRIPTION
Xd processor 706X has the same hardware as Yd processor 706Y, and is therefore not shown in detail.
Current Y mux-register 710 may be a 12 bit 2:1 multiplexer-register (three 74298's) for the current vertex of each face as the vertices are received in CCW order from quotient registers 640-l and 640-t.
Previous Y register 716 may be a 12 bit storage register (two 74174's) for holding the vertex just preceding the current vertex.
First vertex Y register 718 may be a 12 bit storage register (two 74174's) for holding the first vertex while the intermediate vertices are processed. The first vertex is loaded into current mux-register 710 as the last vertex is advanced to previous vertex status to form the last edge of the face.
Adder 720 may be a 12 bit adder (three 74283's) for calculating delta Y=Ydc-Ydp, and forwarding SIGN Y to Y and X multiplexers-registers 730s and 730t.
Inverter 722 may be a 12 bit inverting buffer (two 74S04's) for inverting Ydp into -Ydp. The carry in on adder 720 is forced to l to complete the complement of Ydp.
Start point and terminate point multiplexer-register 730 may be 12 bit 2:1 multiplexer-registers (three 74298's each) for simultaneously holding both Ydc and Ydp available for selection as either Yds or Ydt.
Delta Y register 724 may be a 12 bit storage register (three 74S175's) for holding delta Yc while divider 740 forms the slope (delta Xp/delta Yp) for the previous edge. Additionally register 724 may include a zero detect circuit (one 74S30) for providing delta Y=0 to control 70 when the slope is horizontal and the edge may be omitted from further processing.
Divider 740 may be a 12 input bit-20 output bit binary division nonrestoring divider as described in projection stage 64, for calculating slope=delta X/delta Y. The dividend delta X may be right shifted into additional shift register (one 74166) for scaling down the resulting slope to accomodate a Y increment of one raster line. In the embodiment shown the right shift is nine places to accomodate a 1024 scan line, interlaced display (2 to the 9th=512).
Sorter 750 may be a 12 bit key-96 bit non key sorter for output edge data in order ascending of Yds, formed by:
(a) a 16 word 12 bit key data RAM (three 74S189's) for receiving and storing the key data (Yds) in input order.
(b) a 16 word 5 bit pointer RAM (two 74S189's) for storing the RAM pointers.
(c) a three level pointer pushdown stock (two mux-registers 74298's--first level, one 74S174--second level, and one 74S174--third level) for manipulating pointers into sorted order each time a new key is received by the key data RAM.
(d) address counter (one 74161) and smallest key pointer register (one 74S174) for generating RAM addresses and storing the current smallest key RAM address.
(e) RAM address multiplexer (two 74S153's) and a pointer RAM input multiplexer (three 74S153's) which cooperates with the three level stack and address counter for selecting RAM addresses and the pointer RAM input.
(f) an existing key register (three 74S175's) and comparator (three 74S85's) for determining where to insert the input key among the existing key in the key data RAM. The existing key register also stores key data to be advanced to image generator 44.
(g) non key data output register (twenty-four 74S175's) for storing non key data (Xds, slope, Ydt, Zc, and CIF) to be advanced to image generator 44.
CONTROL LOGIC
Processor control logic 70 responds to instruction code and data flags contained in the data flow from data base 48 for processing the coordinate data through image processor 42. The flow tables described below disclose the logic involved in controlling each stage of image processor 42. Various hardware circuit configurations could incorporate this logic.
XII. COLOR INTENSITY FLAG--CIF (11)
In this instruction the CIF registers are loaded with CIF data from bus 307. Word counter 320B is decremented after each load until B=0.
XIV. STRING INSTRUCTION--STG (12)
In this instruction the initial face of a string of faces is processed from RAM 350 through translation stage 60 into rotation stage 62 as a string of light points or four sided faces. The vertices of the four sided faces are retrieved from RAM 350 in CCW order as described in "XI. RECALL A--RCA (9)."
XV. LOAD H--LDH (13) AND LOAD N--LDN (14)
In this instruction data is loaded into H/N address register 3 from data bus 307, and then into H/N RAM 410 as described in Section VI. H/N Ram 410 receives the data during an idle portion of its cycle.
ROTATION STAGE 62
FIG. 8A shows the logic-diagram for the processing of translated point coordinates (Vt) from translation stage 62. Each new Vt is loaded into multiplexers 416X, Y, and Z (Step I). The object code in CIF register 460 which accompanies each new Vt is examined to determine if the new Vt is associated with a 3D face requiring visibility testing (Decision A). If so, the dot product of Vt.multidot.Vn (from N RAMs 410X, Y, and Z) is calculated (Step II). The sign bit of the dot product reveals whether the 3D face is visible or not (Decision B). The vertex of visible 3D faces (Decision B - yes) and the remaining non-3D face vertices (Decision A - no) are multiplied by the three.times.three H matrix in H RAMs 410X, Y, and Z to provide the rotated vector Vc - Zc first, Yc second, and Xc last (Step III). Each coordinate is loaded into registers 450X, Y, and Z as they are calculated (Decision C and D, Steps IV, V, and VI).
CLIPPING STAGE 63
FIGS. 8 B and C show the logic diagram for the control of clipping stage 63. The first point coordinates are loaded into multiplexers 520 (Step 2) and the outcode (OC) for each point is determined by window circuits 510. The object code in CIF register 590 is examined to determine whether the first coordinate is really a polygon vertex (or line end point) or merely a single light point (Decision A). In the case of vertices (and end points), the next vertex (or other end point) is loaded and outcode (OC) determined (Step 4). The OC's are examined to determine if the edge defined by the two vertices crosses the Z=0 plane (Decision C). If the edge crosses the Z=0 plane, then the intersection point is determined by a binary search (Step 5). If the edges do not cross the Z=0 plane, then the OC's of both points are examined to determine if they both are in front of pilot's eye 220 (Z=0 plane) or behind pilot's eye 220 and therefore definitely not visible (Decision D). The endpoints of edges which intersect the Z=0 plane or which are completely in front thereof, are examined via their OC for visibility (Decisions F, G, and H, and Step 8). If both endpoints are out of view (Case 3) the OC's are examined to determine if clipping is required (Decision I). If both endpoints are in view (Case 1) or otherwise do not require clipping, the next vertex coordinates are loaded. If only one vertex is in view (Case 2) or clipping is otherwise required (Case 3), the edge is processed through the appropriate series of binary search routines based on the OC's (Decision J). The binary search routines determine the interception points of the edge with the left, right, bottom or top boundaries of image plane 262. Each interception point becomes a new vertex of a new polygon formed by the visible portion of the original polygon face.
EDGE STAGE 65
FIG. 8D shows the logic diagram for the control of projection stage 64, processor 706X and Y, and slope divider 740. The clipped points from clipping stage 63 are loaded into registers 610 for projection division (Step 1). The quotients (projected points) are forwarded from registers 640 to edge stage 65, where it is examined for face data (Decision A). Non face data such as points and line segments are forwarded immediately to FIFO memory 910. Each face data point is examined for a first vertex (Decision B), which are loaded in V1 register 718 and current Yd multiplier register 710 (Step 2). Each non first vertex is loaded into register 710 as the current Yd and the previous Yd is advanced to register 716 (Step 3). Xd is similarly processed through processor 706X. Delta X and delta Y are calculated from their current and previous values, and loaded into registers 724 (Step 4). When the last vertex becomes the previous vertex in register 716 (Decision C), the face is closed by advancing V1 from register 718 to register 710 as the current vertex (Step 5). The last slope is calculated from the previous vertex (Vlast) and the current vertex (V1) and entered into register 724. The slopes are calculated by slope divider 740 as the delta X's and delta Y's are provided (Step 6).
TEXTURE STAGE 72
FIG. 8E shows the logic diagram for the control of Yds sorter 750. Input face edges are loaded into sorter 750 and examined for horizontal edges--delta Y=0 (Decision D). Horizontal edges are forwarded to FIFO memory 910 (Step 7). The non horizontal edges are examined for a first edge (Decision E). The first edge is entered at the start of the sort list (Step 8). Non first edges are examined to determine whether the input Yds is less than the last or output Yds in sorter 750 (Decision F). Smaller input Yds are entered at the start of the sort list (Step 9). Larger Yds are examined for a last edge (Decision G). Last edge is entered in last place of sort list (Step 10). The second edge is loaded (Step 11) and examined for input Yds less than the last Yds in sorter 750 (Decision H). Smaller Yds are inserted in the sort list (Step 12). Larger Yds are examined for last edge (Decision I). Last edges are entered into the sort list (Step 13). If the input edge is not the last edge, the next edge is loaded (Step 14). The input edge is again examined for a last edge (Decision J)--return to Decision D of flow chart for non last edge, and output sorter 750 to FIFO memory 910 for last edge.
SECTION XIV
DISPLAY GENERATOR 44
TEXTURE STAGE 72
Texture Stage 72, shown in FIG. 9, provides miniraster data for the set of horizontal scan lines forming each face. The miniscan lines progressively increase and/or decrease in response to the face edge list (Xds, Yds, Xslope, and Ydt for each edge) from face generation stage 65. The miniraster data for each miniscan line includes the Xd coordinate of the left hand end point (XdL), the width of the miniscan line (W), the Yd coordinate (Yd scan), Zc and CIF.
The edge list is loaded into memory 910 in ascending Yd order by face order once each frame, and extracted in the same order twice each frame--once for the field of even miniscan lines, and once for the field of odd miniscan lines. X coordinate generators 920L and 920R provide XdLc and XdRc respectively for each miniscan line by combining Xds with the Xslopes of the two opposed edges of the face which contain the end points of the scan line. XdLs is incremented by the left hand slope (XL slope) to form each XdL, and XdRs is incremented by the right hand slope (XR slope) to form each XdR. Only generator 920 is shown in detail. Slope multiplexer 928 divides the XL slope by two (select START) for the first scan line of the even field, to accomodate the one half scan height displacement between the interlaced odd and even fields on display 82. During the remainder of the display cycle, the XL slope is passed through slope multiplexer 928 without division (select ACC) to accomodate the proper height spacing between adjacent miniscan lines in the same field. Adder 930 combines the X coordinate of the previous scan line (XdLp) with the current XL slope to provide the current X coordinate (XdLc). Output multiplexer register 940 provides either XdLs (select START) or XdLc (select ACC) to miniraster data register 950. Subtractor 952 provides the width W of each scan line by subtracting XdLc from XdRc (output of generator 920R). The Y coordinate of the miniscan lines (Yd scan) is similarly formed by incrementing Yds with Yslope from Yslope generator 960. At the end of each edge, Yd scan equals or exceeds the Ydt on the left edge (YdLt) or right edge (YdRt). The signals Yd scan .gtoreq.YdLt and Yd scan .gtoreq.YdRt indicate to control logic 70 that the next XL slope or XR slope is required in Xd generators 920.
DETAILED DESCRIPTION
FIFO memory 210 may be a 2048 words.times.100 bits memory (two hundred 82S11's) for sequentially outputting the complete edge list twice each cycle. Memory 210 interfaces with the remainder of miniraster calculator 72 through a 100 bit register (twenty five 74S175's).
XL slope register 924 may be a 20 bit storage register (five 74S175's) for holding each new Xslope as they are provided by memory 910.
XL slope multiplexer 928 may be a 20 bit 2:1 multiplexer (five 74S157's) with the START input right shifted to provide a division by two. The START and ACC select are provided by control logic 70.
XL Adder 930 may be a 20 bit adder (five 74283's) for incrementing each previous X left coordinate (XdLp) by the current XL slope.
Limit multiplexer 934 may be a 20 bit 4:1 multiplexer (ten 74S153's) for preventing underflow and overflow when an edge approaches the display boundary. The four inputs are XdLc (twice), all ones (overflow), and all zeros (underflow). The two select inputs are the sign bits of XdLc and XL slope. Underflow occurs when both sign XdLc and sign XL slope are negative. Overflow occurs when sign XdLc is negative and sign XL slope is positive.
XdLs register 938 may be a 12 bit register (three 74S175's) for holding the X coordinate of the starting end point of the current edge (Xds) as it is provided by FIFO memory 910.
Output multiplexer register 940 may be a 20 bit 2:1 multiplexer register (five 25S09's) for accumulating XdLc and outputting either XdLs or XdLc. The output is returned to adder 930 and forwarded to miniraster data register 950.
Miniraster data register 950 may be a 76 bit register (nineteen 74S175's) for holding the miniraster data (XdLc 12 bits, W 12 bits, Yd scan 12 bits, CIF 24 bits, and Z 16 bits.
Subtractor 952 may be a 12 bit subtractor (three 74283's and two 74S04's) for providing the width of each miniscan line (W=XdRc-XdLc) to register 950.
Yslope generator 960 may be a 12 bit register (three 74S175's) hardwired to specify the maximum number of miniraster scan lines per frame. This number defines the scan density or Yslope.
Yslope multiplexer 964 may be a 12 bit multiplexer (two 74S157's) similar in function to Xslope multiplexer 928.
Y Adder 968 may be a 12 bit adder (three 74283's) for combining the 12 bits of Yslope with the 12 bits of Y coordinate of the previous scan line (Ydp) to form the Y coordinate of the current scan line (Yd scan).
Multiplexer register 970 may be a 12 bit multiplexer register (three 25S09's) similar in function to output multiplexer register 940.
Ydt register 974 may be a pair of 12 bit registers (six 74S175's) for holding the Yd coordinates of the left hand edge termination point (YdLt) and the right hand edge termination point (YdRt) which are periodically forwarded by FIFO memory 910.
Comparator 978 may be a pair of 12 bit comparators (six 74S85's) for comparing Yd scan with YdLt and YdRt to determine the end of each edge.
DEFLECTION CONTROL 74
Deflection stage 74 receives Yd scan accompanied by a series of XdLc's and W's for generating the sweep voltages which provide the series of horizontal scan lines outlining each polygon face. Yd scan identifies vertical position of the first vertex. XdL identifies the left hand start of each scan line thereafter. W determines the length of each scan line. Conventional integrator techniques may be employed to provide the appropriate X and Y ramp deflection voltages. The Y ramp changes at a uniform rate starting at Yd scan to move the CRT beam vertically across the face being displayed. The X ramps change at a much faster rate starting from an XdL to move the beam horizontally a distance indicated by the associated W. Suitable deflection techniques are disclosed in detail in U.S. Pat. No. 3,999,308 entitled "Real-Time Simulation of a Point System Having Textured Areas as Viewed by a Moving Observer" issued on Dec. 28, 1976 to Robert Louis Peters.
VIDEO CONTROL 76
Video control 76 receives color and intensity data from CIF 660 in projection stage 64 for each face being displayed to control the color and display brightness of the scan lines forming that face. If desired, the display intensity may be attenuated by Zc data for range simulation. Suitable video control techniques are also disclosed in detail in U.S. Pat. No. 3,999,308.
FULL RASTER EMBODIMENT
If desired, the edge list from register 760 may be displayed on a full raster in the conventional frame manner across the entire screen of display device 82. The vertices of all visible polygon faces (or visible portions thereof) for each frame are sorted by Yds to arrange the vertices in display order by raster. Next, the contents of each scan line are sorted by Xds to arrange the vertices in order of display within each scan line. The resulting Yds - Xds sorted edge list with accompanying slope and Ydt data is processed through a conventional full raster display generator which provides the necessary vertical and horizontal sweep voltage waveforms.
SECTION XV
Operation of Shape Memory and Scaling Control
Shape memory 60M is shown in translation stage 60 (FIG. 3) as 16 word random access memory 350 which is loaded with 15 or less dependent vertices (typically from several faces) at addresses A=1 to A=15 in response to load instructions (i.e. LDA, LXY, LX, LY or LZ; see VI-4 to VI-6). Address A=0 is always occupied by Vp from flight simulator 16. The coordinates of each dependent vertex in both two dimensional and three dimensional structures depend on an initial point which is the first vertex of each face for two dimensional structures or may be an outside point for three dimensional structures (see the delta data format of Section V, shown in FIG. 2A). After shape memory 60M is loaded with dependent vertice coordinates forming fundamental shapes, the initial point of each face is provided via Recall an instruction (i.e. RCA, RXY, RCX, RCY or RCZ; see VI-7 to VI-8). Each dependent vertex is combined with its initial point by accumulator 370 to effect either the two dimension or three dimension translation (see Section VIII page 3).
Two-Dimensional Example--FIG. 10
Table I shows the load and recall instructions to input register 310 and the corresponding writing and reading by shape memory 60M for processing rectangular (128'.times.8196') runway 1010, rectangular (1'.times.64') center markings 1020A, B, C, . . . W, truncated parking lot 1030 and miscellaneous fields 1040 (512'.times.512'), 1050 (128'.times.128') and 1060 (64'.times.64'). All of the faces of the FIG. 10 scene are located in the XY ground plane and do not require any change in elevation (Z coordinate). Also, for illustrative convenience, all of the face edges are oriented parallel with the X and Y axis. The delta data entries for these axis aligned faces is merely a single X or Y entry to advance each dependent vertex over the previous vertex. Each fundamental shape of FIG. 10 may be loaded into shape memory 60M (RAM 350) by a separate load instruction on the first occassion for that fundamental shape. In Table I, the fundamental shapes are rectangular runway 1010, truncated parking lot 1030, and the largest field 1040. Each shape has been entered into RAM 350 as required. Alternatively, the entire series of fundamental shapes (or part thereof) may be loaded into RAM 350 under one instruction, to be recalled and scaled later as required. Center markings 1020 A-WW do not require a load instruction or separate space within the shape memory because they are identical in shape and orientation to previously entered runway 1010. The only difference between runway 1010 and center markings 1020 A-WW is the size and number. Center marking 1020 A-Z are provided by scaling down the data for runway 1010. Scalor control 60C (scalor 360) right shifts the binary point of the X, Y, and Z coordinates therein one place for S=1, two places for S=2, etc. An input of S=7 to scalor 360 reduces the 128'.times.8196' dimensions of runway 1010 to the 1'.times.64' dimensions of center markings 1020.
Recall instructions provide the first vertex to each face (the initial object point) and supply the addresses in RAM 350 of the delta data for the other vertices of that face. The output to rotation stage 62 is formed by each first vertex along with the accumulating sum of each first vertex and the delta data for each subsequent vertex dependent thereon. Accumulator 370 accomplishes the necessary addition.
Three-Dimensional Example--FIG. 11
Table II shows the load and recall instructions to input register 310 and the corresponding writing and reading by shape memory 60M for processing the rectangular volume (64' deep.times.128' wide.times.32' high) of hanger 1110. For illustrative convenience, the three edges of hanger 1110 are positioned parallel to the three axis of the object coordinate system. The relative positions with respect to initial point 1120 of the eight vertices of hanger 1110 are loaded into RAM 350. Next, CIF data is processed which indicates to control logic 70 that hanger 1110 is a 3D object (Obj Code=0). Other data such as intensity (I), color, scan resolution (Ver Res) etc. are also processed from the CIF entry. Initial point 1120 for hanger 1110 is loaded into RAM 350 at address A=1. Each face A-E is then recalled one at a time by means of the addresses given in the B1 word following the RCA instruction. The vertices are always recalled from RAM 350 in CCW order as viewed from the outside of the 3D object being processed. Hanger 1110 is processed through the remainder of image processor 42 as a series of adjacent faces. Additional identical hangers may be generated without reloading RAM 350 merely by loading another initial point (Vo) at address A=1 and recalling the vertices in the same order. Other building having the same fundamental shape but different dimensions may be provided by loading an initial point with different scale data S.
SECTION XVI
Conclusion
The objects of this invention are accomplished by providing shape data defining a series of fundamental shapes from which particular shapes are recalled as required throughout the image processing to form each face. The terrain data base is compressed because each object face is stored in the data base as a single initial point plus a series of addresses and a scale factor, rather than a plurality of separate vertices. As each initial point is processed, the appropriate vertices are recalled from RAM 350 to form the shape of the face and the scaling circuit reduces the shape to the required face size. The scene content may be selected to minimize the number of fundamental shapes, orientations, and sizes of the faces required. The same fundamental shapes at particular orientations are repeatedly recalled and scaled to provide the required faces.
It will be apparent to those skilled in the art that various changes may be made in the apparatus and techniques described without departing from the scope of the invention. For example, runways and peripheral building may be at an angle with respect to the X and Y axis. The alignment depicted in FIGS. 10 and 11 simplifies the enabling disclosure and does not represent a limitation of the visual system. Further, scaling does not have to be uniform for each axis. Each fundamental shape may be scaled nonuniformly by specifying a particular Sx, Sy, and Sz. The fundamental cube shape may be to scaled unilaterally scaled to form cubes of different sizes and variously shaped and sized rectangular volumes.
Claims
I claim as my Invention:
1. An image data system for providing a two dimensional perspective display of object items within a three dimensional object coordinate system formed by polygon faces, each face of which incorporates a fundamental object shape from a series of predetermined fundamental object shapes having various dimensions and orientations from a series of predetermined dimensions and orientations, and each face of which has an initial point, comprising: data source means for providing image data in accordance with a predetermined data format including the following types of image data initial position data for defining the position of the initial point for each polygon face with respect to the object coordinate system, shape data for defining the relative positions of the vertices of each object shape of the series of predetermined fundamental object shapes, with respect to the initial point for faces incorporating that object shape, each fundamental object shape being formed by straight edges of predetermined dimensions and orientations extending between the vertices of that object shape, shape data associated with each initial point for modifying the dimensions of the incorporated fundamental shape to provide the vertices of the face for that initial point, and other data associated with the initial points for defining other visual parameters for the face thereof, the image data having codes bits associated therewith for distinguishing between the initial positional data and the shape data and the other data; image data decoder means responsive to the code bits for processing each type of image data; random access memory means for receiving shape data at predetermined address locations in response to the image data decoder means; scalor means responsive to the shape data in the random access memory and to the scale data for changing the dimensions of the edges of the fundamental object shape incorporated by each face; accumulator means which receives the initial position data for each initial point in response to the image data decoder means and receives the scaled shape data for that initial point from the scalor means in response to the image data decoder means for combining each initial point with the scaled shape data therefor to provide the position data of the remaining vertices of each object face; image data processor means for providing two dimensional display coordinates for each face vertex which maintains the three dimensional perspective of the object faces; and display means for receiving the display coordinates and generating a two dimensional visual display of the object face system in perspective.
2. The system of claim 1, wherein the shape data includes the write address location of the relative position of the vertices of each object shape to be entered into the random access memory means.
3. The system of claim 2, wherein the initial position data of each initial point includes the read address location within the random access memory means of the relative position of the vertices of the object shape incorporated in the polygon face of that initial point.
4. The system of claim 3, wherein the write and read address locations of the relative positions of the vertices of each object shape are sequential within the random access memory means and the shape data and initial position data each further include the start address of the sequence of address locations for each object shape.
5. The system of claim 4, wherein image data control means includes an address counter which receives the start address of each object shape from the shape data therefor and which is incremented after each vertex relative position is entered into the random access memory for identifying the address location of the next vertex relative position of that object shape.
6. The system of claim 5, wherein the shape data for each object shape further includes the number of address locations required to store the relative positions of the vertices of each object shape.
7. The system of claim 6, wherein the initial position data for each initial point further includes the number of address locations required to store the relative positions of the vertices of the object shape incorporated by the polygon face of that initial point.
8. The system of claim 4, wherein some polygon faces form two dimensional object items within the three dimensional object coordinate system, and the initial point for each of these some polygon faces is the first vertex of that polygon face.
9. The system of claim 8, wherein the shape data for each sequentially addressed vertex of each of the some polygon faces for the two dimensional object items defines the relative position of the second vertex of each polygon object face with respect to the position of the initial object point of that face, and defines the relative position of each remaining sequential vertex of that face with respect to the immediately previous vertex.
10. The system of claim 9, wherein the accumulator means adds the relative position of second vertex of each polygon face to the position of the initial point for that face to determine the position of the first vertex, and adds the relative position of each subsequent vertex to the position of the immediately previous vertex to determine the position of each subsequent vertex.
11. The system of claim 4, wherein other polygon faces form three dimensional object items within the three dimensional object coordinate system, and the initial point of each of these other polygon faces is not one of the vertices thereof.
12. The system of claim 11, wherein the shape data for each sequentially addressed vertex of each of the other polygon faces for the three dimensional object items defines the relative position of each vertex of each face with respect to the initial point for that face.
13. The system of claim 12, wherein the accumulator adds the relative position of each vertex of each polygon face to the position of the initial point for that polygon face to determine the position of each vertex of that face.
14. The system of claim 4, wherein the scalor means provides the polygon faces by changing the dimensions of the edges of the fundamental shapes by a power of two.
15. The system of claim 14, wherein the scalor means provides the polygon faces by changing the dimensions of the edges by shifting the binary point of the relative position coordinates of each vertex of the fundamental object shape incorporated in that face.
16. The system of claim 14, wherein the scalor means provides the polygon faces by uniformly changing the dimensions of the edges by shifting the binary point of each coordinate of the relative position of each vertex of that face an equal number of places.