US 6,717,577 B1Grant
Vertex cache for 3D computer graphics
Issue Date:2004-04-06
•21 Claims
•10 Drawing Sheets
Abstract
In a 3D interactive computer graphics system such as a video game display system, polygon vertex data is fed to a 3D graphics processor/display engine via a vertex cache used to cache and organize indexed primitive vertex data streams. The vertex cache may be a small, low-latency cache memory local to the display engine hardware. Polygons can be represented as indexed arrays, e.g., indexed linear lists of data components representing some feature of a vertex (for example, positions, colors, surface normals, or texture coordinates). The vertex cache can fetch the relevant blocks of indexed vertex attribute data on an as-needed basis to make it available to the display processor—providing spatial locality for display processing without requiring the vertex data to be prestored in display order. Efficiency can be increased by customizing and optimizing the vertex cache and associated tags for the purpose of delivering vertices to the graphics engine—allowing more efficient prefetching and assembling of vertices than might be possible using a general-purpose cache and tag structure.
Metadata
Assignee
- Nintendo Co., Ltd.
Inventors
- Howard H. Cheng
- Robert Moore
- Farhad Fouladi
- Timothy J. Van Hook
Application Information
Application Number:US 09/465,754
Filing Date:1999-12-17
Priority Date:1999-10-28
Art Unit:7
Classifications
IPC:
G06T 1500
Field of Search:
34550334543034552634542034550234558234550634552234541934542334544134550134556834553734555771111871113371112836523003716 20707101
Patent Drawings (10 sheets)
Description
[0002] This application claims the benefit of Provisional application Ser. No. 60/161,915, filed Oct. 28, 1999.
FIELD OF THE INVENTION
[0003] The present invention relates to 3D interactive computer graphics, and more specifically, to arrangements and techniques for efficiently representing and storing vertex information for animation and display processing. Still more particularly, the invention relates to a 3D graphics integrated circuit including a vertex cache for more efficient imaging of 3D polygon data.
BACKGROUND AND SUMMARY OF THE INVENTION
[0004] Modem 3D computer graphics systems construct animated displays from display primitives, i.e., polygons. Each display object (e.g., a tree, a car, or a person or other character) is typically constructed from a number of individual polygons. Each polygon is represented by its vertices—which together specify the location, orientation and size of the polygon in three-dimensional space—along with other characteristics (e.g., color, surface normals for shading, textures, etc.). Computer techniques can efficiently construct rich animated 3D graphical scenes using these techniques.
[0005] Low cost, high speed interactive 3D graphics systems such as video game systems are constrained in terms of memory and processing resources. Therefore, in such systems it is important to be able to efficiently represent and process the various polygons representing a display object. For example, it is desirable to make the data representing the display object compact, and to present the data to the 3D graphics system in a way so that all of the data needed for a particular task is conveniently available.
[0006] One can characterize data in terms of temporal locality and spatial locality. Temporal locality means the same data is being referenced frequently in a small amount of time. In general, the polygon-representing data for typical 3D interactive graphics applications has a large degree of temporal locality. Spatial locality means that the next data item referenced is stored close in memory to the last one referenced. Efficiency improvements can be realized by increasing the data's spatial locality. In a practical memory system that does not allow unlimited low-latency random access to an unlimited amount of data, performance is increased if all data needed to perform a given task is stored close together in low-latency memory.
[0007] To increase the spatial locality of the data, one can sort the polygon data based on the order of processing—assuring that all of the data needed to perform a particular task will be presented at close to the same time so it can be stored together. For example, polygon data making up animations can be sorted in a way that is preferential to the type of animation being performed. As one example, typical complex interactive real-time animation such as surface deformation requires manipulation of all the vertices at the surfaces. To perform such animation efficiently, it is desirable to sort the vertex data in a certain way.
[0008] Typical 3D graphical systems perform animation processing and display processing separately, and these separate steps process the data differently. Unfortunately, the optimal order to sort the vertex data for animation processing is generally different from the optimal sort order for display processing. Sorting for animation may tend to add randomness to display ordering. By sorting a data stream to simplify animation processing, we make it harder to efficiently display the data.
[0009] Thus, for various reasons, it may not be possible to assume that spatial locality exists when accessing data for display. Difficulty arises from the need to efficiently access an arbitrarily large display object. In addition, for the reasons explained above, there will typically be some amount of randomness—at least for display purposes—in the order the vertex data is presented to the display engine. Furthermore, there may be other data locality above the vertex level that would be useful to implement (e.g., grouping together all polygons that share a certain texture).
[0010] One approach to achieving higher efficiency is to provide additional low-latency memory (e.g., the lowest latency memory system affordable). It might al so be possible to fit a display object in fast local memory to achieve random access. However, objects can be quite large, and may need to be double-buffered. Therefore, the buffers required for such an approach could be very large. It might also be possible to use a main CPU's data cache to assemble and sort the polygon data in an optimal order for the display engine. However, to do this effectively, there would have to be some way to prevent the polygon data from thrashing the rest of the data cache. In addition, there would be a need to prefetch the data to hide memory latency—since there will probably be some randomness in the way even data sorted for display order is accessed. Additionally, this approach would place additional loading on the CPU—especially since there might be a need in certain implementations to assemble the data in a binary format the display engine can interpret. Using this approach, the main CPU and the display engine would become serial, with the CPU feeding the data directly to the graphics engine. Parallelizing the processing (e.g., to feed the display engine through a DRAM FIFO buffer) would require substantial additional memory access bandwidth as compared to immediate-mode feeding.
[0011] Thus, there exists a need for more efficient techniques that can be used to represent, store and deliver polygon data for a 3D graphics display process.
[0012] The present invention solves this problem by providing a vertex cache to organize indexed primitive vertex data streams.
[0013] In accordance with one aspect provided by the present invention, polygon vertex data is fed to the 3D graphics processor/display engine via a vertex cache. The vertex cache may be a small, low-latency memory that is local to (e.g., part of) the 3D graphics processor/display engine hardware. Flexibility and efficiency results from the cache providing a virtual memory view much larger than the actual cache contents.
[0014] The vertex cache may be used to build up the vertex data needed for display processing on the fly on an as-needed basis. Thus, rather than pre-sorting the vertex data for display purposes, the vertex cache can simply fetch the relevant blocks of data on an as-needed basis to make it available to the display processor. Based on the high degree of temporal locality exhibited by the vertex data for interactive video game display and the use of particularly optimal indexed-array data structures (see below), most of the vertex data needed at any given time will be available in even a small set-associative vertex cache having a number of cache lines proportional to the number of vertex data streams. One example optimum arrangement provides a 512×128-bit dual ported RAM to form an 8 set-associative vertex cache.
[0015] Efficiency can be increased by customizing and optimizing the vertex cache and associated tags for the purpose of delivering vertices to the 3D graphics processor/display engine—allowing more efficient prefetching and assembling of vertices than might be possible using a general-purpose cache and tag structure. Because the vertex cache allows data to be fed directly to the display engine, the cost of additional memory access bandwidth is avoided. Direct memory access may be used to efficiently transfer vertex data into the vertex cache.
[0016] To further increase the efficiencies afforded by the vertex cache, it is desirable to reduce the need to completely re-specify a particular polygon or set of polygons each time it is (they are) used. In accordance with a further aspect provided by the present invention, polygons can be represented as arrays, e.g., linear lists of data components representing some feature of a vertex (for example, positions, colors, surface normals, or texture coordinates). Each display object may be represented as a collection of such arrays along with various sets of indices. The indices reference the arrays for a particular animation or display purpose. By representing polygon data as indexed component lists, discontinuities are allowed between mappings. Further, separating out individual components allows data to be stored more compactly (e.g., in a fully compressed format). The vertex cache provided by the present invention can accommodate streams of such indexed data up to the index size.
[0017] Through use of an indexed vertex representation in conjunction with the vertex cache, there is no need to provide any resorting for display purposes. For example, the vertex data may be presented to the display engine in a order presorted for animation as opposed to display—making animation a more efficient process. The vertex cache uses the indexed vertex data structure representation to efficiently make the vertex data available to the display engine without any need for explicit resorting.
[0018] Any vertex component can be index-referenced or directly inlined in the command stream. This enables efficient data processing by the main processor without requiring the main processor's output to conform to the graphics display data structure. For example, lighting operations performed by the main processor may generate only a color array from a list of normals and positions by loop-processing a list of lighting parameters to generate the color array. There is no need for the animation process to follow a triangle list display data structure, nor does the animation process need to reformat the data for display. The display process can naturally consume the data provided by the animation process without adding substantial data reformatting overhead to the animation process.
[0019] On the other hand, there is no penalty for sorting the vertex data in display order; the vertex data is efficiently presented to the display engine in either case, without the vertex cache significantly degrading performance vis-a-vis a vertex presentation structure optimized for presenting data presorted for display.
[0020] In accordance with a further aspect provided by this invention, the vertex data includes quantized, compressed data streams in any of several different formats (e.g., 8-bit fixed point, 16-bit fixed point, or floating point). This data can be indexed (i.e., referenced by the vertex data stream) or direct (i.e., contained within the stream itself). These various data formats can all be stored in the common vertex cache, and subsequently decompressed and converted into a common format for the graphics display pipeline. Such hardware support of flexible types, formats and numbers of attributes as either immediate or indexed input data avoids complex and time-consuming software data conversion.
BRIEF DESCRIPTION OF THE DRAWINGS
[0021] These and other features and advantages provided by the present invention will be better and more completely understood by referring to the following detailed description of preferred embodiments in conjunction with the drawings of which:
[0022] FIG. 1 is a block diagram of an example interactive 3D graphics system;
[0023] FIG. 1A is a block diagram of the example graphics and audio coprocessor shown in FIG. 1;
[0024] FIG. 1B is a more detailed schematic diagram of portions of the FIG. 1A graphics and audio coprocessor showing an example 3D pipeline graphics processing arrangement;
[0025] FIG. 2 shows an example command processor including a vertex cache provided with vertex index array data;
[0026] FIG. 2A shows an example display list processor including a vertex cache provided in accordance with the present invention;
[0027] FIG. 2B shows an example dual FIFO arrangement;
[0028] FIG. 3 is a schematic diagram of an example indexed vertex data structure;
[0029] FIG. 3A shows an example vertex descriptor block;
[0030] FIG. 4 is a block diagram of an example vertex cache implementation;
[0031] FIG. 5 shows an example vertex cache memory address format; and
[0032] FIG. 6 shows an example vertex cache tag status register format.
DETAILED DESCRIPTION OF PRESENTLY PREFERRED EXAMPLE EMBODIMENTS
[0033] FIG. 1 is a schematic diagram of an overall example interactive 3D computer graphics system 100 in which the present invention may be practiced. System 100 can be used to play interactive 3D video games accompanied by interesting stereo sound. Different games can be played by inserting appropriate storage media such as optical disks into an optical disk player 134. A game player can interact with system 100 in real time by manipulating input devices such as handheld controllers 132, which may include a variety of controls such as joysticks, buttons, switches, keyboards or keypads, etc.
[0034] System 100 includes a main processor (CPU) 102, a main memory 104, and a graphics and audio coprocessor 106. In this example, main processor 102 receives inputs from handheld controllers 132 (and/or other input devices) via coprocessor 100. Main processor 102 interactively responds to such user inputs, and executes a video game or other graphics program supplied, for example, by external storage 134. For example, main processor 102 can perform collision detection and animation processing in addition to a variety of real time interactive control functions.
[0035] Main processor 102 generates 3D graphics and audio commands and sends them to graphics and audio coprocessor 106. The graphics and audio coprocessor 106 processes these commands to generate interesting visual images on a display 136 and stereo sounds on stereo loudspeakers 137R, 137L or other suitable sound-generating devices.
[0036] System 100 includes a TV encoder 140 that receives image signals from coprocessor 100 and converts the image signals into composite video signals suitable for display on a standard display device 136 (e.g., a computer monitor or home color television set). System 100 also includes an audio codec (compressor/decompressor) 138 that compresses and decompresses digitized audio signals (and may also convert between digital and analog audio signalling formats). Audio codec 138 can receive audio inputs via a buffer 140 and provide them to coprocessor 106 for processing (e.g., mixing with other audio signals the coprocessor generates and/or receives via a streaming audio output of optical disk device 134). Coprocessor 106 stores audio related information in a memory 144 that is dedicated to audio tasks. Coprocessor 106 provides the resulting audio output signals to audio codec 138 for decompression and conversion to analog signals (e.g., via buffer amplifiers 142L, 142R) so they can be played by speakers 137L, 137R.
[0037] Coprocessor 106 has the ability to communicate with various peripherals that may be present within system 100. For example, a parallel digital bus 146 may be used to communicate with optical disk device 134. A serial peripheral bus 148 may communicate with a variety of peripherals including, for example, a ROM and/or real time clock 150, a modem 152, and flash memory 154. A further external serial bus 156 may be used to communicate with additional expansion memory 158 (e.g., a memory card).
Graphics And Audio Coprocessor
[0038] FIG. 1A is a block diagram of components within coprocessor 106. Coprocessor 106 may be a single integrated circuit. In this example, coprocessor 106 includes a 3D graphics processor/display engine 107, a processor interface 108, a memory interface 110, an audio digital signal processor (DSP) 162, an audio memory interface (I/F) 164, an audio interface and mixer 166, a peripheral controller 168, and a display controller 128.
[0039] 3D graphics processor/display engine 107 performs graphics processing tasks, and audio digital signal processor 162 performs audio processing tasks. Display controller 128 accesses image information from memory 104 and provides it to TV encoder 140 for display on display device 136. Audio interface and mixer 166 interfaces with audio codec 138, and can also mix audio from different sources (e.g., a streaming audio input from disk 134, the output of audio DSP 162, and external audio input received via audio codec 138). Processor interface 108 provides a data and control interface between main processor 102 and coprocessor 106. Memory interface 110 provides a data and control interface between coprocessor 106 and memory 104. In this example, main processor 102 accesses main memory 104 via processor interface 108 and memory controller 110 that are part of coprocessor 106. Peripheral controller 168 provides a data and control interface between coprocessor 106 and the various peripherals mentioned above (e.g., optical disk device 134, controllers 132, ROM and/or real time clock 150, modem 152, flash memory 154, and memory card 158). Audio memory interface 164 provides an interface with audio memory 144.
[0040] FIG. 1B shows a more detailed view of 3D graphics processor/display engine 107 and associated components within coprocessor 106. 3D graphics processor/display engine 107 includes a command processor 114 and a 3D graphics pipeline 116. Main processor 102 communicates streams of graphics data (i.e., display lists) to command processor 114. Command processor 114 receives these display commands and parses them (obtaining any additional data necessary to process them from memory 104), and provides a stream of vertex commands to graphics pipeline 116 for 3D processing and rendering. Graphics pipeline 116 generates a 3D image based on these commands. The resulting image information may be transferred to main memory 104 for access by display controller 128—which displays the frame buffer output of pipeline 116 on display 136.
[0041] In more detail, main processor 102 may store display lists in main memory 104, and pass pointers to command processor 114 via bus interface 108. The command processor 114 (which includes a vertex cache 212 discussed in detail below) fetches the command stream from CPU 102, fetches vertex attributes from the command stream and/or from vertex arrays in memory, converts attribute types to floating point format, and passes the resulting complete vertex polygon data to the graphics pipeline 116 for rendering/rasterization. As explained in more detail below, vertex data can come directly from the command stream, and/or from a vertex array in memory where each attribute is stored in its own linear array. A memory arbitration circuitry 130 arbitrates memory access between graphics pipeline 116, command processor 114 and display unit 128. As explained below, an on-chip 8-way set-associative vertex cache 212 is used to reduce vertex attribute access latency.
[0042] As shown in FIG. 1B, graphics pipeline 116 may include transform unit 118, a setup/rasterizer 120, a texture unit 122, a texture environment unit 124 and a pixel engine 126. In graphics pipeline 116, transform unit 118 performs a variety of 3D transform operations, and may also perform lighting and texture effects. For example, transform unit 118 transforms incoming geometry per vertex from object space to screen space; transforms incoming texture coordinates and computes projective texture coordinates; performs polygon clipping; performs per vertex lighting computations; and performs bump mapping texture coordinate generation. Set up/rasterizer 120 includes a set up unit which receives vertex data from the transform unit 118 and sends triangle set up information to rasterizers performing edge rasterization, texture coordinate rasterization and color rasterization. Texture unit 122 performs various tasks related to texturing, including multi-texture handling, post-cache texture decompression, texture filtering, embossed bump mapping, shadows and lighting through the use of projective textures, and BLIT with alpha transparency and depth. Texture unit 122 outputs filtered texture values to the texture environment unit 124. Texture environment unit 124 blends the polygon color and texture color together, performing texture fog and other environment-related functions. Pixel engine 126 performs z buffering and blending, and stores data into an on-chip frame buffer memory.
[0043] Thus, graphics pipeline 116 may include one or more embedded DRAM memories (not shown) to store-frame buffer and/or texture information locally. The on-chip frame buffer is periodically written to main memory 104 for access by display unit 128. The frame buffer output of graphics pipeline 116 (which is ultimately stored in main memory 104) is read each frame by display unit 128. Display unit 128 provides digital RGB pixel values for display on display 136.
Vertex Cache And Vertex Index Array
[0044] FIG. 2 is a schematic illustration of command processor 114 including a vertex cache 212 and a display list processor 213. Command processor 114 handles a wide range of vertex and primitive data structures, from a single stream of vertex data containing position, normal, texture coordinates and colors to fully indexed arrays. Any vertex component can be index-referenced or directly in-lined in the command stream. Command processor 114 thus supports flexible types, formats and numbers of attributes as either immediate or indexed data.
[0045] Display list processor 213 within command processor 114 processes display list commands provided by CPU 102—typically via a buffer allocated within main memory 104. Vertex cache 212 caches indexed polygon vertex data structures such as the example data structure 300 shown in FIG. 2. Example indexed polygon vertex data structure 300 may include a vertex index array 304 which references a number of vertex component data arrays (e.g., a color data array 306a, a texture vertex data array 306b, a surface normal data array 306c, a position vertex data array 306d, and so on). Vertex cache 212 accesses the vertex data from these arrays 306 in main memory 104, and caches them for fast access and use by display list processor 213.
Display List Processor
[0046] FIG. 2A shows example display list processor 213 performed by command processor 114. In this FIG. 2A example, display list processor 213 provides several stages of parsing. Display list commands received from main processor 102 are interpreted by a display list stream parser 200. Display list stream parser 200 may use an address stack 202 to provide nesting of instructions—or dual FIFOS may be used to store a stream of vertex commands from a FIFO in main memory 106 to allow subroutine branching in instancing (see FIG. 2B) without need for reloading prefetched vertex command data. Using the FIG. 2B approach, the display list commands may thus provide for a one-level-deep display list—where the top level command stream can call the display list one level deep. This “call” capability is useful for pre-computed commands and instancing in geometry.
[0047] Display list stream parser 200 routes commands that affect the state of graphics pipeline 116 to the graphics pipeline. The remaining primitive command stream is parsed by a primitive stream parser 204 based on a primitive descriptor obtained from memory 104 (see below).
[0048] The indices to vertices are de-referenced and parsed by a vertex stream parser 208 based on a vertex descriptor 306 which may be provided in a table in hardware. The vertex stream provided to vertex stream parser 208 may include such indices to vertex data stored within main memory 104. Vertex stream parser 208 can access this vertex data from main memory 104 via vertex cache 212—thus separately providing the vertex commands and associated referenced vertex attributes via different paths in the case of indexed as opposed to direct data. In one example, vertex stream parser 208 addresses vertex cache 212 as if it were the entirety of main memory 104. Vertex cache 212, in turn, retrieves (and often times, may prefetch) vertex data from main memory 104, and caches it temporarily for use by vertex stream parser 208. Caching the vertex data in vertex cache 212 reduces the number of accesses to main memory 104—and thus the main memory bandwidth required by command processor 114.
[0049] Vertex stream parser 208 provides data for each vertex to be rendered within each triangle (polygon). This per-vertex data is provided, along with the per-primitive data outputted by primitive stream parser 204, to a decompression/inverse quantizer block 214. Inverse quantizer 214 converts different vertex representations (e.g., 8-bit and 16-bit fixed point format data) to a uniform floating-point representation used by graphics pipeline 116. Inverse quantizer 214 provides hardware support for a flexible variety of different types, formats and numbers of attributes, and such data can be presented to display list processor 213 as either immediate or indexed input data. The uniform floating-point representation output of inverse quantizer 214 is provided to graphics pipeline 116 for rasterization and further processing. If desired as an optimization, a further small cache or buffer may be provided at the output of inverse quantizer 214 to avoid the need to re-transform vertex strip data.
Vertex Index Array
[0050] FIG. 3 shows a more detailed example of an indexed vertex list 300 of the preferred embodiment used to provide indirect (i.e., indexed) vertex attribute data via vertex cache 212. This generalization indexed vertex list 300 may be used to define primitives in the system shown in FIG. 1. Each primitive is described by a list of indices, each of which indexes into an array of vertices. Vertices and primitives each use format descriptors to define the types of their items. These descriptors associate an attribute with a type. An attribute is a data item that has a specific meaning to the rendering hardware. This affords the possibility of programming the hardware with descriptors so it can parse and convert the vertex/primitive stream as it is loaded. Using the minimum size type and the minimum number of attributes per vertex leads to geometry compression. The FIG. 3 arrangement also allows attributes to be associated with the vertices, the indices, or the primitive, as desired.
[0051] Thus, in the FIG. 3 example indexed vertex array 300, a primitive list 302 defines each of the various primitives (e.g., triangles) in the data stream (e.g., prim0, prim1, prim2, prim3, . . . ). A primitive descriptor block 308 may provide attributes common to a primitive (e.g., texture and connectivity data which may be direct or indexed). Each primitive within primitive list 302 indexes corresponding vertices within a vertex list 304. A single vertex within vertex list 304 may be used by multiple primitives within primitive list 302. If desired, primitive list 302 may be implied rather than explicit—i.e., vertex list 304 can be ordered in such a way as to define corresponding primitives by implication (e.g., using triangle strips).
[0052] A vertex descriptor block 306 may be provided for each vertex within vertex list 304. Vertex descriptor block 306 includes attribute data corresponding to a particular vertex (e.g., rgb or other color data, alpha data, xyz surface normal data). As shown in FIG. 2, vertex descriptor block 306 may comprise a number of different indexed component blocks. The vertex attribute descriptor block 30610 defines which vertex attributes are present, the number and size of the components, and how the components are referenced (e.g., either direct—that is, included within the quantized vertex data stream—or indexed). In one example, the vertices in a DRAW command for a particular primitive all have the same vertex attribute data structure format.
[0053] FIG. 3A shows an example list of attributes provided by vertex attribute block 306. The following attributes may be provided:
| Attribute |
|---|
[0054] In this example vertex attribute descriptor block 306, the position attribute is always present, may be either indexed or direct, and can take a number of different quantized, compressed formats (e.g., floating point, 8-bit, integer, or 16-bit). All remaining attributes may or may not be present for any given vertex, and may be either indexed or direct as desired. The texture coordinate values may, like the position values, be represented in a variety of different formats (e.g., 8-bit integer, 16-bit integer or floating point), as can the surface normal attribute. The diffused and specular color attributes may provide 3 (rgb) or 4 (rgba) values in a variety of formats including 16-bit threes-complement, 24-bit threes-complement, 32-bit threes-complement, or 16-, 24- or 32-bit fours-complement representations). All vertices for a given primitive preferably have the same format.
[0055] In this example, vertex descriptor 306 references indexed data using a 16-bit pointer into an array of attributes. A particular offset used to access a particular attribute within the array depends upon a number of factors including, e.g., the number of components in the attribute; the size of the components, padding between attributes for alignment purposes; and whether multiple attributes are interleaved in the same array. A vertex can have direct and indirect attributes intermixed, and some attributes can be generated by the hardware (e.g., generating a texture coordinate from a position). Any attribute can be sent either directly or as an index into an array. Vertex cache 212 includes sufficient cache lines to handle the typical number of respective data component streams (e.g., position, normal, color and texture) without too many cache misses.
Vertex Cache Implementation
[0056] FIG. 4 shows an example schematic diagram of vertex cache 212 and associated logic. Vertex cache 212 in this example includes an 8-Kilobyte cache memory 400 organized as a 512×128-bit dual ported RAM. Since there are multiple attribute streams being looked up in the cache 212, an eight set-associative cache including eight tag lines 402 is used to reduce thrashing. Each tag line includes a 32×16 bit dual ported tag RAM 404 and associated tag status register 406. Tag RAMS 404 store the main memory address of the corresponding data block stored within vertex RAM 400. Address calculation block 408 determines whether necessary vertex attribute data is already present within vertex RAM 400—or whether an additional fetch to main memory is required. Cache lines are prefetched from main memory 104 to hide memory latency. Data required to process a particular component is stored within a queue 410 having a depth that is proportional to memory latency.
[0057] FIG. 5 shows an example memory address format provided by vertex stream parser 208 to vertex cache 212. This memory address 450 includes a field 452 providing a byte offset into a cache line; a tag RAM address 454; and a main memory address for comparison with the contents of tag RAMs 404. Address calculation block 408 compares the main memory address 456 with the tag RAM 404 contents to determine whether the required data is already cached within vertex RAM 400, or whether it needs to be fetched from main memory 104.
[0058] The tag status registers 406 store data in the format shown in FIG. 6. A “data valid” field 462 indicates whether the data in that particular cache line is valid. A counter field 464 keeps track of the number of entries in queue 410 that depend on the cache line. Counter field 464 is used in the case that all tag status registers 406 show “data valid” if a miss occurs. Address calculation block 408 then needs to throw one of the cache lines out to make room for the new entry. If counter field 464 is not zero, the cache line is still in use and cannot be thrown away. Based on a modified partial LRU algorithm, address calculation block 408 selects one of the cache lines for replacement. The “data valid” field 462 is set to “invalid”, and the cache line is replaced with a new contents from main memory 104. If another attribute index maps to the same cache line, the counter field 464 is incremented. Once the data arrives from main memory 104, the “data valid” bit is set and an entry can be processes from queue 410. Otherwise, the processing of queue 410 will be stalled until the data gets into the cache RAM 400. Once the cache RAM 400 is accessed for the queue entry, counter 464 decrements.
[0059] While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not to be limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims.
Claims
We claim:
1. A 3D videographics system including:
a memory storing polygon vertex data, and
a 3D graphics engine including a graphics pipeline having at least a transform unit, a rasterizer, a texture unit and a pixel engine, said 3D graphics engine generating and displaying images at least in part in response to said polygon vertex data,
said 3D graphics engine comprising a vertex cache arrangement operatively coupled to said memory, said vertex cache arrangement caching said polygon vertex data from said memory prior to use by said 3D graphics engine transform unit, wherein said polygon vertex data includes an indexed polygon vertex data structure and said vertex cache arrangement operates in accordance with said indexed polygon vertex data structure representation to cache vertex attribute data and make it available for efficient access by the 3D graphics engine transform unit without requiring explicit resorting of said polygon vertex data for image display.
2. A vertex cache arrangement as in claim 1 wherein 3D graphics engine is disposed on an integrated circuit, and said vertex cache arrangement comprises a memory device disposed on said integrated circuit and operatively coupled to said 3D graphics engine.
3. A vertex cache arrangement as in claim 2 wherein said memory device comprises a set-associative cache memory for caching said vertex data.
4. A vertex cache arrangement as in claim 3 wherein said set-associative cache memory provides eight cache lines.
5. A vertex cache arrangement as in claim 2 wherein said memory device comprises an 8 kilobyte low-latency random access memory.
6. A vertex cache arrangement as in claim 1 including a queue and a miss queue.
7. A vertex cache arrangement as in claim 1 wherein said vertex cache arrangement is coupled to said memory and, in use, fetches vertex data from said memory as said vertex data is needed by said 3D graphics engine.
8. A vertex cache arrangement as in claim 1 further including a hardware-based inverse quantizer operatively coupled between said vertex cache and said 3D graphics engine, said inverse quantizer converting plural vertex data formats into a uniform floating-point format for consumption by said 3D graphics engine.
9. A vertex cache arrangement as in claim 1 wherein said indexed vertex data representation comprises an indexed array referencing attribute data.
10. A vertex cache arrangement as in claim 9 wherein said indexed array directly references said attribute data.
11. A vertex cache arrangement as in claim 1 wherein said indexed polygon vertex data structure comprises an indexed array referencing vertex attribute data.
12. A vertex cache arrangement as in claim 11 wherein said indexed array directly references said attribute data.
13. A vertex cache arrangement as in claim 11 wherein said indexed array indirectly references said attribute data.
14. In a 3D videographics system including a memory storing polygon vertex data, and a 3D graphics engine including a graphics pipeline having at least a transform unit, a rasterizer, a texture unit and a pixel engine, said 3D graphics engine generating and displaying images at least in part in response to said polygon vertex data,
a method for caching polygon vertex data prior to use by said 3D graphics engine transform unit, said method including the steps of:
representing said polygon vertex data by an indexed polygon vertex data structure;
retrieving said polygon vertex data from said memory; and
caching said polygon vertex data in a low-latency cache memory device local to said 3D graphics engine to make said vertex data available for efficient access by the 3D graphics engine transform unit.
15. A method as in claim 14 further including the step of fetching vertex data from said memory to said cache memory device as said vertex data is needed by said 3D graphics engine.
16. A method as in claim 14 further including the step of converting plural vertex data formats stored in said cache memory device into a uniform floating-point format for consumption by said 3D graphics engine.
17. A 3D videographics system including:
a memory storing polygon vertex data and
a 3D graphics pipeline that renders and displays images at least in part in response to said polygon vertex data,
wherein said polygon vertex data includes an indexed polygon vertex data structure and said videographics system further comprises a vertex cache operatively coupled to said memory and to a command stream processor, said vertex cache retrieving and caching polygon vertex data from said memory prior to use by said 3D graphics pipeline according to said indexed polygon vertex data structure representation, wherein said vertex data is made available for efficient access by the 3D graphics pipeline without requiring explicit resorting of said polygon vertex data for image display.
18. A vertex data caching arrangement for a 3D videographics system comprising:
a memory storing polygon vertex attribute data and an indexed polygon vertex data structure indexing at least a portion of said polygon vertex attribute data;
a command stream processor that parses at least indices corresponding to said indexed polygon vertex data structure and provides said parsed indices to a low-latency cache memory device;
a low-latency cache memory device operatively coupled to the command stream processor and to said memory, said cache memory device retrieving polygon vertex attribute data from said memory in response to at least parsed indices provided by the command stream processor and caching the retrieved vertex attribute data; and
a graphics pipeline coupled to said cache memory device, said graphics pipeline generating image data for displaying at least in part in response to the vertex attribute data cached in said low-latency cache memory device.
19. A memory device storing a 3D graphics command stream for use by a 3D graphics engine of the type including a graphics pipeline having at least a transform unit, a rasterizer, a texture unit and a pixel engine, said 3D graphics engine, in use, generating images for display at least in part in response to said 3D graphics command stream, said 3D graphics engine including a vertex cache that caches polygon vertex data from memory prior to use by said transform unit, said stored graphics command stream including a vertex stream that references indexed polygon vertex attribute data cached in the vertex cache for efficient use by said graphics pipeline without requiring explicit re-ordering of vertices represented by said vertex stream specially for image display.
20. The memory device of claim 19 wherein the vertex stream directly references at least some of the indexed polygon vertex attribute data.
21. The memory device of claim 19 wherein the vertex stream references a vertex descriptor array including color and position attributes.
Patent Citations (357)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4275413(A) | 1981-06-01 | Sakamoto et al. | Applicant |
| US4357624(A) | 1982-11-01 | Greenberg | Applicant |
| US4463380(A) | 1984-07-01 | Hooks, Jr. | Applicant |
| US4586038(A) | 1986-04-01 | Sims et al. | Applicant |
| US4600919(A) | 1986-07-01 | Stern | Applicant |
| US4615013(A) | 1986-09-01 | Yan et al. | Applicant |
| US4625289(A) | 1986-11-01 | Rockwood | Applicant |
| US4692880(A) | 1987-09-01 | Merz et al. | Applicant |
| US4808988(A) | 1989-02-01 | Burke et al. | Applicant |
| US4817175(A) | 1989-03-01 | Tenenbaum et al. | Applicant |
| US4855934(A) | 1989-08-01 | Robinson | Applicant |
| US4888712(A) | 1989-12-01 | Barkans et al. | Applicant |
| US4897806(A) | 1990-01-01 | Cook et al. | Applicant |
| US4907174(A) | 1990-03-01 | Priem | Applicant |
| US4918625(A) | 1990-04-01 | Yan | Applicant |
| US4935879(A) | 1990-06-01 | Ueda | Applicant |
| US4974176(A) | 1990-11-01 | Buchner et al. | Applicant |
| US4974177(A) | 1990-11-01 | Nishiguchi | Applicant |
| US4989138(A) | 1991-01-01 | Radochonski | Applicant |
| US5003496(A) | 1991-03-01 | Hunt, Jr. et al. | Applicant |
| US5016183(A) | 1991-05-01 | Shyona | Applicant |
| US5018076(A) | 1991-05-01 | Johary et al. | Applicant |
| US5043922(A) | 1991-08-01 | Matsumoto | Applicant |
| US5062057(A) | 1991-10-01 | Blacken et al. | Applicant |
| US5091967(A) | 1992-02-01 | Ohsawa | Applicant |
| US5097427(A) | 1992-03-01 | Lathrop et al. | Applicant |
| US5144291(A) | 1992-09-01 | Nishizawa | Applicant |
| US5204944(A) | 1993-04-01 | Wolberg et al. | Applicant |
| US5224208(A) | 1993-06-01 | Miller, Jr. et al. | Applicant |
| US5239624(A) | 1993-08-01 | Cook et al. | Applicant |
| US5241658(A) | 1993-08-01 | Masterson et al. | Applicant |
| US5255353(A) | 1993-10-01 | Itoh | Applicant |
| US5268995(A) | 1993-12-01 | Diefendorff et al. | Applicant |
| US5268996(A) | 1993-12-01 | Steiner et al. | Applicant |
| US5278948(A) | 1994-01-01 | Luken, Jr. | Applicant |
| US5307450(A) | 1994-04-01 | Grossman | Applicant |
| US5315692(A) | 1994-05-01 | Hansen et al. | Applicant |
| US5345541(A) | 1994-09-01 | Kelley et al. | Applicant |
| US5353424(A) | 1994-10-01 | Partovi et al. | Examiner |
| US5357579(A) | 1994-10-01 | Buchner et al. | Applicant |
| US5361386(A) | 1994-11-01 | Watkins et al. | Applicant |
| US5363475(A) | 1994-11-01 | Baker et al. | Applicant |
| US5377313(A) | 1994-12-01 | Scheibl | Applicant |
| US5394516(A) | 1995-02-01 | Winser | Applicant |
| US5402532(A) | 1995-03-01 | Epstein et al. | Applicant |
| US5404445(A) | 1995-04-01 | Matsumoto | Applicant |
| US5408650(A) | 1995-04-01 | Arsenault | Applicant |
| US5412796(A) | 1995-05-01 | Olive | Applicant |
| US5415549(A) | 1995-05-01 | Logg | Applicant |
| US5416606(A) | 1995-05-01 | Katayama et al. | Applicant |
| US5422997(A) | 1995-06-01 | Nagashima | Applicant |
| US5432895(A) | 1995-07-01 | Myers | Applicant |
| US5432900(A) | 1995-07-01 | Rhodes et al. | Applicant |
| US5438663(A) | 1995-08-01 | Matsumoto et al. | Applicant |
| US5448689(A) | 1995-09-01 | Matsuo et al. | Applicant |
| US5461712(A) | 1995-10-01 | Chelstowski et al. | Applicant |
| US5467438(A) | 1995-11-01 | Nishio et al. | Applicant |
| US5467459(A) | 1995-11-01 | Alexander et al. | Applicant |
| US5469535(A) | 1995-11-01 | Jarvis et al. | Applicant |
| US5473736(A) | 1995-12-01 | Young | Applicant |
| US5475803(A) | 1995-12-01 | Stearns et al. | Applicant |
| US5487146(A) | 1996-01-01 | Guttag et al. | Applicant |
| US5490240(A) | 1996-02-01 | Foran et al. | Applicant |
| US5495563(A) | 1996-02-01 | Winser | Applicant |
| US5504499(A) | 1996-04-01 | Horie et al. | Applicant |
| US5506604(A) | 1996-04-01 | Nally et al. | Applicant |
| US5535374(A) | 1996-07-01 | Olive | Applicant |
| US5543824(A) | 1996-08-01 | Priem et al. | Applicant |
| US5544292(A) | 1996-08-01 | Winser | Applicant |
| US5548709(A) | 1996-08-01 | Hannah et al. | Applicant |
| US5553228(A) | 1996-09-01 | Erb et al. | Applicant |
| US5557712(A) | 1996-09-01 | Guay | Applicant |
| US5559954(A) | 1996-09-01 | Sakoda et al. | Applicant |
| US5561746(A) | 1996-10-01 | Murata et al. | Applicant |
| US5561752(A) | 1996-10-01 | Jevans | Applicant |
| US5563989(A) | 1996-10-01 | Billyard | Applicant |
| US5566285(A) | 1996-10-01 | Okada | Applicant |
| US5573402(A) | 1996-11-01 | Gray | Applicant |
| US5579456(A) | 1996-11-01 | Cosman | Applicant |
| US5582451(A) | 1996-12-01 | Baumann | Applicant |
| US5586234(A) | 1996-12-01 | Sakuraba et al. | Applicant |
| US5593350(A) | 1997-01-01 | Bouton et al. | Applicant |
| US5600763(A) | 1997-02-01 | Greene et al. | Applicant |
| US5606650(A) | 1997-02-01 | Kelley et al. | Applicant |
| US5607157(A) | 1997-03-01 | Nagashima | Applicant |
| US5608864(A) | 1997-03-01 | Bindlish et al. | Applicant |
| US5616031(A) | 1997-04-01 | Logg | Applicant |
| US5621867(A) | 1997-04-01 | Murata et al. | Applicant |
| US5628686(A) | 1997-05-01 | Svancarek et al. | Applicant |
| US5638535(A) | 1997-06-01 | Rosenthal et al. | Applicant |
| US5644364(A) | 1997-07-01 | Kurtze et al. | Applicant |
| US5649082(A) | 1997-07-01 | Burns | Applicant |
| US5650955(A) | 1997-07-01 | Puar et al. | Applicant |
| US5651104(A) | 1997-07-01 | Cosman | Applicant |
| US5657045(A) | 1997-08-01 | Katsura et al. | Applicant |
| US5657443(A) | 1997-08-01 | Krech, Jr. | Applicant |
| US5657478(A) | 1997-08-01 | Recker et al. | Applicant |
| US5659671(A) | 1997-08-01 | Tannenbaum et al. | Applicant |
| US5659673(A) | 1997-08-01 | Nonoshita | Applicant |
| US5659715(A) | 1997-08-01 | Wu et al. | Applicant |
| US5664162(A) | 1997-09-01 | Dye | Applicant |
| US5666439(A) | 1997-09-01 | Ishida et al. | Applicant |
| US5678037(A) | 1997-10-01 | Osugi et al. | Applicant |
| US5682522(A) | 1997-10-01 | Huang et al. | Applicant |
| US5684941(A) | 1997-11-01 | Dye | Applicant |
| US5687304(A) | 1997-11-01 | Kiss | Applicant |
| US5691746(A) | 1997-11-01 | Shyu | Applicant |
| US5694143(A) | 1997-12-01 | Fielder et al. | Applicant |
| US5696892(A) | 1997-12-01 | Redmann et al. | Applicant |
| US5703806(A) | 1997-12-01 | Puar et al. | Applicant |
| US5706481(A) | 1998-01-01 | Hannah et al. | Applicant |
| US5706482(A) | 1998-01-01 | Matsushima et al. | Applicant |
| US5714981(A) | 1998-02-01 | Scott-Jackson et al. | Applicant |
| US5724561(A) | 1998-03-01 | Tarolli et al. | Applicant |
| US5726689(A) | 1998-03-01 | Negishi et al. | Applicant |
| US5726947(A) | 1998-03-01 | Yamazaki et al. | Examiner |
| US5734386(A) | 1998-03-01 | Cosman | Applicant |
| US5739819(A) | 1998-04-01 | Bar-Nahum | Applicant |
| US5740343(A) | 1998-04-01 | Tarolli et al. | Applicant |
| US5740383(A) | 1998-04-01 | Nally et al. | Applicant |
| US5742749(A) | 1998-04-01 | Foran et al. | Applicant |
| US5742788(A) | 1998-04-01 | Priem et al. | Applicant |
| US5745118(A) | 1998-04-01 | Alcorn et al. | Applicant |
| US5745125(A) | 1998-04-01 | Deering et al. | Examiner |
| US5748199(A) | 1998-05-01 | Palm | Applicant |
| US5748986(A) | 1998-05-01 | Butterfield et al. | Applicant |
| US5751291(A) | 1998-05-01 | Olsen et al. | Applicant |
| US5751292(A) | 1998-05-01 | Emmot | Applicant |
| US5751295(A) | 1998-05-01 | Becklund et al. | Applicant |
| US5751930(A) | 1998-05-01 | Katsura et al. | Applicant |
| US5754191(A) | 1998-05-01 | Mills et al. | Applicant |
| US5757382(A) | 1998-05-01 | Lee | Applicant |
| US5760783(A) | 1998-06-01 | Migdal et al. | Applicant |
| US5764228(A) | 1998-06-01 | Baldwin | Applicant |
| US5764237(A) | 1998-06-01 | Kaneko | Applicant |
| US5767856(A) | 1998-06-01 | Peterson et al. | Applicant |
| US5767858(A) | 1998-06-01 | Kawase et al. | Applicant |
| US5768629(A) | 1998-06-01 | Wise et al. | Applicant |
| US5777623(A) | 1998-07-01 | Small | Applicant |
| US5781927(A) | 1998-07-01 | Wu et al. | Applicant |
| US5791994(A) | 1998-08-01 | Hirano et al. | Applicant |
| US5801711(A) | 1998-09-01 | Koss et al. | Applicant |
| US5801720(A) | 1998-09-01 | Norrod et al. | Examiner |
| US5805175(A) | 1998-09-01 | Priem | Applicant |
| US5808619(A) | 1998-09-01 | Choi et al. | Applicant |
| US5808630(A) | 1998-09-01 | Pannell | Applicant |
| US5809219(A) | 1998-09-01 | Pearce et al. | Applicant |
| US5809278(A) | 1998-09-01 | Watanabe et al. | Applicant |
| US5815165(A) | 1998-09-01 | Blixt | Applicant |
| US5818456(A) | 1998-10-01 | Cosman et al. | Applicant |
| US5819017(A) | 1998-10-01 | Akeley et al. | Applicant |
| US5821940(A) | 1998-10-01 | Morgan et al. | Examiner |
| US5822516(A) | 1998-10-01 | Krech, Jr. | Applicant |
| US5828382(A) | 1998-10-01 | Wilde | Applicant |
| US5828383(A) | 1998-10-01 | May et al. | Applicant |
| US5828907(A) | 1998-10-01 | Wise et al. | Applicant |
| US5831624(A) | 1998-11-01 | Tarolli et al. | Applicant |
| US5831625(A) | 1998-11-01 | Rich et al. | Applicant |
| US5831640(A) | 1998-11-01 | Wang et al. | Applicant |
| US5835096(A) | 1998-11-01 | Baldwin | Applicant |
| US5835792(A) | 1998-11-01 | Wise et al. | Applicant |
| US5838334(A) | 1998-11-01 | Dye | Applicant |
| US5844576(A) | 1998-12-01 | Wilde et al. | Applicant |
| US5850229(A) | 1998-12-01 | Edelsbrunner et al. | Applicant |
| US5856829(A) | 1999-01-01 | Gray, III et al. | Applicant |
| US5859645(A) | 1999-01-01 | Latham | Applicant |
| US5861888(A) | 1999-01-01 | Dempsey | Applicant |
| US5861893(A) | 1999-01-01 | Stugress | Applicant |
| US5867166(A) | 1999-02-01 | Myhrvold et al. | Applicant |
| US5870097(A) | 1999-02-01 | Snyder et al. | Applicant |
| US5870098(A) | 1999-02-01 | Gardiner | Applicant |
| US5870102(A) | 1999-02-01 | Tarolli et al. | Applicant |
| US5870109(A) | 1999-02-01 | McCormack et al. | Applicant |
| US5870587(A) | 1999-02-01 | Danforth et al. | Applicant |
| US5872902(A) | 1999-02-01 | Kuchkuda et al. | Applicant |
| US5877741(A) | 1999-03-01 | Chee et al. | Applicant |
| US5877770(A) | 1999-03-01 | Hanaoka | Applicant |
| US5877771(A) | 1999-03-01 | Drebin et al. | Applicant |
| US5880736(A) | 1999-03-01 | Peercy et al. | Applicant |
| US5880737(A) | 1999-03-01 | Griffin et al. | Applicant |
| US5883638(A) | 1999-03-01 | Rouet et al. | Applicant |
| US5886701(A) | 1999-03-01 | Chauvin et al. | Applicant |
| US5886705(A) | 1999-03-01 | Lentz | Applicant |
| US5887155(A) | 1999-03-01 | Laidig | Applicant |
| US5890190(A) | 1999-03-01 | Rutman | Applicant |
| US5892517(A) | 1999-04-01 | Rich | Applicant |
| US5892974(A) | 1999-04-01 | Koizumi et al. | Applicant |
| US5894300(A) | 1999-04-01 | Takizawa | Applicant |
| US5900881(A) | 1999-05-01 | Ikedo | Applicant |
| US5903283(A) | 1999-05-01 | Selwan et al. | Applicant |
| US5909218(A) | 1999-06-01 | Naka et al. | Applicant |
| US5909225(A) | 1999-06-01 | Schinnerer et al. | Applicant |
| US5912675(A) | 1999-06-01 | Laperriere | Applicant |
| US5912676(A) | 1999-06-01 | Malladi et al. | Applicant |
| US5914721(A) | 1999-06-01 | Lim | Applicant |
| US5914725(A) | 1999-06-01 | McInnis et al. | Applicant |
| US5914729(A) | 1999-06-01 | Lippincott | Applicant |
| US5920876(A) | 1999-07-01 | Ungar et al. | Applicant |
| US5923332(A) | 1999-07-01 | Izawa | Applicant |
| US5923334(A) | 1999-07-01 | Luken | Applicant |
| US5926182(A) | 1999-07-01 | Menon et al. | Applicant |
| US5926647(A) | 1999-07-01 | Adams et al. | Applicant |
| US5933150(A) | 1999-08-01 | Ngo et al. | Applicant |
| US5933154(A) | 1999-08-01 | Howard et al. | Applicant |
| US5933155(A) | 1999-08-01 | Akeley | Applicant |
| US5933529(A) | 1999-08-01 | Kim | Applicant |
| US5936641(A) | 1999-08-01 | Jain et al. | Applicant |
| US5936683(A) | 1999-08-01 | Lin | Applicant |
| US5940089(A) | 1999-08-01 | Dilliplane et al. | Applicant |
| US5940538(A) | 1999-08-01 | Spiegel et al. | Applicant |
| US5943058(A) | 1999-08-01 | Nagy | Applicant |
| US5943060(A) | 1999-08-01 | Cosman et al. | Applicant |
| US5945997(A) | 1999-08-01 | Zhao et al. | Applicant |
| US5949421(A) | 1999-09-01 | Ogletree et al. | Applicant |
| US5949423(A) | 1999-09-01 | Olsen | Applicant |
| US5949428(A) | 1999-09-01 | Toelle et al. | Applicant |
| US5956042(A) | 1999-09-01 | Tucker et al. | Applicant |
| US5956043(A) | 1999-09-01 | Jensen | Applicant |
| US5958020(A) | 1999-09-01 | Evoy et al. | Applicant |
| US5959640(A) | 1999-09-01 | Rudin et al. | Applicant |
| US5963220(A) | 1999-10-01 | Lee et al. | Applicant |
| US5966134(A) | 1999-10-01 | Arias | Applicant |
| US5977979(A) | 1999-11-01 | Clough et al. | Applicant |
| US5977984(A) | 1999-11-01 | Omori | Applicant |
| US5982376(A) | 1999-11-01 | Abe et al. | Applicant |
| US5982390(A) | 1999-11-01 | Stoneking et al. | Applicant |
| US5986659(A) | 1999-11-01 | Gallery et al. | Applicant |
| US5986663(A) | 1999-11-01 | Wilde | Applicant |
| US5986677(A) | 1999-11-01 | Jones et al. | Applicant |
| US5987567(A) | 1999-11-01 | Rivard et al. | Applicant |
| US5990903(A) | 1999-11-01 | Donovan | Applicant |
| US5995120(A) | 1999-11-01 | Dye | Applicant |
| US5995121(A) | 1999-11-01 | Alcokrn et al. | Applicant |
| US5999189(A) | 1999-12-01 | Kaiiya et al. | Applicant |
| US5999198(A) | 1999-12-01 | Horan et al. | Applicant |
| US6002407(A) | 1999-12-01 | Fadden | Applicant |
| US6002410(A) | 1999-12-01 | Battle | Applicant |
| US6005582(A) | 1999-12-01 | Gabriel et al. | Applicant |
| US6005583(A) | 1999-12-01 | Morrison | Applicant |
| US6005584(A) | 1999-12-01 | Kitamura et al. | Applicant |
| US6007428(A) | 1999-12-01 | Nishiumi et al. | Applicant |
| US6008820(A) | 1999-12-01 | Chauvin et al. | Applicant |
| US6011562(A) | 2000-01-01 | Gagne et al. | Applicant |
| US6011565(A) | 2000-01-01 | Kuo et al. | Applicant |
| US6014144(A) | 2000-01-01 | Nelson et al. | Applicant |
| US6016150(A) | 2000-01-01 | Lengvel et al. | Applicant |
| US6016151(A) | 2000-01-01 | Lin | Applicant |
| US6018350(A) | 2000-01-01 | Lee et al. | Applicant |
| US6020931(A) | 2000-02-01 | Bilbrey et al. | Applicant |
| US6021417(A) | 2000-02-01 | Massarksy | Applicant |
| US6022274(A) | 2000-02-01 | Takeda et al. | Applicant |
| US6023261(A) | 2000-02-01 | Ugaiin | Applicant |
| US6026182(A) | 2000-02-01 | Lee et al. | Applicant |
| US6028608(A) | 2000-02-01 | Jenkins | Applicant |
| US6031542(A) | 2000-02-01 | Wittig | Applicant |
| US6035360(A) | 2000-03-01 | Doidge et al. | Applicant |
| US6037948(A) | 2000-03-01 | Liepa | Applicant |
| US6038031(A) | 2000-03-01 | Murphy | Applicant |
| US6038348(A) | 2000-03-01 | Carlev | Applicant |
| US6040843(A) | 2000-03-01 | Monroe et al. | Applicant |
| US6040844(A) | 2000-03-01 | Yamaguchi et al. | Applicant |
| US6041010(A) | 2000-03-01 | Puar et al. | Applicant |
| US6043804(A) | 2000-03-01 | Greene | Applicant |
| US6043821(A) | 2000-03-01 | Sprague et al. | Applicant |
| US6046746(A) | 2000-04-01 | Deering | Applicant |
| US6046747(A) | 2000-04-01 | Saunders et al. | Applicant |
| US6046752(A) | 2000-04-01 | Kirkland et al. | Applicant |
| US6049337(A) | 2000-04-01 | Van Overveld | Applicant |
| US6049338(A) | 2000-04-01 | Anderson et al. | Applicant |
| US6052125(A) | 2000-04-01 | Gardiner et al. | Applicant |
| US6052126(A) | 2000-04-01 | Sakuraba et al. | Applicant |
| US6052127(A) | 2000-04-01 | Vaswani et al. | Applicant |
| US6052129(A) | 2000-04-01 | Fowler et al. | Applicant |
| US6052133(A) | 2000-04-01 | Kang | Applicant |
| US6054993(A) | 2000-04-01 | Devic et al. | Applicant |
| US6054999(A) | 2000-04-01 | Strandberg | Applicant |
| US6057847(A) | 2000-05-01 | Jenkins | Applicant |
| US6057849(A) | 2000-05-01 | Haubner et al. | Applicant |
| US6057851(A) | 2000-05-01 | Luken et al. | Applicant |
| US6057859(A) | 2000-05-01 | Handelman et al. | Applicant |
| US6057861(A) | 2000-05-01 | Lee et al. | Applicant |
| US6057862(A) | 2000-05-01 | Margulis | Applicant |
| US6057863(A) | 2000-05-01 | Olarig | Applicant |
| US6061462(A) | 2000-05-01 | Tostevin et al. | Applicant |
| US6064392(A) | 2000-05-01 | Rohner | Applicant |
| US6067098(A) | 2000-05-01 | Dye | Applicant |
| US6070204(A) | 2000-05-01 | Poisner | Applicant |
| US6072496(A) | 2000-06-01 | Guenter et al. | Applicant |
| US6075543(A) | 2000-06-01 | Akeley | Applicant |
| US6075546(A) | 2000-06-01 | Hussain et al. | Applicant |
| US6078311(A) | 2000-06-01 | Pelkey | Applicant |
| US6078333(A) | 2000-06-01 | Wittig et al. | Applicant |
| US6078334(A) | 2000-06-01 | Hanaoka et al. | Applicant |
| US6078338(A) | 2000-06-01 | Horan et al. | Applicant |
| US6081274(A) | 2000-06-01 | Shiraishi | Applicant |
| US6088035(A) | 2000-07-01 | Sudarsky et al. | Applicant |
| US6088042(A) | 2000-07-01 | Handelman et al. | Applicant |
| US6088487(A) | 2000-07-01 | Kurashige | Applicant |
| US6088701(A) | 2000-07-01 | Whaley et al. | Applicant |
| US6091431(A) | 2000-07-01 | Saxena et al. | Applicant |
| US6092158(A) | 2000-07-01 | Harriman et al. | Applicant |
| US6094200(A) | 2000-07-01 | Olsen et al. | Applicant |
| US6097435(A) | 2000-08-01 | Stanger et al. | Applicant |
| US6097437(A) | 2000-08-01 | Hwang | Applicant |
| US6104415(A) | 2000-08-01 | Gossett | Applicant |
| US6104417(A) | 2000-08-01 | Nielsen et al. | Applicant |
| US6105094(A) | 2000-08-01 | Lindeman | Applicant |
| US6108743(A) | 2000-08-01 | Debs et al. | Applicant |
| US6111582(A) | 2000-08-01 | Jenkins | Applicant |
| US6111584(A) | 2000-08-01 | Murphy | Applicant |
| US6115047(A) | 2000-09-01 | Deering | Applicant |
| US6115049(A) | 2000-09-01 | Winner et al. | Applicant |
| US6118462(A) | 2000-09-01 | Margulis | Applicant |
| US6128026(A) | 2000-10-01 | Brothers, III | Applicant |
| US6144365(A) | 2000-11-01 | Young et al. | Applicant |
| US6144387(A) | 2000-11-01 | Liu et al. | Applicant |
| US6151602(A) | 2000-11-01 | Hejlsberg et al. | Applicant |
| US6155926(A) | 2000-12-01 | Miyamoto et al. | Applicant |
| US6157387(A) | 2000-12-01 | Kotani | Applicant |
| US6166748(A) | 2000-12-01 | Van Hook et al. | Applicant |
| US6172678(B1) | 2001-01-01 | Shiraishi | Applicant |
| US6177944(B1) | 2001-01-01 | Fowler et al. | Applicant |
| US6191794(B1) | 2001-02-01 | Priem et al. | Applicant |
| US6200253(B1) | 2001-03-01 | Nishiumi et al. | Applicant |
| US6204851(B1) | 2001-03-01 | Netschke et al. | Applicant |
| US6215496(B1) | 2001-04-01 | Szeliski et al. | Applicant |
| US6215497(B1) | 2001-04-01 | Leung | Applicant |
| US6226713(B1) | 2001-05-01 | Mehrotra | Examiner |
| US6232981(B1) | 2001-05-01 | Gossett | Applicant |
| US6236413(B1) | 2001-05-01 | Gossett et al. | Applicant |
| US6239810(B1) | 2001-05-01 | Van Hook et al. | Applicant |
| US6252608(B1) | 2001-06-01 | Snyder et al. | Applicant |
| US6252610(B1) | 2001-06-01 | Hussain | Applicant |
| US6264558(B1) | 2001-07-01 | Nishiumi et al. | Applicant |
| US6268861(B1) | 2001-07-01 | Sanz-Pastor et al. | Applicant |
| US6275235(B1) | 2001-08-01 | Morgan, III | Applicant |
| US6285779(B1) | 2001-09-01 | Lapidous et al. | Applicant |
| US6292194(B1) | 2001-09-01 | Powll, III | Examiner |
| US6329997(B1) | 2001-12-01 | Wu et al. | Applicant |
| US6331856(B1) | 2001-12-01 | Van Hook et al. | Applicant |
| US6339428(B1) | 2002-01-01 | Fowler et al. | Applicant |
| US6342892(B1) | 2002-01-01 | Van Hook et al. | Applicant |
| US6353438(B1) | 2002-03-01 | Van Hook et al. | Applicant |
| US6356497(B1) | 2002-03-01 | Puar et al. | Applicant |
| US6408362(B1) | 2002-06-01 | Arimilli et al. | Examiner |
| US6417858(B1) | 2002-07-01 | Bosch et al. | Applicant |
| US6426747(B1) | 2002-07-01 | Hoppe et al. | Applicant |
| US6437781(B1) | 2002-08-01 | Tucker et al. | Applicant |
| US6459429(B1) | 2002-10-01 | Deering | Applicant |
| US6466223(B1) | 2002-10-01 | Dorbie et al. | Applicant |
| US6469707(B1) | 2002-10-01 | Voorhies | Applicant |
| US6476808(B1) | 2002-11-01 | Kuo et al. | Applicant |
| US6476822(B1) | 2002-11-01 | Burbank | Applicant |
| US6496187(B1) | 2002-12-01 | Deering et al. | Applicant |
| EP637813(A2) | 1995-02-01 | Applicant | |
| JP9-330230 | 1997-12-01 | Applicant | |
| WO/93/04429 | 1993-03-01 | Applicant |
Non-Patent Literature (82)
- GDC 2000: Advanced OpenGL Game Development, “A Practical and Robust Bump-mapping Technique for Today's GPUs,” by Mark Kilgard, Jul. 5, 2000, www.nvidia.com.Applicant
- Technical Presentations: “Texture Space Bump Mapping,”Sim Dietrich, Nov. 10, 2000, www.nvidia.com.Applicant
- Whitepapers: “Texture Addressing,” Sim Dietrich, Jan. 6, 2000, www.nvidia.com.Applicant
- ZDNet Reviews, from PC Magazine, “Other Enhancements,” Jan. 15, 1999, wysiwyg://16/http://www4.zdnet.com...ies/reviews/0,4161,2188286,00.html.Applicant
- ZDNet Reviews, from PC Magazine, “Screen Shot of Alpha-channel Transparency,” Jan. 15, 1999, wysiwyg://16/http://www4.zdnet.com...ies/reviews/0,4161,2188286,00.html.Applicant
- Alpha (transparency) Effects, Future Technology Research Index, http://www.futuretech.vuurwerk.n1/alpha.html.Applicant
- Blythe, David, 5.6 Transparency Mapping and Trimming with Alpha, http://toolbox.sgi.com/TasteOfDT/d...penGL/advanced 98/notes/node41.html, Jun. 11, 1998.Applicant
- 10.2 Alpha Blending, http://www.sgi.com/software/opengl/advanced98/notes/node146.html.Applicant
- 10.3 Sorting, http://www.sgi.com/software/opengl/advanced98/notes/node147.html.Applicant
- 10.4 Using the Alpha Function, http://www.sgi.com/software/opengl/advanced98/notes/node148.html.Applicant
- Winner, Stephanie, et al., “Hardware Accelerated Rendering Of Antialiasing Using A Modified A-buffer Algorithm,” Computer Graphics Proceedings, Annual Conference Series, 1997, pp 307-316.Applicant
- Debevec, Paul, et al., “Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping,” University of California at Berkeley.Applicant
- Gibson, Simon, et al., “Interactive Rendering with Real-World Illumination,” Rendering Techniques 2000; 11th Eurographics Workshop on Rendering, pp. 365-376 (Jun. 2000).Applicant
- Segal, Mark, et al., “Fast Shadows and Lighting Effects Using Texture Mapping,” Computer Graphics, 26, 2, pp.. 249-252 (Jul. 1992).Applicant
- White paper, Kilgard, Mark J., “Improving Shadows and Reflections via the Stencil Buffer” (Nov. 3, 1999).Applicant
- “OpenGL Projected Textures,” from web site:HTTP:// reality.sgi.com, 5 pages.Applicant
- “5.13.1 How to Project a Texture,” from web site: www.sgi.com, 2 pages.Applicant
- Arkin, Alan, email, subject: “Texture distortion problem,” from web site: HTTP://reality.sgi.com (Jul. 1997).Applicant
- Moller, Tomas et al., “Real-Time Rendering,” pp. 179-183 (AK Peters Ltd., 1999).Applicant
- Williams, Lance, “Casting Curved Shadows on Curved Surfaces,” Computer Graphics (SIGGRAPH '78 Proceedings), vol. 12, No. 3, pp. 270-274 (Aug. 1978).Applicant
- Woo et al., “A Survey of Shadow Algorithms,” (IEEE Computer Graphics and Applications, vol. 10, No. 6, pp. 13-32 (Nov. 1990).Applicant
- Heidrich et al., “Applications of Pixel Textures in Visualization and Realistic Image Synthesis,” Proceedings 1999 Symposium On Interactive 3D Graphics, pp. 127-134 (Apr. 1999).Applicant
- Hourcade et al, “Algorithms for Antialiased Cast Shadows”, Computers and Graphics, vol. 9, No. 3, pp. 260-265 (1985).Applicant
- Michael McCool, “Shadow Volume Reconstruction from Depth Maps”, ACM Transactions on Graphics, vol. 19, No. 1, Jan. 2000, pp. 1-26.Applicant
- RenderMan Artist Tools, PhotoRealistic RenderMan 3.8 User's Manual, Pixar (Aug. 1998).Applicant
- RenderMan Interface Version 3.2 (Jul. 2000).Applicant
- White paper, Dietrich, Sim, “Cartoon Rendering and Advanced Texture Features of the GeForce 256 Texture Matrix, Projective Textures, Cube Maps, Texture Coordinate Generation and DOTPRODUCT3 Texture Blending” (Dec. 16, 1999).Applicant
- Peter J. Kovach, INSIDE DIRECT 3D, Alpha Testing, ppp 289-291 (1999).Applicant
- Web site information, CartoonReyes, REM Infografica, http://www.digimotion.co.uk/cartoonreyes.htm.Applicant
- Raskar, Ramesh et al., “Image Precision Silhouette Edges,” Symposium on Interactive 3D Graphics 1999, Atlanta, 7 pages (Apr. 26-29, 1999).Applicant
- Schlechtweg, Stefan et al., Rendering Line-Drawings with Limited Resources, Proceedings of GRAPHICON '96, 6th International Conference and Exhibition on Computer Graphics and Visualization in Russia, (St. Petersburg, Jul. 1-5, 1996) vol. 2, pp 131-137.Applicant
- Haeberli, Paul et al., “Texture Mapping as a Fundamental Drawing Primitive,” Proceedings of the Fourth Eurographics Workshop on Rendering, 11pages, Paris, France (Jun. 1993).Applicant
- Schlechtweg, Stefan et al., “Emphasising in Line-drawings,” Norsk samarbeid innen grafisk databehandling: NORSIGD Info, medlemsblad for NORSIGD, Nr 1/95, pp. 9-10.Applicant
- Markosian, Lee et al., “Real-Time Nonphotorealistic Rendering,” Brown University site of the NSF Science and Technology Center for Computer Graphics and Scientific Visualization, Providence, RI, 5 pages (undated).Applicant
- Feth, Bill, “Non-Photorealistic Rendering,” [email protected], CS490—Bruce Land, 5 pages (Spring 1998).Applicant
- Elber, Gershon, “Line Art Illustrations of Parametric and Implicit Forms,” IEEE Transactions on Visualization and Computer Graphics, vol. 4, No. 1, Jan.-Mar. 1998.Applicant
- Zeleznik, Robert et al. “SKETCH: An Interface for Sketching 3D Scenes,” Computer Graphics Proceedings, Annual Conference Series 1996, pp. 163-170.Applicant
- Computer Graphics World, Dec. 1997.Applicant
- Reynolds, Craig, “Stylized Depiction in Computer Graphics, Non-Photorealistic, Painterly and Toon Rendering,” an annotated survey of online Resources, 13 pages, last update May 30, 2000, http://www.red.com/cwr/painterly.html.Applicant
- Render Man Artist Tools, Using Arbitrary Output Variables in Photorealistic Renderman (With Applications), PhotoRealistic Renderman Application Note #24, 8 pages, Jun. 1998, http://www.pixar.com/products/renderman/toolkit/Toolkit/AppNotes/appnote.24.html.Applicant
- Decaudin, Philippe, “Cartoon-Looking Rendering of 3D Scenes,” Syntim Project Inria, 6 pages, http://www-syntim.inria.fr/syntim/recherche/decaudin/cartoon-eng.html.Applicant
- Hachigian, Jennifer, “Super Cel Shader 1.00 Tips and Tricks,” 2 pages, wysiwyg://thePage.13/http://members.xoom.com/_XMCM.jarvia/3D/celshade.html.Applicant
- Digimation Inc., “The Incredible Comicshop,” info sheet, 2 pages, http://www.digimation.com/asp/product/asp?product_id=33.Applicant
- Softimage/3D Full Support, “Toon Assistant,” 1998 Avid Technology, Inc., 1 page, http://www.softimage.com/3dsupport/techn...uments/3.8/features3.8/rel_notes.56.html.Applicant
- Cambridge Animo—Scene III, info sheet, Cambridge Animation Systems, 2 pages, http://www.com-ani.co.uk/casweb/products/software/SceneIII.htm.Applicant
- Mulligan, Vikram, Toon, info sheet, 2 pages, http://digitalcarversguild.com/products/toon/toon.ttml.Applicant
- Toony Shader, “Dang I'm tired of photorealism,” 4 pages, http://www.visi.com/˜mcdonald/toony.html.Applicant
- “Cartoon Shading , Using Shading Mapping,” 1 page, http://www.goat.com/alias/shader.html#toonshad.Applicant
- Web site information, CartoonReyes, http://www.zentertainment.com/zentropy/review/cartoonreyes.html.Applicant
- VIDI Presenter 3D Repository, “Shaders.” 2 pages, http://www.webnation.com/vidirep/panels/renderman/shaders/toon.phtml.Applicant
- The RenderMan Interface Version 3.1, (Sep. 1989).Applicant
- “Renderman Artist Tools, PhotoRealistic RenderMan Tutorial,” Pixar (Jan. 1996).Applicant
- Web site materials, “Renderman Artist Tools, PhotoRealistic RenderMan 3.8 User's Manual,” Pixar.Applicant
- NVIDIA.com, technical presentation, “AGDC Per-Pixel Shading” (Nov. 15, 2000).Applicant
- NVIDIA.com, technical presentation, Introduction to DX8 Pixel Shaders (Nov. 10, 2000).Applicant
- NVIDIA.com, technical presentation, “Advanced Pixel Shader Details” (Nov. 10, 2000).Applicant
- “Developer's Lair, Multitexturing with the ATI Rage Pro,” (7 pages) from ati.com web site (2000).Applicant
- Slide Presentation, Sébastien Dominé, “nVIDIA Mesh Skinning, OpenGl”.Applicant
- Singh, Karan et al., “Skinning Characters using Surface-Oriented Free-Form Deformations,” Toronto Canada.Applicant
- “Hardware Technology,” from ATI.com web site, 8 pages (2000).Applicant
- “Skeletal Animation and Skinning,” from ATI.com web site, 2 pages (Summer 2000).Applicant
- “Developer Relations, ATI Summer 2000 Developer Newsletter,” from ATI.com web site, 5 pages (Summer 2000).Applicant
- Press Releases, “ATI's RADEON family of products delivers the most comprehensive support for the advance graphics features of DirectX 8.0,” Canada, from ATI.com web site, 2 pages (Nov. 9, 2000).Applicant
- “ATI RADEON Skinning and Tweening,” from ATI.com web site, 1 page (2000).Applicant
- Hart, Evan et al., “Vertex Shading with Direct3D and OpenGL,” Game Developers Conference 2001, from ATI.com web site (2001).Applicant
- Search Results for: skinning, from ATI.com web site, 5 pages (May 24, 2001).Applicant
- Hart, Evan et al., “Graphics by rage,” Game Developers Conference 2000, from ATI.com web site (2000).Applicant
- Efficient Command/Data Interface Protocol For Graphics, IBM TDB, vol. 36, issue 9A, Sep. 1, 1993, pp. 307-312.Applicant
- Shade, Jonathan et al., “Layered Depth Images,” Computer Graphics Proceedings, Annual Conference Series, pp. 231-242 (1998).Applicant
- Videum Conference Pro (PCI) Specification, product of Winnov (Winnov), published Jul. 21, 1999.Applicant
- Whitepaper: Implementing Fog in Direct3D, Jan. 3, 2000, www.nvidia.com.Applicant
- Akeley, Kurt, “Reality Engine Graphics”, 1993, Silicon Graphics Computer Systems, pp. 109-116.Applicant
- White paper, Huddy, Richard, “The Efficient Use of Vertex Buffers,” (Nov. 01, 2000).Applicant
- White paper, Spitzer, John, et al., “Using GL_NV_array_range and GL_NV_Fence on GEForce Products and Beyone” (Aug. 1, 2000).Applicant
- White paper, Rogers, Douglas H., “Optimizing Direct3D for the GeForce 256” (Jan. 3, 2000).Applicant
- White paper, “Technical Brief, AGP 4X With Fast Writes—A Unique NVIDIA GeForce 256 Feature” (Nov. 10, 1999).Applicant
- Hoppe, Hugues, “Optimization of Mesh Locality for Transparent Vertex Caching,” Proceedings of SIGGRAPH, pp. 269-276 (Aug. 8-13, 1999).Applicant
- Hook, Brian, “An Incomplete Guide to Programming DirectDraw and Direct3D Immediate Mode (Release 0.46),” printed from web site: www.wksoftware.com, 42 pages.Applicant
- Thompson, Tom, “Must-See 3-D Engines,” BYTE Magazine, printed from web site www.byte.com, 10 pages (Jun. 1996).Applicant
- Thompson, Nigel, “Rendering with Immediate Mode,” Microsoft Interactive Developer Column: Fun and Games, printed from web site msdn.microsoft.com, 8 pages (Mar. 97).Applicant
- “HOWTO: Animate Textures in Direct3D Immediate Mode,” printed from web site support.microsoft.com, 3 pages (last reviewed Dec. 15, 2000).Applicant
- “INFO: Rendering a Triangle Using an Execute Buffer,” printed from web site support.microsoft.com, 6 pages (last reviewed Oct. 20, 2000).Applicant