US 5,058,137 AGrant
Lempel-Ziv Decoder
Issue Date:1991-10-15
•6 Claims
•9 Drawing Sheets
Abstract
A decoder for data encoded in a form combining a prefix which is a previously coded sub-string and a next data element in the data stream. The decoder includes memories for storing code words and data separately. Upon receipt of a code word the decoder stores the previously received code word, applies the newly received word to the code word memory to obtain the location of the last data element which is part of the data represented by the newly received code word, and another code word associated with the prefix. Upon completion of decoding the latest code word, the first data element of the decoded word is appended to the next previously received code word, and the combination is stored as the equivalent of a code word which is next after the highest code word already received. At least one memory is shared for use during encoding and decoding.
Metadata
Assignee
- North American Philips Corporation
Inventor
- Imran A. Shah
Application Information
Application Number:US 3882837
Filing Date:1989-07-31
Priority Date:1989-07-31
Art Unit:263
Classifications
IPC:
H04L 2706
Field of Search:
37534135837025;94;12251;65;91426;261.1;261.2109
Patent Drawings (9 sheets)
Description
Cross-Reference to Related Applications
The preferred embodiment disclosed herein embodies inventions claimed in four other concurrently filed commonly-owned applications, by applicant herein and/or Brian C. Johnson, namely U.S. application Ser. Nos. 388,263; 388,279; 388,281; and 388,282.
Background of the Invention
The present invention relates to data decoders, and more particularly to a decoder for Lempel-Ziv-encoded data.
The need for improved data compression schemes is well known, because vast quantities of data are generated and used by present computer systems. Even larger amounts of data will be required to be stored and processed in the future. Frequently, it is necessary to compress the data in order to reduce data storage requirements. Moreover, as more computers are operated as part of a computer network, it will more often be necessary to compress the data in order to reduce the time and cost of data transmission.
An increasingly popular technique for data compression is the Lempel-Ziv (LZ) algorithm. The LZ algorithm efficiently compresses data in one pass without any prior knowledge of the frequency distribution of the data symbols. There is also a decoding algorithm for decompressing the encoded data.
One consequence of data compression is the additional burden on the computer's central processor. If large quantities of data are to be compressed or decompressed, then a significant amount of computer time may be required. This will diminish the gains achieved by the use of data compression.
Summary of the Invention
An object of the invention to provide a data decoder that can be used in a computer or data transmission or processing system to decode LZ-encoded data. According to the invention a decoder for decoding Lempel-Ziv encoded data includes a for storing code words and data words corresponding to the stored code words and some means for receiving and storing a code word to be decoded. Means apply the stored code word to be decoded to the memory means for reading out a data element and another code word and apply the another code word and each successive code word read out from the memory means to the memory means until the stored code word is decoded.
Brief Description of the Drawing
FIG. 1 illustrates the data organization used in the present invention;
FIG. 2 illustrates the memory architecture according to the invention;
FIG. 3 illustrates another memory architecture according to the invention;
FIG. 4 illustrates a data compressor-decompressor having the memory architecture shown in FIG. 3;
FIG. 5 illustrates a data encoder used in the compressor-decompressor shown in FIG. 4;
FIG. 6 illustrates a decoder used in the compressor-decompressor shown in FIG. 4;
FIG. 7 is a schematic of the hash circuit shown in FIG. 4;
FIG. 8 is a schematic of one of the modulo-two adders shown in FIG. 7;
FIGS. 9 and 10 are schematics of other embodiments of hash circuits;
FIG. 11 illustrates a last-in first-out buffer comprising part of the control of the encoder shown in FIG. 5;
FIG. 12 is a block diagram of a data repacker 14 shown in FIG. 4 in accordance with the invention.
Detailed Description of the Invention
The data organization or data structure used is illustrated in FIG. 1. A link field 1a is stored in memory independently of other data 2c at an address corresponding to a hash function value. Multiple link fields are stored in memory in a table at addresses corresponding to hash table values, and the value stored in the link field 2b at a hash table address is a pointer to the memory location or address of a corresponding key 2a and any other associated data fields 2c. Each key 2a is contained in a record 2 which also has an associated link field 2b for storing a pointer to a record of a successive key corresponding to the same hash address.
The corresponding memory architecture is shown in FIG. 2 and comprises a first memory 1 and a second memory 2. The first memory 1 stores only the link field values at the addresses comprising the hash table. Each address of the memory 1 is a hash table address and is addressed by a hash function value applied to the memory 1. In accordance with the invention, the capacity of memory 1 is chosen to optimize hashing according to a desired criteria. The load factor of the memory 1 used to store the hash table can be predetermined, and the capacity of memory 1 selected to achieve that load factor.
It is evident that the capacity of memory 1 and its load factor can be selected solely according to the size of the hash table, if desired. There is no need to consider the number of key fields or other data fields that will be stored, in order to select the capacity of memory 1. Memory 2 is used to store the key and other data fields.
Data stored in memory 2 can be inserted successively, and the address values at which the keys and other data are stored are the pointer values in the memory 1. The capacity of memory 2 is selected to be sufficient to meet the storage requirements for the keys and other data. The link fields in memory 2 permits chaining to be used for collision resolution. The first key corresponding to a particular hash address that is inserted in the memory 2 has an address in memory 2 corresponding to the pointer stored in memory 1 at the hash address. The second key corresponding to the same hash address is stored in memory 2 at an address of memory 2 which is stored in the link field of the record containing the first key. In this way, a linked list is created within memory 2 that is accessed through the pointer value stored in memory 1. The keys and other data successively stored in memory 2 can be stored in contiguous memory in the form of linked lists to maximize utilization of memory 2. The capacity of memory 2 need only be sufficient to meet the storage requirements of the data. Thus, the capacity of each memory can be independently optimized for hashing.
A consequence of the decoupling of the hash addresses and the associated key and other associated data fields is that a minimum of two memory accesses is required in order to retrieve a key. This doubling of retrieval time for a single key might be acceptable if retrieval of stored data is infrequent. However, if the stored data must be accessed repeatedly it would be desirable to effectively eliminate, or at least greatly reduce, the increased access time of the memory architecture just described.
FIG. 3 illustrates another memory embodiment comprised of a first memory 3 for storing the link fields comprising the hash table. A second memory 4 stores key and other associated data fields, and link fields associated with each key, in the manner already described. Thus, both embodiments use the same method of data organization. This second embodiment further comprises a register 5 for storing the pointer values read out from the first memory 3, and for using the pointer values stored therein to access the second memory 4. The storage of the pointer value read out from the first memory 3 within the register 5 permits a second key to be hashed to the first memory 3 while the second memory 4 is being accessed.
For example, suppose a key k.sub.i is hashed to a particular address in the first memory 3 and a pointer stored at that address is read out. At the next read operation a subsequent key k.sub.i+1 will be hashed to another address of the memory 3, while the pointer value in the register 5 will address the memory 4 to read out the data associated with k.sub.i. The system can look for a match of key k.sub.i with the content of memory 4 while the key k.sub.i+1 is being hashed to the first memory 3. If a match with key k.sub.1 is attained the pointer associated with key k.sub.i+1 can be applied to the second memory 4; otherwise, nothing is done with the pointer corresponding to key k.sub.i+1 until key k.sub.i is resolved as either a success or failure. In either event, the access of the first memory 3 by the hashed value of key k.sub.i+1 will have already occurred and will not contribute to the total search time.
One application for the disclosed data structure and memory architecture is in the area of data compression. FIG. 4 illustrates the structure of a dedicated integrated circuit for carrying out data compression according to the Lempel-Ziv algorithm, in which hashing is carried out by hardware circuits. The data which is hashed is organized and stored in a memory as just described.
A good introductory explanation of the Lempel-Ziv (LZ) algorithm can be found in the article by Terry A. Welch, "A Technique for High-Performance Data Compression", Computer, June 1984, pp. 8-19. The treatment of the algorithm given in the Welch article is summarized below.
The LZ algorithm maps strings of input characters into fixed-length codes. The string-code word pairs are stored in a table called the string table. Table entries are generated during data compression. More particularly, a message comprised of a sequence of characters is parsed character-serially in one pass, and the longest recognized input string S is parsed off each time. A recognized string is one that already exists in the string table. The code word for the recognized string S is transmitted, and the recognized string S with the next character C of the message appended, SC, is added to the string table and assigned a unique code word.
The LZ algorithm can be more explicitly described as follows
Starting with an initialized string table containing the character set from which the message will be composed, the first message character is read and set to the prefix string S. If there is a subsequent message character it is read and appended to the prefix string to form the new string SC. The string table is then checked to determine whether the string SC is already entered. If there already is an entry for SC, then the string SC is set to the prefix string S, the next message character C is read, and the step is repeated. Otherwise, if the string SC is not in the table, the output code word for the prefix string S is transmitted, a new table entry for the string SC is created, the character C is set to the prefix string S, and the step is repeated.
The data compressor/decompressor is comprised of a first-in first-out buffer memory (FIFO) 10 having an input which constitutes a data port which receives the sequence of message characters to be compressed. The FIFO 10 is not an essential element of the system but is used to smooth the data rate which could otherwise vary because of the variable search times that can occur during execution of the LZ algorithm.
A coder/decoder (CODEC) 12 receives the output from the FIFO 10 and encodes the applied signal according to the LZ algorithm by operating in the encoding mode. The encoded signals from the CODEC 12 are applied to repacker 14 which accepts input data streams of variable width and which generates output data streams of variable width. The repacker 14 output is applied to the FIFO 16 which is effective to smooth the rate of the code signals sent from the code port of the data compressor/decompressor.
The FIFO's 10 and 16, the CODEC 12, and the repacker 14 are initialized and put in operation by the microprocessor/memory interface 18. The interface 18 receives control signals from the system in which the data compressor/decompressor is incorporated, and passes signals between the components of the data compressor/decompressor just described and memories used by it. The FIFO's 10 and 16, CODEC 12, repacker 14 and interface 18 are, in the preferred embodiment, fabricated as a single integrated circuit, as shown by the dashed line in FIG. 4. The memories 20, 21 and 22, which are described below, are separate components. Alternatively, some or all of the components of the data compressor/decompressor could be constructed as separate units, or memory could be provided on the integrated circuit comprising the data compressor/decompressor.
The memory architecture requires that the Lempel-Ziv algorithm be executed somewhat differently than the basic LZ algorithm described above. This is because the first memory (21 in FIG. 4) contains only pointer values and thus can not be addressed without the string prefix, and the string prefix will not be available without accessing and resolving the search in the second memory (22 in FIG. 4).
In order to use the pipelined memory architecture the LZ algorithm is executed by assuming a prefix and then hashing the prefix-data combination. If the resulting pointer value is stored in the first memory 21 a success is assumed. Accordingly, a successive assumed prefix and new data are hashed to the first memory 21 while the key derived from the previous hashing operation addresses the second memory 22. If there is a match between the two keys one cycle of the processing of the next-prefix data will have been achieved. On the other hand, if the key does not match, i.e. there is a failure, the assumption about the prefix was incorrect. In the next cycle the key will be written in the second memory, and also during that cycle the new key with the corrected prefix will be hashed to the first memory. In this way the speed increase attributable to a pipeline architecture can be achieved with the LZ algorithm.
The justification of anticipating the prefix value is a consequence of the fact that the LZ algorithm compresses data such as an image by a factor of two to three, with average string lengths of between four and six data elements. This results in success about three times more frequently than failure when searching for a prefix-data combination. Consequently, one can anticipate a prefix and be correct 75% of the time, even before a prefix can actually be resolved.
In LZ encoding, data strings of varying length are represented by codes. Each successive data word is appended to a prefix, which is a code representing a string of previous data words. A search is then performed in the code-table for this prefix-data combination, representing a longer string. If the prefix-data combination is found in the code table ("a success") the code assigned to this prefix-data combination becomes the new prefix. The next data word will then be appended to this new prefix when the cycle is repeated. If the prefix-data combination is not found in the code table, it is added to the table along with a new code-word representing it. The prefix, representing the longest found data string found in the table, is transmitted.
The CODEC 12 includes circuitry for both encoding input data according to the LZ algorithm, and for decoding LZ-encoded data.
The encoder portion of the CODEC 12 is illustrated in FIG. 5. A new data word is received from the FIFO 10 by the data register 32. A prefix register 33 stores a prefix to which the new data word is to be appended. The new data word and the prefix from the register 33 are applied to a hash circuit 34 which develops a hash address and an abbreviated key. The hash circuit 34 is described in detail, below.
The hash address is applied through the signal path 35 to the hash-tag memory 20, 21 to read out the content of the memory 20, 21 at the address corresponding to the hash function. The tag value read out from the hash-tag memory is either 0 or 1 depending upon certain conditions. The memory 21 reads out a pointer to the possible location of the key in the second memory. (Although hash-tag memory 20, 21 is shown in FIG. 5 as part of the encoder, it is physically separate from the encoder as shown in FIG. 4)
A tag bit value of 0 indicates that the prefix-data combination has not been encountered before (a "failure"). In this case a new code word corresponding to the hash address is obtained from the code-word-counter 37 and entered at the memory location of the hash memory 21 through the encoder control 36. The tag bit is re-written as a 1 to indicate a valid entry at the memory location. Finally, the abbreviated key is entered at the code-word location of the key-code-word memory 22. The prefix-multiplexer 40 selects the current data from the register 32 as the next prefix and stores it the prefix-register 33. The current prefix content of the register 33 is transmitted out through the transmit multiplexer 45 to the repacker 14.
A tag bit value 1 indicates a valid entry in the hash memory 21. In this case, the content of the hash memory will be used in the next cycle as an address to read and compare the abbreviated key. At the same time the prefix multiplexer 40 will assume that the abbreviated key will match and will use the contents of the hash memory 21 as the next prefix. If the abbreviated key matches, i.e., a success, the prefix assumption was valid. The operation of the encoder continues using the results of the access to the hash-memory.
If the abbreviated key does not match and the tag bit of the key-code word memory 22 is 0, which indicates an end of list, then the condition is a failure following a collision. The assumption made about the prefix in order to carry out the hash operation was incorrect. The results of the hash operation are then ignored and the old data stored in the old data register 41 is used as the new and correct prefix. At the same time the old prefix stored in the register 42 is transmitted out. The tag bit value of the key/code-word memory is updated to 1, and the code word value is written in the code-word memory 22. In the next cycle, using the code word memory contents as the address, the new abbreviated key is written in the key memory 22 and the tag bit at that location is initialized to 0. In other words, a new link is added to the link list, and the end-of-list pointer is updated.
When the abbreviated key does not match, but the tag bit of the key/code-word memory is 1, the end of the list has not yet been reached. The content of the code-word memory 22 at this address is pointing to the next possible location of the key being sought.
In the next cycle the content of the code-word memory is used as an address and the key is searched for again. This process is continued until either the key is found, a success occurs, the end-of-list is reached, or a failure occurs. Each time an address is found pointing to the next possible location of the key, it is assumed that the key is going to be found there. Because a success is assumed, this address is used as the prefix for hashing and is passed through the prefix multiplexer 40 to the hash circuit 34. The results of a hashing are used only if the key matches, i.e. a success occurs.
Information regarding the data to code word correspondence developed by the encoder during the encoding process is used by the decoder during subsequent decoding. During encoding a transmission is made after every failure, and is accompanied by a new code-table entry. This information is used by the decoder. Each time the decoder receives a code it makes a corresponding entry to its code-table by appending the first character of the currently received code to the previous code and assigning a new code word to it in the code table. At the same time the decoder outputs a string corresponding to the current code, always operating just a step behind the encoder.
The decoder circuit of the CODEC 12 is shown in FIG. 6. Current code word register 51 receives a code word from the repacker 14. The register 51 receives a code word after a previous code word has been decoded so that the code word stored in the register 51 is the current code word to be decoded. The code word stored in the register 51 is also stored in the register 52 for use as the previous code word after the register 51 receives a new code word. Finally, the current code word is tested by the circuit 53 to determine whether it is "Special"as described later.
The multiplexer 54 applies the current code word to the comparator 55 which checks whether the code word belongs to the "Basic"set or is a "Special"case. If the code word is not Basic and not Special the multiplexer 56 passes it to address register 56a to be used as an address for retrieving the data-code word entry at that address in the data memory 57 and code word memory 58. The data at that address is transmitted through the multiplexer 59 to the LIFO control logic 138. Similarly, the code word retrieved from that address is used again, and is transmitted through multiplexer 54 to the comparator 55 to determine whether it is Basic. This sequence of steps is repeated until the code word retrieved from the code word memory 58 is Basic.
If the code word is determined to be Basic, the end-of-string condition has been reached. The end-of-string condition occurs when the decoder has completed unraveling the string represented by the current code word. The register 55a provides a one-clock-pulse delay in the control signals consistent with the pipeline operation of the decoder. At this time the decoder is ready to make a new entry in the decoder table at the memory address pointed to by the next-entry counter 60 through the next entry value latch 60a and the multiplexer 56. The decoder is also ready to accept a new code word from the current-code-word register 51. In the next cycle of operation the Basic code word is output from the register 61 through the multiplexer 59. At the same time a new entry comprising the previously received code word stored in the register 52, and the first character of the current code word, stored in register 61, is written into the code word memory 58 and data memory 57, respectively. A new code word is also taken from the current code word register 51 at this time.
A code word is considered Special if it is also the next entry to be made in the decoder table. The new code word is compared by the Special comparator 53 with the count value of the next entry counter 60. If the new code word and the next entry counter value match the code word is Special. The Special condition latch 53a provides a clock delay required by the pipelining of the decoder. Because no entry corresponding to this code word has been made in the decoder tables, the data memory 57 and the code word memory 58 will not be accessed in the following cycle of operation. Instead, the first character of the previous code word, stored it the register 62 is transmitted to the LIFO 10 through the multiplexer 59. To continue the decoding the previously received code word from the register 52 is passed through the second previous code word register 52a which functions as a pipeline delay latch, to the multiplexer 54 and used as the address to access the data memory 57 and the code word memory 58.
The scheme for generating the hash function is implemented by a special purpose circuit. Before describing the hash function generating circuit the mathematical functions governing the hash function will be considered.
The design of hash function generators has received considerable attention. The hash function generator must efficiently generate the hash function from the key, and it must perform a pseudo-randomizing function so that all of the keys are not mapped into the same hash address.
For example, a small five-character ASCII field would require (128).sup.5 or over one trillion memory address, if it were to be stored in unique addresses corresponding to its value. The first character of the five character field might be taken as a simple hash function thereby reducing the address field of the hash function to only 128 locations. To retrieve a data item of interest one would address the memory location corresponding to the value of the first character of the key, and then look for the entry with the key that matches all five characters. Obviously, if every key started with the same character, then the desired key and data could be retrieved only by searching the entire address space of the keys.
It should also be noted that in the given example, all keys corresponding to a particular hash function have the same first character. Thus, in such a case the first character of the keys need not be stored, and an abbreviated key can be used instead. In this example the abbreviated key would be the last four letters of the word. Accordingly, it would be desirable to use a hash function generator that is efficient, is pseudo-randomizing and which permits the use of abbreviated keys. This last property imposes the requirement that the hash function and the abbreviated key uniquely represent the input key.
According to the method that is employed, the key k, hash function h and abbreviated key a, are represented in binary form as vectors. The hash function generator H and abbreviated key generator A are matrices of l's and 0's which satisfy the following equations, ##EQU1## Consequently, the combination of the hash function h and the abbreviated key a uniquely represent the original key k. This is an important feature. The uniqueness of the combination of the hash function and the abbreviated key allows for the storage of just the abbreviated key in the second memory with an attendant reduction in memory requirements, and without the loss of the ability to resolve collisions.
The form of the hash function generator H, and the operations required to compute equation (1), are particularly well suited to hardware implementation. This can be seen by expanding equation (1) to show the individual elements of the matrix H and vector k as follows: ##EQU2## The hash function generator H is an m.times.n matrix, where hij =0 or 1. The key k is a column vector of n bits, and k.sub.i = 0 or 1. Carrying out the matrix multiplication yields: ##EQU3## which is an m.times.1 column vector. Each element of the hash function h is calculated as the sum
where the multiplications are binary multiplications, or logical AND, and the summation is binary addition without carry, or modulo-two addition. Thus, the products h.sub.ij k.sub.j =1 or 0 depending upon whether h.sub.ij is 1 or 0, and signals corresponding to the products h.sub.ij k.sub.j can be obtained by simply transmitting or not transmitting the bit k.sub.j depending upon whether h.sub.ij is 1 or zero. The ith bit, h.sub.i, of the hash function h is then equal to the modulo-two sum of the transmitted k.sub.j values for that particular value of i.
For example, assume the following hash function generator: ##EQU4## which is a (3 .times.6) matrix for generating a three-bit hash function from a six-bit key.
A hashing circuit which implements this generator and carries out hashing using it is shown in FIG. 7. The hashing circuit is comprised of n signal lines each corresponding to a column of the hash function generator H. The key k is represented by binary signals k1 through k6, and each is applied to a corresponding one of the signal lines 64, 65, 66 etc. The modulo-two adders 67, 68 and 69 with their input connections each correspond to a row of the hash function generator H, and each develops a binary output signal corresponding to one of the three bits of the hash function h.
The connections between the signal lines 64 etc. and the inputs of the modulo-two adders 67-69 correspond to the non-zero elements of the hash function generator H. For example, modulo-two adder 67 corresponds to the first row of the matrix H, which has 1 in the first, third and sixth columns. Signal line 70 connects the signal line for k.sub.1 to the modulo-two adder 67, and similarly signal line 71 connects the signal line for k.sub.3 and signal line 72 connects the signal line for k.sub.6 to it. The output of adder 67 is then (k.sub.1 +k.sub.3 +k.sub.6) (mod 2) =h.sub.1.
Similarly, the modulo-two adders 68 and 69 develop binary output signals corresponding to the bits h.sub.2 and h.sub.3 of the hash function h. In the case where an abbreviated key is to be generated, additional modulo-two adders are provided for the respective bits of the abbreviated key.
The modulo-two adders can be constructed by connecting Exclusive-OR gates 67a and 67b in the manner shown in FIG. 8. This circuit is also known as a parity checker and can be readily expanded by adding more Exclusive-OR gates in order to accommodate more than three inputs.
An advantage of the disclosed hashing circuit is that hashing can be carried out at the system clock speed. Unlike other hashing techniques which use other types of hash function generators, the matrix multiplication of equation (1) is carried out in a single step with the simultaneous occurrence of the multiplications and additions comprising the matrix multiplication. Thus, the circuit can be readily used for carrying out hashing in real time.
Another advantage of the hashing circuit is that it can be made programmable, and a particular hash function generator H can be selected after the circuit has been fabricated. A programmable embodiment of the hashing circuit is shown in FIG. 9. This circuit comprises n input signal lines 81, 82, 83, etc. each for receiving a corresponding one of the binary signals k.sub.1 through k.sub.n corresponding to the bits of the key. There are m modulo-two counters, the first and last of which are labeled 89 and 89m. The output of each modulo-two counter is a binary signal corresponding to one bit of the hash function h.
Each modulo-two counter has n inputs, and n circuit paths 91, 92, etc. are connected to the respective inputs. The signal lines 81, 82, . . . and the circuit paths 91, 92, . . . cross in an array to permit interconnections between the two. The interconnections between the signal lines and the circuit paths are made by diodes 100, 101, etc. Each diode is connected between a respective one of the signal lines and a respective one of the circuit paths. For example; diode 100 connects signal path 81 and circuit path 91; diode 101 connects signal path 82 and circuit path 92, etc. The diodes are fusible in order to open the connection which they establish. Upon the application of a sufficiently high voltage to a selected one of the diodes, the selected diode fails and an open circuit exists between the signal line and the circuit path between which it was connected. The use of fusible diodes to open predefined circuit links and thereby render a circuit programmable is known from programmable logic device technology and can be done in the manner known in that technology.
For simplicity, not all of the signal lines, circuit paths or diodes are shown. As the programmable hash circuit has been described, however, there are n circuit paths for each of the m modulo-two adders, and a diode for connecting each of the signal lines to a corresponding circuit path. This structure is programmable to realize any m-bit hash function, but the modulo-two adders are consequently of the maximum size.
In another embodiment of the invention the modulo-two adders have fewer inputs than the number of signal lines, and at some of the circuit paths is connected to more than one signal line. Such an embodiment is shown in FIG. 10 in which the modulo-two adders 120, 121 and 122 have fewer than n inputs. In this particular embodiment, the modulo-two adders 120 and 121 have an equal number of inputs and the modulo-two adder 122 has a fewer number of inputs. Different schemes for allocating diode connections between the signal lines and the circuit paths can be used. The modulo-two adders 120 and 121 have a sufficient number of diodes 110, 111, etc. so that each signal line is connected to at least one circuit path. In contrast, every signal line is connected to every circuit path for the modulo-two adder 122 so as to achieve the maximum degree of programmability.
The matrix which is a composite of the hash function generator H and the abbreviated key generator A can be derived in a straightforward manner. Starting with the identity matrix pairs of bit rows or columns can be selected at random, added modulo-two, and the sum substituted for the first selected row or column, or simply exchanged. These linear operations applied to an invertible matrix preserves the invertibility property. Consequently, it provides a way to generate a randomized invertible matrix. These steps must be repeated any number of times, and the first m rows of the resulting matrix is H and the remaining (n-m) rows is A.
To reverse the order of characters in the string sequence as the LZ decoding algorithm requires, the data decoder applies its output to a last-in first-out buffer (LIFO), which is illustrated in FIG. 11. The LIFO is comprised of two random access memories (RAM) 130 and 131 controlled by LIFO control logic 138, through which input data from CODEC 12 and output data pass. A first character string is read into the memory 130. The character order is preserved by the address counter 132 which develops a sequence of address values for storing the characters of the input string in sequence.
Diminishment of the system performance by LIFO operation is avoided by the provision of a second RAM 131 which can also be addressed during addressing of the RAM 130. Character strings are stored in order in the RAM 131 under control of its corresponding address counter 133.
To prevent loss of data an overflow memory 135 is provided to receive and store data when the respective RAM 130 or 131 being written into is full. For example, if an input string is written into RAM 130 and its capacity is reached, the input string is then written into the overflow memory 135. The order of the string is preserved by using the address counter 132 for both the RAM 130 and the overflow RAM 135. When the RAM 130 becomes full additional data is passed to the overflow RAM 135 and the address counter 132 continues the sequential count of address values associated with the string being read in. The address values are applied through the address multiplexer 136 so that correspondence between the string characters and the count value is preserved even though the string is stored in two physically separate memories.
When the string data is read out the address counter 132 counts backward from the last memory value address during the writing of the sting into the overflow RAM 135. In this way the stored string is read out in reverse order.
During the reading out of the string stored in the overflow RAM 135 and RAM 130, another string is written into the RAM 131 and stored at successive memory locations having addresses determined by the address counter 133. The feature of separate means for developing address values for the respective memories 130, 131 enables them to be operated separately so that one can write in data while data is read out from the other. In this way equal length strings can be reversed without slowing the processing speed of the system in which the LIFO buffer is used.
From the described mode of operation it is clear that for RAMS 130 and 131 having at least a depth D, the LIFO buffer can continuously buffer strings of length 2D without any loss of speed. This result follows from the fact that a stored string of length 2D filling one RAM, for example RAM 130, and the overflow RAM 135 is read out first from the overflow RAM 135 in order to reverse the string. During this reading out the simultaneous writing and storage of a subsequent string will start with the RAM 131. The RAM 131 of depth D will not be completely filled until the overflow RAM 135, which stored a string segment of length D, is empty thus freeing the overflow RAM 135 to store the remaining segment of length D of the string being written.
In order to handle strings of length greater than 2D the overflow RAM 135 must have a depth greater than D. Strings longer than 2D will degrade the performance of the LIFO buffer. The degree of performance degradation is equal to the sum of the long string length and the short string length divided by twice the long string length. In the worst case the LIFO buffer speed approaches one-half the maximum speed.
The data repacker 14 circuit is shown in FIG. 12. It is comprised of an input data register 140 and an output data latch 141, both of which help improve system performance. Neither the register 140 or the latch 141 are used in the actual data repacking function, however.
The holding register 142 is used to store intermediate results and has a storage length twice the size of the data words being repacked. Shifter 143 and shifter 144 also have a storage length twice the size of the data words and select a number of bits equal to the data word length, e.g. sixteen of thirty-two bits. The multiplexer is a 2:1 multiplexer. One input of the multiplexer 145 is connected to the output of the holding register 142, to maintain the contents of register 142 until the amount of valid data remaining leaves room for concatenation of new data latched in register 140. When directed by the control circuit 146, the other input receives concatenated input data and data from shifter 143.
In operation, the control circuit 146 receives signals from the microprocessor/memory interface 18 which represent the number of bits in (NBI) and the number of bits out (NBO). From this information it determines a most significant bit (MSB) and a least significant bit (LSB) of the intermediate data which will be stored in the holding register 142.
When data is passed to the input of the repacker it is latched by the input data register 140, and on the next clock cycle it is combined with the intermediate data in the holding register 142, if there is room. There will be room if there are fewer valid intermediate data bits in the holding register 142 than the number of bits in a data word. The number of valid data bits equals MSB minus LSB. If there is sufficient room the input data becomes the high bits of the holding register, and the shifted data from the holding register becomes the low bits of the holding register. If there is insufficient room in the holding register 142 the input data is not combined with the intermediate data. The shifter 144 receives a signal indicating the LSB and shifts its content to right-justify the intermediate data for presentation at the output.
Claims
What is claimed:
1. A decoder for decoding Lempel-Ziv encoded data, comprising; memory means for storing code words and data corresponding to the stored code words; means for receiving and for storing a code word to be decoded; means for storing data elements read out from said memory means during decoding; and means for applying said code word to be decoded to said memory means for reading out a data element, and a prefix coded as another code word, and supplying said data element to said means for storing; and for applying said another code word to said memory means, for reading out a further data element and a successive code word, supplying said further data element to said means for storing, and applying each successive code word read out from said memory means to said memory means until the stored code word is decoded, said means for applying comprising a multiplexer having an input for receiving the stored code word to be decoded and having another input for receiving a latest code word read out from said memory means.
2. A decoder for decoding encoded data, comprising: first memory means for storing code words and data corresponding to the stored code words; means for receiving and for storing a code word to be decoded; second memory means connected for shared use in encoding and decoding; means of controlling said second memory means to provide data on a last-in first-out basis during decoding; means for applying said code word to be decoded to said first memory means for reading out a data element, and a prefix coded as another code word, and supplying said data element to said second memory means; and for applying said another code word to said first memory means, for reading out a further data element and a successive code word, supplying said further data element to said second memory means, and applying each successive code word read out from said memory means to said first memory means until all data elements corresponding to said code word to be decoded have been supplied to said second memory means.
3. A decoder for decoding Lempel-Ziv encoded data, comprising; memory means for storing code words and data corresponding to the stored code words; means for receiving and for storing a code word to be decoded; means for storing data elements read out from said memory means during decoding; and means for applying said code word to be decoded to said memory means for reading out a data element, and a prefix coded as another code word, and supplying said data element to said means for storing; and for applying said another code word to said memory means, for reading out a further data element and a sucessive code word, supplying said further data element to said means for storing, and applying each successive code word read out from said memory means to said memory means until the stored code word is decoded, means for determining when the code word is one of a set of basic code words indicating the end of a string; means for maintaining the address value of the next entry to be made in said memory means; means for storing the previously received code word; and means for writing the previously received code word and the first character of the current code word into said memory means for making a new decoder table entry in response to the determination of the end of the string condition.
4. A decoder according to claim 3, wherein said means for applying the stored code word is comprised of a first multiplexer having a first input for receiving the stored code word to be decoded and having a second input for receiving the code word read out from said memory means, and a second multiplexer having a first input for receiving the output of said first multiplexer and a second input for receiving the address value of the next entry to be made in said memory means.
5. A decoder according to claim 3, wherein said means for determining is a comparator connected to receive the output of said means for applying.
6. A decoder according to claim 3, wherein said means for maintaining the address value is a counter.