US 5,398,322 AGrant
Number Theory Mapping Generator for Addressing Matrix Structures
Issue Date:1995-03-14
•7 Claims
•1 Drawing Sheets
Abstract
The generation of number theory mappings and their application to the addressing of matrix structures through the provision of an address generator which is optimized for the general task of applying "on-the-fly" number theory mappings to matrix operands as they are fetched from memory. The address generator comprises a set of six matrix descriptor storage registers, a finite state machine controller, a first decrementer for cyclically decrementing a first matrix size descriptors from a first of the six storage registers, a second decrementer for cyclically decrementing a second matrix size descriptor from a second of the six storage registers, a finite difference engine which adds one of two matrix difference descriptors to a previously calculated address value obtained from an address register, a modulo arithmetic computation unit which computes the residue of the output of the finite difference engine modulo a matrix modulo descriptor, and an adder which adds an offset value stored as a matrix base descriptor to the output of the modulo arithmetic computation unit. The output sequence from the adder is the desired address generator output.
Metadata
Assignee
- Luminis Pty. Ltd.
Inventor
- Warren Marwood
Application Information
Application Number:US 958319&
Filing Date:1993-05-18
Priority Date:1990-06-27
Art Unit:235
Classifications
IPC:
G06F 1200
Field of Search:
395400;425;164;166
Patent Drawings (1 sheets)
Description
This invention relates to the generation of number theory mappings and their application to the addressing of matrix structures in computer systems. The invention provides particular advantages when used in computer architectures that include systolic processors.
Background of the Invention
Address generation has been a continuing problem for computers, particularly as operation speeds have increased. As the number and range of applications has expanded, there has arisen a need for address generators to produce a range of non-sequential address sequences. A common example is the bit- reversed addressing for the FFT.
Common Digital Signal Processing (DSP) addressing patterns include:
Sequential
Inverted
Reflected
Bit-reversed
Perfect shuffled (Interleaved)
Multiple shuffled
Parallel shuffled
These patterns are in common usage as a result of the vector nature of the common computer architectures. Reference can be made to the paper by ZOBEL, R. N., "Some alternative techniques for hardware address generators for digital signal processors", ISCAS'88, CH2458-8/88 pp. 69-72, 1988, for a description of hardware which implements these addressing patterns. Another paper which describes a versatile hardware address indexing unit is by NWACHUKWU, E. O., "Address generation in an array processor", IEEE Trans. on Computers, Vol. C-34, No. 2, pp. 170-173, February 1985. A further paper which in part describes a general purpose address generation technique is the paper by HALL, F. E. and ROCCO Jr., A. G., "A compact programmable array processor", The Lincoln Laboratory Journal, Volume 2, Number 1, 1989.
In all of these papers the address generation techniques are designed to optimise vector-based algorithms. Matrices and matrix algorithms are supported as operations upon sets of vectors. These approaches have limitations when matrix algorithms are implemented which can not readily be expressed in terms of sets of vectors. An example of such an algorithm is the one-dimensional Fourier transform implemented with the prime factor algorithm.
The object of this invention is the provision of an address generator which is optimised for general matrix algorithms and which is capable of applying `on-the-fly` number theory mappings to matrix operands as they are fetched from memory.
Mapping Generator Architecture
A conventional approach to the problem of addressing matrices stored in a linear memory space is to consider addressing the elements of the matrix in terms of strides. The strides specify the linear distance between successive elements of rows or columns respectively. The problem with this approach is that it is not possible to both fetch matrix operands and simultaneously apply general number theory mappings. The mappings must be applied to the matrices as separate operations. These operations must be done in software in a conventional machine and incur significant time penalties.
Examination of conventional matrix storage schemes shows that they can be considered as simple mappings between one-dimensional and multi-dimensional subspaces. Address generation for the matrices can therefore be performed by carrying out a particular mapping from one dimension to or from two or more dimensions. This can be provided by constructing a hardware implementation of a general number theory mapping. The hardware must provide a general capability to support mappings from one dimension to multi-dimensional subspaces.
The solution to the problem is therefore to replace the conventional address generator with a hardware architecture which implements a general number theory mapping, which unlike prior software for the implementation of particular linear transform algorithms is generally applicable to a range of problems which includes but is not limited to linear transforms.
Summary of the Invention
In its broadest from the invention is an address generator to generate at its output, output addresses of elements of an N-dimensional matrix comprising
storage means for storing at least four descriptors representative of a matrix structure, wherein,
at least two size descriptors representative of the size of two dimensions of an n-dimensional matrix and
at least a further two of said descriptors are difference descriptors representative of the values of two finite address differences,
a counter means per size descriptor,
a sequential N-dimensional finite difference calculation means having as input said difference descriptors and an initially zero previously calculated output address from the address generator whereby said counter means controls the finite difference used by the calculation means to calculate a calculation means output address which is also the address generator output address of an element of an N-dimensional matrix.
In a further aspect of the invention the address generator further comprises the use of a modulo descriptor representative of an address value which is greater than all matrix element addresses,
subtraction means for subtraction from said calculation means output address said modulo descriptor to produce a modulo subtraction means result and a subtraction means sign output,
selection means to select as the output of said address generator either of the calculation means output address or the subtraction means output address according to the subtraction means sign output.
Brief Description of the Drawings
FIG. 1 depicts a schematic representation of a preferred number theory mapping address generator.
Detailed Description of the Drawings
The mapping which has been chosen for description by embodiment is known as the alternate integer representation. It has been used to implement a generalised p-dimensional factorization of the T-transform.
Mappings which have also been considered include the Alternate Integer Representation, the Chinese Remainder Theorem and other simple mappings.
From one dimension n to two dimensions (n.sub.1, n.sub.2), the mappings are:
The Alternate Integer Representation is
where N.sub.1 and N.sub.2 are mutually prime and N.sub.1 N.sub.2 =N and where n.sub.1 =0,1, . . . ,N.sub.1 -1 and n.sub.2 =0,1, . . . ,N.sub.2 -1.
The Chinese Remainder Theorem is
where N.sub.1 and N.sub.2 are mutually prime, N.sub.1 N.sub.2 =N and (a).sub.N (a.sup.-1).sub.N =1.
The notation (a).sub.N means that a is evaluated modulo N.
The Simple Mapping used conventionally to store matricies in linear memory is
Examination of equations (1) to (3) shows that each can be implemented with a second order difference engine implemented with a modulo arithmetic capability as described in the following embodiment and mapping examples, provided that the constants are chosen appropriately. Consider the following expression:
This maps an element n of an arbitrary matrix [A] stored in a linear address space starting at base.sub.-- address onto the (n.sub.1, n.sub.2) element of a two-dimensional address space. (.).sub.q normally requires a division operation. However, by performing a conditional subtraction of q during each calculation the modulo arithmetic can be performed without the complexity of multiplication or division.
To address sequentially all elements of the matrix [A] in some order determined by the constants .DELTA.1, .DELTA.2 and q, n.sub.1 and n.sub.2 are indexed through their respective ranges (the dimension of the matrix). Some of the choices for these constants are given in table 1, and the associated mapping is identified.
Table 1: Values for .DELTA.1, .DELTA.2 and q which implement three different mappings from a one-dimensional to a two-dimensional space.
where max.sub.-- int is the maximum integer of the number representation used. This removes the use of modulo arithmetic. It must be noted that the mappings are not restricted to one-to-one for some parameters.
Some matrix types for which this addressing technique provides access include
Dense matrices
Diagonal matrices
Circulant matrices (e.g. the unit matrix)
Constant matrices
Number Theory mapped matrices
Mapping Generator Implementation
FIG. 1 shows a block schematic of a circuit which implements the difference engine of equation (4). `C` code which simulates the generator is given in Table 3. The address generator assumes a two-phase implementation using a Programmable Logic Array (PLA) to generate the necessary control signals.
The address generator 10 of FIG. 1 comprises in this embodiment a set of six matrix descriptor storage registers 11-16, a finite state machine controller 17, a decrementer 18 for cyclically decrementing a matrix size descriptor 12, an additional decrementer 19 for cycliclly decrementing the matrix size descriptor 11, a finite difference engine 20 which adds one of two matrix difference descriptors 13 or 14 to a previously calculated address value obtained from the address register 21, a modulo arithmetic computation unit 22 which computes the residue of the finite difference engine output 20 modulo the matrix modulo descriptor 15 and an adder 23 which adds an offset value stored as the matrix base descriptor 16 to the output of the modulo arithmetic computation unit 22. The output sequence from the base adder 23 is the desired address generator output.
The finite difference engine 20 has inputs from matrix difference descriptors 13 and 14 which represent difference values which are to be conditionally added to the contents of address register 21. The initial state causes a zero address to be computed by the difference engine by directing to the inputs of the adder 24 through 2:1 multiplexer 25 the ones complement of the matrix difference descriptor 14, and through 2:1 multiplexer 26 the unchanged matrix difference descriptor 14 and a non-zero carry value supplied by the finite state machine 17. For subsequent states multiplexer 25 directs the contents of address register 21 to the adder 24, and multiplexer 26 selects as a function of its control input either matrix difference descriptor 14 or matrix difference descriptor 13. The finite state machine 17 controls both multiplexers 25 and 26 in their various states and provides a zero carry value to the adder 24 in all states other than the initial state. For matrices of higher dimension than two the 2:1 multiplexer 26 is replaced by a multiplexer with a larger number of inputs.
The modulo arithmetic computation unit 22 comprises an adder 27 having as inputs the ones complement of the matrix modulo descriptor 15, the output of the finite difference engine and a logic high carry whose output is the difference between the finite difference engine output address and the matrix modulo descriptor value. The unit 22 further comprises a multiplexer 28 which is controlled by the sign of the adder 27 result to pass either the unchanged output of the finite difference engine 20 or the output of the adder 27 to its output. The output of the multiplexer 28 is supplied to the address register 21 for use in the computation of the next address. The address supplied by the multiplexer is a valid address sequence for the matrix structure.
The address sequence obtained from unit 22 can be adapted for use in a computer system by offsetting the values by a constant which is stored as a matrix base descriptor 16, and which is added to the output of unit 22 in a base adder 23.
The cyclic decrementer 18 comprises a serially arranged configuration of a multiplexer 29, a register 30 and a register decrementer/test-means 31. The finite state machine 17 initialises the decrementer 31 to zero in the initial state and consequently causes the test-means to cause the multiplexer 29 to pass the matrix size descriptor 12 to the register 30. In subsequent states the contents of the register 30 is decremented in register decrementer 31 and tested for the zero value. A non-zero value causes the multiplexer 29 to store the register decrementer output in the register 30. A zero value causes the multiplexer 29 to pass the matrix size descriptor 12 to the register 30. This description is applicable to each of the plurality of counters required for an n-dimensional generator.
TABLE 2: State table for one embodiment of a two-dimensional address generator PLA.
The state table for the address generator is shown in table 2. Variables are:
s0,s1: state address lines
run: start flag
zf1,zf2: zero flags from decrementers
rld1,rld2: reload signals for the decrementers
cin: carry input to first adder.
Equations which describe the outputs are:
Area and Time Considerations
It is assumed that in the schematic of FIG. 1, all computations are done in a two-phase clocked system, with the address calculation being performed with combinatorial logic. Further, it is assumed that the circuits are implemented in a CMOS technology and use the simplest possible ripple-carry addition circuits. Using these assumptions there are estimated to be in excess of 5000 transistors in the multiplexer/inversion/addition datapath for a 32-bit implementation, and less than 10000 transistors in the complete generator.
Consider a technology in which the slowest ripple-carry adder has an execution time per bit of 2 ns. The output from the second adder will follow the output from the first by about 5 ns, and will occur about 70 ns after phase 2 is active. This timing determines the start time of the third addition, which requires a further 70 ns including the multiplexer delay. Thus the generator can execute in approximately 200 ns, allowing 50 ns for a phase1 clock cycle. In an embodiment of the invention only about 10 ns would be needed for the phase 1 clock period.
Additional registers can be added to the circuit to reduce the number of adders.
Multiplexer-based Manchester carry circuits can execute at less than 1 ns per bit in current processes. These circuits allow the multiplexing of a single adder to perform the three additions at the expense of some additional registers and control circuitry. Benefits of this approach are that the operands are not required at the same time and so a RAM register-file can be used to minimise the area of the data registers.
If faster address generation is required, the adder architecture can be replaced with faster structures. In this case a trade off, of area for execution time is performed. To achieve maximum performance the mapping generator can be pipelined, and it is estimated that with existing processes it is reasonable to expect addresses to be generated at a rate that exceeds 50 MHz.
The use of number theory mapping hardware implemented as a difference engine provides access to both normal and transposed matrix structures, including constant matrices stored as a single scalar. Circulant matrices are generated from a single row. The generality of the approach makes possible the use of prime factor mappings of dense matrices without time penalty. The prime factor mappings are used to optimise performance when executing algorithms such as convolutions, correlations and a large number of linear transforms. Examples of these transforms include the Fourier transform, the Chirp-z transform and the Hartley transform.
The technique is elegant as the number theory mappings which were originally additional operations are implemented without time penalty. In addition, as the conventional storage schemes for matrices appear as a subset of the mapping capability of the generator, the need for conventional address generation hardware is removed.
Matrix Addressing Examples
Arguments which are required by the generator of this embodiment are the set {base, delta1, delta2, n1, n2, q}. The following examples consider 3.times.5, 5.times.3 and 5.times.5 matrices, and show the address sequences which are used for normal, transposed, prime factor mapped and circulant matrices. The examples shown are obtained by executing the simulator provided in FIG. 2.
1. Normal Form
A 3.times.5 matrix stored in row order requires a simple linear sequence.
Enter base,delta1,delta2,n1,n2,q
0 1 1 5 3 15
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14
A non-zero base address simply offsets the address sequence, e.g.
Enter base,delta1,delta2,n1,n2,q
100 1 1 5 3 15
100 101 102 103 104 105 106 107 108 109 110 111 112 113 114
2. Transposed Form
Transposition of the above matrix requires the following arguments.
Enter base,delta1,delta2,n1,n2,q
0 5 -9 3 5 15
0 5 10 1 6 11 2 7 12 3 8 13 4 9 14
This is a multiple-shuffle of the sequential addresses.
3. Prime factor mappings
A prime factor mapping of the matrix is given by the following:
Enter base,delta1,delta2,n1,n2,q
0 3 8 5 3 15
0 3 6 9 12 5 8 11 14 2 10 13 1 4 7
4. Transposed prime factor mappings
Transposition of the above mapped matrix is obtained by:
Enter base,delta1,delta2,n1,n2,q
0 5 8 3 5 15
0 5 10 3 8 13 6 11 1 9 14 4 12 2 7
5. Circulant matrices
For matrices which are circulant, major savings in both storage and generation time are possible by computing only the first row, and generating the required matrix from this one row. As an example the generator is used to generate a 3.times.5 matrix from a single 5-element array.
Enter base,delta1,delta2,n1,n2,q
0 1 0 5 3 5
0 1 2 3 4 4 0 1 2 3 3 4 0 1 2
This is the technique used to generate the unit matrix I from a single row with a one in the first element position followed by N- 1 zeroes (for an order N matrix).
A skew-circulant matrix is generated similarly:
Enter base,delta1,delta2,n1,n2,q
0 1 2 5 3 5
0 1 2 3 4 1 2 3 4 0 2 3 4 0 1
Constant Matrices
Where an algorithm calls for the multiplication of a matrix by a scalar constant, e.g. C=aA, it is readily implemented by a Hadamard multiplication of the matrix by an identically dimensioned matrix whose elements are the desired constant. This is readily achieved by generating a single scalar and then choosing parameters for the mapping hardware which construct the constant matrix from the one scalar, i.e. for a scalar at address 0:
Enter base,delta1,delta2,n1,n2,q
0 0 0 5 3 1
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Sub-matrix generation
Sub-matrices are extracted from an arbitrary matrix with appropriate offsets, e.g. the 2.times.2 sub-matrix of the matrix in the first example, starting at element a.sub.2,2.
Enter base,delta1,delta2,n1,n2,q
6 1 4 2 2 15
6 7 11 12
Skewed sub-matrices are extracted similarly.
A Multi-Dimensional Transform Example
The T transform is a linear transform which uses as its kernel the real function cas.theta.=cos.theta.+sin.theta. defined by Hartley in 1942. The discrete transform is defined as a matrix vector product. Alternate integer representation mappings can be used to re-write one-dimensional T transforms whose lengths are factorable into co-prime integers as multi-dimensional transforms. These transforms can be implemented as sets of matrix products. The T transform can be used as a faster algorithm for computing both the Hartley and Fourier transforms for real data.
Hartley, in 1942 [1], defined an alternative real kernel for the Fourier integrals which led to the following transform pair discussed in detail in [2]: ##EQU1## where cas (2.pi.ft)=cos (2.pi.ft)+sin (2.pi.ft), X(t) is a real function of time, and H(f) is a real function of frequency.
These integrals are the continuous Hartley transforms. For sampled data systems the Discrete Hartley Transform (DHT) pair can be written as ##EQU2##
Equations (7) and (8) are best considered as matrix-vector products.
When number theory mappings are applied to the matrix-vector products which define the Hartley transform the mappings convert the one-dimensional matrix-vector product, or convolution, to a multi-dimensional convolution which can be implemented as a series of matrix-matrix multiplications. These higher dimensional transforms are not readily expressed in terms of the kernel.
A related transform which is defined expressly in terms of the cas kernel is the T transform. The one-dimensional T-transform is identical to the Hartley transform, and is defined by equation (7).
The Multi-Dimensional Prime Factor T Transform
Consider the mapping of the linear input and output vectors x(n) and X(k) into p-dimensional forms using the alternate integer representation maps ##EQU3## and the product is given by: ##EQU4## where the length N of the vectors is factorable into p co-prime factors N.sub.1. . . N.sub.p, and ##EQU5##
Substitution of this product into the DHT equation (7) converts the one-dimensional Hartley transform into a multi-dimensional transform. However, this multi-dimensional form is not a simple extension Of the cas kernel.
The T multi-dimensional transform is written directly in terms of the kernel, and for the p-dimensional case is written simply as ##EQU6##
The inverse transform is simply ##EQU7##
This transform is of interest for the following reasons:
it is readily computed with a recursive procedure
filtering can be done in the T domain
the Hartley transform for 2, 3 and 4 dimensions can be readily derived from it.
the real Fourier transform for 2, 3 and 4 dimensions is derivable directly from the T transform.
Although Fourier and Hartley transforms of higher dimension than four can be computed with the T transform, it is likely to be less computationally efficient than the direct computation.
The following presents the relationship between the T and Hartley transforms.
The identity
can be used with the two-dimensional T transform to compute the Hartley transform. Let T(k.sub.1,k.sub.2) be the two-dimensional T transform. Then the two-dimensional Hartley transform is given by
For the three-dimensional case, the following identity is used:
Let T(k.sub.1,k.sub.2,k.sub.3) be the three-dimensional T transform. Then the three-dimensional Hartley transform is given by
Example code for the computation of the p-dimensional T-transform is given in Table 4. Additional code which generates the Hartley transform from a two-dimensional T-transform is given in Table 5 . The T-transform is computed directly with two matrix products in this example to minimise overheads. For higher dimensional factorizations than two, the generalised algorithm would be used, and a tensor.sub.-- add.sub.-- real function used to implement the sums as required. ##SPC1##
Claims
The claims defining the invention are as follows:
1. An address generator to generate at its output, output addresses of elements of an N-dimensional matrix comprising storage means for storing at least four descriptors representative of a matrix structure, wherein, at least two size descriptors representative of the size of two dimensions of an N-dimensional matrix and at least a further two of said descriptors are difference descriptors representative of the values of two finite address differences, a counter means per size descriptor, a sequential N-dimensional finite difference calculation means having as inputs said difference descriptors and an initially zero, previously calculated output address from the address generator whereby one of said counter means controls the finite difference used by the calculation means to calculate a calculation means output address which is also the address generator output address of an element of said N-dimensional matrix.
2. An address generator according to claim 1 wherein said storage means also stores a modulo descriptor representative of an address value which is greater than all matrix element addresses, subtraction means for subtraction from said calculation means output address said modulo descriptor to produce a modulo subtraction means result and a subtraction means sign output, selection means to select as the output of said address generator either of the calculation means output address or the subtraction means output address according to the subtraction means sign output.
3. An address generator according to claim 2 wherein said selection means selects as the output of said address generator said calculation means output address if said subtraction means sign output is negative or said subtraction means output address if said subtraction means sign output is positive.
4. An address generator according to claim 3 further comprising a base descriptor representative of an offset value, an addition means to add said base descriptor to said selection means output to provide an offset address as the address gererator output address of said element of said N-dimensional matrix.
5. An address generator according to claim 1 wherein each or said counter means further comprises: a selection means having first, second and at least one control input, said first input being one of said at least two size descriptors, a counter storage means adapted to receive and store a current counter value input from said selection means, a decrementer means adapted to receive and decrement a current counter value from said counter storage means and to output the decremented counter value to said selection means second input, a test means to test said decrementer means output for a zero value and to output a signal to a first of said at least one control input of said selection means which is representative of the true or false result of the test, whereby, a true result of said test controls said selection means to pass said one of said at least two size descriptions size descriptor from said selection means first input to said counter storage means, and, a false result of said test controls said selection means to pass from said selection means second input said decrementer means output to said counter storage means.
6. An address generator according to claim 5 wherein each said counter means per size descriptor controls a subsequent counter to operate only when the test means signal of its controlling counter is representative of a true result.
7. An address generator according to claim 6, further comprising: a finite difference control signal generator, having at least two inputs, each input adapted to receive said test means signal from a respective one of said counter means, for generating at least one control signal to select which of said at least two difference descriptors are input to said finite difference calculation means.
Patent Citations (9)
Non-Patent Literature (3)
- E. O. Nwachukwu "Address Generation in an Array Processor," IEEE Transactions on Computers, vol. C-34, No. 2, Feb. 1985, pp. 170-173.
- R. N. Zobel, "Some Alternative Techniques for Hardware Address Generators for Digital Signal Processors," ISCAS, 1988, pp. 69-72.
- F. E. Hall and A. G. Rocco, Jr., "A Compact Programmable Array Processor," The Lincoln Laboratory Journal, vol. 2, No. 1, 1989, pp. 41-62.