Background of the Invention
This invention is in the field of charge coupled devices, hereinafter referred to as CCD, utilized for implementing a Haddamard transform representative of sequency components of an image directly on the image focal plane.
Haddamard transform methods are frequently used in video signal processing systems.
The prior art, inter alia, requires large CCD multiplexing registers which introduce transfer errors.
Also, in the prior art the imaged data is multiplexed in the off-focal plane in the time domain. Such data is then A/D converted and fed to a digital processor that operated on the data to take the Haddamard transform thereof.
Summary of the Invention
According to the scope of the invention, the novel features comprise implementation of the Haddamard transform directly on an image focal plane.
The signal sensed from the focal plane will thus, without more, be in the transformed or sequency domain inapposite to either the space or time domains.
The order in which a transform is taken is governed by the mechanization and matrix interconnection of the CCD's with respect to the sequencies, and thus by virtue of such mechanization the CCD matrices are self programmable from which undesired sequencies may be deleted.
Hence an object of the invention is to improve contemporary methods of taking the Haddamard transform of an image by eliminating all off-focal plane transform processing.
The transformed sequencies can be selected using programmed clocks. This results in a highly flexible system in which undesired sequencies can be eliminated.
Accordingly, unlike the prior art, the scheme presented does not require CCD multiplexing registers and hence eliminates a source of errors introduced by the presence and operation of such registers.
The present system, not taking imaged data in the off-focal plane time domain, does not require A/D converters nor digital processors to effect a Haddamard transform of the data.
The method utilized in mechanization, is equally applicable to a one or two dimensional Haddamard transforms taken directly on the focal plane.
Brief Description of the Drawings
FIG. 1 is a block electrical schematic of a pair of matrices according to the invention.
FIG. 2 is a detailed block schematic breakdown of one of the elements of the square matrix as in FIG. 1.
FIG. 3 is a simplified schematic of two unit cells of one of the matrices capable of providing a Haddamard transform.
FIG. 4 is a phase related set of waveforms constituting logic level inputs from a pair of clocks that give rise to a plurality of Haddamard sequencies when inputted to the system of FIG. 1.
Detailed Description
With reference to the figures, several matrices of CCD's may therefore be utilized wherein the square matrix has an array of CCD's each of which is referred to as the unit cell composing a CCD 30, a detector 40 and a DC bias source 50, illustrated in FIG. 2. The unit cell is typically shown at D.sub.11.
In the illustration of FIG. 1, two unit cell matrices are shown. One unit cell matrix is of the 4 .times. 4 type, D.sub.11 . . . D.sub.44, and the other is a single column matrix D.sub.1 . . . D.sub.4.
Matrix of unit cells D.sub.11 . . . D.sub.44 is interconnected electrically in the horizontal direction by bus wires 70 and in the vertical direction by bus wires 80.
With reference to clocks 10 and 20, it may be seen that clock 10 feeds signal levels .phi..sub.1, .phi..sub.2, .phi..sub.3 and .phi..sub.4 required to provide a four sequency transform set, which signal levels constitute a series of rectangular signals the amplitude of which is unity, in different phase relationships and repetition rates feeding bus bar system 80 and thus feeding all unit cells D.sub.11 and D.sub.44. Clock 20 provides like signals of different repetition rates and phase relationships referred to as .phi..sub.5, .phi..sub.6, .phi..sub.7 and .phi..sub.8 which feed unit cells D.sub.1 through D.sub.4, respectively.
Buffer amplifiers A.sub.1 through A.sub.4 are optionally provided, integral between the outputs of cells D.sub.11, D.sub.21, D.sub.31 and D.sub.41 and cells D.sub.1, D.sub.2, D.sub.3 and D.sub.4, respectively, chiefly for isolation of the two matrices. Cells D.sub.1 through D.sub.4 are interconnected by means of bus bar 90 which also provides the output sequence components of the on-focal plane Haddamard transform.
As an example, one unit cell D.sub.11 is illustrated in FIG. 2. It is noted that CCD 30 and optical detector 40 are both well known in the art. In this unit cell example, CCD 30 receives the .phi..sub.1 input from clock 10. Bus bar system 70 provides means for connecting the output of CCD 30 so as to feed such bus bar which in this illustration will feed amplifier A.sub.1, when used, or otherwise as a direct input to D.sub.1. Bus bar 70 acts herein as a means for summing all the CCD type 30 outputs of matrix D.sub.11 . . . D.sub.44. Also a like summing bar 90 provides the sum of the outputs of D.sub.1 . . . D.sub.4, which receive inputs from amplifier A.sub.1 . . . A.sub.4 when used, or otherwise inputs directly from D.sub.11 . . . D.sub.41. CCD 30 is interconnected with photosensitive detector 40, as an input to CCD 30, detector 40 being an element at one rectangular coordinate point on the focal plane. Detector 40 is normally DC biased by battery 50, as shown.
Any one dimensional array can easily be extended to a two dimensional array. FIG. 1 shows the arrays and the required clocks. The first matrix multiplication takes place on the focal plane and the second matrix multiplication take place at the output cell array D.sub.1 through D.sub.4, with the clocks labeled .phi..sub.5 to .phi..sub.8. The reset circuitry is not shown in order to enhance simplicity in illustrating the invention. The output cells operate in the same fashion as the unit cells, except the signals are inputs from amplifiers A.sub.1 through A.sub.4 instead of detectors D.sub.11 through D.sub.44. The .phi..sub.5 to .phi..sub.8 waveforms operate at different clock rates as compared with the .phi..sub.1 to .phi..sub.4 clock rates, as diagrammatically shown in FIG. 4.
The output cells can also be used as a multiplexer for a one dimensional array output if clocks .phi..sub.5 to .phi..sub.8 are pulsed-on in-sequence.
The sequencies resulting from an on focal plane of one or two dimensional Haddamard transform structure, may be read directly from such focal plane without CCD read out registers or adjoining CCD transversal filters. In this system, option is available to address only such sequencies as are desired.
The two matrix array of FIG. 1 may be expressed in matrix algebraic form. The Haddamard transform comprises a matrix similar to the algebraic matrix of series of .+-.1's comprising such algebraic-like matrix, which provide the sequencies S.sub.00 through S.sub.33.
The Haddamard transform may be expressed in matrix algebraic symbology as illustrated by expressions (1) through (5).
where:
[S] = sequency pattern of the Haddamard matrix (1)
[h.sub.1 ] = Haddamard matrix
[d] = unit cell detector matrix ##EQU1##
To obtain sequency S.sub.03 from (1), as an example, the matrix structure reduces to: ##EQU2##
The Haddamard transform matrix is shown in expression (1) as a matrix of .+-. digits. The h.sub.1 matrix is referred to as the Haddamard operator matrix. The unit cells detector matrix, d, represents the signal amplitudes from detectors in D.sub.11 to D.sub.44. The sequency matrix [S] is the direct transformed output.
In order to illustrate the operation of the invention, the operation required to get the S.sub.03 output as shown by expression (2) will be described. The clock pulse polarity can be determined for .phi..sub.1 . . . .phi..sub.8 during the S.sub.03 time period. The outputs from the amplifier A.sub.1 . . . A.sub.4 will be
Such amplifier outputs represented by expression (3) are equivalent to multiplying matrix [h.sub.2 ] by matrix [d], in accordance with expression (2) resulting in a matrix:
and as a consequence of multiplying (4) by [h.sub.3 ], sequency S.sub.03 results. Note that matrix inputs as at (4) are fed into cells D.sub.1 . . . D.sub.4 respectively. Also, when multiplying matrix of (4) by matrix [h.sub.3 ] the output of such multiplication will appear at bus 90 with the clocks as they are shown during the S.sub.03 period being the algebraic sum of:
therefore it can be seen that the sequency output S.sub.03 is a summation of all detector signals with .+-.1 weighting coefficients as determined by .phi..sub.1 . . . .phi..sub.8.
With reference to either the D.sub.11 . . . D.sub.44 matrix in FIG. 1 or its equivalent algebraic representation in expressions (1) or (2), and the details of D.sub.11 in terms of detector 40 and CCD 30 therein, it should be noted that since the structures of all CCD's 30 are the same, the input to these CCD's being an electrical signal from detectors 40, that the D coefficient of the matrix of FIG. 1 and the expressions in (1) or (2) would be a function of the amplitudes of the signals imposed upon the sensing faces of photon detectors 40. However, the outputs of CCD's 30 will be controlled by logic levels .+-.1 in accordance with the phase diagram, FIG. 4. Therefore by taking the different vertical slices of the 16 sequencies S.sub.00 . . . S.sub.33, and adding the values of the .+-. levels for each of the .phi.'s multiplied by the numeric value of each D coefficient, in each case will give the several sequency outputs.
The clock input .phi..sub.1 to CCD 30 weights the signal to D.sub.11 with a .+-.1, such that if the clock output is at a high signal, the output to bus 70 will be +D.sub.11, or if clock .phi..sub.1 is at a low signal level, the output to bus 70 will be -D.sub.11.
A one row or one column of matrix D.sub.11 . . . D.sub.44 could be used for Haddamard transformations in the focal plane wherein each of the unit cells thereof had a .phi. input which was different in phase and repetition rate, the outputs of such cells being connected by a common bus bar, such as 70 or 90 whereat the output sequencies would be available. In a four unit cell arrangement four sequencies would be available.
It is out that whether a single row or column matrix or a multiple rectangular matrix were used, that the Haddamard transform in terms of the sequencies at the output bus bars would represent the direct Haddamard transform inapposite to the inverse transform thereof.
Each of the matrices, particularly the matrix in which the unit cells contain photon detectors 40, may be fabricated on a integrated circuit. Therefore, in an integrated circuit construction, detectors 40 would automatically be in the focal plane to effect the desired results.
CCD 30 is shown and discussed in U.S. Pat. No. 3,930,255, FIG. 2 thereof, and may be used throughout the instant system.
A photo diode, such as photon detector 40, is discussed at page 401 of the textbook Solid State Physical Electronics, 2nd Ed., by Von der Ziel, published by Prentice-Hall, Inc., of Englewood Cliffs, N.J., is one type of detector out of many that may be used in the instant system.
Just a final word about one application, of the many, in which this inventive system may be utilized. The sequency outputs at the sequency output terminal of the instant invention may be hard wired to an A/D converter, with the output of the A/D converter being fed to a digital computer type memory. The output of the memory is fed to a pulse-code modulation transmitter which transmits via air the Haddamard sequencies that constitute the coded format of the pulse code to be received by a receiver responsive to pulse coded signals. The receiver output is fed to a D/A converter which feeds an inverse Haddamard transform circuit, known in the art, which in turn feeds a TV-type raster scanned system display also known in the art. No computer program is required to effect this usage. The display shows the actual image, from which the original data in the image focal plane was taken, such as an image of a person, animal, thing or the like.