Predictive Signal Coding With Partitioned Quantization

This invention relates to speech signal communication systems and more particularly to digital speech signal processing adapted to reduce transmission rates.

The processing of signals for transmission over digital channels in telephone and other types of communication systems generally includes the sampling of the input signals, quantization of the samples, and generation of a set of codes representative of the quantized signal samples. As is well known, speech signal samples are highly correlated so that each signal sample has a component that is predictable from its past values. The predictable and unpredictable components of the speech signal can be separated and encoded at approximate rates to provide efficient utilization of a digital channel without affecting the subjective quality of the speech signal.

Predictive signal arrangements as disclosed in U.S. Pat. Nos. 3,502,986 and 3,631,520 involve generation of predictive parameter signals from the succession of speech samples and the formation of a predicted value for each speech signal sample from the generated parameters and the preceding speech signal samples. The difference between each sample and its predicted value is quantized, digitally encoded, and sent to a receiver along with the predictive parameters. The difference signal is encoded at the receiver and combined with the predictive parameters and other signal information already stored in the receiver. In this manner, only the unpredicted signal component need be quantized and transmitted at a high bit rate and a saving in channel capacity is achieved. The saving is generally reflected in the reduced bit rate needed to transmit a signal of predetermind quality.

U.S. Pat. No. 4,133,976 issued Apr. 7, 1978 to B. S. Atal and M. R. Schroeder and assigned to the same assignee discloses a predictive speech signal coding arrangement in which a set of formant-related predictive parameters corresponding to the short-term redundant structure of the speech signal and a set of pitch-related prediction parameters corresponding to the long-term redundant structure of the speech signal are generated. Since the speech signal is quasi-stationary, the prediction parameters need only be generated once every 10 milliseconds. The remaining portion of the speech signal corresponds to the unpredicted component generally termed the prediction residual.

While the prediction parameter signals representative of the predictive speech signal component can be transmitted at a relatively low bit rate without adverse effects, the transmission rate of the prediction residual is critical to the quality of the reconstructed speech signal. Typically, the predicted signal component parameters require a transmission rate of 3 to 4 kilobits per second. At total bit rates lower than 10 kilobits per second, it is often necessary to quantize the prediction residual with only one bit per sample. This two level quantization results in both peak-clipping of the prediction residual and granular distortion. It is an object of the invention to provide improved digital speech communication at low bit rates.

The invention is directed to a predictive speech signal communication arrangement in which an input signal is analyzed in successive time intervals to generate a set of prediction parameter signals for each interval. Jointly responsive to the input signal and the prediction parameter signals, a signal representative of the prediction residual is produced. A quantized signal corresponding to the prediction residual is generated and encoded for transmission over a digital channel. The quantized signal generation includes partitioning the prediction residual signal into a plurality of distinct portions and selectively quantizing the distinct portions of the prediction residual signal.

FIG. 1 depicts a block diagram of a digital speech signal coding circuit illustrative of the invention;

FIG. 2 depicts a block diagram of a digital speech signal decoding circuit useful in conjunction with the circuit of FIG. 1;

FIG. 3 depicts a detailed block diagram of the prediction parameter computer of the circuit of FIG. 1;

FIG. 4 shows a detailed block diagram of the threshold signal generator circuit of FIG. 1;

FIG. 5 shows a detailed block diagram of the formant predictor circuits of FIGS. 1 and 2;

FIG. 6 shows a detailed block diagram of the voice periodicity predictors of FIGS. 1 and 2;

FIG. 7 shows waveforms illustrating the operation of the predictive parameter circuit of FIG. 3; and

FIG. 8 shows signal waveforms illustrative of the operation of the circuit of FIG. 1.

FIG. 1 depicts a predictive speech signal coder illustrative of the invention. In FIG. 1, a speech signal s(t)from speech signal source 101 is supplied to filter and sampler circuit 103. Signal s(t) is low-pass filter and modified by a high frequency emphasis arrangement in circuit 103 and is then sampled at a predetermined rate. Circuit 103 may comprise a low-pass filter with a cutoff frequency of 4 kilohertz, a preemphasis netowrk with a +6 db per octave slope beginning at 700 hertz, and a sampler having a sampling rate of 8 kilohertz. The successive signal samples from circuit 103 are applied to analog-to-digital converter 105. In the A-to-D converter, a digital code s.sub.n suitable for use in the encoder is produced for each signal sample.

The coded signal samples s.sub.n from converter 105 are sequentially applied to one input of predictive parameter computer 135. The s.sub.n samples are also supplied to formant predictor 107 through a delay 106 and lead 108. Delay 106 may comprise a shift register or other delay elements well known in the art. Predictor 107 is responsive to the code samples s.sub.n from delay 106 and the prescribed set of predictive signals A=a.sub.1, a.sub.2, . . . a.sub.k, . . . a.sub.p obtained from computer 135 to generate a predictive code. ##EQU1## for each sample where a.sub.k is the k.sup.th linear prediction parameter coefficient and p is the order of the predictor. As is well known in the art, predictor 107 is operative to predict the present value of each signal sample s.sub.n from the weighted sum of a number of prior sample values in accordance with expression 1. The prediction is based on the short-term spectral envelope of the speech signal and the formant structure of the vocal tract as represented by the prediction parameter signals a.sub.1, a.sub.2, . . . , a.sub.p.

FIG. 5 shows a tranversal filter well known in the art which may be used as formant predictor 107. The predictor of FIG. 5 is characterized in z transform notation as ##EQU2## In FIG. 5, p is equal to 10, shift register 503 is a 10 stage register operated at an 8 kilohertz sampling rate. The sampling clock pulses CL1 are provided by clock generator 140. Register 503 receives the successive s.sub.n samples from delay 106 on line 501. The output of the first register stage on line 504-1 is supplied to one input of multiplier 505-1. In similar manner, the outputs of the remaining stages of shift register 503 on lines 504-2 through 504-10 are supplied to multiplers 505-2 through 505-10, respectively. The linear prediction coefficient signals a.sub.1, a.sub.2, . . . , a.sub.10 are applied to multipliers 505-1 through 505-10 via line 510 as indicated in FIG. 5. Each multiplier is operative to form the product s.sub.n-k a.sub.k. The products are summed two at a time in adders 507-2 through 507-10. The signal representative of the sum of the products in accordance with expression 1 is then available on the transverse filter output line 512.

The predicted signal from format predictor 107 is applied to the negative input of subtractor network 109 wherein it is subtracted from the current coded sample s.sub.n of the speech signal from delay 106. The resultant difference signal ##EQU3## corresponds to the speech signal with its formant redundancy removed.

Voice periodicity predictor 128 is effective to remove pitch related redundancy from the speech signal whereby the prediction residual of the speech signal is further reduced. The output of quantizer 111 is supplied to adder 131. Adder 131 and voice periodicity predictor 128 are adapted to form a predicted value code d'.sub.n for each difference signal sample responsive to a set of prior difference codes d.sub.n, quantizer output signals, and prediction parameter signals B=b.sub.1, b.sub.2, b.sub.3, as well as code M representative of the pitch period of the current speech signal segment. The sum of the quantizer output signal QO.sub.n and the predicted difference signal is formed in adder 131. The sum output of adder 131 is supplied to the input of periodicity predictor 128. As described in the forementioned U.S. Pat. No. 4,133,976, predictor 128 produces a signal representative of the predicted value of the present difference signal in accordance with

The predictor is characterized in z transform notation by

where z.sup.-m represents a delay of m samples. b.sub.1, b.sub.2, and b.sub.3 are prediction coefficient signals determined by minimizing the mean squared prediction error between the difference signal d.sub.n and its predicted value.

Signals M and b.sub.1, b.sub.2, and b.sub.3 are produced in computer 135 for each speech signal interval. The predicted value of the current difference signal d.sub.n is subtracted from the output of subtractor 109 in subtraction network 126. In this manner the pitch period related redundancy of the speech signal is removed from the difference signal.

FIG. 6 shows an arrangement for predictor 128. In FIG. 6, shift register 603 comprises 120 stages. These stages store the successive samples received from adder 131 on line 601. The 120 stages of register 603 provide a time period of 15 milliseconds which period is the longest anticipated pitch interval in the speech signal. The output of each stage of the shift register is supplied to selector circuit 605. The selector circuit is operative to selectively gate three consecutive shift register stage outputs responsive to signal M from computer 135. The selection is done in accordance with equations 4 and 5. The output of the left-most selected shift register stage is applied to multiplier 606-1. The output of the other selected shift register stages are applied to multipliers 606-2 and 606-3 respectively. Predictive parameter signals b.sub.1, b.sub.2, and b.sub.3 are applied to multipliers 606-1, 606-2, and 606-3 from computer 135 via line 611. The product codes from the multipliers are summed in adders 607-2 and 607-3. In this manner the predicted value code d'.sub.n for the present difference signal appears on line 612.

Prediction parameter computer 135 generates the predictive parameter signals required for the operation of the coder circuit of FIG. 1. Speech signals, as is well known in the art, are nonstationary. The characteristics of speech, however, change relatively slowly so that it is sufficient to adapt the predictive parameter signals to the changing speech signal once every 10 milliseconds at an 8 kilohertz sampling rate. Thus, prediction parameter computer 135 receives the speech samples s.sub.n from A-to-D converter 105 during each 10 millisecond time frame. Responsive to the signal samples, computer 135 provides prediction parameter and other signals for the next 10 millisecond time frame to accommodate the changing signal conditions. The signal samples s.sub.n are delayed in delay 106 so that the delay in parameter signal formation is accounted for.

FIG. 3 shows a signal processing arrangement suitable for use as computer 135 in FIG. 1. Referring to FIG. 3, processor 309 is operative to generate a set of formant related linear prediction coefficient signals a.sub.1,a.sub.2 . . . ,a.sub.10, a set of pitch related prediction coefficient signals b.sub.1, b.sub.2, b.sub.3, a set of formant related partial correlation coefficient signals r.sub.1,r.sub.2, . . . ,r.sub.10, a .theta..sub.0 signal to control the threshold of center clipper 164, a .theta..sub.p signal for noise shaping control, a pitch related signal M, and a step-size signal .DELTA. for use in other portions of the coder of FIG. 1. The output signals from processor 309 are stored in output stores 331 through 337. Processor 309 may be one of several microprocessor or other small size computer arrangements such as the C.S.P., Inc. Macro Arithmetic Processor System 100.

Controller 307 of FIG. 3 is adapted to partition each 10 millisecond speech frame into a sequence of predetermined time periods, each time period being dedicated to a particular operating mode. The operating modes are illustrated in FIG. 7. Clock pulses CL2 from clock 140 of FIG. 1 are shown in waveform 703. A CL3 clock pulse occurs at time t.sub.1 the beginning of the 10 millisecond time frame illustrated in FIG. 7. This CL2 clock pulse places controller 307 in its data input mode until time t.sub.2 as illustrated in waveform 705.

During the data input mode, controller 307 is connected to processor 309 and to speech sample store 320. Responsive to control signals from controller 307, the 80 s.sub.n sample codes inserted into sample store 320 in the immediately preceding 10 millisecond time frame are transferred to data memory 316 via input-output interface 318. The data inupt mode is terminated at time t.sub.2 when 80 sample codes from store 320 have been supplied to predetermined addresses in data memory 316. While the stored 80 samples are transferred into data memory 316, the speech samples of the current frame are continually inserted into store 320 under control of clock pulse CL1.

Just after time t.sub.2 controller 307 is switched to its formant prediction parameter mode as shown in waveform 707. In this formant prediction parameter mode, linear prediction coefficient (LPC) program memory 303 is connected to central processor 312 via controller 307, controller interface circuit 310 and bus 340. Responsive to the permanently stored instructions in read only memory 303, processor 309 is operative to generate formant partial correlation coefficient signals r.sub.m =r.sub.1,r.sub.2, . . . ,r.sub.10 and linear prediction coefficient signals A=a.sub.1,a.sub.2, . . . ,a.sub.10. Signals A and r.sub.m are transferred to stores 331 and 333, respectively. The stored instructions for the generation of the formant predictor signals in ROM 303 are listed in FORTRAN language in Appendix 1.

As is well known in the art, these parameter signals are generated by forming the covariance matrix P whose terms are ##EQU4## and speech correlation factors ##EQU5## Factors g.sub.1 through g.sub.10 are then computed in accordance with ##EQU6## where T is the lower triangular matrix obtained by the triangular decomposition of

The partial correlation coefficients r.sub.m are then generated in accordance with ##EQU7## corresponds to the energy of the speech signal in the 10 millisecond time frame. Formant linear prediction parameter signals A=a.sub.1, a.sub.2, . . . ,a.sub.10 are computed from the partial correlation parameter signals r.sub.m in accordance with the recursive formulation ##EQU8## The partial correlation parameter signals r.sub.m, and the linear prediction parameter signals a.sub.i generated in processor 309 during the formant prediction parameter mode are transferred from data memory 316 to stores 331 and 333 for use during the next 10 millisecond time frame. The signals A are also transferred to noise shaping filter 173 in FIG. 1. During the formant prediction parameter mode, controller 307 is operative to count the CL1 clock pulses from clock 140 to determine the termination time of the mode.

At time t.sub.3, after the transfer of the partial correlation and linear prediction parameter signals to stores 331 and 333, controller 307 is placed in its pitch prediction parameter mode as illustrated in waveform 709. Between times t.sub.3 and t.sub.4, controller 307 is operative to connect pitch prediction program memory 305 to central processor 312 via controller interface 310 and bus 340. The instruction codes permanently stored in ROM 305 are listed in FORTRAN language in Appendix 2. These instruction codes are operative to form the pitch parameter signals b.sub.1, b.sub.2, and b.sub.3, as well as pitch-related signal M for use in voice periodicity predictor 128 of FIG. 1. Processor 309 is operative during the pitch prediction mode to determine the correlations between difference signals d.sub.n and d.sub.n-i over a prescribed interval as shown in Equation 12 ##EQU9## In this manner the time index i for which .zeta..sub.i is maximum is selected. M, the time at which .zeta..sub.i is maximum, is transferred from data memory 316 under control of controller 307. Processor 309 is further operative to compute pitch prediction parameters b.sub.1, b.sub.2, and b.sub.3 on the basis of the minimization of ##EQU10## Signals M and b.sub.1, b.sub.2, and b.sub.3 are transferred to stores 332 and 335 via input-output interface circuit 318 by time t.sub.4. Between times t.sub.4 and t.sub.5 the signal shown in waveform 711 is enabled. Responsive to the signal of waveform 711, controller 307 is operative to connect quantizer step-size program store 306 to processor 309. In this manner, processor 309 is adapted to receive the permanently stored instruction codes of ROM 306. These instruction codes are shown in the FORTRAN language listing of Appendix 3. In the interval between times t.sub.4 and t.sub.5 processor 309 is operative to generate signal R in accordance with ##EQU11## and to form step-size signal .DELTA. in accordance with

where v.sub.peak is the peak value of the signal d.sub.n -b.sub.1 d.sub.n-M+ 1-b.sub.2 d.sub.n-M-b.sub.3 d.sub.n -M-1. Signals .theta..sub.p and .theta..sub.0 are also formed in accordance with

The .theta..sub.p, .DELTA. and .theta..sub.0 signals are then stored in stores 334, 336, and 337 respectively by time t.sub.5. The signals from stores 331 through 337 formed during a 10 millisecond time frame are then available at the output of parameter computer 135 for the next successive time frame in the circuit of FIG. 1. The signals s.sub.n from converter 105 are simultaneously supplied to parameter computer 135 and delay 106 whereby the outputs of computer 135 are effective to control the sequence of speech samples s.sub.n from which they were formed.

The output of subtractor 126 corresponds to the speech signal with both formant and pitch period redundancies removed. Subtractor 162 is jointly responsive to the redundancy free signal from subtractor 126 and the output of noise-shaping filter 173 to provide a minimum redundancy and noise-shaped signal.

The prediction residual signal at the output of subtractor 126

is modified by noise-shaping filter 173 in accordance with the arrangements disclosed in aforementioned U.S. Pat. No. 4,133,976. The output of subtractor 162, QI.sub.n, is then supplied to divider circuit 166. The divider is operative to scale signal QI.sub.n by the frame step-size signal .DELTA. from prediction parameter computer 135. After appropriate scaling the signal QI.sub.n is center clipped in center clipper circuit 164.

As a result of the center clipping, the lower amplitude samples of the prediction residual signal are replaced by zero and only the zero and the higher amplitude values of the prediction residual signal are supplied to quantizer 111. In this manner, the high amplitude portions of the prediction residual signal can be very accurately quantized while the lower amplitude portions of the prediction residual signal are replaced by zero value samples. Most of the available bits for prediction residual transmission are then utilized for the high amplitude prediction residual portions. Advantageously there is very little or no distortion produced in the communication system by the even severe center clipping of the prediction residual while the accurate quantization of the high amplitude prediction residual signal portions provides improved intelligiblity.

Threshold generator 160 receives an initial threshold value signal .theta..sub.0 for the current 10 millisecond time frame from prediction parameter computer 135. The threshold value output signal .theta..sub.n which controls the center clipping thresholds of clipper circuit 164 is a function of the initial threshold value .theta..sub.0, the redundancy reduced prediction residual signal v.sub.n, the noise filter input to the center clipper QI.sub.n, and the output samples Q.theta..sub.n from quantizer 111. The threshold value is adapted during each time frame so that only a predetermined percent .gamma. of the prediction residual samples are supplied to quantizer 111. The samples from the center clipper can then be accurately quantized. Typically only 10 percent of the quantized prediction residual samples need be nonzero. For each 10 millisecond time frame, the initial threshold value .theta..sub.0 is selected so tat it is exceeded by only 10 percent of the values of the signal v.sub.n in that frame. Threshold signal generator 160 is adapted to supply a varying .theta..sub.n signal to center clipper 164 so that the selected percentage, e.g., 10 percent of the prediction residual samples are nonzero.

Threshold signal generator 160 is shown in greater detail in FIG. 4. Referring to FIG. 4, the prediction residual signal v.sub.n is supplied from subtractor 126 to absolute value former 401. The absolute value former, as is well known in the art, may comprise a sign control circuit for digital coded input signals or a full wave rectifier circuit for analog or sampled data type signals. In like manner, the signal from subtractor 162 is passed through absolute value former 403 while the signal from the output of multiplier 168 is supplied to absolute value former 405. The output of absolute former circuit 401 is averaged in averaging circuit 407 with a five millisecond time constant characteristic to form signal {V.sub.n }. The output of absolute value former 403 is averaged in circuit 409 with the five millisecond time constant characteristic to for signal {QI.sub.n }. Similarly, the signal from absolute former 405 is averaged in circuit 411 with a five millisecond time constant characteristic to form signal {Q.theta..sub.n }. The output of averaging circuit 409 is supplied to one input of divider circuit 415 while the output of averaging circuit 407 is supplied to the other input. Divider circuit 415 is operative to form the ratio

The signal from averaging circuit 411 is scaled by a factor of (100)/(.gamma.) in multiplication circuit 420 and the output of scaler circuit 420 is multiplied by the ratio obtained from divider 415. The typical value of .gamma. is 10 percent. The resultant at the output of multiplier 425 is multiplied by the initial threshold value .theta..sub.0 to form the threshold signal ##EQU12## where .beta. is typically 0.5.

The center clipped prediction residual signal from center clipper 164 is supplied to quantizer 111 which may comprise a 15 level uniform quantizer with step size v.sub.peak /7. As a result of the center clipping arrangements in FIG. 1 the eight innermost levels .+-.1, .+-.2, .+-.3, and .+-.4 remain zero with a very high probability. The quantizer output is constrained to have only seven levels 0, .+-.5, .+-.6, and .+-.7.

The waveforms of FIG. 8 illustrate the effects of the adaptively controlled center clipping arrangement of FIG. 1. Waveform 801 represents speech signal s(t) after preemphasis in filter 103. Waveform 803, 805, and 807 are obtained from the arrangement of FIG. 1 in which center clipper circuit 164 and threshold signal generator 160 are removed and quantizer 111 is a two level quantizer. Such a system is typical of prior art arrangements. Waveform 803 represents the input signal to the two-level quantizer and waveform 805 is the quantized signal obtained therefrom. Waveform 807 is the decoded speech signal resulting from waveform 805. As is readily seen, it is difficult to avoid both peak clipping and granular distortion in the two-level quantizer scheme.

Waveform 809 is the output signal from subtractor 162 in FIG. 1 with the adaptive center clipping apparatus and a 15 level quantizer. The broken line in waveform 809 represents the threshold level .theta..sub.n from generator 160. Waveform 811 represents the output of quantizer 111 in FIG. 1. As is evident in waveform 811, only those portions of the signal in waveform 809 which exceed threshold level signal .theta..sub.n are accurately quantized. All other portions are replaced by zero value samples. The reconstructed speech signal derived from waveform 811 is shown in waveform 813. It is evident from waveform 813 that substantially less peak clipping and less granular distortion results from the adaptive center clipping arrangement of FIG. 1. The improved results are obtained with a reduction of step size and considerable improvement in the quality of the reconstructed speech.

The quantizer output signal obtained from multiplier 168, QO.sub.n, is temporarily stored in store 170 and the prediction residual signals therefrom are converted into digital codes in coder 112. Coding arrangements such as those described in the article "On Variable Length to Block Coding" appearing in the IEEE Transactions on Information Theory Volume IT-18, pages 765-744, November 1972 by F. Jelinik and K. S. Schneider or in the article "A 9.6/16 KB/S Speech Digitizer" by S. U. H. Qureshi and G. D. Forney, Jr. appearing in the Conference Record of the International Conference on Communications, pages 30-31, 30-36, June 1975 may be used. The output of coder 112 corresponds to the prediction residual component of the speech signal from signal source 101. Multiplexer and modulator circuit 115 is adapted to assemble the codes from coder 112 and the parameter outputs of predictor computer 135 into a combined signal set and to supply the signal set in appropriately modulated form to communication channel 150.

The decoder circuit shown in FIG. 2 receives the transmission from communication channel 150 and is operative to form a replica of the speech signal s(t). In FIG. 2, modulator and demultiplexer circuit 201 is responsive to the signals received from communication channel 150 to provide the quantized prediction residual signal q.sub.n and step size signal .DELTA. to digital decoder 203. The digital decoder, as is well known in the art, causes signal q.sub.n to be scaled by step size signal .DELTA.. The scaled quantized prediction residual signal is applied to one input of adder circuit 205. The other input to the adder circuit is provided by voice periodicity predictor 217.

The pitch related parameter signals B=b.sub.1, b.sub.2, b.sub.3, and M from demultiplexer and demodulator 201 for each 10 millisecond time frame are stored in B coefficient store 213. These signals are then supplied to voice periodicity predictor 217. Predictor 217 is substantially identical to predictor 128 of FIG. 1 as shown in FIG. 6. Responsive to the sequence of signal codes from adder 205 and prediction parameter signals b.sub.1, b.sub.2, b.sub.3, and M from store 213, predictor 217 adds the pitch related predicted component of the speech signal to the prediction residual from decoder 203. The resulting excitation signal from adder 205 is then applied to one input of adder 207. The other input of adder 207 is obtained from formant predictor 219.

The parcor parameter signals r.sub.m for each 10 millisecond time frame are transferred from demultiplexer 201 to coefficient converter and store 215. The converter is adapted to transform the partial correlation parameter signals r.sub.m into linear prediction parameter signals A=a.sub.1, a.sub.2, . . . , a.sub.10. Coefficient converter 215 may comprise a signal processor such as used in computer 135 of FIG. 1 or other miniature processor arrangements well known in the art. Converter 215 forms the prediction parameter signals a.sub.1, a.sub.2, . . . ,a.sub.10 from the partial correlation signals r.sub.m in accordance with the recursive formulation of equation 11. Signals r.sub.m are transmitted over channel 150 because, as is well known in the art, improved signal stability results.

Formant predictor 219 is identical to predictor 107 of FIG. 1 shown in detail in FIG. 5. Responsive to the excitation signals from adder 207 and the formant prediction parameter signals a.sub.1, a.sub.2, . . . ,a.sub.10 from converter 215, the formant predictor generates the predicted formant component of the speech signal. Consequently, the output of adder 207 corresponds to the sequence of signals codes .[.S.sub.n which codes form a replica of the signal codes sn in.]. S.sub.n which form a replica of the signal signal codes S.sub.n in the circuit of FIG. 1. The adder circuit is supplied to digital-to-analog converter circuit 209. The analog signal from converter 209 is then filtered in filter 211 so that components above 4 kilohertz are removed. The output of filter 211 is an analog replica signal s(t).

The invention has been described with reference to an illustrative embodiment thereof. It is to be understood that various modifications may be made by one skilled in the art without the departing from the spirit and scope of the invention.