Background
The invention is directed to encoding and decoding speech.
Speech encoding and decoding have a large number of applications and have been studied extensively. In general, one type of speech coding, referred to as speech compression, seeks to reduce the data rate needed to represent a speech signal without substantially reducing the quality or intelligibility of the speech. Speech compression techniques may be implemented by a speech coder.
A speech coder is generally viewed as including an encoder and a decoder. The encoder produces a compressed stream of bits from a digital representation of speech, such as may be generated by converting an analog signal produced by a microphone using an analog-to-digital converter. The decoder converts the compressed bit stream into a digital representation of speech that is suitable for playback through a digital-to-analog converter and a speaker. In many applications, the encoder and decoder are physically separated, and the bit stream is transmitted between them using a communication channel.
A key parameter of a speech coder is the amount of compression the coder achieves, which is measured by the bit rate of the stream of bits produced by the encoder. The bit rate of the encoder is generally a function of the desired fidelity (i.e., speech quality) and the type of speech coder employed. Different types of speech coders have been designed to operate at high rates (greater than 8 kbs), mid-rates (3-8 kbs) and low rates (less than 3 kbs). Recently, mid-rate and low-rate speech coders have received attention with respect to a wide range of mobile communication applications (e.g., cellular telephony, satellite telephony, land mobile radio, and in-flight telephony). These applications typically require high quality speech and robustness to artifacts caused by acoustic noise and channel noise (e.g., bit errors).
Vocoders are a class of speech coders that have been shown to be highly applicable to mobile communications. A vocoder models speech as the response of a system to excitation over short time intervals. Examples of vocoder systems include linear prediction vocoders, homomorphic vocoders, channel vocoders, sinusoidal transform coders ("STC"), multiband excitation ("MBE") vocoders, and improved multiband excitation ("IMBE.TM.") vocoders. In these vocoders, speech is divided into short segments (typically 10-40 ms) with each segment being characterized by a set of model parameters. These parameters typically represent a few basic elements of each speech segment, such as the segment's pitch, voicing state, and spectral envelope. A vocoder may use one of a number of known representations for each of these parameters. For example the pitch may be represented as a pitch period, a fundamental frequency, or a long-term prediction delay. Similarly the voicing state may be represented by one or more voiced/unvoiced decisions, by a voicing probability measure, or by a ratio of periodic to stochastic energy. The spectral envelope is often represented by an all-pole filter response, but also may be represented by a set of spectral magnitudes or other spectral measurements.
Since they permit a speech segment to be represented using only a small number of parameters, model-based speech coders, such as vocoders, typically are able to operate at medium to low data rates. However, the quality of a model-based system is dependent on the accuracy of the underlying model. Accordingly, a high fidelity model must be used if these speech coders are to achieve high speech quality.
One speech model which has been shown to provide high quality speech and to work well at medium to low bit rates is the Multi-Band Excitation (MBE) speech model developed by Griffin and Lim. This model uses a flexible voicing structure that allows it to produce more natural sounding speech, and which makes it more robust to the presence of acoustic background noise. These properties have caused the MBE speech model to be employed in a number of commercial mobile communication applications.
The MBE speech model represents segments of speech using a fundamental frequency, a set of binary voiced/unvoiced (V/UV) metrics, and a set of spectral magnitudes. A primary advantage of the MBE model over more traditional models is in the voicing representation. The MBE model generalizes the traditional single V/UV decision per segment into a set of decisions, each representing the voicing state within a particular frequency band. This added flexibility in the voicing model allows the MBE model to better accommodate mixed voicing sounds, such as some voiced fricatives. In addition this added flexibility allows a more accurate representation of speech that has been corrupted by acoustic background noise. Extensive testing has shown that this generalization results in improved voice quality and intelligibility.
The encoder of an MBE-based speech coder estimates the set of model parameters for each speech segment. The MBE model parameters include a fundamental frequency (the reciprocal of the pitch period); a set of V/UV metrics or decisions that characterize the voicing state; and a set of spectral magnitudes that characterize the spectral envelope. After estimating the MBE model parameters for each segment, the encoder quantizes the parameters to produce a frame of bits. The encoder optionally may protect these bits with error correction/detection codes before interleaving and transmitting the resulting bit stream to a corresponding decoder.
The decoder converts the received bit stream back into individual frames. As part of this conversion, the decoder may perform deinterleaving and error control decoding to correct or detect bit errors. The decoder then uses the frames of bits to reconstruct the MBE model parameters, which the decoder uses to synthesize a speech signal that perceptually resembles the original speech to a high degree. The decoder may synthesize separate voiced and unvoiced components, and then may add the voiced and unvoiced components to produce the final speech signal.
In MBE-based systems, the encoder uses a spectral magnitude to represent the spectral envelope at each harmonic of the estimated fundamental frequency. Typically each harmonic is labeled as being either voiced or unvoiced, depending upon whether the frequency band containing the corresponding harmonic has been declared voiced or unvoiced. The encoder then estimates a spectral magnitude for each harmonic frequency. When a harmonic frequency has been labeled as being voiced, the encoder may use a magnitude estimator that differs from the magnitude estimator used when a harmonic frequency has been labeled as being unvoiced. At the decoder, the voiced and unvoiced harmonics are identified, and separate voiced and unvoiced components are synthesized using different procedures. The unvoiced component may be synthesized using a weighted overlap-add method to filter a white noise signal. The filter is set to zero all frequency regions declared voiced while otherwise matching the spectral magnitudes labeled unvoiced. The voiced component is synthesized using a tuned oscillator bank, with one oscillator assigned to each harmonic that has been labeled as being voiced. The instantaneous amplitude, frequency and phase are interpolated to match the corresponding parameters at neighboring segments.
MBE-based speech coders include the IMBE.TM. speech coder and the AMBE.RTM. speech coder. The AMBE.RTM. speech coder was developed as an improvement on earlier MBE-based techniques. It includes a more robust method of estimating the excitation parameters (fundamental frequency and V/UV decisions) which is better able to track the variations and noise found in actual speech. The AMBE.RTM. speech coder uses a filterbank that typically includes sixteen channels and a non-linearity to produce a set of channel outputs from which the excitation parameters can be reliably estimated. The channel outputs are combined and processed to estimate the fundamental frequency and then the channels within each of several (e.g., eight) voicing bands are processed to estimate a V/UV decision (or other voicing metric) for each voicing band.
The AMBE.RTM. speech coder also may estimate the spectral magnitudes independently of the voicing decisions. To do this, the speech coder computes a fast Fourier transform ("FFT") for each windowed subframe of speech and then averages the energy over frequency regions that are multiples of the estimated fundamental frequency. This approach may further include compensation to remove from the estimated spectral magnitudes artifacts introduced by the FFT sampling grid.
The AMBE.RTM. speech coder also may include a phase synthesis component that regenerates the phase information used in the synthesis of voiced speech without explicitly transmitting the phase information from the encoder to the decoder. Random phase synthesis based upon the V/UV decisions may be applied, as in the case of the IMBE.TM. speech coder. Alternatively, the decoder may apply a smoothing kernel to the reconstructed spectral magnitudes to produce phase information that may be perceptually closer to that of the original speech than is the randomly-produced phase information.
The techniques noted above are described, for example, in Flanagan, Speech Analysis, Synthesis and Perception, Springer-Verlag, 1972, pages 378-386 (describing a frequency-based speech analysis-synthesis system); Jayant et al., Digital Coding of Waveforms, Prentice-Hall, 1984 (describing speech coding in general); U.S. Pat. No. 4,885,790 (describing a sinusoidal processing method); U.S. Pat. No. 5,054,072 (describing a sinusoidal coding method); Almeida et al., "Nonstationary Modeling of Voiced Speech", IEEE TASSP, Vol. ASSP-31, No. 3, June 1983, pages 664-677 (describing harmonic modeling and an associated coder); Almeida et al., "Variable-Frequency Synthesis: An Improved Harmonic Coding Scheme", IEEE Proc. ICASSP 84, pages 27.5.1-27.5.4 (describing a polynomial voiced synthesis method); Quatieri et al., "Speech Transformations Based on a Sinusoidal Representation", IEEE TASSP, Vol, ASSP34, No. 6, December. 1986, pages 1449-1986 (describing an analysis-synthesis technique based on a sinusoidal representation); McAulay et al., "Mid-Rate Coding Based on a Sinusoidal Representation of Speech", Proc. ICASSP 85, pages 945-948, Tampa, Fla., March 26-29, 1985 (describing a sinusoidal transform speech coder); Griffin, "Multiband Excitation Vocoder", Ph.D. Thesis, M.I.T, 1987 (describing the Multi-Band Excitation (MBE) speech model and an 8000 bps MBE speech coder); Hardwick, "A 4.8 kbps Multi-Band Excitation Speech Coder", SM. Thesis, M.I.T, May 1988 (describing a 4800 bps Multi-Band Excitation speech coder); Telecommunications Industry Association (TIA), "APCO Project 25 Vocoder Description", Version 1.3, Jul. 15, 1993, IS102BABA (describing a 7.2 kbps IMBE.TM. speech coder for APCO Project 25 standard); U.S. Pat. No. 5,081,681 (describing IMBEM.TM. random phase synthesis); U.S. Pat. No. 5,247,579 (describing a channel error mitigation method and formant enhancement method for MBE-based speech coders); U.S. Pat. No. 5,226,084 (describing quantization and error mitigation methods for MBE-based speech coders); U.S. Pat. No. 5,517,511 (describing bit prioritization and FEC error control methods for MBE-based speech coders).
Summary of the Invention
The invention features a new AMBE.RTM. speech coder for use in a satellite communication system to produce high quality speech from a bit stream transmitted across a mobile satellite channel at a low data rate. The speech coder combines low data rate, high voice quality, and robustness to background noise and channel errors. This promises to advance the state of the art in speech coding for mobile satellite communications. The new speech coder achieves high performance through a new dual-subframe spectral magnitude quantizer that jointly quantizes the spectral magnitudes estimated from two consecutive subframes. This quantizer achieves fidelity comparable to prior art systems while using fewer bits to quantize the spectral magnitude parameters. AMBE.RTM. speech coders are described generally in U.S. Application Ser. No. 08/222,119, filed Apr. 4, 1994 and entitled "ESTIMATION OF EXCITATION PARAMETERS"; U.S. Application Ser. No. 08/392,188, filed Feb. 22, 1995 and entitled "SPECTRAL REPRESENTATIONS FOR MULTI-BAND EXCITATION SPEECH CODERS"; and U.S. Application Ser. No. 08/392,099, filed Feb. 22, 1995 and entitled "SYNTHESIS OF SPEECH USING REGENERATED PHASE INFORMATION", all of which are incorporated by reference.
In one aspect, generally, the invention features a method of encoding speech into a 90 millisecond frame of bits for transmission across a satellite communication channel. A speech signal is digitized into a sequence of digital speech samples, the digital speech samples are divided into a sequence of subframes nominally occurring at intervals of 22.5 milliseconds, and a set of model parameters is estimated for each of the subframes. The model parameters for a subframe include a set of spectral magnitude parameters that represent the spectral information for the subframe. Two consecutive subframes from the sequence of subframes are combined into a block and the spectral magnitude parameters from both of the subframes within the block are jointly quantized. The joint quantization includes forming predicted spectral magnitude parameters from the quantized spectral magnitude parameters from the previous block, computing residual parameters as the difference between the spectral magnitude parameters and the predicted spectral magnitude parameters for the block, combining the residual parameters from both of the subframes within the block, and using vector quantizers to quantize the combined residual parameters into a set of encoded spectral bits. Redundant error control bits then are added to the encoded spectral bits from each block to protect the encoded spectral bits within the block from bit errors. The added redundant error control bits and encoded spectral bits from two consecutive blocks are then combined into a 90 millisecond frame of bits for transmission across a satellite communication channel.
Embodiments of the invention may include one or more of the following features. The combining of the residual parameters from both of the subframes within the block may include dividing the residual parameters from each of the subframes into frequency blocks, performing a linear transformation on the residual parameters within each of the frequency blocks to produce a set of transformed residual coefficients for each of the subframes, grouping a minority of the transformed residual coefficients from all of the frequency blocks into a prediction residual block average (PRBA) vector and grouping the remaining transformed residual coefficients for each of the frequency blocks into a higher order coefficient (HOC) vector for the frequency block. The PRBA vectors for each subframe may be transformed to produce transformed PRBA vectors and the vector sum and difference for the transformed PRBA vectors for the subframes of a block may be computed to combine the transferred PRBA vectors. Similarly, the vector sum and difference for each frequency block may be computed to combine the two HOC vectors from the two subframes for that frequency block.
The spectral magnitude parameters may represent the log spectral magnitudes estimated for the Multi-Band Excitation ("MBE") speech model. The spectral magnitude parameters may be estimated from a computed spectrum independently of the voicing state. The predicted spectral magnitude parameters may be formed by applying a gain of less than unity to the linear interpolation of the quantized spectral magnitudes from the last subframe in the previous block.
The error control bits for each block may be formed using block codes including Golay codes and Hamming codes. For example, the codes may include one [24,12] extended Golay code, three [23,12] Golay codes, and two [15,11] Hamming codes.
The transformed residual coefficients may be computed for each of the frequency blocks using a Discrete Cosine Transform ("DCT") followed by a linear 2 by 2 transform on the two lowest order DCT coefficients. Four frequency blocks may be used for this computation and the length of each the frequency block may be approximately proportional to the number of spectral magnitude parameters within the subframe.
The vector quantizers may include a three way split vector quantizer using 8 bits plus 6 bits plus 7 bits applied to the PRBA vector sum and a two way split vector quantizer using 8 bits plus 6 bits applied to the PRBA vector difference. The frame of bits may include additional bits representing the error in the transformed residual coefficients which is introduced by the vector quantizers.
In another aspect, generally, the invention features a system for encoding speech into a 90 millisecond frame of bits for transmission across a satellite communication channel. The system includes a digitizer that converts a speech signal into a sequence of digital speech samples, a subframe generator that divides the digital speech samples into a sequence of subframes that each include multiple digital speech samples. A model parameter estimator estimates a set of model parameters that include a set of spectral magnitude parameters for each of the subframes. A combiner combines two consecutive subframes from the sequence of subframes into a block. A dual-frame spectral magnitude quantizer jointly quantizes parameters from both of the subframes within the block. The joint quantization includes forming predicted spectral magnitude parameters from the quantized spectral magnitude parameters from a previous block, computing residual parameters as the difference between the spectral magnitude parameters and the predicted spectral magnitude parameters, combining the residual parameters from both of the subframes within the block, and using vector quantizers to quantize the combined residual parameters into a set of encoded spectral bits. The system also includes an error code encoder that adds redundant error control bits to the encoded spectral bits from each block to protect at least some of the encoded spectral bits within the block from bit errors, and a combiner that combines the added redundant error control bits and encoded spectral bits from two consecutive blocks into a 90 millisecond frame of bits for transmission across a satellite communication channel.
In another aspect, generally, the invention features decoding speech from a 90 millisecond frame that has been encoded as described above. The decoding includes dividing the frame of bits into two blocks of bits, wherein each block of bits represents two subframes of speech. Error control decoding is applied to each block of bits using redundant error control bits included within the block to produce error decoded bits which are at least in part protected from bit errors. The error decoded bits are used to jointly reconstruct spectral magnitude parameters for both of the subframes within a block. The joint reconstruction includes using vector quantizer codebooks to reconstruct a set of combined residual parameters from which separate residual parameters for both of the subframes are computed, forming predicted spectral magnitude parameters from the reconstructed spectral magnitude parameters from a previous block, and adding the separate residual parameters to the predicted spectral magnitude parameters to form the reconstructed spectral magnitude parameters for each subframe within the block. Digital speech samples are then synthesized for each subframe using the reconstructed spectral magnitude parameters for the subframe.
In another aspect, generally, the invention features a decoder for decoding speech from a 90 millisecond frame of bits received across a satellite communication channel. The decoder includes a divider that divides the frame of bits into two blocks of bits. Each block of bits represents two subframes of speech. An error control decoder error decodes each block of bits using redundant error control bits included within the block to produce error decoded bits which are at least in part protected from bit errors. A dual-frame spectral magnitude reconstructor jointly reconstructs spectral magnitude parameters for both of the subframes within a block, wherein the joint reconstruction includes using vector quantizer codebooks to reconstruct a set of combined residual parameters from which separate residual parameters for both of the subframes are computed, forming predicted spectral magnitude parameters from the reconstructed spectral magnitude parameters from a previous block, and adding the separate residual parameters to the predicted spectral magnitude parameters to form the reconstructed spectral magnitude parameters for each subframe within the block. A synthesizer synthesizes digital speech samples for each subframe using the reconstructed spectral magnitude parameters for the subframe.
Other features and advantages of the invention will be apparent from the following description, including the drawings, and from the claims.
Brief Description of the Drawing
FIG. 1 is a simplified block diagram of a satellite system.
FIG. 2 is a block diagram of a communication link of the system of FIG. 1.
FIGS. 3 and 4 are block diagrams of an encoder and a decoder of the system of FIG. 1.
FIG. 5 is a general block diagram of components of the encoder of FIG. 3.
FIG. 6 is a flow chart of the voice and tone detection functions of the encoder.
FIG. 7 is a block diagram of a dual subframe magnitude quantizer of the encoder of FIG. 5.
FIG. 8 is a block diagram of a mean vector quantizer of the magnitude quantizer of FIG. 7.
Description
An embodiment of the invention is described in the context of a new AMBE speech coder, or vocoder, for use in the IRIDIUM.RTM. mobile satellite communication system 30, as shown in FIG. 1. IRIDIUM.RTM. is a global mobile satellite communication system consisting of sixty-six satellites 40 in low earth orbit. IRIDIUM.RTM. provides voice communications through handheld or vehicle based user terminals 45 (i.e., mobile phones).
Referring to FIG. 2, the user terminal at the transmitting end achieves voice communication by digitizing speech 50 received through a microphone 60 using an analog-to-digital (A/D) converter 70 that samples the speech at a frequency of 8 kHz. The digitized speech signal passes through a speech encoder 80, where it is processed as described below. The signal is then transmitted across the communication link by a transmitter 90. At the other end of the communication link, a receiver 100 receives the signal and passes it to a decoder 110. The decoder converts the signal into a synthetic digital speech signal. A digital-to-analog (D/A) converter 120 then converts the synthetic digital speech signal into an analog speech signal that is converted into audible speech 140 by a speaker 130.
The communications link uses burst-transmission time-division-multiple-access (TDMA) with a 90 ms frame. Two different data rates for voice are supported: a half-rate mode of 3467 bps (312 bits per 90 ms frame) and a full-rate mode of 6933 bps (624 bits per 90 ms frame). The bits of each frame are divided between speech coding and forward error correction ("FEC") coding to lower the probability of bit errors that normally occur across a satellite communication channel.
Referring to FIG. 3, the speech coder in each terminal includes an encoder 80 and a decoder 110. The encoder includes three main functional blocks: speech analysis 200, parameter quantization 210, and error correction encoding 220. Similarly, as shown in FIG. 4, the decoder is divided into functional blocks for error correction decoding 230, parameter reconstruction 240 (i.e., inverse quantization) and speech synthesis 250.
The speech coder may operate at two distinct data rates: a full-rate of 4933 bps and a half-rate of 2289 bps. These data rates represent voice or source bits and exclude FEC bits. The FEC bits raise the data rate of the full-rate and half-rate vocoders to 6933 bps and 3467 bps, respectively, as noted above. The system uses a voice frame size of 90 ms which is divided into four 22.5 ms subframes. Speech analysis and synthesis are performed on a subframe basis, while quantization and FEC coding are performed on a 45 ms quantization block that includes two subframes. The use of 45 ms blocks for quantization and FEC coding results in 103 voice bits plus 53 FEC bits per block in the half-rate system, and 222 voice bits plus 90 FEC bits per block in the full-rate system. Alternatively, the number of voice bits and FEC bits can be adjusted within a range with only gradual effect on performance. In the half-rate system, adjustment of the voice bits in the range of 80 to 120 bits with the corresponding adjustment in the FEC bits in the range of 76 to 36 bits can be accomplished. Similarly, in the full-rate system, the voice bits can be adjusted over the range of 180 to 260 bits with the corresponding adjustment in the FEC bits spanning from 132 to 52 bits. The voice and FEC bits for the quantization blocks are combined to form a 90 ms frame.
The encoder 80 first performs speech analysis 200. The first step in speech analysis is filterbank processing on each subframe followed by estimation of the MBE model parameters for each subframe. This involves dividing the input signal into overlapping 22.5 ms subframes using an analysis window. For each 22.5 ms subframe, a MBE subframe parameter estimator estimates a set of model parameters that include a fundamental frequency (inverse of the pitch period), a set of voiced/unvoiced (V/UV) decisions and a set of spectral magnitudes. These parameters are generated using AMBE techniques. AMBE.RTM. speech coders are described generally in U.S. Application Ser. No. 08/222,119, filed Apr. 4, 1994 and entitled "ESTIMATION OF EXCITATION PARAMETERS"; U.S. Application Ser. No. 08/392,188, filed Feb. 22, 1995 and entitled "SPECTRAL REPRESENTATIONS FOR MULTI-BAND EXCITATION SPEECH CODERS"; and U.S. Application Ser. No. 08/392,099, filed Feb. 22, 1995 and entitled "SYNTHESIS OF SPEECH USING REGENERATED PHASE INFORMATION", all of which are incorporated by reference.
In addition, the full-rate vocoder includes a time-slot ID that helps to identify out-of-order arrival of TDMA packets at the receiver, which can use this information to place the information in the correct order prior to decoding. The speech parameters fully describe the speech signal and are passed to the encoder's quantization 210 block for further processing.
Referring to FIG. 5, once the subframe model parameters 300 and 305 are estimated for two consecutive 22.5 ms subframes within a frame, the fundamental frequency and voicing quantizer 310 encodes the fundamental frequencies estimated for both subframes into a sequence of fundamental frequency bits, and further encodes the voiced/unvoiced (V/UV) decisions (or other voicing metrics) into a sequence of voicing bits.
In the described embodiment, ten bits are used to quantize and encode the two fundamental frequencies. Typically, the fundamental frequencies are limited by the fundamental estimate to a range of approximately [0.008, 0.05] where 1.0 is the Nyquist frequency (8 kHz), and the fundamental quantizer is limited to a similar range. Since the inverse of the quantized fundamental frequency for a given subframe is generally proportional to L, the number of spectral magnitudes for that subframe (L=bandwidth/fundamental frequency), the most significant bits of the fundamental are typically sensitive to bit errors and consequently are given high priority in FEC encoding.
The described embodiment uses eight bits in half-rate and sixteen bits in full-rate to encode the voicing information for both subframes. The voicing quantizer uses the allocated bits to encode the binary voicing state (i.e., 1=voiced and 0=unvoiced) in each of the preferred eight voicing bands, where the voicing state is determined by voicing metrics estimated during speech analysis. These voicing bits have moderate sensitivity to bit errors and hence are given medium priority in FEC encoding.
The fundamental frequency bits and voicing bits are combined in the combiner 330 with the quantized spectral magnitude bits from the dual subframe magnitude quantizer 320, and forward error correction (FEC) coding is performed for that 45 ms block. The 90 ms frame is then formed in a combiner 340 that combines two consecutive 45 ms quantized blocks into a single frame 350.
The encoder incorporates an adaptive Voice Activity Detector (VAD) which classifies each 22.5 ms subframe as either voice, background noise, or a tone according to a procedure 600. As shown in FIG. 6, the VAD algorithm uses local information to distinguish voice subframes from background noise (step 605). If both subframes within each 45 ms block are classified as noise (step 610), then the encoder quantizes the background noise that is present as a special noise block (step 615). When the two 45 ms block comprising a 90 ms frame are both classified as noise, then the system may choose not to transmit this frame to the decoder and the decoder will use previously received noise data in place of the missing frame. This voice activated transmission technique increases performance of the system by only requiring voice frames and occasional noise frames to be transmitted.
The encoder also may feature tone detection and transmission in support of DTMF, call progress (e.g., dial, busy and ringback) and single tones. The encoder checks each 22.5 ms subframe to determine whether the current subframe contains a valid tone signal. If a tone is detected in either of the two subframes of a 45 ms block (step 620), then the encoder quantizes the detected tone parameters (magnitude and index) in a special tone block as shown in Table 1 (step 625) and applies FEC coding prior to transmitting the block to the decoder for subsequent synthesis. If a tone is not detected, then a standard voice block is quantized as described below (step 630).
The vocoder includes VAD and Tone detection to classify each 45 ms block as either a standard Voice block, a special Tone block or a special noise block. In the event a 45 ms block is not classified as a special tone block, then the voice or noise information (as determined by the VAD) is quantized for the pair of subframes comprising that block. The available bits (156 for half-rate, 312 for full-rate) are allocated over the model parameters and FEC coding as shown in Table 2, where the Slot ID is a special parameter used by the full-rate receiver to identify the correct ordering of frames that may arrive out of order. After reserving bits for the excitation parameters (fundamental frequency and voicing metrics), FEC coding and the Slot ID, there are 85 bits available for the spectral magnitudes in the half-rate system and 183 bits available for the spectral magnitudes in the full-rate system. To support the full-rate system with a minimum amount of additional complexity, the full-rate magnitude quantizer uses the same quantizer as the half-rate system plus an error quantizer that uses scalar quantization to encode the difference between the unquantized spectral magnitudes and the quantized output of the half-rate spectral magnitude quantizer.
A dual-subframe quantizer is used to quantize the spectral magnitudes. The quantizer combines logarithmic companding, spectral prediction, discrete cosine transforms (DCTs) and vector and scalar quantization to achieve high efficiency, measured in terms of fidelity per bit, with reasonable complexity. The quantizer can be viewed as a two dimensional predictive transform coder.
FIG. 7 illustrates the dual subframe magnitude quantizer that receives inputs 1a and 1b from the MBE parameter estimators for two consecutive 22.5 ms subframes. Input 1a represents the spectral magnitudes for odd numbered 22.5 ms subframes and is given an index of 1. The number of magnitudes for subframe number 1 is designated by L.sub.1. Input 1b represents the spectral magnitudes for the even numbered 22.5 ms subframes and is given the index of 0. The number of magnitudes for subframe number 0 is designated by L.sub.0.
Input 1a passes through a logarithmic compander 2a, which performs a log base 2 operation on each of the L.sub.1 magnitudes contained in input 1a and generates another vector with L.sub.1 elements in the following manner :
where y[i] represents signal 3a. Compander 2b performs the log base 2 operation on each of the L.sub.0 magnitudes contained in input 1b and generates another vector with L.sub.0 elements in a similar manner:
where y[i] represents signal 3b.
Mean calculators 4a and 4b following the companders 2a and 2b calculate means 5a and 5b for each subframe. The mean, or gain value, represents the average speech level for the subframe. Within each frame, two gain values 5a, 5b are determined by computing the mean of the log spectral magnitudes for each of the two subframes and then adding an offset dependent on the number of harmonics within the subframe.
The mean computation of the log spectral magnitudes 3a is calculated as:
where the output, y, represents the mean signal 5a.
The mean computation 4b of the log spectral ##EQU1## magnitudes 3b is calculated in a similar manner: ##EQU2## where the output, y, represents the mean signal 5b.
The mean signals 5a and 5b are quantized by a quantizer 6 that is further illustrated in FIG. 8, where the mean signals 5a and 5b are referenced, respectively, as mean1 and mean2. First, an averager 810 averages the mean signals. The output of the averager is 0.5*(mean1+mean2). The average is then quantized by a five-bit uniform scalar quantizer 820. The output of the quantizer 820 forms the first five bits of the output of the quantizer 6. The quantizer output bits are then inverse-quantized by a five-bit uniform inverse scalar quantizer 830. Subtracters 835 then subtract the output of the inverse quantizer 830 from the input values mean1 and mean2 to produce inputs to a five-bit vector quantizer 840. The two inputs constitute a two-dimensional vector (z1 and z2) to be quantized. The vector is compared to each two-dimensional vector (consisting of x1(n) and x2(n)) in the table contained in Appendix A ("Gain VQ Codebook (5-bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0, 1, . . . 31. The vector from Appendix A that minimizes the square distance, e, is selected to produce the last five bits of the output of block 6. The five bits from the output of the vector quantizer 840 are combined with the five bits from the output of the five-bit uniform scalar quantizer 820 by a combiner 850. The output of the combiner 850 is ten bits constituting the output of block 6 which is labeled 21c and is used as an input to the combiner 22 in FIG. 7.
Referring further to the main signal path of the quantizer, the log companded input signals 3a and 3b pass through combiners 7a and 7b that subtract predictor values 33a and 33b from the feedback portion of the quantizer to produce a D.sub.1 (1) signal 8a and a D.sub.1 (0) signal 8b.
Next, the signals 8a and 8b are divided into four frequency blocks using the look-up table in Appendix O. The table provides the number of magnitudes to be allocated to each of the four frequency blocks based on the total number of magnitudes for the subframe being divided. Since the number of magnitudes contained in any subframe ranges from a minimum of 9 to a maximum of 56, the table contains values for this same range. The length of each frequency block is adjusted such that they are approximately in a ratio of 0.2:0.225:0.275:0.3 to each other and the sum of the lengths equals the number of spectral magnitudes in the current subframe.
Each frequency block is then passed through a discrete cosine transform (DCT) 9a or 9b to efficiently decorrelate the data within each frequency block. The first two DCT coefficients 10a or 10b from each frequency block are then separated out and passed through a 2.times.2 rotation operation 12a or 12b to produce transformed coefficients 13a or 13b. An eight-point DCT 14a or 14b is then performed on the transformed coefficients 13a or 13b to produce a prediction residual block average (PRBA) vector 15a or 15b. The remaining DCT coefficients 11a and 11b from each frequency block form a set of four variable length higher order coefficient (HOC) vectors.
As described above, following the frequency division, each block is processed by the discrete cosine transform blocks 9a or 9b. The DCT blocks use the number of input bins, W, and the values for each of the bins, x(0), x(1), . . . , x(W-1) in the following manner: ##EQU3## The values y(0) and y(1) (identified as 10a) are separated from the other outputs y(2) through y(W-1) (identified as 11a).
A 2.times.2 rotation operation 12a and 12b is then performed to transform the 2-element input vector 10a and 10b, (x(0),x(1)), into a 2-element output vector 13a and 13b, (y(0),y(1)) by the following rotation procedure :
An 8-point DCT is then performed on the four, 2-element vectors, (x(0),x(1), . . . , x(7)) from 13a or 13b according to the following equation: ##EQU4## The output, y(k), is an 8-element PRBA vector 15a or 15b.
Once the prediction and DCT transformation of the individual subframe magnitudes have been completed, both PRBA vectors are quantized. The two eight-element vectors are first combined using a sum-difference transformation 16 into a sum vector and a difference vector. In particular, sum/difference operation 16 is performed on the two 8-element PRBA vectors 15a and 15b, which are represented by x and y respectively, to produce a 16-element vector 17, represented by z, in the following manner:
for i=0, 1, . . . , 7.
These vectors are then quantized using a split vector quantizer 20a where 8, 6, and 7 bits are used for elements 1-2, 3-4, and 5-7 of the sum vector, respectively, and 8 and 6 bits are used for elements 1-3 and 4-7 of the difference vector, respectively. Element 0 of each vector is ignored since it is functionally equivalent to the gain value that is quantized separately.
The quantization of the PRBA sum and difference vectors 17 is performed by the PRBA split-vector quantizer 20a to produce a quantized vector 21a. The two elements z(1) and z(2) constitute a two-dimensional vector to be quantized. The vector is compared to each two-dimensional vector (consisting of x1(n) and x2(n) in the table contained in Appendix B ("PRBA Sum[1,2] VQ Codebook (8-bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0,1, . . . , 255.
The vector from Appendix B that minimizes the square distance, e, is selected to produce the first 8 bits of the output vector 21a.
Next, the two elements z(3) and z(4) constitute a two-dimensional vector to be quantized. The vector is compared to each two-dimensional vector (consisting of x1(n)) and x2(n) in the table contained in Appendix C ("PRBA Sum[3,4] VQ Codebook (6-bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0,1, . . . , 63.
The vector from Appendix C which minimizes the square distance, e, is selected to produce the next 6 bits of the output vector 21a.
Next, the three elements z(5), z(6) and z(7) constitute a three-dimensional vector to be quantized. The vector is compared to each three-dimensional vector (consisting of x1(n), x2(n) and x3(n) in the table contained in Appendix D ("PRBA Sum[5,7] VQ Codebook (7 bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0,1, . . . , 127.
The vector from Appendix D which minimizes the square distance, e, is selected to produce the next 7 bits of the output vector 21a.
Next, the three elements z(9), z(10) and z(11) constitute a three-dimensional vector to be quantized. The vector is compared to each three-dimensional vector (consisting of x1(n), x2(n) and x3(n) in the table contained in Appendix E ("PRBA Dif[1,3] VQ Codebook (8-bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0,1, . . . , 255.
The vector from Appendix E which minimizes the square distance, e, is selected to produce the next 8 bits of the output vector 21a.
Finally, the four elements z(12), z(13), z(14) and z(15) constitute a four-dimensional vector to be quantized. The vector is compared to each four-dimensional vector (consisting of x1(n), x2(n), x3(n) and x4(n) in the table contained in Appendix F ("PRBA Dif[4,7] VQ Codebook (6-bit)"). The comparison is based on the square distance, e, which is calculated as follows:
for n=0,1, . . . , 63.
The vector from Appendix F which minimizes the square distance, e, is selected to produce the last 6 bits of the output vector 21a.
The HOC vectors are quantized similarly to the PRBA vectors. First, for each of the four frequency blocks, the corresponding pair of HOC vectors from the two subframes are combined using a sum-difference transformation 18 that produces a sum and difference vector 19 for each frequency block.
The sum/difference operation is performed separately for each frequency block on the two HOC vectors 11a and 11b, referred to as x and y respectively, to produce a vector, ##EQU5## where B.sub.m0 and B.sub.m1, are the lengths of the mth frequency block for, respectively, subframes zero and one, as set forth in Appendix O, and z is determined for each frequency block (i.e., m equals 0 to 3). The J+K element sum and difference vectors z.sub.m are combined for all four frequency blocks (m equals 0 to 3) to form the HOC sum/difference vector 19.
Due to the variable size of each HOC vector, the sum and difference vectors also have variable, and possibly different, lengths. This is handled in the vector quantization step by ignoring any elements beyond the first four elements of each vector. The remaining elements are vector quantized using seven bits for the sum vector and three bits for the difference vector. After vector quantization is performed, the original sum-difference transformation is reversed on the quantized sum and difference vectors. Since this process is applied to all four frequency blocks a total of forty (4*(7+3)) bits are used to vector quantize the HOC vectors corresponding to both subframes.
The quantization of the HOC sum and difference vectors 19 is performed separately on all four frequency blocks by the HOC split-vector quantizer 20b. First, the vector z.sub.m representing the mth frequency block is separated and compared against each candidate vector in the corresponding sum and difference codebooks contained in the Appendices. A codebook is identified based on the frequency block to which it corresponds and whether it is a sum or difference code. Thus, the "HOC Sum0 VQ Codebook (7-bit)" of Appendix G represents the sum codebook for frequency block 0. The other codebooks are Appendix H ("HOC Dif0 VQ Codebook (3-bit)"), Appendix I ("HOC Sum1 VQ Codebook (7-bit)"), Appendix J ("HOC Dif1 VQ Codebook (3-bit)"), Appendix K ("HOC Sum2 VQ Codebook (7-bit)"), Appendix L ("HOC Dif2 VQ Codebook (3-bit)"), Appendix M ("HOC Sum2 VQ Codebook (7-bit)"), and Appendix N ("HOC Dif3 VQ Codebook (3-bit)"). The comparison of the vector z.sub.m for each frequency block with each candidate vector from the corresponding sum codebooks is based upon the square distance, e1n for each candidate sum vector (consisting of x1(n), x2(n), x3(n) and x4(n)) which is calculated as: ##EQU6## and the square distance e2.sub.m for each candidate difference vector (consisting of x1(n), x2(n), x3(n) and x4(n)), which is calculated as: ##EQU7## where J and K are computed as described above.
The index n of the candidate sum vector from the corresponding sum notebook which minimizes the square distance e1.sub.n is represented with seven bits and the index m of the candidate difference vector which minimizes the square distance e2.sub.m is represented with three bits. These ten bits are combined from all four frequency blocks to form the 40 HOC output bits 21b.
Block 22 multiplexes the quantized PRBA vectors 21a, the quantized mean 21b, and the quantized mean 21c to produce output bits 23. These bits 23 are the final output bits of the dual-subframe magnitude quantizer and are also supplied to the feedback portion of the quantizer.
Block 24 of the feedback portion of the dual-subframe quantizer represents the inverse of the functions performed in the superblock labeled Q in the drawing. Block 24 produces estimated values 25a and 25b of D.sub.1 (1) and D.sub.1 (0) (8a and 8b) in response to the quantized bits 23. These estimates would equal D.sub.1 (1) and D.sub.1 (0) in the absence of quantization error in the superblock labeled Q.
Block 26 adds a scaled prediction value 33a, which equals 0.8*P.sub.1 (1), to the estimate of D.sub.1 (1) 25a to produce an estimate M.sub.1 (1) 27. Block 28 time-delays the estimate M.sub.1 (1) 27 by one frame (40 ms) to produce the estimate M.sub.1 (-1) 29.
A predictor block 30 then interpolates the estimated magnitudes and resamples them to produce L.sub.1 estimated magnitudes after which the mean value of the estimated magnitudes is subtracted from each of the L.sub.1 estimated magnitudes to produce the P.sub.1 (1) output 31a. Next, the input estimated magnitudes are interpolated and resampled to produce L.sub.0 estimated magnitudes after which the mean value of the estimated magnitudes is subtracted from each of the L.sub.0 estimated magnitudes to produce the P.sub.1 (0) output 31b.
Block 32a multiplies each magnitude in P.sub.1 (1) 31a by 0.8 to produce the output vector 33a which is used in the feedback element combiner block 7a. Likewise, block 32b multiplies each magnitude in P.sub.1 (1) 31b by 0.8 to produce the output vector 33b which is used in the feedback element combiner block 7b. The output of this process is the quantized magnitude output vector 23, which is then combined with the output vector of two other subframes as described above.
Once the encoder has quantized the model parameters for each 45 ms block, the quantized bits are prioritized, FEC encoded and interleaved prior to transmission. The quantized bits are first prioritized in order of their approximate sensitivity to bit errors. Experimentation has shown that the PRBA and HOC sum vectors are typically more sensitive to bits errors than corresponding difference vectors. In addition, the PRBA sum vector is typically more sensitive than the HOC sum vector. These relative sensitivities are employed in a prioritization scheme which generally gives the highest priority to the average fundamental frequency and average gain bits, followed by the PRBA sum bits and the HOC sum bits, followed by the PRBA difference bits and the HOC difference bits, followed by any remaining bits.
A mix of [24,12] extended Golay codes, [23,12] Golay codes and [15,11] Hamming codes are then employed to add higher levels of redundancy to the more sensitive bits while adding less or no redundancy to the less sensitive bits. The half-rate system applies one [24,12] Golay code, followed by three [23,12] Golay codes, followed by two [15,11] Hamming codes, with the remaining 33 bits unprotected. The full-rate system applies two [24,12] Golay codes, followed by six [23,12] Golay codes with the remaining 126 bits unprotected. This allocation was designed to make efficient use of limited number of bits available for FEC. The final step is to interleave the FEC encoded bits within each 45 ms block to spread the effect of any short error bursts. The interleaved bits from two consecutive 45 ms blocks are then combined into a 90 ms frame which forms the encoder output bit stream.
The corresponding decoder is designed to reproduce high quality speech from the encoded bit stream after it is transmitted and received across the channel. The decoder first separates each 90 ms frame into two 45 ms quantization blocks. The decoder then deinterleaves each block and performs error correction decoding to correct and/or detect certain likely bit error patterns. To achieve adequate performance over the mobile satellite channel, all error correction codes are typically decoded up to their full error correction capability. Next, the FEC decoded bits are used by the decoder to reassemble the quantization bits for that block from which the model parameters representing the two subframes within that block are reconstructed.
The AMBE.RTM. decoder uses the reconstructed log spectral magnitudes to synthesize a set of phases which are used by the voiced synthesizer to produce natural sounding speech. The use of synthesized phase information significantly lowers the transmitted data rate, relative to a system which directly transmits this information or its equivalent between the encoder and decoder. The decoder then applies spectral enhancement to the reconstructed spectral magnitudes in order to improve the perceived quality of the speech signal. The decoder further checks for bit errors and smoothes the reconstructed parameters if the local estimated channel conditions indicate the presence of possible uncorrectable bit errors. The enhanced and smoothed model parameters (fundamental frequency, V/UV decisions, spectral magnitudes and synthesized phases) are used in speech synthesis.
The reconstructed parameters form the input to the decoder's speech synthesis algorithm which interpolates successive frames of model parameters into smooth 22.5 ms segments of speech. The synthesis algorithm uses a set of harmonic oscillators (or an FFT equivalent at high frequencies) to synthesize the voiced speech. This is added to the output of a weighted overlap-add algorithm to synthesize the unvoiced speech. The sums form the synthesized speech signal which is output to a D-to-A converter for playback over a speaker. While this synthesized speech signal may not be close to the original on a sample-by-sample basis, it is perceived as the same by a human listener.
Other embodiments are within the scope of the following claims.