US 5,825,311 AGrant

Vector Coding Method, Encoder Using the Same and Decoder Therefor

Issue Date:1998-10-20

•27 Claims

•10 Drawing Sheets

Abstract

Representative vectors z.sub.1i and z.sub.2j are selected from codebooks CB1 and CB1, respetively, and multiplied by weighting coefficient vectors w.sub.1 and w.sub.2 of the same number of dimensions as those of the representative vectors, whereby weighted representative vectors z.sub.1i w.sub.1 and z.sub.2j w.sub.2 are generated. These weighted representative vectors are vector combined into a combined vector y.sub.ij, and a combination of the representative vectors is selected by a control part in such a manner as to minimize the distance between the combined vector y.sub.ij and an input vector X. The weighting coefficient vectors w.sub.1 and w.sub.2 each have a maximum component in a different dimension and are selected so that the sum of diagonal matrixes W.sub.1 and W.sub.2 using components of the weighting coefficient vectors as their diagonal elements becomes a constant multiple of the unit matrix.

Metadata

Assignee

Nippon Telegraph and Telephone Corp.

Inventors

Akitoshi Kataoka
Jotaro Ikedo

Application Information

Application Number:US 7931336

Filing Date:1997-04-23

Priority Date:1994-10-07

Art Unit:289

Classifications

IPC:

G01G 918H03M 730

Field of Search:

34139570451;50;1072.31;2.28;2.32222

Patent Drawings (10 sheets)

Description

Background of the Invention

The present invention relates to a vector coding method that is used to encode speech, images and various other pieces of information and is particularly suited to encoding of information that is transmitted over an error-prone channel such as a mobile radio channel and encodes an input vector through the use of a plurality of codebooks each composed of plural representative vectors. The invention also pertains to a vector encoder using the above-mentioned vector coding method and a vector decoder for decoding codes encoded by the vector encoder.

Methods that have been proposed to transmit vectors over channels prone to channel errors set representative vectors in anticipation of possible channel errors and take into account the channel errors when labeling representative vectors. These methods are disclosed in Kumazawa, Kasahara and Namekawa, "A Communication of Vector Quantizers for Noisy Channels," Transactions of the Institute of Electronics, Information and Communication Engineers of Japan , Vol. J67-B, No. 1, pp. 1-8, 1984, Zeger and Gersho, "Pseudo-Gray Coding," IEEE Trans. on Comm., Vol. 38, No. 12, pp. 2147-2158, 1990, and other literature. These methods hold all representative vectors directly in one codebook, and hence require large storage capacity for storing the codebook.

As a method that does not need large storage capacity in transmitting vectors over channels prone to channel errors, it has been proposed to transmit vectors after quantizing them through the use of two structured codebooks. This is disclosed in Moriya, "Two-Channel Vector Quantizer Applied to Speech coding," Transactions of the Institute of Electronics, Information and Communication Engineers of Japan, IT87-106, pp. 25-30, 1987 and other literature. This method has two small-scale codebooks and uses two representative vectors in combination to reduce the storage capacity needed and transmits two labels indicative of the two representative vectors to lessen the influence of channel errors. This method will be described with reference to FIGS. 1A and 1B. The representative vectors of the codebooks are generated beforehand by learning, for instance. In an encoder depicted in FIG. 1A, one representative vector Z.sub.1i is fetched from a codebook CB1 and one representative vector z.sub.2j from a codebook CB2, then they are added together in a vector combining part 3 to generate a vector sum Y.sub.ij =z.sub.1i +z.sub.2j, and the distance, d(X,y.sub.ij), between the combined representative vector y.sub.ij and an input vector X via an input terminal 4 is calculated, as distortion, in a distance calculating part 5. A control part 6 controls representative vector select switches 7 and 8 for the codebooks CB1 and CB2 and searches them for the representative vectors z.sub.1i and z.sub.2j that minimize the output d(X,y.sub.ij) from the distance calculating part 5. The control part 6 provides, as encoded outputs to an output terminal 9, labels i and j of the representative vectors z.sub.1i and z.sub.2j that provides minimum distance.

In a decoder shown in FIG. 1B, the control part 6 controls representative vector select switches 13 and 14 in accordance with the labels i and j in the input code via an input terminal 11 and reads out representative vectors z.sub.1i and z.sub.2j from codebooks CB3 and CB4, respectively. The thus read-out representative vectors z.sub.1i and z.sub.2j are combined in a vector combining part 17 into a reconstructed vector y.sub.ij =z.sub.1i +z.sub.2j, which is provided to an output terminal 18. Incidentally, the codebooks CB3 and CB4 are identical to CB1 and CB2, respectively.

The method described above in respect of FIGS. 1A and 1B reduces the storage capacity of the codebooks needed for storing the representative vectors and lessens the influence of channel errors by combining the vectors in the decoder through utilization of the two labels corresponding thereto.

With this method, however, if an error arises in the labels during transmission over the channel, then distortion will occur in all elements of the received vector. According to the circumstances, the error will cause an abnormally large amount of distortion in the decoded output.

Another problem of this method is that the amount of processing required is very large because it involves the calculation of the distance d(X,y.sub.ij) for every combination of representative vectors of the two codebooks in search for the pair of representative vectors that minimizes the distance.

Summary of the Invention

An object of the present invention is to provide a vector coding method that prevents an error in the input code to the decoder from causing serious distortion of its output.

Another object of the present invention is to provide a vector coding method that prevents an error in the input code to the decoder from causing serious distortion of its output and permits reduction of the amount of processing required.

Another object of the present invention is to provide a vector encoder that embodies the above-mentioned vector coding method.

Still another object of the present invention is to provide a vector decoder that decodes a vector encoded by the vector coding method that serves the above-mentioned objects.

According to the vector coding method and the encoder of the first aspect of the present invention, representative vectors from respective codebooks are combined and the distance between the combined representative vector and the input vector is calculated; in this instance, the representative vectors to be combined are those multiplied by predetermined different weighting coefficient vectors, each of which is composed of the same number of components. At least one of the components in each weighting coefficient vector assumes a maximum value, and the positions of the maximum components in the respective weighting coefficient vectors differ with the codebooks. The multiplication of each representative vector by the weighting coefficient vector is done on the representative vector read out of each codebook, or weighted representative vectors respectively premultiplied by the weighting coefficient vectors are prestored in each codebook.

According to the vector coding method and the vector encoder of a second aspect of the present invention, in the first aspect, the distribution of the set of weighted representative vectors multiplied by the weighting coefficient vectors for each codebook are approximated with straight lines, then the input vector is projected on each straight line and a plurality of weighted representative vectors present around the projection are chosen for each codebook. The thus chosen weighted representative vectors of the respective codebooks are combined in pairs and that one of the combined vectors which has the minimum distance to the input vector is selected as the combined representative vector.

In a third aspect, the present invention relates to a decoder for codes encoded into vectors according to the first or second aspect. The representative vectors read out of respective codebooks are multiplied by weighting coefficient vectors and the multiplied weighted representative vectors are combined into a reconstructed vector; the weighting coefficient vectors are selected in the same fashion as in the first aspect of the invention.

Brief Description of the Drawings

FIG. 1A is a block diagram showing the configuration of an encoder embodying a conventional vector coding method;

FIG. 1B is a block diagram showing a conventional decoder for use with the encoder of FIG. 1A;

FIG. 2A is a block diagram illustrating an example of the encoder embodying the present invention;

FIG. 2B is a block diagram illustrating an embodiment of the decoder according to the present invention;

FIG. 3A is a graph showing each representative vector z.sub.1i of a codebook CB1;

FIG. 3B is a graph showing a vector obtained by multiplying each representative vector z.sub.1i by a weighting coefficient vector w.sub.1 ;

FIG. 3C is a graph showing each representative vector z.sub.2j of a codebook CB2;

FIG. 3D is a graph showing a vector obtained by multiplying each representative vector z.sub.2j by a weighting coefficient vector w.sub.2 ;

FIG. 3E is a graph showing examples of a combined vector and an erroneous combined vector in the present invention;

FIG. 3F is a graph showing examples of a combined vector and an erroneous combined vector in the prior art;

FIG. 4 is a graph showing a set of weighted representative vectors and a straight line for approximation, for explaining the vector coding method of the present invention;

FIG. 5 is a block diagram illustrating an example of the encoder of the present invention applied to the CELP scheme;

FIG. 6A is a table showing a first codebook with weighted gain vectors stored therein;

FIG. 6B is a table showing a second codebook with weighted gain vectors stored therein;

FIG. 7 is a graph showing weighted gain vectors of FIGS. 6A and 6B on a coordinate system;

FIG. 8 is a block diagram illustrating the encoder of the present invention applied to the quantization of random excitation vectors;

FIG. 9 is a block diagram illustrating the encoder of the present invention applied to the quantization of pitch excitation vectors;

FIG. 10 is a block diagram illustrating the encoder of the present invention applied to the VSELP scheme;

FIG. 11 is a graph showing segmental SN ratio of reconstructed speech with respect to a channel error rate in the cases of using one gain codebook and two gain codebooks for vector encoding of gains g.sub.p and g.sub.c in FIG. 5;

FIG. 12 is a graph showing, as an equivalent Q value, the MOS of the reconstructed speech with respect to the channel error rate in the two cases of FIG. 11; and

FIG. 13 is a graph showing the segmental SN ratio of reconstructed speech with respect to the channel-error rate in the case of the present invention that uses two weighted gain codebooks for vector encoding of the gains g.sub.p and g.sub.c in FIG. 5.

Description of the Preferred Embodiments

In FIGS. 2A and 2B there are illustrated in block form an embodiment of the present invention, in which the parts corresponding to those in FIGS. 1A and 1B are identified by the same reference numerals. In the encoder of FIG. 2A, multipliers 21 and 22 are provided between the representative selection switches 7, 8 and the vector combining part 3, by which components of L-dimensional (where L is an integer equal to or greater than 2) representative vectors z.sub.1l =(z.sub.1i1, z.sub.1i2, . . . , z.sub.1iL) and z.sub.2j =(z.sub.2j1, z.sub.2j2, . . . , z.sub.2jL) selected from the codebooks CB1 and CB2 are multiplied by the corresponding components of L-dimensional weighting coefficient vectors w.sub.1 =(w.sub.11, w.sub.12, . . . , W.sub.1L) and w.sub.2 =(w.sub.21, W.sub.22, . . . , w.sub.2L), respectively. At least one of the L components forming each of the weighting coefficient vectors w.sub.1 and w.sub.2 assumes a maximum value and the positions of the maximum components in the respective weighting coefficient vectors w.sub.1 and w.sub.2 differ with the codebooks CB1 and CB2. According to the present invention, letting the weighting coefficient vectors w.sub.1 and w.sub.2 be represented by the following weighting coefficient matrixes W.sub.1 and W.sub.2 that have, as diagonal elements, the values w.sub.11, w.sub.12, . . . , W.sub.1L of the components by which the respective components of the representative vectors are multiplied: ##EQU1## the weighting coefficient vectors w.sub.1 and w.sub.2 may preferably be selected so that the sum of the weighting coefficient matrixes W.sub.1 and W.sub.2 of the codebooks CB1 and CB2 becomes a constant multiple of the unit matrix as follows: ##EQU2## where K is a predetermined constant. Vectors w.sub.1 z.sub.1i and w.sub.2 z.sub.2j, obtained by multiplying the representative vectors z.sub.1i and z.sub.2j by the weighting coefficient vectors w.sub.1 and w.sub.2, respectively, are combined in the vector combining part 3, and the codebooks CB1 and CB2 are searched for representative vectors z.sub.1i and z.sub.2j that minimize the distance between the combined vector y.sub.ij and the input vector X.

With such a configuration as described above, for example, when L=2, the representative vectors z.sub.1i and z.sub.2j are expressed by two-dimensional vectors z.sub.1i =(z.sub.1i1, z.sub.1i2) and z.sub.2j =(z.sub.2j1, z.sub.2j2), respectively. Suppose that k=2 and that the weighting coefficients which satisfy Eq. (3) are W.sub.1 =(w.sub.11 =1.8, w.sub.12 =0.2) and w.sub.2 =(w.sub.21 =0.2, w.sub.22 =1.8). Assuming that representative vectors z.sub.11, z.sub.12, . . . of the codebook CB1 are distributed substantially uniformly all over a plane of a certain two-dimensional range defined by z.sub.1i1 in the first-dimensional direction and z.sub.1i2 in the second-dimensional direction as shown in FIG. 3A, weighted representative vectors z.sub.11 ' and z.sub.12 ', . . . , obtained by multiplying each representative vector z.sub.1i =(z.sub.1i1, z.sub.1i2) by the weighting coefficient vector w.sub.1 =(1.8, 0.2), are concentrated close to the first-dimensional axis as shown in FIG. 3B. Similarly, assuming that representative vectors z.sub.21, z.sub.22, . . . of the codebook CB2 are distributed substantially uniformly all over the plane of a certain two-dimensional range defined by two axes as depicted in FIG. 3C, weighted representative vectors, obtained by multiplying the representative vectors z.sub.21, z.sub.22, . . . by the weighting coefficient vectors w.sub.2 =(0.2, 1.8), are concentrated close to the second-dimensional axis as shown in FIG. 3D.

Suppose, for example, that when it is judged at the transmitting side that the weighted combined vector y.sub.ij of the representative vectors z.sub.21 and z.sub.1i has the minimum distortion with respect to the input signal X, the label of the one weighted representative vector z.sub.1i becomes z.sub.1i ' because of a channel error as shown in FIG. 3E. In this instance, the combined vector y.sub.ij changes to y.sub.ij ' at the receiving side. There is a possibility that the weighted representative vector z.sub.1i changes to any other weighted representative vectors z.sub.1i ', but since the vector z.sub.1i has a biased distribution, the value of the second-dimensional component of an error vector, .DELTA.y=.DELTA.y.sub.ij -y.sub.ij ', between the combined vectors y.sub.ij and y.sub.ij ' is relatively small, no matter how much the vector z.sub.1i may change. In contrast to this, in the case where the combined vector is not multiplied by the weighting coefficient, if the one representative vector z.sub.1i changes to a representative vector z.sub.1i ', combined vectors of these vectors z.sub.1i and z.sub.1i ' and the other representative vector z.sub.2j become y.sub.ij and y.sub.ij ', respectively, as shown in FIG. 3F. Since there is a likelihood of the representative vector z.sub.1i changing to any of the representative vectors of the codebook CB1 and since the representative vectors z.sub.11, z.sub.12, . . . are distributed over a wide range, the error vector .DELTA.y between the combined vector y.sub.ij and the changed combined vector y.sub.ij ' is likely to have appreciably large first- and second-dimensional components.

In other words, in the example of FIG. 3E, when the weighted representative vector w.sub.1 z.sub.1i =(w.sub.11 z.sub.1i1, w.sub.12 z.sub.1i2) becomes w.sub.1 z.sub.1i '=(w.sub.11 z.sub.1i1 ', w.sub.12 z.sub.1i1 ') because of a channel error, distortion is concentrated on the first-dimensional component w.sub.11 z.sub.1i1 ' to keep down distortion of the second-dimensional component w.sub.12 z.sub.1i2 ', by which distortion is reduced as a whole.

FIG. 2B illustrates in block form an embodiment of the decoder of the present invention, which is supplied with the labels i and j and the weighting coefficient vectors w.sub.1 and w.sub.2 from the encoder of FIG. 2A and decodes the code y.sub.ij. The decoder has the same codebooks CB3 and CB4 as CB1 and CB2 in FIG. 2A, reads out representative vectors of the labels i and j of the inputted code from the codebooks CB3 and CB4 and combines them as is the case with FIG. 1B. In this embodiment, multipliers 24 and 25 are provided between the switches 13, 14 and the vector combining part 17, by which representative vectors z.sub.1i and z.sub.2j read out of the codebooks CB3 and CB4 are multiplied by the same weighting coefficient vectors w.sub.1 and w.sub.2 as those used by the corresponding multipliers 21 and 22 of the FIG. 2A encoder. The thus multiplied representative vectors w.sub.1 z.sub.1i and w.sub.2 z.sub.2j are combined in the vector combining part 17 into the reconstructed vector y.sub.ij. As will be evident from the above, it is also possible to omit the multipliers 21, 22, 24 and 25 by prestoring in the codebooks CB1, CB3 and CB2, CB4 in FIGS. 2A and 2B weighted representative vectors obtained by multiplying the representative vectors z.sub.1i and z.sub.2j by the weighting coefficient vectors w.sub.1 and w.sub.2, respectively.

In the encoder of FIG. 2A, the combined vector y.sub.ij is determined for every combination of representative vectors z.sub.1i and z.sub.2j prestored in the codebooks CB1 and CB2, then the distortion of each combined vector is calculated with respect to the input signal vector X, and a decision is made of which pair of representative vectors z.sub.1i and z.sub.2j provides the minimum distortion. With this method, however, the number of calculations increases sharply as the codebooks CB1 and CB2 increase in size. Next, a description will be given of a scheme which pre-selects small numbers of representative vectors z.sub.1i and z.sub.2j and determines the pair of representative vectors of the minimum distortion among them, thereby reducing the computational complexity and hence shortening the operation time.

Let it be assumed, for example, that the codebooks CB1 and CB2 in FIG. 2A have 8 and 16 representative vectors, respectively, and that the vectors z.sub.1i and z.sub.2j are all two-dimensional. In FIG. 4, eight weighted representative vectors, obtained by multiplying the eight representative vectors z.sub.1i of the codebook CB1 by the weighting coefficient vector w.sub.1 =(w.sub.11 =1.8, w.sub.12 =0.2), are indicated by crosses; 16 weighted representative vectors, similarly obtained by multiplying the 16 representative vectors z.sub.2j of the codebook CB2 by the weighting coefficient vectors w.sub.2 =(w.sub.21 =0.2, w.sub.22 =1.8), are indicated by white circles. The input signal vector is indicated by X, which is composed of a predetermined number of signal samples of each frame, two samples in this example.

The two-dimensional weighting coefficient vectors w.sub.1 and w.sub.2 for the two-dimensional vectors z.sub.1i and z.sub.2j are determined such that they satisfy Eq. (3); w.sub.11 +w.sub.21 =w.sub.12 +w.sub.22 =2 in this example. As depicted in FIG. 4, the weighted representative vectors marked with the white circles and the weighted representative vectors marked with the crosses are distributed separately on opposite sides of a straight line of a 45.degree.-gradient passing through the origin (0, 0). The following description will be given on the assumption that there are stored such weighted representative vectors in the codebooks CB1 and CB2 in FIG. 2A and in the CB3 and CB4 in FIG. 2B, with the multipliers 21, 22, 24 and 25 left out.

With this scheme, the set of weighted representative vectors (indicated by the crosses) of the codebook CB1 is approximated with a straight line 27. That is, the straight line 27 is determined so that the sum of distances, D.sub.11, D.sub.12, . . . , D.sub.18, between it and the respective crosses (or distances in the second-dimensional axis direction) is minimum. Likewise, the set of weighted representative vectors (indicated by the white circles) of the codebook CB2 is approximated with a straight line 28. The straight line 28 is also determined so that the sum of distances, D.sub.21, D.sub.22, . . . , D.sub.216, between it and the respective white circles (or distances in the first-dimensional axis direction) is minimum.

The input vector X is projected on the approximating straight lines 27 and 28 and pluralities of weighted representative vectors present around the projections are selected. That is, a calculation is made of the value on the abscissa and hence a first-dimensional value p.sub.1x at the intersection P.sub.1 of a straight line 29 passing through the input signal vector X and parallel to the approximating straight line 28 and the approximating straight line 27, then the value p.sub.1x and first-dimensional values (values of first components) of the cross-marked weighted representative vectors having a wide first-dimensional distribution are compared, and a predetermined number, for example, three, of the weighted representative vectors are selected, as a subgroup H.sub.1, in increasing order of the difference between the value P.sub.1x and the first-dimensional value of the respective weighted representative vector. In this way, the weighted representative vectors are pre-selected for the codebook CB1. Similarly, a calculation is made of a value on the ordinate and hence a second-dimensional value p.sub.2y at the intersection P.sub.2 of a straight line 31 passing through the input signal vector x and parallel to the approximating straight line 27 and the approximating straight line 28, then the second-dimensional value p.sub.2y and second-dimensional values (values of second components) of the white-circled weighted representative vectors having a wide second-dimensional distribution, and a predetermined number, for example, three, of the weighted representative vectors are selected, as a subgroup H.sub.2, in the order of increasing differences between the value p.sub.2y and the second-dimensional values of the weighted representative vectors. This is the pre-selection of the weighted representative vectors for the codebook CB2.

Only the weighted representative vectors thus pre-selected from the codebooks CB1 and CB2 are searched for a pair of weighted representative vectors that provides the minimum distance between their combined vector and the input signal vector. In this example, since three weighted representative vectors are pre-selected from each of the codebooks CB1 and CB2, the number of their combinations is nine, and hence the number of combined vectors is nine. When the pre-selection scheme is not adopted, the number of combinations of the weighted representative vectors (the number of combined representative vectors) is 8.times.16=128, and when the pre-selection is made, the number of calculations for the distance to the input signal vector X is reduced down to 9/128 of the number of calculations needed when no pre-selection takes place. In this pre-selection scheme, when M codebooks are used, the number of dimensions of representative vectors is also set to M. The M weighting coefficient vectors each have at least one maximum component at a different component position (that is, in a different dimension), and by multiplying the representative vector by the weighting coefficient vector, that dimension is emphasized more than the other dimensions.

FIG. 5 illustrates an embodiment of the coding method of the present invention applied to speech coding of the CELP (Code-Excited Linear Prediction Coding) system. In the CELP system, as disclosed by M. R. Schroeder and B. S. Atal in "Code-Excited Linear Prediction (CELP): High-Quality Speech at Very Low Bit Rates", Proc. ICASSP'85, pp. 937-940, 1985, for instance, pitch excitation vectors read out of a pitch excitation source codebook and random excitation vectors read out of a random excitation source codebook are respectively provided with gains and are combined in pairs, then the combined vectors are each fed as an excitation signal to a synthesis filter to obtain synthesized speech, then two vectors and two gains therefor are determined which minimize distortion of the synthesized speech with respect to input speech, and labels of these vectors and labels of the gains are outputted as encoded results of the input speech, together with the filter coefficients of the synthesis filter. By applying the vector coding method of the present invention to the encoding of the gains for the two vectors in the CELP system, it is possible to prevent the occurrence of gross distortion in the decoded or reconstructed speech by a channel error in the codes representing the gains.

The input speech signal X fed via an input terminal 34 is sampled with a fixed period and is expressed as a vector that is provided as a sequence of digital sample values for each frame period. The input signal vector X of every frame is subjected to, for example, an LPC analysis in a filter-coefficient determining part 35, from which linear predictive coefficients are provided. The linear predictive coefficients are used to calculate a spectrum envelope parameter, which is quantized in a filter coefficient quantizing part 36, and the quantized value is set as the filter coefficient of a synthesis filter 37. In a pitch excitation source codebook 39 there are stored sequences of sample values of waveforms respectively containing different pitch period components and labeled as pitch excitation vectors. In a random-excitation source codebook 43 there are stored sequences of sample values of various random waveforms respectively labeled as random-excitation vectors. The pitch-excitation vectors and the random-excitation vectors stored in the pitch-excitation source codebook 39 and the random-excitation source codebook 43 are each composed of components of the same number as that of samples of one frame. A selection switch 38 is controlled by the control part 6 to select one of the pitch-excitation vectors in the pitch-excitation source codebook 39, and the selected pitch-excitation vector is multiplied by a given gain in a gain providing part 41, thereafter being applied to the synthesis filter 37. The difference between synthesized speech Xp from the synthesis filter 37 and the input speech signal X is calculated by a subtractor 48, and in the distortion calculating part 5 the difference is used to calculate distortion D as D=.vertline..vertline.X-Xp.vertline..vertline..sup.2. Similarly, the other pitch-excitation vectors are sequentially taken out from the pitch-excitation source codebook 39 via the switch 38 under the control of the control part 6, then the above-mentioned distortion is calculated for each pitch-excitation vector, and the pitch-excitation vector of the minimum distortion is determined. Next, one of the random-excitation vectors stored in the random-excitation source codebook 43 is taken out through a switch 42 and amplified by a given gain in a gain providing part 46, thereafter being fed to an adder 47 wherein it is combined with the already determined pitch-excitation vector into an excitation signal vector E. The excitation signal vector E is provided to the synthesis filter 37 to generate synthesized speech and its distortion with respect to the input speech signal is similarly calculated. Likewise, such distortion is also calculated for each of the other remaining random-excitation vectors in the random-excitation source codebook 43 and the random excitation vector of the minimum distortion is determined.

After the selection of the pitch excitation vector and the random excitation vector as mentioned above, gains g.sub.p and g.sub.c of the gain providing parts 41 and 46 are so determined as to minimize the distortion as described hereafter. In gain coebooks CB1 and CB2 there are stored gain vectors z.sub.1i (where i=1, . . . , a) and z.sub.2j (where j=1, . . . , b), respectively. The gain vectors z.sub.1i and z.sub.2j are each composed of two components and expressed as z.sub.1i =(z.sub.1i1, z.sub.1i1) and z.sub.2j =(z.sub.2j1, z.sub.2j2), respectively. The gain vectors z.sub.1i and z.sub.2j taken out of the gain codebooks CB1 and CB2 are multiplied by weighting coefficient vectors w.sub.1 =(w.sub.11, w.sub.12) and w.sub.2 =(w.sub.21, w.sub.22) by multipliers 21 and 22, respectively, from which weighted gain vectors y.sub.i =(y.sub.i1, y.sub.i2) and y.sub.j =(y.sub.ji, y.sub.j2) are provided. Here,

In a vector combining part 3 the weighted gain vectors y.sub.i and y.sub.j are combined into a combined gain vector G=(g.sub.p, g.sub.c) which is composed of such components as follows:

The first and second components g.sub.p and g.sub.c of the combined gain vector G are provided as first and second gains to the gain providing parts 41 and 46, wherein they are used to multiply the pitch excitation vector C.sub.P and the random excitation vector C.sub.R from the pitch excitation source codebook 39 and the random excitation source codebook 43, respectively.

The pitch excitation vector g.sub.p c.sub.P and the random excitation vector g.sub.c C.sub.R multiplied by the gains g.sub.p and C.sub.R in the gain providing parts 41 and 46, respectively, are added together by the adder 47 and the added output is fed as an excitation vector E=g.sub.p C.sub.P +g.sub.c C.sub.R to the synthesis filter 37 to synthesize speech X. The difference between the synthesized speech X and the input speech signal X is calculated by the subtractor 48 and the difference is provided to the distortion calculating part 5, wherein D=.vertline..vertline.X-X.vertline..vertline..sup.2 is calculated as the distortion of the synthesized speech X with respect to the input speech signal X. The control part 6 controls the selection switches 7 and 8 to control the selection of the gain vectors of the gain codebooks CB1 and CB2, and the selected gain vectors z.sub.1i and z.sub.2j are multiplied by the different weighting coefficient vectors w.sub.1 and w.sub.2 by the multipliers 21 and 22, respectively, thereafter being provided to the vector combining part 3. The weighting coefficient vectors w.sub.1 and w.sub.2 are two-dimensional vectors that satisfy Eq. (3), and the two elements of each vector differ from each other. The gain vectors of the codebooks CB1 and CB2 are selected so that they minimize the distortion which is calculated in the distortion calculating part 5. Upon selection of the gain vectors that minimize the distortion, gain labels indicating the selected gain vectors of the gain codebooks CB1 and CB2, labels indicating the excitation vector and the random excitation vector of the pitch excitation source codebook 39 and the random excitation source codebook 43 determined as described previously and label indicating the filter coefficient set in the synthesis filter 37 are outputted, as encoded results of the input speech signal X, from a code outputting part 49.

In the FIG. 5 embodiment, the distortion is calculated for every combination of gain vectors selected from the gain codebooks CB1 and CB2 so as to determined the pair of gain vectors that provides the minimum distortion. As referred to previously with respect to FIG. 4, however, the pair of gain vectors, which provides the minimum distortion, may also be determined by pre-selecting pluralities of candidates of gain vectors z.sub.1i and z.sub.2j and calculating the distortion for every combination of such pre-selected gain vectors in the case where they are combined with the pitch excitation vector C.sub.P and the random excitation vector C.sub.R. In this instance, as is the case with FIG. 4, weighted gain codebooks CB1' and CB2' are prepared, for example, as Tables I and II as shown in FIGS. 6A and 6B, by precalculating weighted gain vectors

which are the products of the gain vectors z.sub.1i and z.sub.2j of the gain codebooks CB1 and CB2 and the weighting coefficient vectors w.sub.1 =(w.sub.11, w.sub.12) and w.sub.2 =(w.sub.21, w.sub.22), and the codebooks CB1' and CB2' are used as substitutes for the codebooks CB1 and CB2 in FIG. 5 and the multipliers are left out. As in the case of FIG. 4, all two-dimensional weighted vectors y.sub.1i of the weighted gain codebook CB1' are plotted as points on a two-dimensional coordinate system as indicated by black circles in FIG. 7 and a straight line L.sub.1 closest to the group of such points is precalculated by the method of least squares. Similarly, all two-dimensional weighted vectors y.sub.2j of the weighted gain codebook CB2' are plotted as points on the two-dimensional coordinate system as indicated by white circles in FIG. 7 and a straight line L.sub.2 closest to the group of such points is precalculated by the method of least squares.

As is the case with the FIG. 5 example, the gains of the gain providing parts 41 and 46 are set arbitrary and the pitch excitation vector C.sub.P that provides the minimum distortion is determined, which is followed by the determination of the random excitation vector C.sub.R that provides the minimum distortion. Next, the output X.sub.P from the synthesis filter 37 is measured when only the pitch excitation vector C.sub.p is applied thereto as an excitation signal with the gains g.sub.p =1 and g.sub.c =0. Likewise, the output X.sub.R from the synthesis filter 37 is measured when only the random excitation vector C.sub.R is applied thereto as an excitation signal with the gains g.sub.p =0 and g.sub.c =1. Since the synthesized speech output X from the synthesis filter 37, which is provided when the vectors C.sub.P and C.sub.R selected from the codebooks 39 and 43 are multiplied by the gains g.sub.p and g.sub.c, respectively, is expressed as X=g.sub.p X P+g.sub.c X.sub.R, the distortion D of the synthesized speech X with respect to the input speech signal X is given by the following equation: ##EQU3## where t indicates a transposition. By partially differentiating the above equation by the gains g.sub.p and g.sub.c to obtain those which minimize the distortion D, the following equations are obtained:

Since the distortion D is a downward convex function with respect to each of the gains g.sub.p and g.sub.c as is evident from Eq. (6), the gains g.sub.p and g.sub.c that minimize the distortion D are values when .differential.D/.differential.g.sub.p =0 and .differential.D/.differential.g.sub.c =0. Hence, we have

from Eqs. (7) and (8), respectively. From the following equation, ##EQU4## the gains g.sub.p and g.sub.c that satisfy Eqs. (9) and (10) simultaneously are expressed as follows: ##EQU5## Expanding Eq(12), the gains g.sub.p and g.sub.c are given by the following equations, respectively:

where k=1/(X.sub.P.sup.t X.sub.P .multidot.X.sub.R.sup.t X.sub.R -2X.sub.P.sup.t X.sub.R). The pair of gains {g.sub.p, g.sub.c } thus obtained is the combination of gains that minimizes the distortion D. This pair is plotted as the optimum gain vector as indicated by a point P.sub.0 in FIG. 7 and straight lines parallel to the straight lines L.sub.2 and L.sub.1 are drawn from the point P.sub.0, determining their intersections P.sub.1 and P.sub.2 with the lines L.sub.1 and L.sub.2. A plurality of weighted gain vectors y.sub.1i =(y.sub.1i1, y.sub.1i2) whose ordinate values are close to the point P.sub.1 are selected from the codebook CB1' (Table I shown in FIG. 6A) to form a first subgroup. Similarly, a plurality of weighted gain vectors y.sub.2j =(y.sub.2j1, y.sub.2j2) whose abscissa values are close to the point p.sub.2 are selected from the codebook CB2' (Table II shown in FIG. 6B) to form a second subgroup.

In this case, predetermined numbers of weighted gain vectors (for example, four from Table I with respect to the point P.sub.1 and eight from Table II with respect to the point P.sub.2) are selected in increasing order of distance from the points P.sub.1 and P.sub.2. Another method is to select weighted gain vectors that lie within predetermined distances d.sub.1 and d.sub.2 from the points P.sub.1 and P.sub.2, respectively. Alternatively, since eight vectors y.sub.1i are prestored in the codebook CB1', mean values of i=n-th and i=(n+4)th ones of the gain components y.sub.1i2 are calculated for n=1, 2, 3, 4, respectively, and the thus obtained values are set as threshold values Th.sub.1, Th.sub.2, Th.sub.3 and Th.sub.4. If the ordinate value p.sub.1c at the intersection P.sub.1 is p.sub.1c .ltoreq.Th.sub.1, then (i=1, . . . , 4)th weighted gain vectors are selected, and if Th.sub.n <p.sub.1c <Th.sub.n +1 where n=1, 2, 3, 4, then (i=n+1, . . . , n+4)th weighted gain vectors are selected. Similarly, since the number of vectors y.sub.2j stored in the codebook CB2' is 16, mean values of (j=m)th and (j=m+8)th ones of gain components y.sub.2ji are calculated for m=1, . . . , 8, respectively, and the values thus obtained are set as threshold values Th.sub.1, . . . , Th.sub.8. If the abscissa value p.sub.2p at the intersection P.sub.2 is p.sub.2p <Th.sub.1, (j=1, . . . , 8)th weighted gain vectors are selected, and if Th.sub.m<p2p .ltoreq.Th.sub.m+1 where m=1, . . . , 8, (j=m+1, . . . , m+8)th vectors are selected. It is also possible to use various other selecting methods.

A description will be given of still another method of pre-selecting candidates of vectors from the codebooks without using the aforementioned approximating straight lines L.sub.1 and L.sub.2 based on the method of least squares. At first, the synthesized speech signal X.sub.P is measured when only the pitch excitation vector C.sub.P from the pitch excitation source codebook 39 is provided as the excitation signal vector E to the synthesis filter 37, with the gain vectors set to g.sub.p =1 and g.sub.c =0. Similarly, the synthesized speech signal X.sub.C is measured when only the random excitation vector C.sub.R from the random excitation source codebook 43 is provided as the excitation signal vector E, with the gain vectors set to g.sub.p =0 and g.sub.c =1. For the pre-selection of the gain vectors stored in the gain codebook CB1, a value D.sub.1 (i) is calculated for every i as follows:

Then, a predetermined number, for example, three, of gain vectors are pre-selected from the gain codebook CB1 in increasing order of the value D.sub.1 (i). For the pre-selection of the gain vectors stored in the gain codebook CB2, a value D.sub.2 (j) is similarly calculated for every j as follows:

Then, a predetermined number, for example, three, of gain vectors are pre-selected from the gain codebook CB2 in increasing order of the value D.sub.2 (j). Only for the triplets of gain vectors z.sub.1i and Z.sub.2j thus pre-selected from the codebooks CB1 and CB2, a value D(i,j) is calculated as follows:

Then, i and j that minimize the value are provided as encoded outputs. This method also permits reduction of the computational complexity involved.

All pairs of thus pre-selected weighted gain vectors that are selected one by one from the first and second subgroups, respectively, are searched for a pair of weighted gain vectors that provide the minimum distortion from the input speech signal X, that is, an optimum pair of first and second gains g.sub.p and g.sub.c is thus determined and combined. Then, labels, which represent the pair of pitch excitation vector and random excitation vector determined previously and the combined gain vector (g.sub.p, g.sub.c), that is, a label of the pitch excitation vector in the pitch excitation source codebook 39, a label of the random excitation vector in the random excitation source codebook 43, labels of the gain vectors in the weighted gain codebooks CB1' and CB2' (or gain codebooks CB1 and CB2) and a label produced by quantizing the filter coefficient are outputted as encoded results of the input speech vector X.

At any rate, the multiplication of the weighting coefficient vectors w.sub.1 and w.sub.2 by the multipliers 21 and 22 begins to bring about the effect of preventing a channel error from seriously distorting the decoded output when the ratio of corresponding components, for example, w.sub.11 and w.sub.21 of the weighting coefficient vectors exceeds a value 2:1. Even if the ratio is set to 10:1 or more, however, the distortion by the channel error cannot appreciably be improved or suppressed; on the contrary, the decoded output is rather distorted seriously when no channel error arises, that is, when the channel is normal.

In the FIG. 5 embodiment, the weighting coefficient vectors, the weighted gain vectors and the combined gain vector have all been described to be two-dimensional vectors with a view to providing gains to the excitation vectors read out from both of the pitch excitation source codebook 39 and the random excitation source codebook 43. In the CELP system, however, there are cases where pluralities of pitch excitation source codebooks and random excitation source codebooks (which will hereinafter be referred to simply as excitation source codebooks) are provided and excitation vectors read out of the excitation codebooks are respectively multiplied by gains and combined into the excitation signal vector E. In general, according to the present invention, when M excitation gain codebooks are used, M gain codebooks (or weighted gain codebooks) are prepared to provide gains to M excitation vectors and the combined gain vector, the weighting coefficient vectors and the weighted gain vectors are all set to M-dimensional vectors accordingly.

In the FIG. 5 embodiment, the random excitation source codebook 43 may be formed by a plurality of codebooks. For example, as shown in FIG. 8, the random excitation source codebook 43 is formed by two codebooks 43a and 43b; in this instance, one random excitation vector is selected from either of the codebooks 43a and 43b and the thus selected random excitation vectors are multiplied by weighting coefficient vectors w.sub.Ra and w.sub.Rb by weighting coefficient multipliers 51a and 51b, respectively. The weighting coefficient vectors w.sub.Ra and w.sub.Ra are selected such that they bear the same relationship as that between the weighting coefficient vectors w.sub.1 and w.sub.2 described previously with reference to FIG. 2A. The outputs from the multipliers 51a and 51b are combined in a random vector combining part 52 and the combined output is provided, as the random excitation vector selected from the random excitation source codebook 43 in FIG. 5, to the gain providing part 46. As described previously with respect to FIG. 5, random excitation vectors are selected from the random excitation source codebooks 43a and 43b under the control of the control part 6 in such a manner that the distortion of the synthesized speech signal X from the input speech signal X becomes minimum.

As is the case with the encoding of the random excitation vector, the present invention is also applicable to the encoding of the pitch excitation vector in the configuration of FIG. 5. That is to say, as shown in FIG. 9, the pitch excitation source codebook is formed by two codebooks 39a and 39b; one pitch excitation vector is selected from either of the codebooks 39a and 39b, then they are multiplied by weighting coefficient vectors w.sub.Pa and w.sub.pb by weighting coefficient multipliers 53a and 53b, respectively, then these multiplied outputs are combined in a pitch excitation vector combining part 54, and the combined output is provided, as the pitch excitation vector selected from the pitch excitation source vector codebook 43 in FIG. 5, to the multiplier 41. The weighting coefficient vectors w.sub.Pa and .sub.wPb that are set in the multipliers 53a and 53b are determined in the same fashion as the weighting coefficient vectors w.sub.1 and w.sub.2 in FIG. 2A.

The present invention can be applied to the quantization in the filter coefficient quantizing part shown in FIG. 5 by configuring the filter coefficient quantizing part 36 in the same manner as depicted in FIG. 2A. That is, representative spectrum envelope vectors are prestored in the codebooks CB1 and CB2 in FIG. 2A, then one representative spectrum envelope vector selected from either of the codebooks CB1 and CB2 is multiplied by the corresponding one of the weighting coefficient vectors w.sub.1 and w.sub.2, and the multiplied vectors are combined in the vector combining part 3. The representative spectrum envelope vectors that are selected from the codebooks CB1 and CB2 are searched for a combination of representative spectrum envelope vectors that provide the minimum distance between their combined vector and the input spectrum envelope vector from the filter coefficient determining part 35 (FIG. 5).

The vector coding method of the present invention is applicable to the VSELP system as well. FIG. 10 illustrates the principal parts of its embodiment. In this instance, the random excitation source codebook 43 in FIG. 5 is formed by a number of basic vector codebooks 43.sub.1 to 43.sub.n in each of which there is stored one random excitation vector. The random excitation vectors read out of the basic vector codebooks 43.sub.1 to 43.sub.n are polarized positive or negative in polarity control parts 56.sub.1 to 56.sub.n and the polarity-controlled random excitation vectors are multiplied by weighting coefficient vectors w.sub.R1 to w.sub.Rn by weighting coefficient multipliers 57.sub.1 to 57.sub.n. The multiplied outputs are added together by an adder 58 and the added output is provided as the random excitation vector to the multiplier 46 in FIG. 5. The polarity control parts 56.sub.1 to 56.sub.n are individually controlled by the control part 6 in FIG. 5 so that the distortion of the synthesized speech signal from the input speech signal is minimized. In other words, each pair of basic vector codebook 43.sub.i (where i=1, 2, . . . , n) and polarity control part 56.sub.i constitutes one random excitation source codebook and one of two positive and negative random excitation vectors is selected by the control part 6. The weighting coefficient vectors w.sub.R1 to w.sub.Rn of the weighting coefficient multipliers 57.sub.1 to 57.sub.n are set to bear the same relationship as that between the weighting coefficient vectors referred to previously with respect to FIG. 2A.

As will be understood from the description given above with reference to FIG. 10, the random excitation source codebook 43 in FIG. 5 may also be substituted with the basic vector codebooks 43.sub.1 to 43.sub.n and the polarity control parts 56.sub.1 tou 56.sub.n in FIG. 10. The same goes for the codebooks 43a and 43b in FIG. 8. The pitch excitation source codebook 39 in FIG. 5 may also be formed by what is called an adaptive codebook which adaptively generates the pitch excitation vector from the pitch period obtained by analyzing the input speech signal and the excitation signal vector E of the previous frame. This adaptive codebook can be used as the pitch excitation source codebook 39 when the configuration of FIG. 8 or 10 is employed as a substitute for the random excitation source codebook 43. Furthermore, the present invention is also applicable to an arbitrary combination of the vector coding of the power of a speech signal, the vector coding of a spectrum envelope parameter, the vector coding of a pitch excitation source codebook and the vector coding of a random excitation source codebook.

As described previously, the multipliers 21 and 22 in FIG. 2A may be omitted by prestoring, as the representative vectors, weighted representative vectors W.sub.1 z.sub.1i and w.sub.2 z.sub.2j obtained by multiplying the representative vectors in the codebooks CB1 and CB2 by the weighting coefficient vectors w.sub.1 and w.sub.2. Similarly, the multipliers 24 and 25 in FIG. 2B may be omitted by prestoring the weighted representative vectors w.sub.1 z.sub.1i and w.sub.2 z.sub.2j in the codebooks CB3 and CB4, respectively. Also in the FIG. 5 embodiment, the multipliers 21 and 22 may be omitted by prestoring weighted gain vectors in the gain codebooks CB1 and CB2. In FIGS. 8 and 9, too, the multipliers 51a, 51b and 53a and 53b may be omitted by prestoring weighted vectors in the codebooks 43a, 43b and 39a, 39b. While in the above representative vectors read out of two codebooks are vector-combined, the present invention is also applicable to a system wherein representative vectors read out of three or more codebooks are vector-combined. Moreover, the FIG. 5 embodiment of the present invention has been described as being applied to the coding of the input speech signal, but the invention is applicable to the encoding of ordinary acoustic signals as well as to the encoding of the speech signal.

Next, a description will be given of characteristics that are obtained in the cases of applying conventional techniques and the present invention to the vector coding of the gains g.sub.p and g.sub.c in the CELP speech coding shown in FIG. 5.

(A) A first conventional technique substitutes the two gain codebooks CB1 and CB2 in FIG. 5 with one gain codebook which specifies one two-dimensional gain vector by seven-bit label and has 2.sup.7 =128 labels. The one component of the two-dimensional vector read out of the gain codebook is used as the gain g.sub.p for the pitch excitation vector and the other element as the gain g.sub.c for the random excitation vector.

(B) A second conventional technique uses the two gain codebooks CB1 and CB2 shown in FIG. 5 but does not use the weighting coefficient vectors. The codebook CB1 prestores therein 2.sup.3 two-dimensional vectors each of which is specified by a three-bit label, and the codebook CB2 prestores therein 2.sup.4 two-dimensional vectors each of which is specified by a four-bit label. The vectors selected from the two codebooks, respectively, are combined into one two-dimensional combined vector; the one element of the combined vector is used as the gain g.sub.p and the other element as the gain g.sub.c.

(C) In the example of the present invention applied to the encoding of gain vectors in FIG. 5, the gain vectors read out of the gain codebooks CB1 and CB2 in the above-mentioned case (B) are multiplied by the weighting coefficient vectors w.sub.1 =(1.8, 0.2) and w.sub.2 =(0.2, 1.8) and then added together into a combined vector. The gain codebooks CB1' and CB2', which store weighted gain vectors obtained by multiplying the gain vectors read out of the two codebooks CB1 and CB2 by the weighting coefficient vectors w.sub.1 and w.sub.2, respectively, are the same as those in FIGS. 6A and 6B.

In FIG. 11 there are indicated, by the curves A11 and B11, measured results of the segmental SN ratio of reconstructed speech to the error rate when a channel error occurred in the gain labels in the encoded outputs of speech by the configurations of Cases (A) and (B) in FIG. 5. The segmental SN ratio is obtained by measuring the SN ratio of each frame for several minutes and averaging the measured values. The use of two codebooks (curve B11) attains a more excellent segmental SN ratio to the channel error than in the case of using one codebook (curve All).

In FIG. 12 there are shown, by curves A12 and B12, equivalent Q values converted from mean opinion scores of 24 ordinary people about the reconstructed speech with respect to the channel error rate of the gain labels in the case of FIG. 11. As is evident from FIG. 12, the use of two codebooks is preferable from the viewpoint of the channel error rate, and even if the two cases shown in FIG. 11 do not greatly differ in their SN ratio characteristic, they greatly differ psycho-acoustically.

FIG. 13 shows, by the curve C13, measured values of the segmental SN ratio of reconstructed speech to the channel error rate in the Case (C) as in the case of FIG. 11, the curve B11 in the Case (B) being shown for comparison use. Apparently, the SN ratio of the reconstructed speech to the channel error rate in the case of the present invention is better than in the prior art. In view of the fact that the difference between the SN ratios shown in FIGS. 11 and 12 exerts a great influence on the equivalent Q value, it is expected that the present invention, which uses two weighted codebooks, improves the equivalent Q value more than in the case of using two unweighted codebooks.

As described above, according to the present invention, in the case of encoding vectors through the use of a plurality (M) of codebooks each having L-dimensional vectors, L-dimensional weighting coefficient vectors w.sub.1, . . . , w.sub.M for the codebooks are selected so that the sum of weighting coefficient matrixes W.sub.1, . . . , W.sub.M, each having components of the weighting coefficient vectors as diagonal elements, becomes a constant multiple of the unit matrix. As the result of this, the vector distribution of each codebook is deviated or biased by the L weighting coefficient vectors in such a manner that the individual vectors approach different coordinate axes of the L-dimensional coordinate system (that is, compress component values of other dimensions). In the case where a signal is encoded by a pair of such weighted vectors for each codebook in a manner to minimize the distortion and the labels of the M codebooks corresponding to the weighting coefficient vectors are transmitted, if an error occurs, for example, in one of the labels during transmission over the channel, there is a possibility that an error in the coordinate-axis direction of one dimension is large, but since errors in the coordinate-axis direction of all the other dimensions are compressed, the error of the absolute value of the combined vector does not become so large. Hence, the application of the present invention to the encoding of speech signals is effective in suppressing abnormalities that result from channel errors.

Furthermore, according to the present invention, a plurality of weighted vectors of each codebook are pre-selected for input signal vectors and the distortion by encoding is calculated with respect to such pre-selected weighted vectors alone--this appreciably reduces the amount of calculations involved in the encoding and speeds up the encoding.

The present invention is also applicable to what is called a CELP or VSELP speech coding scheme, in which case the invention can be applied to the vector coding of spectrum envelope parameters, the vector coding of power and the vector coding of each codebook individually or simultaneously.

It will be apparent that many modifications and variations may be effected without departing from the scope of the novel concepts of the present invention.

Claims

What is claimed is:

1. A method of encoding an input vector through the use of M codebooks each having a plurality of labeled representative vectors of the same number of dimensions, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) selecting said representative vectors one by one from said M codebooks; (b) multiplying said representative vectors, each selected from one of said M codebooks, by M predetermined weighting coefficient vectors of the same number of dimensions as those of said representative vectors to generate M weighted representative vectors, said M weighting coefficient vectors having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; (c) adding all of said M weighted representative vectors to generate a combined representative vector; (d) calculating the distance between said input vector and said combined representative vector; (e) repeating steps (a), (b), (c) and (d) to search for and determine said combined representative vector which has the minimum distance between it and said input signal vector; and (f) encoding and outputting labels attached to said representative vectors of said codebooks which provided said combined representative vector of said minimum distance.

2. A method of encoding an input vector through the use of M codebooks each having a plurality of labeled representative vectors of the same number of dimensions, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) multiplying representative vectors, each selected from one of said M codebooks, by M weighting coefficient vectors of the same number of dimensions as those of said representative vectors of said M codebooks to obtain an M groups of weighted representative vectors, and determining M straight lines for approximating said M groups of weighted representative vectors, respectively, said M weighted coefficient vectors each having at least one maximum component in a different dimension; (b) projecting said input vector on said M straight lines on an M-dimensional coordinate system and pre-selecting pluralities of weighted representative vectors adjacent or close to said projections, respectively, to form M subgroups; (c) selecting weighted representative vectors from said M subgroups and adding them to obtain a combined representative vector; (d) calculating the distance between said combined representative vector and said input vector; (e) repeating said steps (c) and (d) for each combination of weighted representative vectors of said M subgroups to calculate said distance; and (f) determining labels in said M codebooks which correspond to said weighted representative vectors of the combination that was minimum in said distance, and outputting said labels as encoded results of said input signal vector.

3. A method of encoding an input vector through the use of M codebooks each having a plurality of labeled representative vectors of the same number of dimensions, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) pregenerating M weighted codebooks each having weighted representative vectors obtained by multiplying representative vectors of said M codebooks by M predetermined weighting coefficient vectors of the same number of dimensions as those of said representative vectors, said M weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; (b) selecting representative vectors one by one from said M weighted codebooks; (c) adding all of said M weighted representative codebooks to generate a combined representative vector; (d) calculating the distance between said input vector and said combined representative vector; (e) repeating steps (b), (c) and (d) to search for and determine said combined representative vector which has the minimum distance between it and said input vector; and (f) encoding and outputting labels attached to representative vectors of said codebooks which provided said combined representative vectors of said minimum distance.

4. A method of encoding an input vector through the use of M codebooks each having a plurality of labeled representative vectors of the same number of dimensions, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) multiplying representative vectors of said M codebooks by M weighting coefficient vectors of the same number of dimensions as those of said representative vectors to obtain an M groups of weighted representative vectors, said M weighting coefficient vectors each having at least one maximum component in a different dimension; (b) determining M straight lines for approximating said M groups of weighted representative vector, respectively; (c) projecting said input vector on said M straight lines on an M-dimensional coordinate system and pre-selecting pluralities of weighted representative vectors adjacent or close to said projections, respectively, to form M subgroups; (d) selecting weighted representative vectors from said M subgroups, respectively, and adding them to obtain a combined representative vector; (e) calculating the distance between said combined representative vector and said input vector; (f) repeating said steps (d) and (e) for each combination of weighted representative vectors of said M subgroups to calculate said distance; and (g) determining labels in said M codebooks which correspond to said weighted representative vectors of the combination which was minimum in said distance, and outputting said labels as encoded results of said input vector.

5. The method of claim 1, 2, 3, or 4 wherein said M weighting coefficient vectors are selected so that the sum of M diagonal matrixes using components of said weighting coefficient vectors as their diagonal elements becomes a constant multiple of the unit matrix.

6. The method of claim 2 or 4 wherein said subgroup determining steps includes a step of selecting a predetermined number of said weighted representative vectors closest to the position of projection of said input vector on each of said M straight lines.

7. The method of claim 2 or 4 wherein said subgoup determining step includes a step of selecting said weighted representative vectors lying within the range of a predetermined distance from the position of projection of said input vector on each of said M straight lines.

8. The method of claim 2 or 4 wherein: said representative vectors and said ewihting coefficient vectors are each an M-dimensional vector; said M weighting coefficient vectors each have at least one maximum component in a different dimension to make said dimension an emphasized dimension, F threshold values are predetermined on the basis of the element values of said emphasized dimensions over the entire range defined by maximum and minimum components of said emphasized dimensions of all of said M weighted representative vector corresponding to said codebooks, by which component values of said emphasized dimensions of said M weighting coefficient vectors are split into F+1 regions, and a plurality of said weighted representative vectors are assigned to each of said regions, F being an integer equal to or greater than 1; and said subgroup determining step is a step of comparing values in said emphasized dimensions of said input vector projected on said M straight lines, respectively, with said threshold values to determine the regions to which said values in said emphasized dimensions belong, and selecting said weighted representative vectors belonging to said determined regions to form said subgroups.

9. A method of encoding the vector of an input acoustic signal through the use of M excitation source codebooks each having a plurality of labeled excitation vectors, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) calculating spectrum envelope parameters of said vector of said input acoustic signal, quantizing said spectrum envelope parameters and setting said quantized parameters as filter coefficients of a synthesis filter; (b) selecting M excitation vectors from said M excitation source codebooks so that distortion of an acoustic signal synthesized by said synthesis filter, from said input acoustic signal, is minimized; (c) selecting one gain vector from each of M gain codebooks each having a plurality of labeled M-dimensional gain vectors; (d) multiplying said gain vectors selected from said M gain codebooks by M predetermined M-dimensional weighting coefficient vectors, respectively, to generate M weighted gain vectors, said M weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; (e) adding all of said M weighted gain vectors to obtain a combined gain vector, and defining first to M-th components of said combined gain vector as first to M-th gains; (f) providing said first to M-th gains to said M determined excitation vectors, respectively; (g) adding said M gain-provided excitation vectors and exciting said synthesis filter by said added output to generate a synthesized acoustic signal; (h) calculating distortion of said synthesized acoustic signal from said input acoustic signal; (i) repeating steps (c) to (h) for every combination of respective gain vectors of said M gain codebooks to search for and determine M gain vectors that minimize said distortion, and obtaining M gain labels corresponding to said M gain vectors; and (j) outputting, as at least one part of encoded results of said input acoustic signal, said M gain labels obtained in said step (i) and the labels of said excitation codebooks obtained in said step (b).

10. A method of encoding the vector of an input acoustic signal through the use of M excitation source codebooks each having a plurality of labeled excitation vectors, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) calculating spectrum envelope parameters of said vector of said input acoustic signal, quantizing said spectrum envelope parameters and setting said quantized parameters as filter coefficients of a synthesis filter; (b) selecting M excitation vectors from said M excitation source codebooks, respectively, so that distortion of synthesized speech by said synthesis filter, from said input acoustic signal, is minimized; (c) providing first to M-th gains to said M determined excitation vectors, respectively, adding them to generate an excitation signal vector for excitation of said synthesis filter to generate said synthesized acoustic signal and, for each combination of said excitation vectors, searching for optimum values of said first to M-th gains which minimize said distortion of said synthesized acoustic signal from said input acoustic signal; (d) multiplying respective gain vectors of M gain codebooks each having a plurality of labeled M-dimensional gain vectors by M predetermined M-dimensional weighting coefficient vectors for said M gain codebooks to obtain M groups of weighted gain vectors, and determining M straight lines for approximating said M groups of weighted gain vectors, said M weighting coefficient vectors each having at least one maximum component in a different dimension; (e) projecting a vector, composed of said optimum first to M-th gains, on said M straight lines on an M-dimensional coordinate system, and pre-selecting from said M groups pluralities of weighted gain vectors adjacent or close to said projections to form M subgroup; (f) selecting said weighted representative vectors one by one from said M subgroups, adding them to obtain an M-dimensional combined gain vector, and defining first to M-th gain components of said combined gain vector as first to M-th gains; (g) multiplying said M excitation vectors, determined in step (b), by said first to M-th gain components of said combined gain vector, respectively, and adding them to generate an excitation signal vector; (h) applying said excitation signal vector, generated in said step (g), to said synthesis filter to synthesize an acoustic signal and calculating distortion of said acoustic signal from said input acoustic signal; (i) repeating said steps (f), (g) and (h) for every combination of weighted representative vectors of said M subgroups to calculate said distortion, and determining gain labels in said M codebooks which correspond to said combination of weighted gain vectors which was minimum in said distortion; and (j) outputting labels of said M excitation vectors and said gain labels as at least one part of encoded results of said vector of said input acoustic vector.

11. A method of encoding the vector of an input acoustic signal thorugh the use of M excitation source codebooks each having a plurality of labeled excitation vectors, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) calculating spectrum envelope parameters of said vector of said input acoustic signal, quantizing said spectrum envelope parameters and setting said quantized parameters as filter coefficients of a synthesis filter; (b) selecting said excitation vectors one by one from said M excitation source codebooks so that distortion of a synthesized acoustic signal by said synthesis filter, from said input acoustic signal, is minimized; (c) pregenerating M weighted gain codebooks each having M groups of labeled weighted gain vectors obtained by multiplying M-dimensional gain vectors of M gain codebooks by M predetermined M-dimensional weighting coefficient vectors, respectively, said M weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; (d) selecting representative weighted gain vectors one by one from said M weighted codebooks; (e) adding all of said M weighted gain vectors to generate a combined gain vector, and defining first to M-th components of said combined gain vector as first to M-th gains; (f) providing said first to M-th gains to said M excitation vectors respectively; (g) adding said M gain-provided excitation vectors, and exciting said synthesis filter by said added output to generate a synthesized acoustic signal; (h) calculating distortion of said synthesized acoustic signal from said input acoustic signal; (i) repeating said steps (d) to (h) for every combination of said weighted gain vectors of said M weighted codebooks to search for and determine M weighted gain vectors which minimize said distortion, and obtaining M labels corresponding to said M weighted gain vectors; and (j) outputting, as at least one part of encoded results of said input acoustic signal, said M labels of said M weighted gain codebooks obtained in said step (i) and labels of said M excitation codebooks obtained in said step (b).

12. A method of encoding the vector of an input acoustic signal through the use of M excitation source codebooks each having a plurality of labeled excitation vectors, said M being an integer equal to or greater than 2, said method comprising the steps of: (a) calculating, spectrum envelope parameters of said vector of said input acoustic signal, quantizing said spectrum envelope parameters and setting said quantized parameters as filter coefficients of a synthesis filter; (b) selecting said excitation vectors one by one from said M excitation source codebooks so that distortion of a synthesized acoustic signal by said synthesis filter, from said input acoustic signal, is minimized; (c) providing first to M-th gains to said selected M excitation vectors, adding them to generate an excitation signal vector, and searching for and determining optimum values of said first to M-th gains such that distortion of a synthesized acoustic signal from said synthesis filter excited by said excitation signal vector, from said input acoustic signal, is minimized; (d) pregenerating M weighted codebooks each having M groups of labeled gain vectors obtained by multiplying M-dimensional gain vectors of M gain codebooks by M predetermined M-dimensional weighting coefficient vectors, respectively, said M weighting coefficient vectors each having at least one maximum component in a different dimension, and determining M straight lines for approximating said M groups of weighted gain vectors, respectively; (e) projecting a vector, composed of said optimum first to M-th gains, said M straight lines on an M-dimensional coordinate system, and pre-selecting from said M groups pluralities of weighted gain vectors adjacent or close to said projections to form M subgroups; (f) selecting said weighted gain vectors one by one from said M subgroups, adding them to obtain an M-dimensional combined gain vector, and defining first to M-th gain components of said combined gain vector as first to M-th gains, (g) multiplying said M excitation vectors, determined in said step (b), by said first to M-th gain components of said combined gain vector, and adding them to generate an excitation signal vector; (h) applying said excitation signal vector to said synthesis filter to synthesize an acoustic signal, and calculating its distortion from said input acoustic signal; (i) repeating said steps (f), (g) and (h) for every combination of weighted representative vectors of said M subgroups to calculate said distortion, and searching for and determining gain labels in said M codebooks which correspond to weighted gain vectors of the combination which was minimum in said distortion; and (j) outputting labels of said M determined excitation vectors and said determined gain labels as at least one part of encoded results of said vector of said input acoustic signal vector.

13. The method of claim 9, 10, 11, or 12 wherein said M weighting coefficient vectors are selected so that the sum of M diagonal matrixes using components of said M weighting coefficient vectors as diagonal elements becomes a constant multiple of the unit matrix.

14. The method of claim 10 or 12 wherein said subgroup determining step includes a step of selecting a predetermined number of said weighted gain vectors closest to the position of projection of a vector, composed of said first to M-th gains, on said M straight lines, respectively.

15. The method of claim 10 or 12 wherein said subgroup determining step includes a step of selecting said weighted gain vectors lying within the range of a predetermined distance from the position of projection of a vector, composed of said said first to M-th gains, on said M straight lines, respectively.

16. The method of claim 10 or 12 wherein: letting said dimension corresponding to the maximum component of said each weighting coefficient vector be defined as an emphasized dimension, F threshold values are predetermined over the entire range defined by maximum and minimum values of said components in said emphasized dimensions of all of said weighted gain vectors corresponding to each of said gain codebooks, on the basis of the component values in said emphasized dimensions, by which the component values in said emphasized dimensions of said weighted gain vectors are split into F+1 regions, and a plurality of said weighted gain vectors are assigned to each of said regions, said F being an integer equal to or greater than 1; and said subgroup determining step is a step of comparing values in said emphasized dimensions of a vector composed of said optimum first to M-th gains and projected on said M straight lines, respectively, with said threshold values to determine the regions to which said component values in said emphasized dimensions belong, and selecting said weighted gain vectors belonging to said determined region to form said subgroups.

17. An encoder for encoding the vector of an input signal through the use of a plurality of codebooks, comprising: M codebooks each having a plurality of labeled representative vectors; multiplying means for multiplying representative vectors selected from said M codebooks by M predetermined but different weighting coefficient vectors to generate weighted representative vectors, said M being an integer equal to or greater than 2 and said M weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; a vector combining part for adding said M weighted vectors to generate a combined representative vector; a distance calculating part for calculating the distance between said combined representative vector from said vector combining part and said input vector; and a control part for operating said vector combining part and said distance calculating part while changing the selection of weighted representative vectors from said M weighted codebooks, for determining a combination of weighted representative vectors of said M codebooks which minimizes said distance, and for outputting their corresponding labels as encoded results of the vector of said input signal.

18. An encoder for encoding the vector of an input signal through the use of a plurality of codebooks, comprising: M weighted representative codebooks each having M groups of weighted representative vectors generated by multiplying representative vectors of M groups by M different weighting coefficient vectors, respectively, said M being an integer equal to or greater than 2 and said weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; a vector combining part for adding M weighted vectors respectively selected from said M weighted codebooks to generate a combined representative vector; a distance calculating part for calculating the distance between said combined representative vector from said vector combining part and the vector of said input signal; and a control part for operating said vector combining part and said distance calculating part while changing the selection of weighted representative vectors from said M weighted codebooks, for determining a combination of weighted representative vectors of said M weighted codebooks which minimizes said distance, and for outputting their corresponding labels as encoded results of the vector of said input signal.

19. The encoder of claim 17 or 18 wherein said M weighting coefficient vectors are determined so that the sum of M diagonal matrixes using, as their diagonal elements, components of said M weighting coefficient vectors becomes a constant multiple of the unit matrix.

20. The encoder of claim 17 or 18 wherein said control part includes means which determines M straight lines closest to said M groups of weighted representative vectors, respectively, pre-selects from said M weighted representative codebooks, as subgroups, pluralities of weighted representative vectors adjacent or close to the points of projection of the vector of said input signal on said M straight lines, controls said distance calculating part to calculate said distance for every combination of M weighted representative vectors selected from said M subgroups, and determines the combination of weighted representative vectors which minimizes said distance.

21. An encoder for encoding the vector of an input acoustic signal through the use of a plurality of codebooks, comprising: M excitation source codebooks each having a plurality of excitation vectors, said M being an integer equal to or greater than 2; first to M-th gain providing parts for multiplying said M excitation vectors from said M excitation source codebooks by first to M-th gains, respectively; an adding part for adding said M gain-provided excitation vectors from said first to M-th gain providing parts to generate an excitation signal vector; filter coefficient generating means which analyzes said input acoustic signal to obtain parameters representing its spectrum envelope and quantizes said parameters to generate filter coefficients; a synthesis filter which has said filter coefficients set therein and is excited by said excitation signal vector to synthesize an acoustic signal; distortion calculating means for calculating the difference between said input acoustic signal and said synthesized acoustic signal and for calculating from said difference the distortion of said synthesized acoustic signal from said input acoustic signal; M gain codebooks each having a plurality of labeled M-dimensional gain vectors; multiplying means for multiplying gain vectors respectively selected from said M gain codebooks by M predetermined M-dimensional weighting coefficient vectors to generate weighted gain vectors, said M weighting coefficient vectors each having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; a vector combining part for adding said M weighted gain vectors to generate an M-dimensional combined gain vector and for setting first to M-th components of said combined gain vector as first to M-th gains in said first to M-th gain providing parts, respectively; and control means for controlling the selection of said M excitation vectors from said M excitation source codebooks, for determining a combination of said M excitation vectors which minimizes said distortion of said synthesized acoustic signal from said input acoustic signal, for calculating said distortion by calculating means for every combination of gain vectors respectively selected from said M gain codebooks to determine a combination of M gain vectors which minimizes said distortion, and for outputting labels of said M gain codebooks corresponding to said M determined gain vectors and labels corresponding to said M determined excitation vectors as at least one part of encoded results of said input acoustic signal.

22. An encoder for encoding the vector of an input acoustic signal through the use of a plurality of codebooks, comprising: M excitation source codebooks each having a plurality of excitation vectors, said M being an integer equal to or greater than 2; first to M-th gain providing parts for multiplying said M excitation vectors from said M excitation source codebooks, respectively; an adding part for adding said M gain-provided excitation vectors from said first to M-th gain providing parts to generate an excitation signal vector; filter coefficient generating means which analyzes said input acoustic signal to obtain parameters representing its spectrum envelope and quantizes said parameters to generate filter coefficients; a synthesis filter which has said filter coefficients set therein and is excited by said excitation signal vector to synthesize an acoustic signal; distortion calculating means which calculates the difference between said input acoustic signal and said synthesized acoustic signal and calculates from said difference the distortion of said synthesized acoustic signal from said input acoustic signal; M weighted gain codebooks each having M groups of weighted gain vectors generated by multiplying M groups of M-dimensional gain vectors by M-dimensional weighting coefficient vectors, said M weighting coefficient vectors having at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector being different from at least one of the other components of said weighting coefficient vector; a vector combining part which adds M weighted vectors respectively selected from said M weighted codebooks to generate a combined representative vector and sets first to M-th components of said combined gain vector as first to M-th gains in said first to M-th gain providing parts, respectively; and control means which controls the selection of said M excitation vectors from said M excitation source codebooks, determines a combination of said M excitation vectors which minimizes said distortion of said synthesized acoustic signal from said input acoustic signal, obtains by calculating means said distortion for each combination of weighted gain vectors selected from said M weighted gain codebooks, determines a combination of M weighted gain vectors which minimizes said distortion, and outputs labels of said M weighted gain codebooks corresponding to said M determined weighted gain vectors and labels corresponding to said M determined excitation vectors as at least one part of encoded results of said input acoustic signal.

23. The encoder of claim 21 or 22 wherein said M weighting coefficient vectors are selected so that the sum of M diagonal matrixes using the components of said M weighting coefficient vectors as their diagonal elements becomes a constant multiple of the unit matrix.

24. The encoder of claim 21 or 22 wherein said control means includes means which: determines M straight lines closest to weighted gain vectors of said M groups, respectively; when said M excitation vectors are being determined, controls said first to M-th gains to determine their optimum values which minimize said distortion; pre-selects, as subgroups, from weighted gain vectors of said M groups a plurality of weighted gain vectors adjacent or close to the points of projection of a vector, composed of said optimum first to M-th gains, on said M straight lines, respectively; and controls said distortion calculating means to calculate said distortion for each combination of M weighted gain vectors respectively selected from said M subgroups and determines a combination of weighted gain vectors which minimizes said distortion.

25. A decoder for decoding an inputted code by referring to a plurality of codebooks, comprising: M codebooks each having a plurality of labeled representative vectors, said M being an integer equal to or greater than 2; multiplying means which selects representative vectors corresponding to respective labels in said input code from the corresponding ones of said codebooks and multiplies said selected representative vectors by M weighting coefficient vectors predetermined for said M codebooks to generate M weighted representative vectors; and a vector combining part which combines said M weighted representative vectors into a reconstructed vector; wherein said M weighting coefficient vectors each has at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector is different from at least one of the other components of said weighting coefficient vector.

26. A decoder for decoding an inputted code by referring to a plurality of codebooks, comprising: M weighted codebooks each having a plurality of labeled weighted representative vectors, said M being an integer equal to or greater than 2; and a vector combining part which selects from said M weighted codebooks weighted representative vectors corresponding to M labels in said input code and combines them into a reconstructed vector; wherein said M weighting coefficient vectors each have at least one maximum component in a different dimension and at least one of the components of each weighting coefficient vector is different from at least one of the other components of said weighting coefficient vector.

27. The decoder of claim 25 or 26, wherein said M weighting coefficient vectors are selected so that the sum of M diagonal matrixes using components of said M weighting coefficient vectors as their diagonal elements become a constant multiple of the unit matrix.

Patent Citations (5)

Patent	Date	Inventor
US5086471	1992-02-01	Tanaka et al.
US5274741	1993-12-01	Taniguchi et al.
US5396576	1995-03-01	Miki et al.
US5677986	1997-10-01	Amada et al.
US5687284	1997-11-01	Serizawa et al.

Abstract

Description