US 5,774,849 AGrant
Method and Apparatus for Generating Frame Voicing Decisions of an Incoming Speech Signal
Issue Date:1998-06-30
•14 Claims
•2 Drawing Sheets
Abstract
A method is disclosed for generating frame voicing decisions for an incoming speech signal having periods of active voice and non-active voice for a speech encoder in a speech communication system. The method first extracts a predetermined set of parameters from the incoming speech signal for each frame and then makes a frame voicing decision of the incoming speech signal for each frame according to a set of difference measures extracted from the predetermined set of parameters. The predetermined set of extracted parameters comprises a description of the spectrum of the incoming speech signal based on line spectral frequencies ("LSF"). Additional parameters may include full band energy, low band energy and zero crossing rate. The way to make a frame voicing decision of the incoming speech signal for each frame according to the set of difference measures is by finding a union of sub-spaces with each sub-space being described by a linear function of at least a pair of parameters from the predetermined set of parameters.
Metadata
Assignee
- Rockwell International Corporation
Inventors
- Adil Benyassine
- Eyal Shlomot
Application Information
Application Number:US 589509&
Filing Date:1996-01-22
Priority Date:1996-01-22
Art Unit:245
Classifications
IPC:
G10L 506
Field of Search:
3957042.22-2.25;2.28;2.35-2.37;2.42;2.55;2.6213-216;219;226-228;233;246;251
Patent Drawings (2 sheets)
Description
Related Application
The present invention is related to another pending Patent Application, entitled USAGE OF VOICE ACTIVITY DETECTION FOR EFFICIENT CODING OF SPEECH, filed on the same date, with Ser. No. 589,321, and also assigned to the present assignee. The disclosure of the Related Application is incorporated herein by reference.
1. Field of Invention
The present invention relates to speech coding in communication systems and more particularly to dual-mode speech coding schemes.
2. Art Background
Modern communication systems rely heavily on digital speech processing in general and digital speech compression in particular. Examples of such communication systems are digital telephony trunks, voice mail, voice annotation, answering machines, digital voice over data links, etc.
A speech communication system is typically comprised of an encoder, a communication channel and a decoder. At one end, the speech encoder converts a speech which has been digitized into a bit-stream. The bit-stream is transmitted over the communication channel (which can be a storage medium), and is converted again into a digitized speech by the decoder at the other end.
The ratio between the number of bits needed for the representation of the digitized speech and the number of bits in the bit-stream is the compression ratio. A compression ratio of 12 to 16 is achievable while keeping a high quality of reconstructed speech.
A considerable portion of the normal speech is comprised of silence, up to an average of 60% during a two-way conversation. During silence, the speech input device, such as a microphone, picks up the environment noise. The noise level and characteristics can vary considerably, from a quite room to a noisy street or a fast moving car. However, most of the noise sources carry less information than the speech and hence a higher compression ratio is achievable during the silence periods.
In the following description, speech will be denoted as "active-voice" and silence or background noise will be denoted as "non-active-voice".
The above argument leads to the concept of dual-mode speech coding schemes, which are usually also variable-rate coding schemes. The different modes of the input signal (active-voice or non-active-voice) are determined by a signal classifier, which can operate external to, or within, the speech encoder. A different coding scheme is employed for the non-active-voice signal, using less bits and resulting in an overall higher average compression ratio. The classifier output is binary, and is commonly called "voicing decision." The classifier is also commonly called Voice Activity Detector ("VAD").
The VAD algorithm operates on frames of digitized speech. The frame duration usually coincided with the frames of the speech coder. For each frame, the VAD is using a set of parameters, extracted from the input speech signal, to make the voicing decision. These parameters usually include energies and spectral parameters. A typical VAD operation is based on the comparison of such set of instantaneous parameters to a set of parameters which represents the background noise characteristics. Since the noise characteristics are unknown beforehand, they are usually modeled as a running average estimates of the energies and the spectral parameters during non-active voice frames.
A schematic representation of a speech communication system which employs a VAD for a higher compression rate is depicted in FIG. 1. The input to the speech encoder (110) is the digitized incoming speech signal (105). For each frame of digitized incoming speech signal the VAD (125) provides the voicing decision (140), which is used as a switch (145) between the active-voice encoder (120) and the non-active-voice encoder (115). Either the active-voice bit-stream (135) or the non-active-voice bit-stream (130), together with the voicing decision (140) are transmitted through the communication channel (150). At the speech decoder (155) the voicing decision is used in the switch (160) to select the non-active-voice decoder (165) or the active-voice decoder (170). For each frame, the output of either decoders is used as the reconstructed speech (175).
Summary of the Present Invention
A method is disclosed for generating frame voicing decisions for an incoming speech signal having periods of active voice and non-active voice for a speech encoder in a speech communication system. The method first extracts a predetermined set of parameters from the incoming speech signal for each frame and then makes a frame voicing decision of the incoming speech signal for each frame according to a set of difference measures extracted from the predetermined set of parameters. The predetermined set of extracted parameters comprises a description of the spectrum of the incoming speech signal based on line spectral frequencies ("LSF"). Additional parameters may include full band energy, low band energy and zero crossing rate. The way to make a frame voicing decision of the incoming speech signal for each frame according to the set of difference measures is by finding a union of sub-spaces with each sub-space being described by a linear function of at least a pair of parameters from the predetermined set of parameters.
Brief Description of the Drawings
Additional features, objects and advantages of the present invention will become apparent to those skilled in the art from the following description, wherein:
FIG. 1 is a schematic representation of a speech communication system using a VAD.
FIG. 2 is a process flowchart of the VAD in accordance with the present invention.
Detailed Description of the Preferred Embodiment
A voice activity detection method and apparatus for a speech communication system is disclosed. In the following description, the present invention is described in terms of functional block diagrams and process flow charts, which are the ordinary means for those skilled in the art of speech coding to communicate among themselves. The present invention is not limited to any specific programming languages, since those skilled in the art can readily determine the most suitable way of implementing the teaching of the present invention.
A. General
In the preferred embodiment, a Voice Activity Detection (VAD) module is used to generate a voicing decision which switches between an active-voice encoder/decoder and a non-active-voice encoder/decoder. The binary voicing decision is either 1 (TRUE) for the active-voice or 0 (FALSE) for the non-active-voice.
The VAD flowchart of operation is given in FIG. 2. The VAD operates on frames of digitized speech. The frames are processed in time order and are consecutively numbered from the beginning of each conversation/recording.
At the first block (200), four parametric features are extracted from the input signal. Extraction of the parameters can be shared with the active-voice encoder module (120) and the non-active-voice encoder module (115) for computational efficiency. The parameters are the frame full band energy, the frame low-band energy, a set of spectral parameters called Line Spectral Frequencies ("LSF") and the frame zero crossing rate.
If the frame number is less than N.sub.i, an initialization block (205) for the average frame energy takes place, and the voicing decision is forced to 1.
If the frame number is equal to N.sub.i, the average frame energy is updated at block (215) and an initialization block (220) for the running averages of the background noise characteristics takes place.
If the frame number is larger than N.sub.i, the average frame energy update block (215) takes place.
At the next block (230) a set of difference parameters is calculated. This set is generated as difference measures between the current frame parameters and the running averages of the background noise characteristics. Four difference measures are calculated:
a spectral distortion
an energy difference
a low-band energy difference
a zero-crossing difference
The initial voicing decision is made at the next block (235), using multi-boundary decision regions in the space of the four difference measures. The active-voice decision is given as the union of the decision regions and the non-active-voice decision is its complementary logical decision.
The initial decision does not take into account neighboring past frames, which can help in decision smoothing, considering the stationarity of the speech signal. Energy consideration, together with neighboring past frames decisions, are used in block (240) for decision smoothing.
The difference parameters were generated at block (230) as a difference between the current frame parameters and the running averages of the background noise characteristics. These running averages are updated in block (250). Since the running averages are updated only in the presence of background noise, and not in the presence of speech, few energy thresholds are tested at block (245), and an update takes place only if the thresholds are met.
B. Parameters Extraction
For each frame a set of parameters is extracted from the speech signal. The parameters extraction module can be shared between the VAD (125), the active-voice encoder (120) and the non-active-voice encoder (115). The primary set of parameters is the set of autocorrelation coefficients, which is derived according to ITU-T, Study Group 15 Contribution--Q. 12/15, Draft Recommendation G.729, Jun. 8, 1995, Version 5.0, or DIGITAL SPEECH--Coding for Low Bit Rate Communication Systems by A.M. Kondoz, John Wiley & Son, 1994, England. The set of autocorrelation coefficients will be denoted by {R(i)}.sub.i=0.sup.q.
1) Line Spectral Frequencies (LSF)
A set of linear prediction coefficients is derived from the autocorrelation and a set of {LSF.sub.i }.sub.i=1.sup.p is derived from the set of linear prediction coefficients, as described in ITU-T, Study Group 15 Contribution--Q. 12/15, Draft Recommendation G.729, Jun. 8, 1995, Version 5.0, or DIGITAL SPEECH--Coding for Low Bit Rate Communication Systems by A.M. Kondoz, John Wiley & Son, 1994, England.
2) Full Band Energy
The full band energy E.sub.f is the logarithm of the normalized first autocorrelation coefficient R(0):
where N is a predetermined normalization factor.
3) Low Band Energy
The low band energy E.sub.1 measured on 0 to F.sub.l Hz band, is computed as follows:
where h is the impulse response of an FIR filter with cutoff frequency at F.sub.l Hz, R is the Toeplitz autocorrelation matrix with the autocorrelation coefficients on each diagonal, and N is a predetermined normalization factor.
4) Zero Crossing Rate
Normalized zero-crossing rate ZC for each frame is calculated by: ##EQU1## where {x(i)} is the pre-processed input speech signal and M is a predetermined number.
C. Average Energy Initialization And Update
The running average for the frame energy is denoted by E. The initial value for E, calculated at block (205), is: ##EQU2##
This running average is updated for each frame after the N.sub.i frame, at block (215), using:
D. Initialization Of The Running Averages Of The Background Noise Characteristics
The spectral parameters of the background noise, denoted by {LSF.sub.i }.sub.i=1.sup.p are initialized to the constant values {LSF.sub.i.sup.0 }.sub.i=1.sup.p. The average of the background noise zero-crossings, denoted by ZC is initialized to the constant value ZC.sub.0.
At block (220), if the frame number is equal to N.sub.i, the running averages of the background noise full band energy, denoted by E.sub.f, and the background noise low-band energy, denoted by E.sub.l, are initialized. The initialization procedure uses the initial value of the running average of the frame energy-E, which can also be modified by this initialization.
The initialization procedure is illustrated as follows: ##EQU3## E. Generating The Difference Parameters
Four difference measures are generated from the current frame parameters and the running averages of the background noise at block (230).
1) The Spectral Distortion .DELTA.S
The spectral distortion measure is generated as the sum of squares of the difference between the current frame {LSF.sub.i }.sub.i=1.sup.p vector and the running averages of the background noise {LSF.sub.i }.sub.i=1.sup.p : ##EQU4## 2) The Full-Band Energy Difference .DELTA.E.sub.f
The full-band energy difference measure is generated as the difference between the current frame energy, E.sub.f, and the running average of the background noise energy, E.sub.f :
3) The Low-Band Energy Difference .DELTA.E.sub.l
The low-band energy difference measure is generated as the difference between the current frame low-band energy, E.sub.l, and the running average of the background noise energy, E.sub.l :
4) The Zero-Crossing Difference .DELTA.ZC
The zero-crossing difference measure is generated as the difference between the current frame zero-crossing rate, ZC, and the running average of the background noise zero-crossing rate, ZC:
F. Multi-Boundary Initial Voicing Decision
The four difference parameters lie in the four dimensional Euclidean space. Each possible vector of difference parameters defines a point in that space. A predetermined decision region of the four dimensional Euclidean space, bounded by three dimensional hyper-planes, is defined as non-active-voice region, and its complementary is defined as active-voice region. Each of the three dimensional hyper-planes is defining a section of the boundary of that decision region. Moreover, for the simplicity of the design, each hyper-plane is perpendicular to some two axes of the four dimensional Euclidean space.
The initial voicing decision, obtained in block (235), is denoted by I.sub.VD. For each frame, if the vector of the four difference parameters lies within the non-active-voice region, the initial voicing decision is 0 ("FALSE"). If the vector of the four difference parameters lies within the active-voice region, the initial voicing decision is 1 ("TRUE"). The 14 boundary decisions in the four-dimensional space are defined as follows:
1) if .DELTA.S>a.sub.1 .multidot..DELTA.ZC+b.sub.1 then I.sub.VD =1
2) if .DELTA.S>a.sub.2 .multidot..DELTA.ZC+b.sub.2 then I.sub.VD =1
3) if .DELTA.S>a.sub.3 then I.sub.VD =1
4) if .DELTA.E.sub.f <a.sub.4 .multidot..DELTA.ZC+b.sub.4 then I.sub.VD =1
5) if .DELTA.E.sub.f <a.sub.5 .multidot..DELTA.ZC+b.sub.5 then I.sub.VD =1
6) if .DELTA.E.sub.f <a.sub.6 then I.sub.VD =1
7) if .DELTA.E.sub.f <a.sub.7 .multidot..DELTA.S+b.sub.7 then I.sub.VD =1
8) if .DELTA.S>b.sub.8 then I.sub.VD =1
9) if .DELTA.E.sub.l <a.sub.9 .multidot..DELTA.ZC+b.sub.9 then I.sub.VD =1
10) if .DELTA.E.sub.l <a.sub.10 .multidot..DELTA.ZC+b.sub.10 then I.sub.VD =1
11) if .DELTA.E.sub.l <b.sub.11 then I.sub.VD =1
12) if .DELTA.E.sub.l <a.sub.12 .multidot..DELTA.S+b.sub.12 then I.sub.VD =1
13) if .DELTA.E.sub.l >a.sub.13 .multidot..DELTA.E.sub.f +b.sub.13 then I.sub.VD =1
14) if .DELTA.E.sub.l <a.sub.14 .multidot..DELTA.E.sub.f +b.sub.14 then I.sub.VD =1
Geometrically, for each frame, the active-voice region is defined as the union of all active-voice sub-spaces, and the non-active-voice region is its complementary region of intersection of all non-active-voice sub-spaces.
G. Voicing Decision Smoothing
The initial voicing decision is smoothed to reflect the long term stationary nature of the speech signal. The smoothing is done in three stages. The smoothed voicing decision of the frame, the previous frame and frame before the previous frame are denoted by S.sub.VD.sup.0, S.sub.VD.sup.-1 and S.sub.VD.sup.-2, respectively. S.sub.VD.sup.-1 is initialized to 1, and S.sub.VD.sup.-2 is initialized to 1.
For start S.sub.VD.sup.0 =I.sub.VD. The first smoothing stage is:
For the second smoothing stage define one Boolean parameter F.sub.VD.sup.-1. F.sub.VD.sup.-1 is initialized to 1. Also define a counter denoted by C.sub.e, which is initialized to 0. Denote the energy of the previous frame by E.sub.-1. The second smoothing stage is: ##EQU5##
For the third smoothing stage define the counter C.sub.s which is initialized to 0. Also define the Boolean parameter F.sub.VD * which is initialized to 0.
The third smoothing stage is:
if S.sub.VD.sup.0 =0
C.sub.s =C.sub.s +1
if S.sub.VD.sup.0 =1 and C.sub.s >L.sub.1 and E-E.ltoreq.T.sub.4 *
S.sub.VD.sup.0 =0
C.sub.s =0
F.sub.VD *=1
if C.sub.s >L.sub.2 and F.sub.VD *=1
F.sub.VD *=0
if S.sub.VD.sup.0 =1
C.sub.S =0
H. Updating The Running Averages Of The Background Noise Characteristics
The running averages of the background noise characteristics are updated at the last stage of the VAD algorithm. At block (245) the following conditions are tested and the updating takes place only if these conditions are met:
If the conditions for update are met, the running averages of the background noise characteristics are updated using first order AR update. A different AR coefficient is used for each parameter. Let .beta..sub.E.sbsb.f be the AR coefficient for the update of E.sub.f, .beta..sub.E.sbsb.f be the AR coefficient for the update of E.sub.l, .beta..sub.ZC be the AR coefficient for the update of ZC and .beta..sub.LSF be the AR coefficient for the update of {LSF.sub.i }.sub.i=1.sup.p. The number of frames which were classified as non-active-voice is counted by C.sub.n. The coefficients .beta..sub.E.sbsb.f, .beta..sub.E.sbsb.l, .beta..sub.ZC, and .beta..sub.LSF depend on the value of C.sub.n. The AR update is done at block (250) according to:
At the final stage E.sub.f is updated according to:
Although only a few exemplary embodiments of this invention have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of this invention. Accordingly, all such modifications are intended to be included within the scope of this invention as defined in the following claims. In the claims, means-plus-function clauses are intended to cover the structures described herein as performing the recited function and not only structural equivalents but also equivalent structures. Thus although a nail and a screw may not be structural equivalents in that a nail employs a cylindrical surface to secure wooden parts together, whereas a screw employs a helical surface, in the environment of fastening wooden parts, a nail and a screw may be equivalent structures.
Claims
We claim:
1. In a speech communication system comprising: (a) a speech encoder for receiving and encoding an incoming speech signal to generate a bit stream for transmission to a speech decoder; (b) a communication channel for transmission; and (c) a speech decoder for receiving the bit stream from the speech encoder to decode the bit stream to generate a reconstructed speech signal, said incoming speech signal comprising periods of active voice and non-active voice, a method for generating frame voicing decisions, comprising the steps of: a) extracting a predetermined set of parameters from said incoming speech signal for each frame; b) making a frame voicing decision of the incoming speech signal for each frame according to said predetermined set of parameters, wherein said predetermined set of parameters in said Step a) comprises a a spectral difference between said incoming speech signal and ambient background noise based on LSF.
2. In a speech communication system comprising: (a) a speech encoder for receiving and encoding an incoming speech signal to generate a bit stream for transmission to a speech decoder; (b) a communication channel for transmission; and (c) a speech decoder for receiving the bit stream from the speech encoder to decode the bit stream to generate a reconstructed speech signal, said incoming speech signal comprising periods of active voice and non-active voice, a method for generating frame voicing decisions, comprising the steps of: a) extracting a predetermined set of parameters from said incoming speech signal for each frame; b) making a frame voicing decision of the incoming speech signal for each frame according to said predetermined set of parameters, wherein said predetermined set of parameters in said Step a) comprises a difference between the zero-crossing rate of said incoming speech signal and the zero-crossing rate of ambient background noise.
3. A method according to claim 2, wherein said predetermined set of parameters further comprises a description of a spectral difference between said incoming speech signal and ambient background noise based on LSF.
4. A method according to claim 3, wherein said predetermined set of parameters further comprises differences in full band energy and low band energy.
5. A method according to claim 4, said Step b) of making the frame voicing decision being based on a selective combination of difference measures of at least 2 of the following parameters: i) LSF; ii) zero-crossing rate; iii) full band energy; iv) low band energy, where at least 1 of the selected parameters is either LSF or zero-crossing rate.
6. A method according to claim 5, further comprising a step of: keeping running averages of difference measures of said at least 2 parameters in said selective combination according to a set of predetermined thresholds.
7. A method according to claim 6, wherein said Step b) makes a frame voicing decision of the incoming speech signal for each frame according to said set of difference measures, based on a union of sub-spaces with each sub-space being described by a linear function of at least a pair of difference measures from said set of difference measures.
8. In a speech communication system comprising: (a) a speech encoder for receiving and encoding an incoming speech signal to generate a bit stream for transmission to a speech decoder; (b) a communication channel for transmission; and (c) a speech decoder for receiving the bit stream from the speech encoder to decode the bit stream to generate a reconstructed speech signal, said incoming speech signal comprising periods of active voice and non-active voice, a method for generating frame voicing decisions, comprising the steps of: a) extracting a predetermined set of parameters from said incoming speech signal for each frame; b) making a frame voicing decision of the incoming speech signal for each frame according to said predetermined set of parameters, based on a union of sub-spaces with each sub-space being described by a linear function of at least a pair of parameters from said predetermined set of parameters.
9. In a speech communication system comprising: (a) a speech encoder for receiving and encoding an incoming speech signal to generate a bit stream for transmission to a speech decoder; (b) a communication channel for transmission; and (c) a speech decoder for receiving the bit stream from the speech encoder to decode the bit stream to generate a reconstructed speech signal, said incoming speech signal comprising periods of active voice and non-active voice, an apparatus coupled to said speech encoder for generating frame voicing decisions, comprising: a) extraction means for extracting a predetermined set of parameters from said incoming speech signal for each frame, wherein said predetermined set of parameters comprises a spectral difference between said incoming speech signal and ambient background noise based on LSF; and b) VAD means for making a voicing decision of the incoming speech signal for each frame according to said predetermined set of parameters, such that a bit stream for a period of either active voice or non-active voice is generated by said speech encoder.
10. An apparatus according to claim 9, wherein said predetermined set of parameters further comprises a description of the incoming speech signal based on a difference between the zero-crossing rate of said incoming speech signal and the zero-crossing rate of ambient background noise.
11. An apparatus according to claim 10, wherein said predetermined set of parameters further comprises differences in full band energy and low band energy.
12. An apparatus according to claim 11, wherein said VAD means makes the frame voicing decision being based on a selective combination of difference measures of at least 2 of the following parameters: i) LSF; ii) zero-crossing rate; iii) full band energy; iv) low band energy, where at least 1 of the selected parameters is either LSF or zero-crossing rate.
13. An apparatus according to claim 12, further comprising: average means coupled to said extraction means for keeping a plurality of running averages of said at least 2 parameters in said selective combination according to a set of predetermined thresholds.
14. An apparatus according to claim 13, wherein said VAD means makes a frame voicing decision of the incoming speech signal for each frame according to said set of difference measures using a union of sub-spaces with each sub-space being described as linear functions of at least a pair of difference measures from said set of difference measures.