US 4,879,748 AGrant
Parallel Processing Pitch Detector
Issue Date:1989-11-07
•13 Claims
•3 Drawing Sheets
Abstract
A pitch detector system for use with speech analysis and synthesis methods having a plurality of identical detectors each responsive to a different portion of a speech signal for estimating a pitch value and a voter circuit responsive to the estimated pitch values for determining a final pitch value. The pitch detectors are identical in design which allows for an efficient software implementation since only one set of program instructions is necessary to implement all of the encoders. The voter subsystem may be implemented by a digital signal processor executing program instructions that calculate a pitch value from the estimated pitch values determined by the pitch detectors and a second set of program instructions for constraining the final pitch value outputted by the voter subsystem so that the calculated pitch value is in agreement with calculated pitch values for previous frames. In addition, the pitch and voters may be implemented by a third set of program instructions executing on the same digital signal processor as the sets of instructions for the voter subsystem.
Metadata
Assignees
- American Telephone and Telegraph Company
- AT&T Bell Laboratories
Inventors
- Joseph Picone
- Dimitrios Prezas
Application Information
Application Number:US 7706332
Filing Date:1985-08-28
Priority Date:1985-08-28
Art Unit:231
Classifications
IPC:
G10L 702
Field of Search:
38136449;38;29-50513.5
Patent Drawings (3 sheets)
Description
Cross-Reference to Related Applications
Concurrently filed herewith and assigned to the same assignee as this application are:
W. T. Hartwell, et al., "Digital Speech Coder With Different Excitation Types", Ser. No. 770,632; and
D. Prezas, et al., "Voice Synthesis Utilizing Multi-Level Filter Excitation", Ser. No. 770,631.
1. Technical Field
This invention relates generally to digital coding of human speech signals for compact storage and subsequent synthesis and, more particularly, to pitch detection and the simultaneous determination of the voiced and unvoiced characterization of discrete frames of speech.
2. Background of the Invention
In order to reduce the bandwidth necessary to transmit human speech, it is known to digitize the human speech and then to encode the speech so as to minimize the number of digital bits per second required to store the coded digitized speech for acceptable quality of speech reproduction after the information has been transmitted and decoded for speech reproduction. Analog speech samples are customarily partitioned into frames or segments of discrete lengths on the order of 20 milliseconds in duration. Sampling is typically performed at a rate of 8 kilohertz (kHz) and each sample is encoded into a multibit digital number. Successive coded samples are further processed in a linear predictive coder (LPC) that determines appropriate filter parameters which model the human vocal tract. Each filter parameter can be used to estimate present values of each signal sampled efficiently on the basis of the weighted sum of a preselected number of prior sample values. The filter parameters model the formant structure of the vocal tract transfer function. The speech signal is regarded analytically as being composed of an excitation signal and a formant transfer function. The excitation component arises in the larynx or voice box and the formant component results from the operation of the remainder of the vocal tract on the excitation component. The excitation component is further classified as voiced or unvoiced, depending upon whether or not there is a fundamental frequency imparted to the air stream by the vocal cords. If there is a fundamental frequency imparted to the air stream by the vocal cords, then the excitation component is classed as voiced. If the excitation is unvoiced, then the excitation component is simply white noise.
To encode the speech for low bit rate transmission, it is necessary to determine the LPC parameters, also referred to as coefficients, for segments of speech and transfer these coefficients to the decoding circuit which is reproducing the speech. In addition, it is necessary to determine the excitation component. First, it must be determined whether this component is to be classed as voiced or unvoiced; and if the classification is voiced, then it is necessary to determine the fundamental frequency imparted to the air stream by the vocal cords. A number of methods exist for determining the LPC coefficients. The problem of determining the fundamental frequency, or as it is commonly referred to, pitch detection, is more difficult.
One prior art method of pitch detection is based primarily on an important property of speech which is the long term regularity of the speech waveform. Ideally, voiced speech can be viewed as a periodic signal consisting of a fundamental frequency component and its harmonics. Therefore, the output of a low-pass filter that cuts off at a frequency less than the second harmonic should be appear as a sine wave with frequency equal to the pitch. That frequency then is determined utilizing amplitude detection circuitry. This method suffers from the fact that actual speech deviates from this model during the transition regions of speech disturbing the regularity. In addition, the pitch period itself may vary depending upon whether the speaker is a male or a female.
The problems of pitch detection can be enhanced under some conditions by removing the formant structure of the speech which is also referred to as spectrum flattening. The spectrum flattening can be done utilizing Fourier transform or linear predictive analysis. The use of an LPC filter to flatten the spectrum is also referred to as inverse filtering to subtract the formant structure from the speech signal. Such a system is disclosed in U.S. Pat. No. 3,740,476, issued June 19, 1973, to B. S. Atal. The resultant residual wave that results from the LPC filtering approximates the excitation function of the vocal tract, and pulse amplitude techniques can be utilized to extract the pitch from this information. This technique fails, however, when the harmonics of the excitation fall under the formants of the speech signal in the frequency domain. When this occurs, the excitation information normally found in the residual wave is removed by the LPC inverse filtering. The result is that the residual signal then looks noisy and the pitch pulses are not easily detected.
Another prior art method of pitch detection is disclosed in the article entitled, "Parallel Processing Techniques for Estimating Pitch Periods of Speech in the Time Domain", B. Gold and L. Rabiner, The Journal of the Acoustical Society of America, Vol. 36, No. 2 (part 2), 1969. This article discloses the use of parallel pitch detectors where each of the pitch detectors is responsive to the analog voice signal to determine individually a pitch estimate. After these estimations of the pitch have been performed, a matrix is constructed of the pitch estimates; and an algorithm is utilized to determine a "correct" pitch. This method experiences problems in detecting the pitch during transitional regions of speech since the method performs all pitch estimations on the original speech signal. In addition, the algorithm utilized to make the determination of the "correct" pitch is concerned, to a large extent, with differentiating between the pitch fundamental and the second and third harmonics.
Summary of the Invention
An illustrative pitch detector system and method utilizing a plurality of detectors each responsive to a different portion of the speech signal for estimating a pitch value, another plurality of detectors each responsive to a different portion of a residual signal calculated from the speech signal, and a voter responsive to the estimated pitch values for determining a final pitch value. The detectors are identical in design which allows an efficient software implementation since only one type of encoder is necessary to implement all of the encoders.
The structural embodiment comprises a sample and quantizer circuit that is responsive to human speech to digitize and quantize the speech. A digital signal processor is responsive to a first set of program instructions for storing a predetermined number of the digitized samples as a speech frame, responsive to a second set of program instructions and the digitized speech samples to generate residual samples of the digitized speech samples that remain after the formant effect of the vocal tract has been substantially removed, responsive to a third set of program instructions and individual predetermined portions of the speech samples for estimating pitch values, responsive to a fourth set of program instructions and the residual samples for estimating pitch values, and responsive to a fifth set of program instructions for determining a final pitch value of said speech frames from the estimated pitch values.
Advantageously, the fifth set of program instructions comprises a first subset of program instructions for calculating a pitch value from the estimated pitch values of the second set of program instruction sets and a second subset of program instructions for constraining the final pitch value so that the calculated pitch value is in agreement with the calculated pitch values from previous frames.
In addition, an unvoiced speech frame is indicated by the calculated pitch value being equal to a predefined value which, advantageously, may be zero; and voiced frames are indicated by the calculated pitch value not being equal to the predefined value. The second subset of program instructions further consists of a first group of instructions responsive to a first sequence consisting of voiced, unvoiced, and voiced frames for generating a new calculated pitch value indicating a voiced frame. A second group of instructions responsive to a second sequence consisting of unvoiced, voiced, and unvoiced frames for generating a new calculated value indicating an unvoiced frame. A third group of instructions responsive to a third sequence consisting of voiced, voiced, and voiced frames for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.
Further, the first group of instructions of the second subset is responsive to the first sequence of frames for setting the calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of the first sequence, and the second group of instructions is responsive to the second sequence of frames for setting the new calculated pitch value to said predefined value.
Also, the second subset of instructions further comprises a fourth group of instructions that are responsive to a fourth sequence consisting of voiced, voiced, and unvoiced frames to calculate a new pitch value equal to the average of the calculated pitch values for the voiced and voiced frames upon the difference between the two voiced frames being less than another predefined value. If the difference between the pitch values for the two voiced frames is greater than the other predefined value, then the new calculated pitch value is set equal to the pitch value of the earlier voiced frame.
In addition, the first subset of program instructions comprises a first group of instructions responsive to all but a subset of the estimated pitch values equaling the predefined value for setting the calculated pitch value equal to the arithmetic average of the subset of value upon the estimated pitch values of the subset of values differing by less than another predefined value from each other. Further, the first group of instructions is responsive to all of the estimated pitch values being equal to the predefined value except for a subset of pitch values for setting the calculated pitch value equal to the predefined value upon the difference between each of the pitch values of the subset being greater than the other predefined value.
Also, the first subset of instructions comprises a second group of instructions responsive to all of the estimated pitch values except one equaling the predefined value for setting the calculated pitch value equal to the estimated pitch value not equal to the predefined value.
Also, the fourth set of program instructions used to estimate pitch values has a first subset of instructions for locating the sample of maximum amplitude within the predetermined portion of the residual samples within the frame. A second subset of instructions locates subsequent maximum samples, also termed candidate samples, in the frame of lesser amplitude than that of the maximum amplitude sample spaced by not less than a minimum distance based on the highest expected fundamental speech frequency from the maximum amplitude sample and each of the other samples within the frame. A third subset of instructions measures one by one the distance between adjacent located candidate samples using as a reference the maximum amplitude sample. A fourth subset of instructions tests for periodicity by comparing successive distance measurements for substantial equality and rejecting candidate samples that are not periodically related to the maximum amplitude sample. A fifth subset of instruction determines the estimated pitch value by calculating the quotient of the distance between extreme valid candidate samples within this speech frame. Finally, a sixth subset of instruction designates whether the frame is voiced or unvoiced. If the frame is unvoiced, the estimated pitch value is set equal to the predefined value, which advantageously may be zero, to indicate an unvoiced frame.
The illustrative method functions in a system having a quantizer and a digitizer for converting analog speech into frames of digital samples and a digital signal processor that is executing a plurality of program instructions for determining the pitch of a particular frame of digital speech. The signal processor determines the pitch by executing the steps of producing residual samples of the digitized speech that remain after the formant effect of the vocal tract has been substantially removed, estimating a first pitch value of the present speech frame from positive ones of the digitized speech samples, estimating a second pitch value from negative ones of the digitized speech samples, estimating a third value from positive ones of the residual samples, estimating a fourth pitch value from negative ones of the residual samples, and determining a final pitch value for a previous speech frame on the basis of the estimated pitch values determined by the estimating steps for a plurality of previous speech frames.
Advantageously, the step of determining the final pitch value is performed by the digital signal processor responding to subsets of programmed instructions to performing the steps of calculating the final pitch value from the first, second, third, and fourth pitch values previously estimated and constraining the final pitch value so that the final pitch value is in agreement with the final pitch values from previous frames as previously determined by the digital signal processor.
Brief Description of the Drawing
FIG. 1 illustrates, in block diagram form, a pitch detector in accordance with this invention;
FIG. 2 illustrates, in block diagram form, pitch detector 108 of FIG. 1;
FIG. 3 illustrates, in graphic form the candidate samples of a speech frame;
FIG. 4 illustrates, in block diagram form, pitch voter 111 of FIG. 1; and
FIG. 5 illustrates a digital signal processor implementation of FIG. 1.
Detailed Description
FIG. 1 shows an illustrative pitch detector which is the focus of this invention. The pitch detector is responsive to analog speech signals received via conductor 113 to indicate on output bus 114 whether the speech excitation is voiced or unvoiced and, if voiced, to indicate the pitch. The latter determinations are performed by pitch voter 111 in response to the outputs of pitch detectors 107 through 110. In order to reduce aliasing, the input speech on conductor 113 is filtered by filter 100 which, advantageously, may be an eighth-order Butterworth analog low-pass filter whose -3 dB frequency is 3.3 kHz. The filtered speech is then digitized and quantized by sampler 112 and linear quantizer 101. The latter transmits the digitized speech, x(n), to clippers 103 and 104 and to LPC coder and inverse filter 102. The output of coder and filter 102 is the residual signal from the inverse filtering that is transmitted to clippers 105 and 106 via path 116. Coder and filter 102 first performs the computations required to determine the filter coefficients that are used by the LPC inverse filter and then uses these filter coefficients to perform the inverse filtering of the digitized voice signal in order to calculate the residual signal, e(n). This is done in the following manner. The digitized speech x(n) is divided into, advantageously, 20 millisecond frames during which it is assumed that the all pole LPC filter is time-invariant. The frame of digitized speech is used to compute a set of reflection coefficients which, advantageously, may be 10, using the lattice computation method. The resulting tenth order inverse lattice filter generates the forwarded prediction error or residual as well as providing the reflection coefficients. The clippers 103 through 106 transform the incoming x and e digitized signals on paths 115 and 116, respectively, into positive-going and negative-going wave forms. The purpose for forming these signals is that whereas the composite waveform might not clearly indicate periodicity the clipped signal might. Hence, the periodicity is easier to detect. Clippers 103 and 105 transform the x and e signals, respectively, into positive-going signals and clippers 104 and 106 transform the x and e signals, respectively, into negative-going signals.
Pitch detectors 107 through 110 are each responsive to their own individual input signals to make a determination of the periodicity of the incoming signal. The output of the pitch detectors occurs two frames after receipt of those signals. Note, that each frame consists of, illustratively, 160 sample points. Pitch voter 111 is responsive to the output of the four pitch detectors to make a determination of the final pitch. The output of pitch voter 111 is transmitted via path 114.
FIG. 2 illustrates in block diagram form, pitch detector 108. The other pitch detectors are similar in design. The maxima locator 201 is responsive to the digitized signals of each frame for finding the pulses on which the periodicity check is performed. The output of maxima locator 201 is two sets of numbers: those representing the maximum amplitudes, M.sub.i, which are the candidate samples, and those representing the location within the frame of these amplitudes, D.sub.i. Distance detector 202 is responsive to these two sets of numbers to determine a subset of candidate pulses that are periodic. This subset represents distance detector 202's determination of what the periodicity is for this frame. The output of distance detector 202 is transferred to pitch tracker 203. The purpose of pitch tracker 203 is to constrain the pitch detector's determination of the pitch between successive frames of digitized signals. In order to perform this function, pitch tracker 203 uses the pitch as determined for the two previous frames.
Consider now in greater detail, the operations performed by maxima locator 201. Maxima locator 201 first identifies within the samples from the frame, the global maxima amplitude, M.sub.0, and its location, D.sub.0, in the frame. The other points selected for the periodicity check must satisfy all of the following conditions. First, the pulses must be a local maxima, which means that the next pulse picked must be the maximum amplitude in the frame excluding all pulses that have already been picked or eliminated. This condition is applied since it is assumed that pitch pulses usually have higher amplitudes than other samples in a frame. Second, the amplitude of the pulse selected must be greater than or equal to a certain percentage of the global maximum, M.sub.i >gM.sub.0, where g is a threshold amplitude percentage that, advantageously, may be 25%. Third, the pulse must be advantageously separated by at least 18 samples from all the pulses that have already been located. This condition is based on the assumption that the highest pitch encountered in human speech is approximately 440 Hz which at a sample rate of 8 kHz results in 18 samples.
Distance detector 202 operates in a recursive-type procedure that begins by considering the distance from the frame global maximum, M.sub.0, to the closest adjacent candidate pulse. This distance is called a candidate distance, d.sub.c, and is given by
where D.sub.i is the in-frame location of the closest adjacent candidate pulse. If such a subset of pulses in the frame are not separated by this distance, plus or minus a breathing space, B, then this candidate distance is discarded, and the process begins again with the next closest adjacent candidate pulse using a new candidate distance. Advantageously, B may have a value of 4 to 7. This new candidate distance is the distance to the next adjacent pulse to the global maximum pulse.
Once pitch detector 202 has determined a subset of candidate pulses separated by a distance, d.sub.c .+-.B, an interpolation amplitude test is applied. The interpolation amplitude test performs linear interpolation between M.sub.0 and each of the next adjacent candidate pulses, and requires that the amplitude of the candidate pulse immediately adjacent to M.sub.0 is at least q percent of these interpolated values. Advantageously, the interpolation amplitude threshold, q percent, is 75%. Consider the example illustrated by the candidate pulses shown in FIG. 3. For d.sub.c to be a valid candidate distance, the following must be true: ##EQU1##
As noted previously,
Pitch tracker 203 is responsive to the output of distance detector 202 to evaluate the pitch distance estimate which relates to the frequency of the pitch since the pitch distance represents the period of the pitch. Pitch tracker 203's function is to constrain the pitch distance estimates to be consistent from frame to frame by modifying, if necessary, any initial pitch distance estimates received from the pitch detector by performing four tests: voice segment start-up test, maximum breathing and pitch doubling test, limiting test, and abrupt change test. The first of these tests, the voice segment start-up test is performed to assure the pitch distance consistency at the start of a voiced region. Since this test is only concerned with the start of the voiced region, it assumes that the present frame has non-zero pitch period. The assumption is that the preceding frame and the present frame are the first and second voice frames in a voiced region. If the pitch distance estimate is designated by T(i) where i designates the present pitch distance estimate from distance detector 202, the pitch detector 203 outputs T*(i-2) since there is a delay of two frames through each detector. The test is only performed if T(i-3) and T(i-2) are zero or if T(i-3) and T(i-4) are zero while T(i-2) is non-zero, implying that frames i-2 and i-1 are the first and second voiced frames, respectively, in a voiced region.
The voice segment start-up test performs two consistency tests: one for the first voiced frame, T(i-2), and the other for the second voiced frame, T(i-1). These two tests are performed during successive frames. The purpose of the voice segment test is to reduce the probability of defining the start-up of a voiced region when such a region is not actually begun. This is important since the only other consistency tests for the voice regions are performed in the maximum breathing and pitch doubling tests and there only one consistency condition is required. The first consistency test is performed to assure that the distance of the right candidate sample in T(i-2) and the most left candidate sample in T(i-1) and T(i-2) are close to within a pitch threshold B+2.
If the first consistency test is met, then the second consistency test is performed during the next frame to ensure exactly the same result that the first consistency test ensured but now the frame sequence has been shifted by one to the right in the sequence of frames. If the second consistency test is not met, then T(i-1) is set to zero, implying that frame i-1 can not be the second voiced frame (if T(i-2) was not set to zero). However, if both of the consistency tests are passed, then frames i-2 and i-1 define a start-up of a voiced region. If T(i-1) is set to zero, while T(i-2) was determined to be non-zero and T(i-3) is zero, which indicates that frame i-2 is voiced between two unvoiced frames, the abrupt change test takes care of this situation and this particular test is described later.
The maximum breathing and pitch doubling test assures pitch consistency over two adjacent voiced frames in a voiced region. Hence, this test is performed only if T(i-3), T(i-2), and T(i-1) are non-zero. The maximum breathing and pitch doubling tests also checks and corrects any pitch doubling errors made by the distance detector 202. The pitch doubling portion of the check checks if T(i-2) and T(i-1) are consistent or if T(i-2) is consistent with twice T(i-1), implying a pitch doubling error. This test first checks to see if the maximum breathing portion of the test is met, that is done by
where A may advantageously have the value 10. If the above equation is met, then T(i-1) is a good estimate of the pitch distance and need not be modified. However, if the maximum breathing portion of the test fails, then the test must be performed to determine if the pitch doubling portion of the test is met. The first part of the test checks to see if T(i-2) and twice T(i-1) meet the following condition, given that T(i-3) is non-zero, ##EQU2## If the above condition is met, then T(i-1) is set equal to T(i-2). If the above condition is not met, then T(i-1) is set equal to zero. The second part of this portion of the test is performed if T(i-3) is equal to zero. If the following are met
If the above conditions are not met, T(i-1) is set equal to zero.
The limiting test which is performed on T(i-1) assures that the pitch that has been calculated is within the range of human speech which is 50 Hz to 400 Hz. If the calculated pitch does not fall within this range, then T(i-1) is set equal to zero indicating that frame i-1 cannot be voiced with the calculated pitch.
The abrupt change test is performed after the three previous tests have been performed and is intended to determine that the other tests may have allowed a frame to be designated as voiced in the middle of an unvoiced region or unvoiced in the middle of a voiced region. Since humans usually cannot produce such sequences of speech frames, the abrupt change test assures that any voiced or unvoiced segments are at least two frames long by eliminating any sequence that is voiced-unvoiced-voiced or unvoiced-voiced-unvoiced. The abrupt change test consists of two separate procedures each designed to detect the two previously mentioned sequences. Once pitch tracker 203 has performed the previously described four tests, it outputs T*(i-2) to the pitch voter 111 of FIG. 1. Pitch tracker 203 retains the other pitch distances for calculation on the next received pitch distance from distance detector 202.
FIG. 4 illustrates in greater detail pitch voter 111 of FIG. 1. Pitch value estimator 401 is responsive to the outputs of pitch detectors 107 through 110 to make an initial estimate of what the pitch is for two frames earlier, P(i-2), and pitch value tracker 402 is responsive to the output of pitch value estimator 401 to constrain the final pitch value for the third previous frame, P(i-3), to be consistent from frame to frame.
Consider now, in greater detail, the functions performed by pitch value estimator 401. In general, if all of the four pitch distance estimates values received by pitch value estimator 401 are non-zero, indicatiing a voiced frame, then the lowest and highest estimates are discarded, and P(i-2) is set equal to the arithmetic average of the two remaining estimates. Similarly, if three of the pitch distance estimate values are non-zero, the highest and lowest estimates are discarded, and pitch value estimator 401 sets P(i-2) equal to the remaining non-zero estimate. If only two of the estimates are non-zero, pitch value estimator 401 sets P(i-2) equal to the arithmetic average of the two pitch distance estimated values only if the two values are close to within the pitch threshold A. If the two values are not close to within the pitch threshold A, then pitch value estimator 401 sets P(i-2) equal to zero. This determination indicates that frame i-2 is unvoiced, although some individual detectors determined, incorrectly, some periodicity. If only one of the four pitch distance estimate values is non-zero, pitch value estimator 401 sets P(i-2) equal to the non-zero value. In this case, it is left to pitch value tracker 402 to check the validity of this pitch distance estimate value so as to make it consistent with the previous pitch estimate. If all of the pitch distance estimate values are equal to zero, then, pitch value estimator 401 sets P(i-2) equal to zero.
Pitch value tracker 402 is now considered in greater detail. Pitch value tracker 402 is responsive to the output of pitch value estimator 401 to produce a pitch value estimate for the third previous frame, P*(i-3), and makes this estimate based on P(i-2) and P(i-4). The pitch value P*(i-3) is chosen so as to be consistent from frame to frame.
The first thing checked is a sequence of frames having the form: voiced-unvoiced-voiced, unvoiced-voiced-unvoiced, or voiced-voiced-unvoiced. If the first sequence occurs as is indicated by P(i-4) and P(i-2) being non-zero and P(i-3) is zero, then the final pitch value, P*(i-3), is set equal to the arithmetic average of P(i-4) and P(i-2) by pitch value tracker 402. If the second sequence occurs, then the final pitch value, P*(i-3), is set equal to zero. With respect to the third sequence, the latter pitch tracker is responsive to P(i-4) and P(i-3) being non-zero and P(i-2) being zero to set P*(i-3) to the arithmetic average of P(i-3) and P(i-4), as long as P(i-3) and P(i-4) are close to within the pitch threshold A. Pitch tracker 402 is responsive to
to perform the following operation ##EQU3## if pitch value tracker 402 determines that P(i-3) and P(i-4) do not meet the above condition (that is, they are not close to within the pitch threshold A), then, pitch value tracker 402 sets P*(i-3) equal to the value of P(i-4).
In addition to the previously described operations, pitch value tracker 402 also performs operations designed to smooth the pitch value estimates for certain types of voiced-voiced-voiced frame sequences. Three types of frame sequences occur where these smoothing operations are performed. The first sequence is when the following is true
When the above conditions are true, pitch value tracker 402 performs a smoothing operation by setting ##EQU4## The second set of conditions occurs when
When this second set of conditions is true, pitch value tracker 402 sets ##EQU5## The third and final set of conditions is defined as
For this final set of conditions occur, pitch value tracker 402 sets
FIG. 5 illustrates an implementation of the blocks of FIG. 1 utilizing a digital signal processor that may advantageously be a Texas Instruments' TMS320-20 digital signal processor. The latter processor along with PROM memory 502 and RAM memory 503 implements blocks 102 through 111 of FIG. 1. The program stored in PROM 502 for implementing the aforementioned elements of FIG. 1 is similar to the C source code program detailed in Appendix A. The program of Appendix A is intended for execution on a Digital Equipment Corp.'s VAX 11/780-5 computer system with suitable digital-to-analog and analog-to-digital converter peripherals or a similar system. The pitch detectors 107 through 110 of FIG. 1 are implemented by common code that utilizes separate data storage areas for each pitch detector in RAM 503. The details given of FIG. 1 in FIGS. 2 and 4 are implemented by sets of program instructions stored within PROM 502. Each set of program instructions can be further subdivided into subsets and groups of programmed instructions.
It is to be understood that the above-described embodiment is merely illustrative of the principles of the invention and that other arrangements may be devised by those skilled in the art without departing from the spirit and scope of the invention. ##SPC1## 10/690
Claims
What is claimed is:
1. A pitch detector system for human speech comprising: means for storing a predetermined number of evenly spaced samples of instantaneous amplitude of said speech as a speech frame; means for generating residual samples from said speech samples; a plurality of identical means each responsive to an individual predetemined portion of said residual samples of said frame for estimating a pitch value of said frame; another plurality of identical means each responsive to an individual predetermined portion of said speech samples of said frame for estimating a pitch value of said frame; means for calculating a final pitch value from the estimated pitch values from each of said plurality and said other plurality of estimating means wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and a voiced frame is indicated by said calculated pitch value being equal to a value other than said predefined value; said calculating means comprises means responsive to all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of said estimated pitch values, said subset comprising all of said estimated pitch values except the lowest magnitude value and the highest magnitude value; means for constraining said final pitch value so that the calculated pitch value is consistent with calculated pitch values from previous frames; said constraining means comprises means responsive to a first sequence of frames comprising a voiced frame and an unvoiced frame and a second voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said first sequence; said generating means comprises a new pitch value generating means responsive to a second sequence of frames comprising an unvoiced frame and a voiced frame and a second unvoiced frame for generating a new calculated value indicating an unvoiced frame; and said new pitch value generating means further reponsive to a third sequence of frames comprising a voiced frame and a second voiced frame and a third voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.
2. The system of claim 1 wherein said generating means responsive to said first sequence comprises means for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and said generating means further comprises means responsive to said second sequence of frames for setting the new calculated pitch value equal to said predefined value.
3. The system of claim 2 wherein said new pitch value generating means further comprises means responsive to a fourth sequence of frames comprising a first voiced frame and a second voiced frame and an unvoiced frame for setting the new calculated pitch value equal to the average of the calculated pitch values for the voiced frames and the unvoiced frame upon the magnitude of the difference between the calculated pitch values of the two voiced frames being less than another predefined value; and means responsive to said fourth sequence for setting the new calculated pitch value equal to the pitch value of the first voiced frame upon the magnitude of the difference between the calculated pitch values for the two voiced frames being greater than said other predefined value.
4. The system of claim 1 wherein said setting means further responsive to said estimated pitch values upon all but a first subset of said estimated pitch values equaling said predefined value for setting said calculated pitch value equal to the arithmetic average of said first subset upon the estimated pitch values of said first subset of said pitch values differing by less than another predefined value from each other; and said setting means further responsive to all of said estimated pitch values being equal to said predefined value except for a second subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon said estimated pitch values of said second subset differing from each other by a magnitude greater than said other predefined value.
5. The system of claim 4 wherein said setting means further responsive to all but one of said estimated pitch values equaling said predefined value for setting said calculated pitch value equal to the one of said estimated pitch values not equal to said predefined value.
6. A pitch detector for human speech comprising: means for storing a predetermined number of evenly spaced speech samples of instantaneous amplitude of said speech as a present speech frame; means for filtering said samples to produce residual samples of the speech remaining after the formant effects of the vocal tract have been substantially removed; first means responsive to positive valued ones of said speech samples for estimating a first pitch value of said present speech frame; second means responsive to negative valued ones of said speech samples for estimating a second pitch value of said present speech frame; third means responsive to positive valued ones of said residual samples for estimating a third pitch value of said present speech frame; a fourth means responsive to negative valued ones of said residual samples for estimating a fourth pitch value of said present speech frame; means for calculating a pitch value from the estimated pitch values from said first, second, third and fourth estimating means wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and a voiced frame is indicated by said calculated pitch value being equal to a value other than said predefined value; said calculating means comprises means responsive to all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of said estimated pitch values, said subset comprising all of said estimated pitch values except the lowest magnitude value and the highest magnitude value; means for constraining said final pitch value so that the calculated pitch value is consistent with calculated pitch values from previous frames; said constraining means comprises means responsive to a first sequence of frames comprising a voiced frame and an unvoiced frame and a second voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said first sequence; means responsive to a second sequence of frames comprising an unvoiced frame and voiced frame and a second unvoiced frame for generating a new calculated value indicating an unvoiced frame; and said generating means further responsive to a third sequence of frames comprising a voiced frame and a second voiced frame and a third voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.
7. The system of claim 6 wherein said generating means responsive to said first sequence comprises means for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and said generating means further responsive to said second sequence of unvoiced and voiced and unvoiced frames for setting the new calculated pitch value to said predefined value.
8. The system of claim 7 wherein said generating means further comprises means responsive to a fourth sequence of frames comprising a first voiced frame and second voiced frame and an unvoiced frame for setting the new calculated pitch value equal to the average of the calculated pitch values for the voiced frames and the unvoiced frame upon the magnitude of the difference between the calculated pitch values of the two voiced frames being less than another predefined value; and means responsive to said fourth sequence for setting the new calculated pitch value equal to the pitch value of said first voiced frame upon the magnitude of difference between the calculated pitch values for the two voiced frames being greater than said other predefined value.
9. The system of claim 6 wherein said setting means further responsive to said estimated pitch values upon all but a first subset of said estimated pitch values equaling said predefined value for setting said calculated pitch value equal to the arithmetic average of said first subset upon the estimated pitch values of said first subset of said pitch values differing by less than another predefined value from each other; and said setting means further responsive to all of said estimated pitch values being equal to said predefined value except for a second subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon said estimated pitch values of said second subset differing from each other by magnitude greater than said other predefined value.
10. The system of claim 9 wherein said setting means further comprises means responsive to all but one of said estimated pitch values equaling said predefined value for setting said calculated pitch value equal to the one of said estimated pitch value not equal to said predefined value.
11. A method for detecting the pitch of human speech with a system comprising a quantizer for converting the speech into frames of digital samples and a digital signal processor responsive to a plurality of program instructions and said frames of digital samples to determine the pitch of the speech, said method comprising the steps of: producing residual samples of the digitized speech that remain after the formant effects of the vocal track have been substantially removed; estimating a first pitch value of a present speech frame in response to positive valued ones of said digitized speech samples; estimating a second pitch value of said present speech frame in response to negative valued ones of said digitized speech samples; estimating a third pitch value of said present speech frame in response to positive valued ones of said residual samples; and estimating a fourth pitch value of said present speech frame in response to negative valued ones of said residual samples; and calculating said final pitch value from said first, second, third, and fourth pitch values wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and a voiced frame is indicated by said calculated pitch value being equal to a value other than said predefined value; said step of calculating comprises the step of setting said calculated pitch value equal to the arithmetic average of a subset of said estimated pitch values, said subset comprising all of said estimated pitch values except the lowest magnitude value and the highest magnitude value; constraining said final pitch value so that said final pitch value is in agreement with final pitch values from previous frames by; said step constraining comprises the steps of generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of a first sequence of frames comprising a voiced frame and unvoiced frame and a second voiced frame; generating a new calculated value indicating an unvoiced frame in response to a second sequence of frames comprising an unvoiced frame and a voiced frame and a second unvoiced frame; and generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of a third sequence of frames comprising a voiced frame and a second voiced frame and a third voiced frame.
12. The method of claim 11 wherein said step of generating a new calculated value in response to said first sequence comprises the step of setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and said step of generating a new calculated value for said second sequence comprises the step of setting the new calculated pitch value of said second sequence equal to said predefined value.
13. The method of claim 12 wherein said constraining step further comprises the step of generating in response to a fourth sequence of frames comprising a first voiced frame and a second voiced frame and an unvoiced frame a new calculated pitch value equal to the average of the calculated pitch values for the two voiced frames and the unvoiced frame upon the magnitude of the difference between the voiced frames being less than another predefined value; and said generating step further generating a new calculated pitch value equal to the pitch value of the first voiced frame upon the difference in magnitude between the two pitch values for the two voiced frames being greater than said other predefined value.
Patent Citations (13)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3496465 | 1970-02-01 | Schroeder | |
| US3617636 | 1971-11-01 | Ogihara | |
| US3740476 | 1973-06-01 | Atal | |
| US3852535 | 1974-12-01 | Zurcher | |
| US3903366 | 1975-09-01 | Coulter | |
| US3916105 | 1975-10-01 | McCray | |
| US3979557 | 1976-09-01 | Schulman et al. | |
| US4004096 | 1977-01-01 | Bauer et al. | |
| US4058676 | 1977-11-01 | Wilkes et al. | |
| US4301329 | 1981-11-01 | Taguchi | |
| US4360708 | 1982-11-01 | Taguchi et al. | |
| US4561102 | 1985-12-01 | Prezas | |
| US4653098 | 1987-03-01 | Nakata et al. |
Non-Patent Literature (15)
- Holm, "Automatic Generation of Mixed Excitation in a Linear Predictive-Speech Synthesizer", IEEE ICASSP '81, pp. 118-120.
- Areseki et al., "Multi-Pulse Excited Speech Coder . . . ", IEEE GLOBECOM '83, pp. 23.3.1-23.3.5.
- Copperi et al., "Vector Quantization and Perceptual Criteria for Low Rate Coding of Speech", IEEE ICASSP '85, pp. 7.6.1-7.6.4.
- Markel, "A Linear Prediction Vocoder Simulation . . . ", IEEE Trans. ASSP, vol. ASSP-22, No. 2, Apr. 1974, pp. 124-134.
- Un et al., "A Pitch Extraction Algorithm Based on LPC Inverse Filtering and AMDF," IEEE Trans. ASSP, vol. ASSP-25, No. 6, 12/77, pp. 565-572.
- Malpass, "The Gold Rabiner Pitch Detector in a Real Time Environment", IEEE EASCON '75, pp. 31-A-31-G.
- Wong, "On Understanding the Quality Problems of LPC Speech", IEEE ICASSP '80, pp. 725-728.
- Alexander, "A Simple Noniterative Speech Excitation Algorithm Using the LPC Residual", IEEE ASSP, vol. ASSP-33, No. 2, 4/85, 432-434.
- Un et al., "A 4800 BPS LPC Vocoder with Improved Excitation", IEEE ICASSP '80, pp. 142-145.
- "Improving Performance of Multipulse LPC Coders at Low Bit Rates", B. Atal and S. Singhal, ICASSP '84, pp. 1.3-1.4.
- "A New Model of LPC Excitation for Producing Natural-Sounding Speech at Low Bit Rates", B. Atal and J. Remde, ICASSP '82, pp. 614-617.
- "An Integrated Pitch Tracking Algorithm for Speech Systems", B. G. Secrest and G. R. Doddington, in Proc. 1983, Int. Conf. Acoust., Speech, Signal Processing, pp. 1352-1355, Apr., 1983.
- "Postprocessing Techniques for Voice Pitch Trackers", B. G. Screst and G. R. Doddington, in Proc. 1982 IEEE Int. Conf. Acoust., Speech, Signal Processing, pp. 172-175, Apr., 1982.
- "A Procedure for Using Pattern Classification Techniques to Obtain a Voiced/Unvoiced Classifier", L. J. Siegel, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-27, No. 1, pp. 83-89, Feb., 1979.
- "Parallel Processing Techniques for Estimating Pitch Periods of Speech in the Time Domain", B. Gold and L. R. Rabiner, The Journal of the Acoustical Society of America, vol. 46, No. 2, pp. 442-448, 1969.