US 5,899,861 AGrant
3-Dimensional Volume by Aggregating Ultrasound Fields of View
Issue Date:1999-05-04
•20 Claims
•5 Drawing Sheets
Abstract
A 3D field of view ultrasound image volume is derived from correlated frames of ultrasound image data. An operator manually translates an ultrasound probe across a patient target area. Frames of sensed echo signals are processed to detect probe motion using beam data registration and correlation techniques. Motion is detected by correlating the frames for probe translation among as many as 6 degrees of freedom. Image registration then is performed for correlated portions to accumulate a large ultrasound image. Such image encompasses an area larger than a single field of view image frame for the given manually-scanned transducer probe.
Metadata
Assignee
- Siemens Medical Systems, Inc.
Inventors
- Barry H. Friemel
- Lee Weng
- Tat-Jin Teo
- Katherine G. Brown
Application Information
Application Number:US 728280&
Filing Date:1996-10-08
Priority Date:1996-03-29
Art Unit:335
Classifications
IPC:
A61B 800
Field of Search:
128600660.07;660.1;653.1;916443;447
Patent Drawings (5 sheets)
Description
Background of the Invention
This invention relates to medical diagnostic ultrasound imaging, and more particularly to a method and apparatus for acquiring ultrasound fields of view to generate three-dimensional ultrasound volumes.
Medical diagnostic ultrasound systems are commonly used to generate two-dimensional diagnostic images of internal features within a patient's body. To do so, a sonographer positions an ultrasound transducer probe adjacent to a patient's target area. The probe is a non-intrusive device including an array of acoustic transducer elements. The transducer elements emit ultrasonic energy at a frequency on the order of 2.0 MHz to 10 MHz. The transmitted ultrasound energy propagates into the patient where it is in part absorbed, dispersed, refracted, and reflected by internal structures. Reflected ultrasound energy is received back at the transducer probe where it is converted back into electronic signals. Body tissues, for example, appear as discontinuities or impedance changes, and are indicated by the converted electronic signals.
Converted electronic signal samples undergo beamforming to correlate the samples in time and space to a patient's target area. Exemplary beamforming parameters for controlling the imaging process include focus, steering, apodization and aperture. Focus is a time delay profile of active transducer elements. Steering is the control of focus depth points along azimuth and elevation axes of a transducer probe scan. Apodization is a voltage weighting profile of active transducer elements. Aperture is the control of the number of transducer elements which are active along azimuth or elevation axes of the transducer probe for a given scan. The beamformed data are processed to analyze echo, Doppler, and flow information and obtain a cross-sectional image of the patient's targeted anatomy (e.g., tissue, flow, Doppler).
A conventional image is a brightness image (i.e., referred to as a `B-mode image`) in which component pixels are brightened in proportion to a corresponding echo sample strength. The B-mode image represents a cross section of the patient target area through a transducer's scanning plane. Typically the B-mode image is a gray scale image in which the range of lighter to darker gray-scale shades correspond to increasing brightness or echo strength. The typical ultrasound B-mode image is formed by a linear scan or sector scan of the patient's target area by the transducer probe. The individual images produced by ultrasound imaging systems include discrete frames. A frame is a tomographic slice which represents a single sample in elevation. For a given frame in which first active transducer elements transmit an ultrasound signal and second active transducer elements receive an ultrasound echo, the transducer probe defines a given field of view. Such field of view depends on the number of active transducer elements, the relative spacing of the elements and the steering and focus of each element. Each frame has a limited field of view due to a relatively narrow region traversed by the transmitted ultrasound energy. The frame is a single tomographic slice having a single elevation sample. As the transducer probe is manipulated along the patient's body surface, each previous image slice is replaced on the viewing display by a new image slice defined by the current position, and thus field of view, of the transducer probe.
Given the generally narrow field of view of conventional ultrasound systems, it is desirable to extend the field of view to acquire images over large portions of the patient anatomy. Increasing the size of transducer or the number of transducer elements are alternative approaches. However, such approaches adds significant hardware expense. Also, increasing the number of transducers increases processing overhead cost. Another approach is to compound images from the scanning process into a larger image. Previously, it has been demonstrated that a real-time compounded ultrasound two-dimensional image could be generated by using so-called compound B-scanners. These B-scanners use a transducer mounted on an arm assembly that constrains the transducer to move along a single plane or axis. Either the arm assembly or the transducer element itself is provided with sensing devices for tracking the precise position of the transducer. This positional information then is used to register each one of discrete image frames into a composite image. An example of an arm assembly is disclosed in U.S. Pat. No. 4,431,007 to Amazeen et al. for Referenced Real-Time Ultrasound Image Display.
Summary of the Invention
According to the invention, a 3D field of view ultrasound image is acquired by manually translating an ultrasound probe across a patient target area, detecting the motion using beam data registering and correlation techniques, then deriving and displaying a compound image. .quadrature.Motion is detected during a frame capturing process by correlating frames of ultrasound data for translation within various degrees of freedom. Each captured image frame has a given field of view. A 3D volume is accumulated from the various image frames using image registration and frame compounding techniques. The image frames are registered. Image frames of overlapping subject matter are compounded at regions of the overlapping subject matter. The resulting 3D volume has an expanded field of view as compared to the component frames.
According to one aspect of the invention, frames of ultrasound data are processed to identify transducer motion within six degrees of freedom. The transducer emits ultrasound energy into the patient. The scan plane defined by the unobstructed path of such energy is used herein as a reference plane for naming the various degrees of freedom. Translation within the scan plane of the transmitted ultrasound is referred to as being "in-plane". Movement of the transducer in-plane along an azimuthal (e.g., `x`) axis is referred to as lateral translation, or in-plane lateral translation. Movement of the transducer in-plane inward toward the patient (e.g., along an y axis) is referred to as axial translation, or in-plane axial translation. Rotating the transducer (at an angle .theta.) within the plane about a normal axis z, as if adjusting the beam steering, is referred to as in-plane rotation. Movement of the transducer to move the scan plane parallel to its prior position (e.g., along a `z` axis) is referred to as elevational translation. Movement of the transducer to rotate the scan plane (at an angle .alpha.) about the `y` axis is referred to as axial rotation. Movement of the transducer to rotate the plane (at an angle .phi.) about the `x` axis is referred to as rotation about the transducer face.
According to another aspect of the invention, the method for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, includes the steps of: moving the transducer array within any of six degrees of freedom while the transducer array is positioned at a patient in the vicinity of the target area. The transducer array emits ultrasound signals and receives returning echoes of the emitted ultrasound signals. At another step, the received echoes within a volume are sampled to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient. A given frame of echo data encompasses a field of view of a first size. The plurality of frames of echo data are registered to derive at least one in-plane motion vector for each one of multiple frames of the plurality of frames. Data rotation is performed on the multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out. The multiple intermediate frames then are processed to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames. Registered portions of the multiple intermediate frames are aggregated using the in-plane motion vectors and the out-of-plane motion vector components to define a 3-dimensional volume encompassing a field of view of a second size. The second size is larger than the first size. The multiple intermediate frames are correlated to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames by using time delays, spectral breadth, power, speckle decorrelation, spectral peak or accelerometer sensor input as an indicator of elevational motion.
According to another aspect of the invention, elevational translation is estimated by measuring time delays among signals in the near field of the transducer scan plane. The received signal from each transducer element in a given column along the elevation at a fixed depth over time is referred to as s(x,y.sub.0,z.sub.n,t). As the transducer array moves along the elevation, ultrasound scatterers pass into the scan-plane of a transducer element z.sub.0 at a time t.sub.0 and beneath an element z.sub.1 at a time t.sub.1. The measure of the time delay between the signals from each of the two elements, (i.e., z.sub.0 and z.sub.1) is directly proportional to transducer velocity. One-dimensional cross-correlation is performed on the received signals over time from the near field at adjacent or nearby transducer elements to define the elevational motion vector component.
According to another aspect of the invention, elevational translation is estimated alternatively by measuring spectral breadth of a pulsed-wave Doppler spectrum for several locations within the scan plane. As the transducer is translated in the elevation direction (i.e., along the z axis) a single sample is taken periodically at a given range. The sampling rate is defined by a pulse repetition frequency. Each sample is transformed from the time domain into the frequency domain using a fast Fourier transform (`IFF`) or the like. The resulting frequency domain representation of multiple samples from the same location within the scan plane is its pulsed-wave Doppler spectrum. As the spectrum is expected to be triangular, one measure for determining breadth of the spectrum is to fit a triangle to the intermediate frame data, then determine the zero crossovers. The frequency band between zero crossovers is a measure of spectral breadth. Alternatively, a 3 dB width or 6 dB width measurement of the spectrum is used as the measure of spectral breadth.
According to another aspect of the invention, elevational translation is estimated alternatively by measuring the power function of the echo signal at a given location within the scan plane. The power function is approximately equal to the integral of the pulsed-wave Doppler spectrum for the sampled scan plane location. The power function of the Doppler signal is proportional to elevational velocity. To determine the power function a high-pass wall filter is applied to the echo data. A broader spectrum output from the wall filter correlates to more energy in the pass band of the filter. The amount of energy correlates directly to the velocity of the transducer. Because axial and lateral translation also appears as increased energy in the pass band, the effects of axial and lateral translation are first factored out before estimated elevational translation using the power mode.
According to another aspect of the invention, elevational translation is estimated alternatively by measuring speckle decorrelation among successive frames. As the transducer is moved in the elevational direction, the ultrasonic speckle changes due to beam parameters. The elevational velocity is estimated by examining the rate of speckle decorrelation in the echo response data. More specifically, elevational motion is estimated by examining the rate of speckle decorrelation in the echo response data after in-plane motion is factored out.
According to another aspect of the invention, elevation translation is estimated alternatively by generating a pulsed-wave Doppler spectra for transducer beams during successive frames. Comparison of peak magnitude locations among the pulsed-wave Doppler spectra is used to estimate the elevation translation. For a given beam the peak for each successive spectra corresponds to the average of the inverse of the distance between neighboring speckle phenomena (due to the random orientation of particles smaller than the resolution of the instrument). Acquisition of spectral peak magnitude is performed for multiple elements in the transducer array. Estimates of elevation motion are made by averaging results in neighborhoods within a frame of data. A rotation vector for a frame is derived from the estimates for the multiple neighborhoods of a given frame.
According to another aspect of the invention, elevational motion vectors for multiple locations within the scan plane are used to derive other out-of-plane motion vector components. Axial rotation (about the y axis) is estimated by examining the difference between elevational velocities at each end of the transducer array (along the azimuthal x axis), (e.g., a change in z component of velocity with respect to x). The change in elevational translation in the x dimension is an estimate for axial rotation. Similarly rotation about the face of the transducer is estimated using multiple estimates of elevational velocity taken at different depths. Estimates at different depths equate to an estimate for rotation about the face of the transducer.
According to another aspect of the invention, in an alternative embodiment an accelerometer is positioned at the transducer probe for indicating changes int the transducer position relative to the earth's gravitational field. Such changes are sued for determining rotational components of transducer motion, (i.e., rotational motion tilting the transducer relative to a gravitational vector).
Brief Description of the Drawings
FIG. 1 is a block diagram of an ultrasound imaging system embodiment for implementing the method of this invention;
FIG. 2 is a perspective view of the transducer of FIG. 1 along with its scan plane and directional reference axes;
FIG. 3 is a processing block diagram of a method for detecting in-plane transducer motion;
FIG. 4 is a diagram of a transducer array of 2;
FIG. 5 is a graph of respective signals depicting time delay estimation according to a method embodiment of this invention;
FIG. 6 is a graph of signals having differing elevation velocity for depicting spectral broadening estimation according to a method embodiment of this invention;
FIG. 7 is a graph of signals having differing elevation velocity subjected to a wall filter for depicting power mode estimation according to a method embodiment of this invention; and
FIG. 8 is a graph of signals having differing elevation velocity for depicting spectral decorrelation according to a method embodiment of this invention.
Detailed Description
Exemplary Ultrasound Host Platform
FIG. 1 shows an ultrasound medical diagnostic imaging system 10. The system 10 emits ultrasound signals and detects response echoes to scan a target area within a patient's anatomy. The ultrasound system 10 includes a system controller 12, transmitter 14, transducer 16, receiver 18, vector processing subsystem(s) 22, Doppler processing subsystem 23, image processing subsystem 24, scan converter 26 and display 28. The system controller 12 provides a user interface 30 (e.g., control panel, display menu, keyboard) and controls system operations. In operation, the system controller 12 triggers the transmitter 14 to generate electrical signals for output to the transducer 16. The transducer 16 converts the electrical signals into an ultrasound transmit wave-pattern. Typically, the transducer 16 is positioned adjacent to and in contact with a patient's anatomy. The transmit wave-pattern propagates into the patient's anatomy where it is refracted, absorbed, dispersed and reflected. The degree of refraction, absorption, dispersion and reflection depends on the uniformity, density and structure of the encountered anatomy. Of interest is the reflected components which propagate back to the transducer 16. These echoes are sensed by the transducer 16 and converted back into electrical signals. The electrical signals are input to a receiver 18 which amplifies the signals. A beamformer portion of receiver 18 groups the echo signals into frames of data scans for given target areas.
A common ultrasound diagnostic application is for examining a fetus 32 within a mother's womb 34. A sonographer 36 moves the transducer 16 along the patient's skin surface 38 in a direction parallel with the ultrasonic scan plane 40. An acoustically conductive lubricating agent typically is applied to the skin prior to the examination to improve acoustic coupling between the transducer 16 and the patient's skin 38. The transmitter 14 sends electrical signals to the transducer 16 causing ultrasound pulses to be emitted into the patient. The pulses propagate through the patient's skin into the body. The pulses in part echo off the fetus 32 returning through the skin 38 to the transducer 16. The transducer 16 converts the echo pulses back into electrical signals. After beamforming, raw beamformed data is fed to back-end processing subsystems 22-26. The back-end processing subsystems typically perform echo processing, Doppler processing, color flow processing, image processing, scan conversion and video processing. Conventional image processing of raw beam-formed echo data includes generating gray-scale image data corresponding to a patients target area. Typically, raw data is encoded by applying a gray-scale value proportional to the echo intensity for a given vector sample. Scan conversion is performed to fill in values for pixels between vector samples. For some applications the encoded image data also is electronically stored in a memory medium, such as a permanent memory storage device (e.g., disk or tape) or a temporary storage device (e.g., solid state memory). Also, the encoded image data often is printed out in a hard copy format, such as a photograph.
In conventional applications, the image displayed on display 28 includes only the information representative of a relatively narrow region defined by the scan plane 40 at a given moment in time. Thus, only a portion of the anatomical features of the fetus 32 are displayed at a given time. According to the method of this invention, however, the display image is aggregated from multiple frames to derive a larger 2:1) or 3D field of view 42 ultrasound image 44.
Acquiring the 3D Field of View
Overview
For a given transducer array 16 there is a given field of view defined by the number of transducer elements and the beamforming parameters for controlling the ultrasound signal transmission and reception. To acquire a 3D volume, image data frames are combined. More specifically, limited field of view image data frames are correlated and registered to define an enlarged 2D or a 3D image. First, echo data is received and beamformed to derive one or more limited field of view frames of image data while the sonographer moves the transducer 16 along the patient's skin surface. Second, registration and correlation of data within 2 or more frames is performed to derive motion vectors for each data element in a given frame. Third, the correlated data is used to define an image. The resulting image is achieved using conventional splicing or rendering techniques and/or by projecting the 3D) volume onto a 2-dimensional plane.
Referring to FIG. 2 the transducer array 16 is shown. The sonographer moves the transducer array 16 within any of six degrees of freedom. The scan plane 40 defined by the unobstructed path of the ultrasound energy emitted from the transducer 16 is used as a reference plane for naming the various degrees of freedom. Translation within the scan plane 40 of the transmitted ultrasound is referred to as being "in-plane". Movement of the transducer in-plane along an azimuthal (e.g., `x`) axis is referred to as lateral translation, or in-plane lateral translation. Movement of the transducer in-plane inward toward the patient (e.g., along a y axis) is referred to as axial translation, or in-plane axial translation. Rotating the transducer (at an angle .theta.) within the scan plane about a normal axis z, as if adjusting the beam steering, is referred to as in-plane rotation. Movement of the transducer to move the scan plane parallel to its prior position (e.g., along a `z` axis) is referred to as elevational translation. Movement of the transducer to rotate the scan plane (at an angle .alpha.) about the `y` axis is referred to as axial rotation. Movement of the transducer to rotate the plane (at an angle .phi.) about the `x` axis is referred to as rotation about the transducer face.
With regard to the step of registering the data, data frames are registered to estimate in-plane motion resulting in two-dimensional motion vectors for each data element of a given frame. Next, using data correlation techniques an elevational (out-of-plane) motion component is derived. Then, using data correlation and/or motion sensor responses out-of-plane axial rotation and rotation about the face components are derived. The in-plane and out-of-plane motion vector components define a 3D motion vector for each pixel of an image frame.
Estimating In-Plane Transducer Motion
FIG. 3 shows a block diagram relating to a method for determining in-plane transducer motion. Registration for in-plane transducer motion is performed for each frame relative to a prior frame. FIG. 3 shows two consecutive image frames 61, 62 denoted as frames n-1 (the previous frame) and frame n (the current frame). The previous image frame n-1 is treated as a reference image frame. The current image frame n is acquired by moving the transducer 16 of FIG. 1 along the skin surface 38.
In one embodiment, the frame n is divided into a plurality of sub-frame blocks 64 to derive frame motion. Local in-plane motion is derived for each block 64. For i total blocks, the i-th block of frame n is referred to as block n(i). For in-plane motion, block size preferably is not to be so small as to decorrelate rapidly with relatively large degrees of motion. Further, block size is not to be so large that motion estimation becomes unstable. In a preferred embodiment a block size of 48.times.48 pixels has been found to be acceptable for motion estimation for a 200.times.400 pixel image frame.
Local motion of each block n(i) is estimated by moving the block n(i) around on the n-1 image frame to find the best match. In a preferred embodiment a search region 64 on image frame n-1 is selected. Such region 64 is smaller than the total area of image frame n-1. In a preferred embodiment a search region size of 32 pixels in each search direction is used for an input image frame rate of 7.5 frames/second, resulting in a search region 66 size of 64.times.64 pixels.
In one embodiment the "best match" is determined using a minimum sum-absolute-difference (MSAD) technique to match the n(i) block with a specific search region of the reference frame n-1. The sum-absolute difference is the sum of absolute differences between corresponding pixel values between a given block and a given search region. The search region 64 with the best match to n(i) is the search region where the sum of absolute differences is a minimum. To improve the computation time, various search techniques are used which reduce the amount of MSAD computations. One technique uses a conventional moving picture expert group (`MPCEG`) encoder. MPEG encoders are available commercially which perform a rough estimate of MSAD location based on historical movement of an image. A best match is sought between an image characteristic within a block 64 and a search region by searching within a local area including a finite dimensional range (e.g., such as within 10 pixels in x and y directions) relative to the image characteristic. A local 2D motion vector v(i) is assigned to a given block n(i).
Accuracy of the local 2D motion vector v(i) is improved by applying constraints to the imaging process. For example, because motion in the y direction from one frame to the next is usually smaller than in the x direction and because the transducer moves along the patient's contour, transducer motion is characteristically more horizontal (x direction) than vertical (y direction). A fast adaptive coarse/fine MSAD search strategy therefore is devised for reducing the number of computations. Specifically, the implemented search range is larger in the x direction than in the y direction and is adaptive to overall motion history. For example, if motion history is in the +x direction, a coarse search is first performed with an increased search area length in the x direction, followed by a fine search. Such an approach has been found to reduce the number of computations substantially.
Another technique for improving results is to estimate the quality and reliability of the MSAD measurement. Quality of the MSAD measure is determined by calculating a term S1(i) as the difference between an MSAD value for a given block n(i) and a mean SAD value. Reliability is measured by calculating a term S2(i) as the motion vector deviation from a past history h(i). Motion vector history h(i) from a past block is a recursive weighted average of prior motion vector values for a given block n(i). In one embodiment a fuzzy logic control block receives S1(i) and S2(i), then combines them to produce a single output w(i) representing the degree of accuracy of the motion vector v(i). Seven fuzzy logic rules are used in a preferred embodiment as listed below:
(1) If S1(i) is low and S2(i) is low, then w(i) is medium;
(2) If S1(i) is medium and S2(i) is low, then w(i) is high;
(3) If S1(i) is high and S2(i) is low, then w(i) is very high;
(4) If S1(i) is low and S2(i) is medium, then w(i) is low;
(5) If S1(i) is medium and S2(i) is medium, then w(i) is medium;
(6) If S1(i) is high and S2(i) is medium, then w(i) is high;
(7) If S2(i) is high, then w(i) is very low.
Thereafter, a centroid defuzzification technique is used to convert the fuzzy output into a numerical value w(i). With w(i) obtained, the motion vector v(i) estimate is improved. If w(i) is large then v(i) is used directly as the final 2D in-plane motion vector 70. If w(i) is very small, then the average frame motion history h(i) is used as the final 2D in-plane motion vector 70. Otherwise, w(i) is used as a weighting factor to average v(i) and h(i). For example, for a w(i)=0.6, the final 2D in-plane motion vector is: 0.6v(i)+(1-0.6)h(i).
The method and apparatus for registering in-plane transducer motion is described in more detail in commonly-assigned U.S. Pat. No. 5,575,286 issued Nov. 19, 1996 of Lee Weng and Arun P. Tirumalai for "Method and Apparatus for Generating Large Compound Ultrasound Image." This patent is incorporated herein by reference and made a part hereof.
Estimating Elevational Transducer Motion
Once an image frame n is correlated for in-plane motion, the data is rotated based upon the final 2-dimensional in-plane motion vector to factor out the in-plane motion variation. The result for a given frame n is an intermediate frame m. The multiple intermediate frames each have in-plane motion factored out. Such intermediate frames now are correlated for out-of-plane motion. According to alternative embodiments, time delay, spectral breadth, power, speckle decorrelation or spectral peak is used as an indicator of elevational translation. Elevational translation variation among transducer elements in the same frame then is used to identify the presence of axial rotation and rotation about the face of the transducer array 16.
Time Delay as an Estimate of Elevational Translation:
Time delay is a useful indicator of elevational motion for a 1.5-dimensional (`1.5D`) or a 2-dimensional transducer array. A 1.5D transducer array and a 2D transducer array each have multiple rows of transducer elements. In a 2D transducer array beamforming parameters are controllable for each element in the array. In a 1.5D array steering control along the elevational direction is omitted, focussing along the elevational direction is limited to symmetrical focussing and apodization profile along the elevational direction (e.g., z-axis) is limited to a symmetrical profile. Beams formed by multiple transducer elements occurring in a given transducer array column (i.e., along the elevational z axis) typically overlap. The resulting beams form a variable-sized composite beam element, rather than an independent beam element for each transducer element. However, by examining the echo samples in the near field for such transducer elements before overlap occurs, the data from each transducer element in a given column along the elevational direction are independent. Examining such independent beam elements is useful for estimating time delay.
The received signal (s) from each transducer element (n) in a given column (e.g., x) along the elevation (z) at a fixed depth (y.sub.0) over time (t), is referred to as s(x,y.sub.0,z.sub.n,t). As the transducer array moves along the elevation direction 80 (see FIG. 4), ultrasound scatterers pass into the scan-plane of a transducer element z.sub.0 at a time t.sub.0 and beneath an element z.sub.1 at a time t.sub.1. The measure of the time delay between the signals from each of the two elements, (i.e., z.sub.0 and z.sub.1) is directly proportional to transducer velocity. FIG. 5 shows the received signal waveform as a function of time for the respective signals, s(x,y.sub.0,z.sub.0,t) and s(x,y.sub.0,z.sub.1,t).
To measure the time delay in-plane motion is factored out. Thus, the intermediate frames are used to measure time delay. Time delay between elements in a given column of elements along the elevation is estimated using any of several alternative criteria. According to a specific embodiment a Sum-Absolute-Difference (SAD) search is performed using equation (I) below: ##EQU1##
where t.sub.1 -t.sub.0 =.tau., the time delay, corresponds to the minimum SAD, .epsilon..sub..tau..
The estimated time delay then is transformed into an elevational motion vector for a given transducer element, wherein the distance moved during time delay, .tau., is the spacing between elevational elements. The velocity is the spacing divided by the time delay. For the first method embodiment velocity is .DELTA.z/(t.sub.1 -t.sub.0). for the second embodiment, velocity is (z.sub.n1 -z.sub.n2)/.DELTA.t. An elevational motion vector is derived for each transducer element and assigned to each data item in a given intermediate frame.
Spectral Broadening Estimates:
An alternative indicator for elevational motion is the spectral breadth of a pulsed-wave Doppler spectrum for a given location within the scan plane. As a transducer is translated in the elevation direction (i.e., along the z axis) a single sample is taken periodically at a given range. The sampling rate is deemed by a pulse repetition frequency. Each sample is transformed from the time domain into the frequency domain using a fast Fourier transform (`FFT`) or the like. The resulting frequency domain representation of multiple samples from the same location in space is called a pulsed-wave Doppler spectrum. The spectrum is determined by transducer geometry, the pulse repetition frequency and the velocity of the transducer movement.
For imaging of stationary tissue and movement of the transducer in only one direction (i.e., the elevational direction), increasing transducer velocity compresses the time-domain signal and results in a broader spectrum 82 (see FIG. 6). Decreasing transducer velocity expands the time-domain signal and results in a narrower spectrum 84. Curves 86, 88 shows spectral broadening for a low elevation velocity response 86 and a high elevation velocity response 88. A stationary transducer corresponds to a delta function at DC frequency. Similar results occur for signals with motion in additional degrees of freedom after correction for such degrees of freedom.
Before measuring spectral breadth, in-plane motion is factored out of the data samples. Thus, data from the intermediate frames is used to derive the spectrum for a given beam at a fixed depth over time, or sample volume. At a first step, a series of repeated samples are collected for a single depth over time from the intermediate frames of data samples. At a second step, a fast Fourier transform is derived for the transducer element corresponding to such collected samples. The fast Fourier transform for the sample transducer element is given below in Equation II, where S is the signal spectrum for the given transducer element, z.sub.0 :
As the spectrum is expected to be triangular, one measure for determining breadth of the spectrum is to fit a triangle to the intermediate frame data, then determine the zero crossovers. The frequency band between zero crossovers are a measure of spectral breadth. Alternatively, a 3 dB width or 6 dB width measurement of the spectrum is used as the measure of spectral breadth.
In one embodiment samples from 32 intermediate frames are used to define a spectrum and derive spectral breadth for a given location within the scan plane for a current intermediate frame m. The spectral breadth then is scaled to define an elevational motion vector. The elevational motion vector is assigned to various data items within the current intermediate frame m. The same process then is repeated for different locations within the scan plane for each intermediate frame m to achieve multiple elevational motion vectors for each frame.
Power Estimation:
Another indicator of elevational translation is derived from the power function of a received echo signal. The power function of the echo signal is approximately equal to the integral of the pulsed-wave Doppler spectrum. More significantly, the power function of the Doppler signal is proportional to elevational velocity.
The power function is obtained using a color flow processing method in which the amount of power traversing a wall filter is measured. As a transducer is moved along the elevational direction, the pulsed-wave Doppler spectrum broadens. A high-pass wall filter 90 is applied to the received signal (see FIG. 7). A broader spectrum output from the wall filter correlates to more energy in the pass band of the filter. Regions 96, 98 encompass the passed power regions for a high elevation velocity, while regions 92, 94 encompass the passed power regions for a relatively lower elevation velocity. The amount of energy correlates directly to the velocity of the transducer. Because axial and lateral translation also appears as increased energy in the pass band, the effects of axial and lateral translation are first factored out before estimated elevational translation using the power mode. More specifically, the intermediate frame data for a given transducer element is passed through the wall filter.
The power mode estimate is given below in equation (111): ##EQU2## where I.sub.i +jQ.sub.i is a complex input signal passed through the wall filter.
The change in the power function over time is related monotonically (or is a monotone function of) the elevational velocity of the transducer. The resulting power action is related to velocity using wall filter shape and transducer geometry, or empirically based on experimental results (for speckle decorrelation and speckle broadening). A number of elevational velocity components are derived within the scan plane for each intermediate frame.
Speckle Decorrelation:
According to still another technique elevational motion is derived by estimating the rate of speckle decorrelation within successive intermediate frames. As the transducer 16 is moved in the elevational direction, the ultrasonic speckle changes due to random scatterers passing through the ultrasonic beam. Regions of well defined speckle are determined by examining speckle statistics throughout the image. Regions which are determined to not have well-developed speckle are eliminated from the processing. One method of determining well-developed speckle is to examine the mean to standard deviation ratio. If the ratio is 1.91, for example, the speckle is considered to be well-developed. The elevational velocity is estimated by examining the rate of speckle decorrelation in the echo response data. More specifically, elevational motion is estimated by examining the rate of speckle decorrelation in the echo response data in the intermediate frames. In one embodiment speckle decorrelation is derived using the function below in equation (IV) or a like function: ##EQU3##
FIG. 8 shows an autocorrelation function for two elevation velocities. Signal 100 corresponds to a faster elevation velocity than signal 102. Speckle decorrelation is performed for multiple sub-frames of each intermediate frame. such decorrelation is scaled to define an elevational velocity component. In a specific embodiment an elevational velocity component is derived for multiple sub-frames of each intermediate frame using a moving window of 2 or more intermediate frames.
For the spectral broadening, power estimation and speckle decorrelation modes, magnitude of elevational motion is derived without directional information. Accordingly, when operating in any of such modes the operator moves the transducer in one direction only. Also, for applications in which the z-axis is reversed, the operator inputs such information so as to reconstruct the image properly for spectral broadening, power estimation and speckle decorrelation modes.
Pulsed-Wave Doppler Spectral Peak Location
According to still another technique elevational motion is derived by estimating by comparing peak locations among pulsed-wave Doppler spectra. A pulsed-wave Doppler spectrum is generated for a given transducer beam during successive frames. Data is gathered for the given transducer element by sampling various ranges periodically during transducer motion exhibiting an elevation translation component.
At one step the envelope of the received signal is captured at a sample of depth ranges at the various sample times. At another step the mean value of the envelope signal in the vicinity of the sample is subtracted from each sample value. At another step, for each depth range the sequence of samples acquired during elevation motion is transformed to the frequency domain using a fast Fourier transform (FFT), autoregressive modelling, or another spectral estimation method. The peak in the magnitude of the spectrum corresponds to the average of the inverse of the distance between neighboring speckle phenomena (due to the random orientation of particles smaller than the resolution of the instrument). The peak in the spectrum is present at higher frequencies for faster elevation speeds.
The process is repeated for each element in the transducer array. Estimates of motion are made by averaging the results in neighborhoods within the frame of data. The location of the peak is determined by transducer geometry, sampling rate, the speed of translation in elevation, and tissue structure insonified. In some embodiments an algorithm for detecting speckle in an image (such as Rayleigh statistics) is used to locate preferable regions of the frame in which to perform the estimate. A rotation vector for a frame then is made from the estimates for the neighborhoods within the frame. For example, a plane is fitted to the neighborhood motion estimates. The angle of intersection of the motion plane and the data frame corresponds to the frame's rotation vector estimate.
Estimating Axial Rotation and Rotation about the Transducer Face
Elevational motion vectors for multiple locations within the scan plane are used to derive other out-of-plane motions. For example, axial rotation is estimated using multiple elevational translation estimates. In one embodiment multiple estimates of elevational translation are determined at either end of a row of transducers (i.e., along the azimuthal x axis). Estimates at different locations along the x axis translate to an estimate for axial rotation. Similarly rotation about the face of the transducer is estimated using multiple estimates of elevational translation taken at near and far depths using any of the above-described techniques. Estimates at different depths then equate to an estimate for rotation about the face of the transducer 16.
To improve accuracy for estimating axial rotation and rotation about the transducer face, in one embodiment the transducer probe includes an accelerometer or "bubble level" type sensor 110. Either of such added sensors 110 determine the transducer position relative to a gravity vector. Any motion of the transducer out of a plane defined by the gravity vector is detected by the added sensor. For example, accuracy in the measurement of axial rotation or rotation about the transducer face is improved when such motion is out of the plane defined by the gravity vector. Due to a relatively small size for either of such sensors, the transducer probe geometry, size and weight are not substantially impacted. En addition because the sensors are comparably small, they do not interfere with the electrical properties of the transducer.
Combining Image Frames
Once local motion vectors are achieved for each pixel block of an image frame, the vector components are combined to define a global motion vector for a given image data frame, n. in one embodiment a minimum least squares error parameter fitting is used to combine the motion vector outputs, using multiple optimization parameters. The weighting gives a motion vector having a larger weight w(i) more effect than those having a smaller weight. Thus, the more reliable motion vectors contribute more heavily to the optimization process. The geometrically correlated frames are combined to form a 3D volume.
Alternative Estimation Procedures
In the description above, the MSAD or SAD routines are disclosed as being the preferred procedures for estimating, for example, in-plane transducer motion. The advantage of these routines is that they require no multiplication steps--only an accumulation of differences--and can thus be carried out very fast. Speed, however, is a function of available processing power, and other estimation routines may be used instead of MSAD and SAD routines as the computational power becomes available. One alternative technique, for example, is conventional least-squares estimation, according to which the squares of absolute differences are accumulated and compared. In all cases, the chosen routine is based on some measure--metric--of difference. Any metric may be used according to the invention, as long as conventional experimentation and theoretical calculations are used to make an acceptable trade-of between speed of computation and the statistical significance of the measure of difference that the chosen routine provides.
Meritorious and Advantageous Effects
It should be apparent that the above method and apparatus is applicable to both real-time imaging and regeneration of recorded image information. In application, a physician may use a conventional ultrasound system to produce image frames that are recorded onto a permanent storage medium, such as a tape. Subsequently, the image frames are processed into a 3D volume for later viewing by a physician by bringing the recorded image frame data to a viewing station. The viewing station processes the image frame data using the method described herein. It should also be apparent that the method and apparatus of this invention, are not limited to processing of ultrasound images, but are equally applicable to other imaging modalities, such as radar.
Claims
What is claimed is:
1. A method for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising the steps of: moving the transducer array within any of six degrees of freedom while the transducer array is positioned at a patient in the vicinity of the target area and while the transducer array emits ultrasound signals and receives returning echoes of the emitted ultrasound signals; sampling the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; aggregating correlated portions of the multiple intermediate frames using at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size.
2. The method of claim 1, in which the step of correlating multiple intermediate frames comprises the step of estimating time delay between the corresponding signals received at each one of at least two transducer elements in an elevational column of transducer elements.
3. The method of claim 1, in which the step of moving comprises at a given time moving the transducer array along one degree of freedom, and in which the step of correlating multiple intermediate frames comprises the step of estimating spectral breadth of a pulsed-wave Doppler spectrum derived from a series of repeated echo data samples of multiple intermediate frames at a single depth over time.
4. The method of claim 1, in which the step of moving comprises at a given time moving the transducer array along one degree of freedom, and in which the step of correlating multiple intermediate frames comprises the steps of passing data samples for a given depth within for each frame of the multiple intermediate frames through a high-pass wall filter to derive a filtered sample set, and deriving a power function of the filtered sample set.
5. The method of claim 1, in which the step of moving comprises at a given time moving the transducer array along one degree of freedom, and in which the step of correlating multiple intermediate frames comprises the step of estimating rate of speckle decorrelation among the multiple intermediate frames.
6. The method of claim 1, in which the transducer array defines a face of transducer elements, and in which at least one out-of-plane motion vector component comprises an elevational motion component, axial rotation motion component and a rotation-about-the-face motion component.
7. An ultrasound diagnostic imaging system for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising: a transducer array having a plurality of transducer elements arranged in a plurality of rows and columns, the transducer array movable within any of six degrees of freedom while positioned at a patient in the vicinity of the target area, the transducer array emitting ultrasound signals and receiving returning echoes of the emitted ultrasound signals; a receiver which samples the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; processing means for: registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; and aggregating correlated portions of the multiple intermediate frames using the at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; and a display device receiving a video signal corresponding to the 3-dimensional image volume which displays the 3-dimensional image volume over a field of view encompassing the second size.
8. The apparatus of claim 7, in which the processor means correlates the multiple intermediate frames by estimating time delay between the corresponding signals received at each one of at least two transducer elements in a transducer array column.
9. The apparatus of claim 7, in which the processor means correlates multiple intermediate frames by estimating spectral breadth of a pulsed-wave Doppler spectrum derived from a series of repeated echo data samples of multiple intermediate frames at a single depth over time.
10. The apparatus of claim 7, further comprising a high pass wall filter and wherein data samples at a given depth for each frame of the multiple intermediate frames pass through the high-pass wall filter to derive a filtered sample set; and in which the processor means correlates multiple intermediate frames by deriving a power function of the filtered sample set.
11. The apparatus of claim 7, in which the processor means correlates multiple intermediate frames by estimating rate of speckle decorrelation among the multiple intermediate frames.
12. The apparatus of claim 7, in which the transducer array defines a face of transducer elements, and in which at least one out-of-plane motion vector component comprises an elevational motion component, axial rotation motion component and a rotation-about-the-face motion component.
13. A method for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising the steps of: moving the transducer array within any of six degrees of freedom while the transducer array is positioned at a patient in the vicinity of the target area and while the transducer array emits ultrasound signals and receives returning echoes of the emitted ultrasound signals; sampling the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; aggregating correlated portions of the multiple intermediate frames using at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; in which: the step of moving comprises at a given time moving the transducer array along one degree of freedom; the step of correlating multiple intermediate frames comprises the step of estimating rate of speckle decorrelation among the multiple intermediate frames; and the image volume is segmented into speckle regions based on a speckle quality factor.
14. A method for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising the steps of: moving the transducer array within any of six degrees of freedom while the transducer array is positioned at a patient in the vicinity of the target area and while the transducer array emits ultrasound signals and receives returning echoes of the emitted ultrasound signals; sampling the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; aggregating correlated portions of the multiple intermediate frames using at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; and sampling a sensor responsive to motion out of a plane defined by a gravity vector; in which: the transducer array defines a face of transducer elements; and at least one out-of-plane motion vector component comprises an elevational motion component, axial rotation motion component and a rotation-about-the-face motion component.
15. A method for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising the steps of: moving the transducer array within any of six degrees of freedom while the transducer array is positioned at a patient in the vicinity of the target area and while the transducer array emits ultrasound signals and receives returning echoes of the emitted ultrasound signals; sampling the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; aggregating correlated portions of the multiple intermediate frames using at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; in which the step of correlating multiple intermediate frames comprises the following sub-steps: generating a spectral estimation on echo data corresponding to a given transducer beam for various depth ranges during multiple frames; identifying a peak for each spectral estimation; and deriving the out-of-plane rotation vector from the identified peaks.
16. The method of claim 6, in which the out-of-plane motion vector is derived by fitting the identified peaks to a plane and determining the intersection of the plane and a data frame for a plurality of the multiple frames used to generate the spectral estimations.
17. An ultrasound diagnostic imaging system for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising: a transducer array having a plurality of transducer elements arranged in a plurality of rows and columns, the transducer array movable within any of six degrees of freedom while positioned at a patient in the vicinity of the target area, the transducer array emitting ultrasound signals and receiving returning echoes of the emitted ultrasound signals; a receiver which samples the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; processing means for: registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; and aggregating correlated portions of the multiple intermediate frames using the at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; and a display device receiving a video signal corresponding to the 3-dimensional image volume which displays the 3-dimensional image volume over a field of view encompassing the second size; in which: the processor means correlates multiple intermediate frames by estimating rate of speckle decorrelation among the multiple intermediate frames; and the image volume is segmented into speckle regions based on a speckle quality factor.
18. An ultrasound diagnostic imaging system for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising: a transducer array having a plurality of transducer elements arranged in a plurality of rows and columns, the transducer array movable within any of six degrees of freedom while positioned at a patient in the vicinity of the target area, the transducer array emitting ultrasound signals and receiving returning echoes of the emitted ultrasound signals; a receiver which samples the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; processing means for: registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; and aggregating correlated portions of the multiple intermediate frames using the at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; and correlating multiple intermediate frames by generating, for each one of multiple transducer elements of the array, a spectral estimation on echo data corresponding to a given transducer beam for various depth ranges during multiple frames, identifying a peak for each spectral estimation, and deriving the out-of-plane rotation vector from the identified peaks; and a display device receiving a video signal corresponding to the 3-dimensional image volume which displays the 3-dimensional image volume over a field of view encompassing the second size.
19. An ultrasound diagnostic imaging system for generating an ultrasound image of a patient target area encompassing a field of view extended beyond a given transducer array's field of view, comprising: a transducer array having a plurality of transducer elements arranged in a plurality of rows and columns, the transducer array movable within any of six degrees of freedom while positioned at a patient in the vicinity of the target area, the transducer array emitting ultrasound signals and receiving returning echoes of the emitted ultrasound signals; a receiver which samples the received echoes within a scan plane at each active transducer element within the transducer array to generate a plurality of frames of echo data for respective positions of the transducer array relative to the patient, a given frame of echo data encompassing a field of view of a first size; processing means for: registering the plurality of frames of echo data to derive at least one in-plane motion vector component for each one of multiple frames of the plurality of frames; performing data rotation on said multiple frames to derive corresponding multiple intermediate frames in which in-plane motion variation is factored out; correlating the multiple intermediate frames to derive at least one out-of-plane motion vector component for each one of the multiple intermediate frames; and aggregating correlated portions of the multiple intermediate frames using the at least one in-plane motion vector component and the at least one out-of-plane motion vector component of each frame to define a 3-dimensional image volume encompassing a field of view of a second size, the second size larger than the first size; and a display device receiving a video signal corresponding to the 3-dimensional image volume which displays the 3-dimensional image volume over a field of view encompassing the second size; in which: the transducer array defines a face of transducer elements; and at least one out-of-plane motion vector component comprises an elevational motion component, axial rotation motion component and a rotation-about-the-face motion component; further comprising: an accelerometer sensor for sensing transducer rotation that is off of a pre-defined line.
20. The apparatus of claim 19, in which the out-of-plane motion vector is derived by fitting the identified peaks to a plane and determining the intersection of the plane and a data frame for a plurality of the multiple frames used to generate the spectral estimations.