US 4,821,728 AGrant
Three-Dimensional Imaging System
Issue Date:1989-04-18
•16 Claims
•7 Drawing Sheets
Abstract
A three-dimensional imaging system for obtaining a three-dimensional image of an object being scanned ultrasonically comprises a source arrangement for sequentially transmitting ultrasonic energy toward the object in successive directions in a first scanning plane, followed by sequential transmission of ultrasonic energy toward the object in successive directions in successive scanning planes parallel to the first scanning plane, a detector arrangement for receiving reflected energy and converting the reflected energy to electrical signals, and a processor for processing the electrical signals to develop reconstructed image data of the object, the reconstructed image data comprising forward projections of the object into a left image plane and a right image plane to form left and right images, respectively, the left and right images forming a stereo pair for composite display by a display unit. In a further embodiment of the invention, the source arrangement sequentially transmits ultrasonic energy toward the object in successive directions in a first scanning plane, and repeats the sequential transmission of ultrasonic energy in successive scanning planes, the successive planes having increasing angular orientations with respect to the first scanning plane. Further features of the invention include the provision of various source-detector combinations and arrangements.
Metadata
Assignee
- National Biomedical Research Foundation
Inventor
- Robert S. Ledley
Application Information
Application Number:US 1502689
Filing Date:1988-01-29
Priority Date:1984-03-28
Art Unit:335
Classifications
IPC:
A61B 800
Field of Search:
1283583647366088;91;92414;415602;621;624;625;626;628;618
Patent Drawings (7 sheets)
Description
Background of the Invention
1. Field of the Invention
The present invention relates to a three-dimensional imaging system for obtaining a three-dimensional image of an object. In particular, the invention relates to a three-dimensional ultrasound imaging system for obtaining a three-dimensional image of an object scanned using ultrasound scanning techniques disclosed below.
2. Description of the Prior Art
Ultrasound scanning systems of various types are well-known in the prior art. For example, most prior art medical ultrasound scanning systems generally utilized may be classified as A-type or B-type.
In an A-type ultrasound scanner, a fixed transducer provides an ultrasound pulse which is directed along a fixed path into a body or object. The times of return for reflections from internal organic interfaces are detected to provide an indication of the distance to such interfaces.
In a B-type scanner, a pulsed ultrasonic beam is swept in a single direction, and, as in the A-type scanner, the successive distances or ranges to reflecting organic interfaces are determined by standard intervalometer methods. These B-type scanners typically provide an indicia of the interface by, in effect, plotting the detected distances against the position of the beam path. Various B-type scanners have included a real-time display, and have effected scanning electrically, for example, by use of a phased transducer array.
U.S. Pat. No. 4,271,706--Ledley discloses an ultrasonic scanner in which an ultrasonic pulse is directed into a body and electrical representations of pulse reflections from body interfaces, along the path of the ultrasonic pulse, are generated. In the ultrasonic scanner of that patent, the ultrasonic signal path is scanned through a volume of the body, and position signals indicative of the instantaneous position are generated. The reflection signals are selectively gated in accordance with a predetermined function of the path disposition to provide a display selectively representing desired interfaces situated within a selected contoured portion of the volume being scanned. By varying the predetermined function, a specific desired interface surface may be displayed. Provisions for developing a three-dimensional display of the selected surface are described in the aforementioned patent.
Other methods and devices for representing electrical spatial curves and spatial images of electrically reproduced ultrasonic images, X-ray images or cardiac vector loops, as well as an apparatus for collecting three-dimensional data relating to the size, shape, location and nature of soft tissue organ structures, are disclosed in U.S. Pat. No. 4,292,977--Krause et al and U.S. Pat. No. Re. 30,397--King. In addition, an ultrasonic stereoscopic imaging device or apparatus for three-dimensional visualization of an object or substance is disclosed in U.S. Pat. No. 4,028,934--Sollish.
Arrangements involving arrays of transducers, or of ultrasonic transmitters and/or receivers, are disclosed in U.S. Pat. Nos. 3,292,018--Clynes, 3,552,382--Mount, and 3,577,772--Perilhou et al.
The following U.S. patents disclose other ultrasonic systems and devices: U.S. Pat. Nos. 3,681,977--Wendt et al; 3,888,238--Meindl et al; 3,936,791--Kossoff; 3,964,296--Matzuk; 4,075,883--Glover; 4,109,642--Reid et al; and 4,121,468--Glover et al.
The ultrasonic arrangements, devices and systems described in the aforementioned patents are characterized by certain disadvantages. For example, ultrasonic arrangements, devices and systems of the prior art failed to take advantage of theories relating to texture and visual perception, as well as binocular perception. Such theories and the related theoretical techniques are disclosed in the following two articles: "Texture and Visual Perception", by Bela Julesz, Scientific American, February 1965, pages 38-48; and "The Resources of Binocular Perception", by John Ross, Scientific American, March 1976, pages 80-86.
Related to the latter observation is the further observation that ultrasonic arrangements, devices and systems of the prior art failed to take advantage of the advanced state of computer and data processing technology, and specifically failed to take advantage of the savings in hardware which can be achieved by development and adoption of sophisticated data processing/programming techniques for processing ultrasonic system data to derive reconstructed image data for the three-dimensional display of three-dimensional images of objects scanned by the three-dimensional imaging system.
Summary of Invention
The present invention relates to a three-dimensional imaging system for obtaining a three-dimensional image of an object scanned by the imaging system.
More specifically, one embodiment of the three-dimensional imaging system of the present invention comprises a source arrangement for sequentially transmitting ultrasonic energy toward an object in successive directions in a first scanning plane, and then repeating the sequential transmission of ultrasonic energy toward the object in the successive directions in successive scanning planes parallel to the first scanning plane, a detector arrangement for receiving energy reflected from the object and converting the reflected energy to electrical signals, and a processor connected to the detector arrangement for processing the electrical signals to develop reconstructed image data relating to the object scanned. In particular, the detector arrangement is disposed in an image plane displaced from the object being scanned and divided into a left image plane and a right image plane, the reconstructed image data being developed as a result of operation of the processor to derive forward projections of the object onto the left image plane and the right image plane to develop a first image and a second image, respectively, the first and second images forming a stereo pair. The system further comprises a display unit for displaying the first and second images compositely, thus displaying the three-dimensional image of the object.
In a further embodiment of the three-dimensional imaging system of the present invention, the source arrangement sequentially transmits ultrasonic energy toward the object in successive directions in a first scanning plane, and then repeats the sequential transmission of the ultrasonic energy toward the object in successive directions in successive scanning planes, the successive scanning planes having increasing angular orientations with respect to the first scanning plane. Energy reflected from the object is converted to electrical signals by the detector arrangement, and then the processor processes the electrical signals to develop reconstructed image data by deriving forward projections of the object onto a left image plane and a right image plane to develop a first image and a second image, respectively, the latter forming a stereo pair of images for composite display on a display unit.
In accordance with further teachings of the invention, either a plurality of source-detector pairs, one for each scanning plane, can be arranged in a line contained within the image plane, and can be arranged to scan the object in a first scanning plane and in successive, parallel scanning planes, respectively, or a single source-detector pair can be disposed at a point (for example, a point of intersection between the image plane and the first scanning plane), and can be arranged to scan the object in the first scanning plane and in successive scanning planes having increasing angular orientations with respect to the first scanning plane.
In addition, scanning in each scanning plane can be accomplished either by a single source and a single detector, or by a pair of sources and a corresponding pair of detectors, or by a single source and a pair of detectors.
Finally, significant savings in scanning time with respect to each scanning plane can be achieved by providing a source which, rather than sequentially scanning in different directions within a given scanning plane, simultaneously transmits scanning signals of different respective frequencies in different respective directions within a given scanning plane.
Therefore, it is a primary object of the present invention to provide a three-dimensional imaging system for obtaining a three-dimensional image of an object being scanned.
It is an additional object of the present invention to provide a three-dimensional imaging system wherein a source arrangement sequentially transmits ultrasonic energy toward an object being scanned in successive directions in a first scanning plane, and repeats the sequential transmission of ultrasonic energy toward the object in successive directions in successive scanning planes parallel to the first plane.
It is an additional object of the present invention to provide a three-dimensional imaging system wherein a source arrangement sequentially transmits ultrasonic energy toward an object being scanned in successive directions in a first scanning plane, and repeats the sequential transmission of ultrasonic energy toward the object in successive directions in successive scanning planes, the successive scanning planes having increasing angular orientations with respect to the first scanning plane.
It is an additional object of the present invention to provide a three-dimensional imaging system having a source arrangement which comprises a plurality of source-detector pairs, one for each scanning plane.
It is an additional object of the present invention to provide a three-dimensional imaging system having a source arrangement comprising a single source-detector pair for performing ultrasonic scanning in a first scanning plane and successive scanning planes, the successive scanning planes having increasing angular orientations with respect to the first scanning plane.
It is an additional object of the present invention to provide a three-dimensional imaging system having a source arrangement comprising, in a given scanning plane, a single source and a single detector.
It is an additional object of the present invention to provide a three-dimensional imaging system having a source arrangement comprising, for a given scanning plane, first and second source-detector pairs.
It is an additional object of the present invention to provide a three-dimensional imaging system having a source arrangement comprising, for a given scanning plane, a single source and a pair of detectors.
The above and other objects that will hereinafter appear, and the nature of the invention, will be more clearly understood by reference to the following description, the appended claims, and the accompanying drawings.
Brief Description of Drawings
FIGS. 1A-1C are graphical illustrations used to describe binocular perception theory as it relates to the present invention.
FIG. 2A is a diagrammatic representation of one embodiment of the present invention, employing parallel scanning planes.
FIG. 2B is a top view of the embodiment of FIG. 2A, as seen along arrow A in FIG. 2A.
FIG. 2C is a diagrammatic representation of a further embodiment of the invention, employing a first scanning plane and successive scanning planes having increasing angular orientations with respect to the first scanning plane.
FIG. 3 is a top view of a further embodiment of the invention, employing two source-detector pairs.
FIG. 4 is a top view of a further embodiment of the invention, employing a single source-detector pair.
FIG. 5 is a top view of a further embodiment of the invention, employing a single source and a pair of detectors.
FIG. 6A is a top view of a further embodiment of the invention, employing the transmission of different respective frequencies in different respective directions within a given scanning plane.
FIGS. 6B and 6C are source arrangements and FIG. 6D is a detector arrangement for implementing the embodiment of FIG. 6A.
FIG. 7 is a block diagram of the three-dimensional imaging system of the present invention.
FIG. 8 is a flowchart of the operations performed by the image processor 72 of FIG. 7.
Detailed Description
The invention will now be more fully described with reference to FIGS. 1A-1C, which are utilized to discuss binocular perception theory as it relates to the present invention.
FIG. 1A depicts a front view of two planes 10 and 12, each containing a random dot pattern. FIG. 1B is a top view of the two planes 10 and 12, wherein it is seen that the plane 12 is located in front of the plane 10. Also seen in FIG. 1B are left and right image planes 14 and 16, which can be thought of as corresponding to the image planes formed by the retinae of left and right eyes of a person viewing the two planes 10 and 12. In FIG. 1B, the dotted lines represent forward projections of the patterns, contained on planes 10 and 12, respectively, onto image planes 14 and 16, respectively.
Turning to FIG. 1C, that figure depicts the projections, onto image planes 14 and 16, respectively, of the images contained on planes 10 and 12, respectively, of FIG. 1B. The projections of the pattern contained on plane 10 onto image planes 14 and 16, respectively, are designated by reference numerals 10a' and 10b', respectively, whereas the projections of the pattern contained on plane 12 onto image planes 14 and 16, respectively, are designated by reference numerals 12a' and 12b', respectively.
If the random dot patterns contained on planes 10 and 12 are viewed monocularly, only a two-dimensional perception results. That is, the monocular perception of the random dot patterns contained on planes 10 and 12 of FIG. 1A will correspond to one or the other of the monocular images 10a', 12a' or 10b', 12b' appearing on image planes 14 and 16, respectively, of FIG. 1C. However, if the random dot patterns on planes 10 and 12 of FIG. 1A are viewed binocularly, the stereo pair of images designated 14 and 16, as seen in FIG. 1C, will result.
In terms of human viewing of the patterns contained on planes 10 and 12, the human brain acts as a processor and processes the stereo pair of monocular images so as to form, in the "mind's eye", a three-dimensional image of planes 10 and 12. Thus, a human who views planes 10 and 12 binocularly will perceive plane 12 as being displaced vertically (in the third dimension) with respect to plane 10.
The present invention exploits the latter theory in the development of an ultrasonic imaging system which has minimal hardware by virtue of the fact that sophisticated programming techniques are employed to process stereo images of reflected ultrasonic energy so as to reconstruct a three-dimensional image of an object scanned ultrasonically.
FIG. 2A depicts a first embodiment of the present invention. As seen therein, a plurality of sources SA, SB, . . . and detectors DA, DB, . . . are arranged in an image plane displaced from an object 20 to be scanned. Each of the sources SA, SB, . . . is connected to a source sequencer 22, which is a conventional sequencing device for activating each of the ultrasonic sources SA, SB, . . . in sequence to scan the object 20. Thus, source SA will scan the object 20 during a first scanning cycle, source SB will scan the object 20 during a second scanning cycle, and so forth.
Turning to FIG. 2B, which is a top view of the embodiment of FIG. 2A, as viewed along arrow A in FIG. 2A, scanning of the object 20 by each source (for example, source SA) consists of the transmission of ultrasonic energy in a first direction 26, followed by successive transmissions of ultrasonic energy in directions displaced by increasing angular amounts from direction 26 until transmission in direction 28 is achieved. In accordance with well-known ultrasonic scanning techniques, the ultrasonic energy will be reflected from material, such as material of the object 20, appearing in the scan path. Such reflected ultrasonic energy will be detected by detectors DA, DB, . . . , such detectors providing detection outputs to a detector data multiplexer 24.
Detector data multiplexer 24 is a conventional device which polls each of detectors DA, DB, . . . in succession, and in correspondence to the scanning cyles of sources SA, SB, . . . Data from the detectors DA, DB, . . . , as multiplexed by detector data multiplexer 24, is provided as a detector data output to the image processing system associated with the present invention, as described subsequently with reference to FIG. 7.
FIG. 2C is a diagrammatic representation of a second embodiment of the invention, wherein a single source S and a single detector D are disposed in an image plane, designated by reference numeral 34, in opposition to an object 20 to be scanned In this embodiment, ultrasonic scanning of the object 20, by means of the transmission of ultrasound signals by source S, takes place in a first scanning plane 36, and is then repeated in successive scanning planes 38, 40, and so forth, each successive scanning plane being angularly displaced from the first scanning plane 36 by increasing angular amounts. Either a manual technique, or any conventional motor capable of imparting motion in two dimensions (such as that in previously discussed U.S. Pat. No. 4,271,706--Ledley), or a combination thereof, can be used to drive the source of FIG. 2C.
Energy reflected from the object 20 as a result of each scanning cycle is received by the single detector D, which provides detector data to the image processing system, which will be described in more detail below with reference to FIG. 7. At this juncture, it is sufficient to state that the image processing system processes the detector data so as to develop data representing forward projections of the object 20 onto image plane 34, such forward projections being represented by the horizontal dotted lines perpendicular to the image plane 34 in FIG. 2C.
FIG. 3 is a diagrammatic representation of a further embodiment of the invention, employing two source-detector pairs. Specifically, a source S1 and a detector D1 form a source-detector pair positioned at the center of a left image plane 42, while a source S2 and a detector D2 form a second source-detector pair positioned at the center of a right image plane 44.
In operation, each source-detector pair scans the object 20 with ultrasound energy during a given scanning cycle. Reflected energy is received by detectors D1 and D2, respectively, and corresponding detector data are provided to the image processing system. The image processing system processes the detector data, in a manner to be discussed in more detail below, so as to develop image data representing forward projections of the object 20 in both the left plane 42 and right plane 44, the image data in these two planes forming a stereo pair.
It is to be recognized that this embodiment of the invention, involving two source-detector pairs, can be utilized in combination with the embodiment of FIG. 2A, in which case there would be two source-detector pairs for each parallel scanning plane, or can be utilized in combination with the embodiment of FIG. 2C, in which case there would be two source-detector pairs positioned in image plane 34 (see FIG. 2C), which source-detector pairs would generate successive pairs of scans corresponding to scans 36, 38, 40 and so forth, each pair of scans angularly displaced with respect to the preceding pairs of scans.
FIG. 4 is a diagrammatic representation of a further embodiment of the invention, wherein a single source-detector pair, comprising source S1 and detector D1, is employed. In this embodiment, the source S1 is located at a different position with respect to the position of detector D1, as shown in FIG. 4. When ultrasonic energy is transmitted by source S1 toward the object 20, the resulting reflected energy is received by detector D1, which provides detector data to the image processing system, the latter processing the detector data to develop image data representing forward projections onto the left plane 46 and right plane 48 of FIG. 4.
Again, it is to be recognized that this embodiment of the invention can be combined with the embodiments of FIG. 2A or 2C, such that there would be one source-detector pair for each parallel scanning plane (as in FIG. 2A), or one source-detector pair for generating each of the angularly displaced scans 36, 38, 40, etc. (as in FIG. 2C).
FIG. 5 is a diagrammatic representation of a further embodiment of the invention, involviong the employment of a single source S1 for transmitting ultrasonic energy toward the object 20, in combination with two detectors D1 and D2, each detector being positioned at the center of a respective image plane 50 or 52. Again, this embodiment of FIG. 5 can be utilized in combination with either the embodiment of FIG. 2A or the embodiment of FIG. 2C.
FIG. 6A is a diagrammatic representation of a further embodiment of the invention, wherein a single source-detector pair S, D is employed to generate, on a simultaneous basis, a plurality of scanning beams or signals having different respective frequencies in different directions. Thus, a predetermined plurality of beams disposed at predetermined angular intervals from left scanning beam 54 through right scanning beam 56 are generated simultaneously, with each respective scanning beam having a different respective frequency.
When energy is reflected, the reflected energy is received by the detector D, and corresponding detector data is provided to the image processing system. Thus, even though the ultrasonic beams or signals are generated simultaneously, and the corresponding detector data is received virtually simultaneously, reflected energy corresponding to one ultrasonic transmission can be distinguished from reflected energy corresponding to the other ultrasonic transmissions by virtue of the difference in frequency. It is to be recognized that this multi-frequency technique can be employed in any of the embodiments described above so as to effect simultaneous ultrasound beam transmission. This results in an extremely short scanning cycle, with overall savings in operational time, as well as achievement of the advantage of superior responsiveness of the overall system.
It is to be appreciated that various source-detector arrangements may be utilized in implementing the multi-frequency technique described above. For example, as shown in FIG. 6B, a plurality of crystal oscillators 61a-61f can be arranged in an angular array around a driver 60, the latter successively activating each oscillator for generating successive signals of different frequencies in respective directions. Alternatively, as shown in FIG. 6C, an arrangement of a plurality of oscillators 61a'-61f' can be connected in common to a driver 60', and can be arranged to rotate in an angular direction as indicated by the arrow 62, the driver 60' being operated at each successive angular position to activate a respective one of the oscillators 61a'-61f', thus generating signals of different frequencies in different respective directions.
With respect to the detection of the signals of different frequencies, a detector arrangement such as that shown in FIG. 6D can be employed. Such a detector arrangement comprises a receiver 68 connected in common to a plurality of filters 69a-69f, each filter having a respective output for providing its respective analog data output to the image processor (as discussed below). In this manner, the image processor is able to differentiate signals of different frequency as received from different respective scan directions.
FIG. 7 is a block diagram of the image processing system employed with the present invention. As seen therein, the image processing system of the present invention basically comprises an analog-to-digital converter (ADC) 70, an image processor 72, and a storage and display unit 74.
The ADC 70 is a standard or conventional analog-to-digital converter which converts the analog detector data received from the detector(s) to digital form for input to the image processor 72.
The image processor 72 is a conventional digital computer which is programmed to process the digital detector data in such a manner (to be described below) as to compute the image data representing forward projections of the reflected ultrasound energy (and thus of the objects encountered by the transmitted ultrasonic energy) onto the image plane(s), as mentioned above.
The storage and display unit 74 is a conventional storage and display unit which, in response to the digital image data (or coordinate data) developed by the image processor 72, in correspondence to the computed forward projection data, displays in two-dimensional form a virtual three-dimensional image representing the object 20 scanned by the ultrasonic scanning system described above.
It is to be noted that the ADC 70 can be implemented by any conventional analog-to-digital converter. The image processor 72 can be implemented by any conventional image processor, such as the IP 5000 manufactured by DeAnza Systems The storage and display unit 74 can be any conventional storage and display unit employed in image processing systems, such as the RAMTEK display unit manufactured by Ramtek Corporation.
FIG. 8 is a flowchart of program operations performed by the image processor 72 in accordance with the present invention. Referring to FIG. 8, the operations of the image processor 72 are as follows. When processing is to start (block 80), the image processor 72 accepts a reflection profile as a function of time from the ADC 70 (block 81). This reflection profile data is differentiated to identify reflective peaks (block 82). Each peak identified within the reflection profile is selected sequentially (block 83), and a decision is made as to whether or not the peak is significant (block 84). Significance of a peak is determined based on various well-known threshold-related or parameter-related techniques, as would be obvious to one of skill in the art.
If the peak is determined to be significant, the X, Y and Z coordinates of the reflective point are computed from the angles and time interval (duration between transmission and reception of a signal reflected from the object being scanned) of each peak (block 85). Computations are performed in accordance with the following well-known coordinate equations: ##EQU1## where k is a scaling factor, T is the time interval for the reflected beam, .phi..sub.i, .phi..sub.j and .phi..sub.k are angles of the beam measured with respect to unit vectors l, J and K.
Once the computation of the X, Y and Z coordinates is carried out, a decision is made as to whether or not the coordinates are inside the field of interest, using further well-known parametric techniques (block 86). If the coordinates are inside the field of interest, the computed coordinates are used to project the detected point onto left and right stereo views in the storage and display unit 74 (block 87).
If (referring to block 84) the peak is determined not to be significant, or if (referring to block 86) the coordinates are determined not to be inside the field of interest, or if (referring to block 87) a point is projected onto the left and right stereo views in the storage and display unit 74, a further determination as to whether or not the last peak has been sequentially processed is made (block 88). If the last peak has not been processed, the next peak is sequentially selected (block 83), and processing continues (blocks 84-87). If the last peak has been processed (block 88), a determination as to whether or not the last profile has been accepted is made (block 89).
If the last profile has not been accepted, the processor accepts another reflection profile (block 81) and processing of that reflection profile proceeds. If, on the other hand, the last profile has been accepted (block 89), the processor 72 ceases operation (block 90).
It should be recognized that the ultrasonic sources SA, S1, S2, and so forth, referred to above can be implemented by any conventional source of ultrasonic energy, as is well known to those of skill in the art. Such ultrasonic energy sources are to be adapted to provide for ultrasonic scanning of an object in terms of (1) the successive transmission of ultrasonic beams in successively incremented angular directions (as described above with respect to FIGS. 2A and 2B), (2) the generation of successive scanning beam cycles occurring in successive scanning planes, the scanning planes having increasing angular orientations with respect to a first scanning plane (as described above with respect to FIG. 2C), and (3) the transmission of a plurality of ultrasonic beams of different respective frequencies in different angular directions (as described above with reference to FIGS. 6A-6D).
In addition, it is to be recognized that the detectors DA, D1, D2, and so forth, described above can be implemented by any conventional detector(s) capable of detecting reflected ultrasonic energy and providing corresponding analog detector data to an image processing system, provided that such detectors are adapted to provide the functions of the present invention, as described above.
As is well known to those of skill in the art, the sources and detectors described above can be provided in the form of transducer elements, arranged either singularly or in transducer arrays. With respect to the provision of transducer arrays, it is also to be recognized that phased arrays of transducers can be employed without departing from the scope of the present invention.
While preferred forms and arrangements have been shown in illustrating the invention, it is to be clearly understood that various changes in detail and arrangement may be made without departing from the spirit and scope of this disclosure.
Claims
What is claimed is:
1. A three-dimensional imaging system for obtaining a three-dimensional image of a three-dimensional object, comprising: source means displaced from the three-dimensional object for transmitting ultrasonic energy toward the three-dimensional object in successive directions in a first scanning plane, each successive direction having an angular orientation, with respect to a reference direction in the first scanning plane, which is greater than the angular orientation with respect to the reference direction of any preceding direction, and for repeating the transmission of ultrasonic energy toward the three-dimensional object in successive directions in successive scanning planes parallel to said first scanning plane; detector means for receiving reflected energy reflected from material of the three-dimensional object as a result of scanning of said three-dimensional object by said source means in said first and said successive scanning planes, and for converting said reflected energy to electrical signals; processing means connected to said detector means for receiving said electrical signals, and for processing said electrical signals to develop reconstructed image data of the three-dimensional object, said reconstructed image data developed by said processing means corresponding to forward projections of the three-dimensional object into a left image plane to form a first image and into a right image plane to form a second image, said first and second images forming a stereo pair, and display means connected to said processing means and responsive to said reconstructed image data developed by said processing means for displaying said first and second images compositely, thereby displaying said three-dimensional image of the three-dimensional object; wherein each of said electrical signals received by said processing means represents a reflection profile for the energy reflected from the material of the three-dimensional object as a result of scanning in a respective one of said successive directions, said processing means comprising means for performing a differentiation operation to identify reflective peaks in the reflection profile.
2. The system of claim 1, wherein said processing means comprises determining means for determining, for each identified reflective peak, whether or not the reflective peak is significant and, if the reflective peak is significant, said processing means computes spatial coordinates of a corresponding point of reflection on the three-dimensional object.
3. The system of claim 2, wherein said processing means comprises additional determining means for determining whether or not the reflective peak is the final reflective peak within the reflection profile, and wherein, if said determining means determines that the reflective peak is not significant, said additional determining means determines whether or not the reflective peak is the final reflective peak within the reflection profile, and said processing means processes a subsequent reflective peak if the reflective peak is not the final reflective peak within the reflection profile, and said processing means processes a subsequent reflection profile if the reflective peak is the final reflective peak within the reflection profile.
4. The system of claim 2, wherein said processing means comprises additional determining means for determining whether or not the computed spatial coordinates of the corresponding point of reflection are within a volumetric field of interest and, if the computed spatial coordinate of the corresponding point of reflection are within the volumetric field of interest, said processing means computes the coordinates of the projection of the corresponding point of reflection onto said left image plane and said right image plane, respectively.
5. The system of claim 4, wherein said processing means comprises further determining means for determining whether or not the reflective peak is the final reflective peak within the reflection profile, and wherein, if said additional determining means determines that the computed spatial coordinates of the corresponding point of reflection are not within the volumetric field of interest, said further determining means determines whether or not the reflective peak is a final reflective peak within the reflection profile and, if the reflective peak is not a final reflective peak within the reflection profile, said processing means processes a subsequent reflective peak within the reflection profile, and, if the reflective peak is a final reflective peak within the reflection profile, said processing means processes a subsequent reflection profile.
6. The system of claim 4, wherein said processing means comprises further determining means for determining whether or not the reflective peak is the final reflective peak within the reflection profile, and wherein, after said processing means computes the coordinates of the projection of the corresponding point of reflection onto said left image plane and said right image plane, respectively, said further determining means determines whether or not the reflective peak is a final reflective peak within the reflection profile, and, if the reflective peak is not a final reflective peak within the reflection profile, said processing means processes a subsequent reflective peak, and, if the reflective peak is the final reflective peak within the reflection profile, said processing means processes a subsequent reflection profile.
7. The system of claim 4, wherein said processing means comprises computing means for computing the spatial coordinates of the corresponding point of reflection from a plurality of angles defining a direction of transmission of the ultrasonic energy transmitted by said source means and from a time interval between transmission by said source means of the ultrasonic energy toward the three-dimensional object and reception by said detector means of the reflected energy reflected from the material of the three-dimensional object.
8. The system of claim 7, wherein said processing means comprises computing means for computing the spatial coordinates of the corresponding point of reflection from the following equations: ##EQU2## where k is a scaling factor, T is the time interval between transmission of the ultrasonic energy and reception of the reflected energy, I, J and K are unit vectors in three-dimensional space, and .phi..sub.i, .phi..sub.j and .phi..sub.k are angles measured with respect to the unit vectors and defining the direction of transmission of the ultrasonic energy.
9. A three-dimensional imaging system for obtaining a three-dimensional image of an object, comprising: source means for transmitting ultrasonic energy in different directions toward said object in a first scanning plane, said different directions having increasing angular orientations with respect to a reference direction, and for repeating the transmission of said ultrasonic energy in different directions toward said object in successive scanning planes; detector means for receiving reflected energy reflected from material of said object and for converting aid reflected energy to electric signals; and processing means connected to said detector means for receiving said electrical signals, and for processing said electrical signals to develop reconstructed image data of said object; wherein said detector means is disposed in an image plane displaced from said object and divided into a left image plane and a right image plane, said reconstructed image data comprising forward projections of said object into a first image in said left image plane and a second image in said right image plane, said first and second images forming a stereo pair; said system further comprising display means for displaying said first and second images compositely, whereby to display said three-dimensional image of said object; wherein said source means comprises at least one ultrasonic source disposed in said left image plane on a first line perpendicular both to said first scanning plane and to said forward projections, said system comprising additional source means for transmitting additional ultrasonic signals in additional different directions toward said object in said first scanning plane, said additional different directions having increasing angular orientations with respect to an additional reference direction, and for repeating the transmission of said ultrasonic signals in said additional different directions toward said object in successive scanning planes, said additional source means comprising at least one additional ultrasonic source disposed in said right image plane on a second line perpendicular both to said first scanning plane and to said forward projections.
10. The system of claim 9, wherein said source means comprises means for repeating the transmission of said ultrasonic energy in said different directions in successive scanning planes parallel to said first scanning plane.
11. The system of claim 9, wherein said source means comprises means for repeating the transmission of said ultrasonic energy in said different directions in successive scanning planes having increasing angular orientations with respect to said first scanning plane.
12. The system of claim 9, wherein the first line on which said at least one ultrasonic source is disposed is parallel to the second line on which said at least one additional ultrasonic source is disposed, whereby said ultrasonic source and said additional ultrasonic source each scan the three-dimensional object in a direction extending from the left image plane to the right image plane.
13. The system of claim 9, wherein said detector means comprises a first ultrasonic transducer disposed in said left image plane and a second ultrasonic transducer disposed in said right image plane.
14. A three-dimensional imaging system for obtaining a three-dimensional image of a three-dimensional object, comprising: source means displaced from the three-dimensional object for transmitting ultrasonic energy toward the three-dimensional object in successive directions in a first scanning plane, each successive direction having an angular orientation, with respect to a reference direction in the first scanning plane, which is greater than the angular orientation with respect to the reference direction of any preceding direction, and for repeating the transmission of ultrasonic energy toward the three-dimensional object in successive directions in successive scanning planes, wherein each successive scanning plane is parallel to said first scanning plane; detector means for receiving reflected energy reflected from material of the three-dimensional object as a result of scanning of said three-dimensional object by said source means in said first and said successive scanning planes, and for converting said reflected energy to electrical signals, wherein said detector means is disposed in an image plane displaced from the three-dimensional object, the image plane being perpendicular to the first scanning plane, the image plane being divided into a left image plane and a right image plane; processing means connected to said detector means for receiving said electrical signals, and for processing said electrical signals to develop reconstructed image data of the three-dimensional object, said reconstructed image data developed by said processing means corresponding to forward projections of the three-dimensional object into said left image plane to form a first image and into said right image plane to form a second image, said first and second images forming a stereo pair; and display means connected to said processing means and responsive to said reconstructed image data developed by said processing means for displaying said first and second images compositely, thereby displaying said three-dimensional image of the three-dimensional object; wherein said source means comprises a plurality of ultrasonic sources disposed in said image plane on a line perpendicular both to said first scanning plane and to said forward projections, said line forming a boundary between said left and right image planes.
15. A three-dimensional imaging system for obtaining a three-dimensional image of an object, comprising: source means for sequentially transmitting ultrasonic energy toward said object in successive directions in a first scanning plane, said successive directions having increasing angular orientations with respect to a reference direction, and for repeating the sequential transmission of ultrasonic energy toward said object in said successive directions in successive scanning planes having increasing angular orientations with respect to said first scanning plane; detector means for receiving reflected energy reflected from material of said object, and for converting said reflected energy to electrical signals; and processing means connected to said detector means for receiving said electrical signals, and for processing said electrical signals to develop reconstructed image data of said object; wherein said detector means is disposed in an image plane displaced from said object and divided into a left image plane and a right image plane, said reconstructed image data comprising forward projections of said object into a first image in said left image plane and a second image in said right image plane, said first and second images forming a stereo pair; said system further comprising display means for displaying said first and second images compositely, whereby to display said three-dimensional image of said object; wherein said detector means comprises a first ultrasonic transducer disposed in said left image plane and a second ultrasonic transducer disposed in said right image plane; and wherein said source means comprises a left ultrasonic source disposed in said first image plane, said system further comprising additional source means for sequentially transmitting ultrasonic energy toward said object in additional successive directions in said first scanning plane, said additional successive directions having increasing angular orientations with respect to an additional reference direction, and for repeating the sequential transmission of ultrasonic energy toward said object in said additional successive directions in said successive scanning planes, said additional source means comprising a right ultrasonic source disposed in said second image plane.
16. A three-dimensional imaging system for obtaining a three-dimensional image of a three-dimensional object, comprising: source means displaced from the three-dimensional object for transmitting ultrasonic energy toward the three-dimensional object in successive directions in a first scanning plane, each successive direction having an angular orientation, with respect to a reference direction in the first scanning plane, which is greater then the angular orientation with respect to the reference direction of any preceding direction, and for repeating the transmission of ultrasonic energy toward the three-dimensional object in successive directions in successive scanning planes parallel to said first scanning plane; detector means for receiving reflected energy reflected from material of the three-dimensional object as a result of scanning of said three-dimensional object by said source means in said first and said successive scanning planes, and for converting said reflected energy to electrical signals, wherein said detector means is disposed in an image plane displaced from the three-dimensional object, the image plane being perpendicular to the first scanning plane, the image plane being divided into a left image plane and a right image plane; processing means connected to said detector means for receiving said electrical signals, and for processing said electrical signals to develop reconstructed image data of the three-dimensional object, said reconstructed image data developed by said processing means corresponding to forward projections of the three-dimensional object into said left image plane to form a first image and into said right image plane to form a second image, said first and second images forming a stereo pair; and display means connected to said processing means and responsive to said reconstructed image data developed by said processing means for displaying said first and second images compositely, thereby displaying said three-dimensional image of the three-dimensional object; wherein said detector means comprises at least one ultrasonic transducer disposed in said image plane on a first line perpendicular both to said first scanning plane and to said forward projections, and at least one additional ultrasonic transducer disposed in said image plane on a second line perpendicular both to said first scanning plane and to said forward projections; and wherein said source means comprises at least one ultrasonic source disposed in said image plane on said first line, said system further comprising additional source means displaced from the three-dimensional object for transmitting ultrasonic energy toward the object in additional successive directions in said first scanning plane, each additional successive direction having an angular orientation, with respect to an additional reference direction in said first scanning plane, which is greater than the angular orientation of any preceding direction, and for repeating the transmission of said ultrasonic energy toward said object in additional successive directions in said successive scanning planes, said additional source means comprising at least one additional ultrasonic source disposed in said image plane on said second line.
Patent Citations (34)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| USRe30397 | 1980-09-01 | King | |
| US3292018 | 1966-12-01 | Clynes | |
| US3552382 | 1971-01-01 | Mount | |
| US3577772 | 1971-05-01 | Perilhou et al. | |
| US3681977 | 1972-08-01 | Wendt et al. | |
| US3705261 | 1972-12-01 | Langley | |
| US3771116 | 1973-11-01 | Farrah | |
| US3794964 | 1974-02-01 | Katakura | |
| US3888238 | 1975-06-01 | Meindl et al. | |
| US3918025 | 1975-11-01 | Koshikawa | |
| US3936791 | 1976-02-01 | Kossoff | |
| US3964296 | 1976-06-01 | Matzuk | |
| US4028934 | 1977-06-01 | Sollish | |
| US4075883 | 1978-02-01 | Glover | |
| US4100916 | 1978-07-01 | King | |
| US4109642 | 1978-08-01 | Reid et al. | |
| US4121468 | 1978-10-01 | Glover et al. | |
| US4159462 | 1979-06-01 | Rocha et al. | |
| US4258574 | 1981-03-01 | Hildebrand et al. | |
| US4271706 | 1981-06-01 | Ledley | |
| US4292977 | 1981-10-01 | Krause et al. | |
| US4322974 | 1982-04-01 | Abele et al. | |
| US4398422 | 1983-08-01 | Haerten | |
| US4412249 | 1983-10-01 | Carmen | |
| US4456982 | 1984-06-01 | Tournois | |
| US4486076 | 1984-12-01 | Taenzer | |
| US4543960 | 1985-10-01 | Harui et al. | |
| US4653000 | 1987-03-01 | Matsumoto | |
| DEX2850251 | 1979-05-01 | ||
| DEX2914099 | 1979-10-01 | ||
| DEX2825339 | 1979-12-01 | ||
| DEX3014878 | 1981-10-01 | ||
| FRX2418472 | 1979-10-01 | ||
| GBX2053476 | 1981-02-01 |
Non-Patent Literature (10)
- Julesz, "Texture and Visual Perception", Scientific American, Feb. 1965, pp.38-48.
- Ross, "The Resources of Binocular Perception", Scientific American, Mar. 1976, pp. 80-86.
- Nakatani et al, "A Binocular Stereoscopic Display System for Endocardiography", IEEE Trans. on Biom. Engr., vol. BME-26, No. 2 (Feb. 1979), pp. 65-68.
- Talbert, "An Add-On Modification for Linear Array Real-Time Ultrasound Scanners to Produce 3-Dimensional Displays"--Conf. (UK), Jun. 1977, 57-67.
- Itoh et al, "A Computer-Aided Three-Dimensional Display System for Ultrasonic Diagnosis of a Breast Tumour", Ultrasonics, vol. 17, No. 6 (Nov. 79), 261-268.
- Hoshino et al, "Microprogrammable Ultrasonic Image Processor and Its Applications to Image Manipulation", SPIE, vol. 314 (1981), pp. 354-361.
- Ito et al, "Real Time Display Unit Achieves 3D Ultrasonic Diagnoses", JEE, vol. 16 (Nov. 1979), pp. 64-69.
- Wells, "Ultrasound 3-D Techniques--Display of Three-Dimensional Data", Biomedical Ultrasonics (Academic Press: 1977), pp. 248-252.
- Nathan, "High-Resolution Echocardiography", NASA Tech. Briefs, vol. 4, No. 1 (Spring 1979), p. 81.
- Ylitalo et al, "A Computer System for Visualizing Three-Dimensional Ultrasound Images as Stereopairs", IEEE Ultrasonics Symp., vol. 2, (Oct.-Nov. 83), 722-725.