US 6,319,201 B1Grant
Imaging device and associated method
Issue Date:2001-11-20
•32 Claims
•10 Drawing Sheets
Abstract
An imaging device includes a flexible substrate, a flexible video screen disposed on the substrate, and a scanner operatively connected to the video screen for providing thereto a video signal encoding an image of objects located near the substrate. The scanner is provided with an analyzing component in the form of a specially programmed digital computer for analyzing scanner sensor signals and determining therefrom three-dimensional shapes of the objects. In medical diagnosis and treatment procedures, the substrate with the video screen is disposed on a selected body portion of a patient, for example, the abdomen or a shoulder or knee, so that the substrate and the video screen substantially conform to the selected body portion and so that the video screen is facing away from the body portion. After the disposition of the substrate and the video screen on the selected body portion of the patient, the scanner is operated to provide a video signal to the video screen, the video signal encoding an image of internal organs of the patient. The video screen is operated to reproduce the image so that internal organ representations as displayed on the video screen substantially overlie respective corresponding actual organs of the patient. Thus, for many purposes and applications, it appears to the user that he or she is able to see through the skin and other overlying tissues to selected underlying organs.
Metadata
Inventor
- Peter J. Wilk
Application Information
Application Number:US 08/950,849
Filing Date:1997-10-15
Priority Date:1997-10-15
Art Unit:7
Classifications
IPC:
A61B 800
Field of Search:
600407600409600437600443600300358305345107359296
Patent Drawings (10 sheets)
Description
Background of the Invention
[0002] This invention relates to an imaging device or system. The imaging device or system is especially useful as a medical system. More particularly, this invention relates to a device or system which determines three-dimensional shapes of objects such as internal organs of a patient preferably by using ultrasonic pressure waves. This invention also relates to a method useful in medical operations.
[0003] In recent years, the escalation of medical costs has captured substantial media and regulatory attention. One reason for the escalating costs is the ever increasing use of expensive machines and testing techniques. Computed assisted tomography (CAT scanning), magnetic resonance imaging (MRI) and some radiological techniques have been in the forefront of contributing to mounting medical costs. In addition to being expensive, these devices are heavy and bulky, making them ill suited to transport.
[0004] In this age of rapidly escalating medical costs, minimally invasive operations have become the method of choice for diagnosis and treatment. In many cases, endoscopic, laparoscopic and radiographic techniques have superseded older diagnostic and therapeutic surgical techniques.
Objects of the Invention
[0005] An object of the present invention is to provide an imaging device or system which is relatively inexpensive and easy to transport.
[0006] It is another object of the present invention to provide an alternative to conventional medical imaging systems.
[0007] A further object of the present invention is to provide a medical imaging system which exhibits reduced costs over conventional imaging systems such as CAT scanners and MRI machines.
[0008] A particular object of the present invention is to provide a medical imaging system which can be used during the performance of so-called minimally invasive medical operations.
[0009] It is an additional object of the present invention to provide a medical imaging system which is portable.
[0010] Another object of the present invention is to provide a medical operating method which provides real time imaging in a cost effective manner.
[0011] These and other objects of the present invention will be apparent from the drawings and descriptions herein.
Summary of the Invention
[0012] An imaging device comprises, in accordance with the present invention, a flexible substrate, a flexible video screen disposed on the substrate, and a scanner operatively connected to the video screen for providing thereto a video signal encoding an image of objects located near the substrate. The scanner is preferably provided with an analyzing component, generally a specially programmed digital computer, for analyzing scanner sensor signals and determining therefrom three-dimensional shapes of the objects.
[0013] This imaging device is considered to be particularly advantageous in medical diagnosis and treatment procedures. The substrate with the video screen is disposed on a selected body portion of a patient, for example, the abdomen or a shoulder or knee, so that the substrate and the video screen substantially conform to the selected body portion and so that the video screen is facing away from the body portion. After the disposition of the substrate and the video screen on the selected body portion of the patient, the scanner is operated to provide a video signal to the video screen, the video signal encoding an image of internal organs of the patient. Preferably, the video screen is operated to reproduce the image so that internal organ representations as displayed on the video screen substantially overlie respective corresponding actual organs of the patient. Thus, for many purposes and applications, it appears to the user (generally a physician) that he or she is able to see through the skin and other overlying tissues to selected underlying organs.
[0014] To enable or facilitate an alignment of the displayed organ representations and the respective underlying actual organs, it is recommended that markers be placed in prespecified locations on the patient. The markers are easily recognized by the analyzing computer and serve to define a reference frame whereby the position and orientation of the video screen relative to the patient's internal organs is detectable. Accordingly, the position and orientation of each portion or area of the video screen relative to the internal organs of the patient is determined to enable the display on the video screen of images of organs underlying the different portions of the screen. Where the screen is folded back on itself in conforming to a curved skin surface of the patient, two or more overlapping screen areas may be provided with the same image signal. However, only the uppermost screen portion of the overlapping areas will be visible to the user.
[0015] The imaging device or system is preferably provided with a number of ancillary components or functional subcomponents for facilitating use of the system as a medical diagnostic and therapeutic tool. For example, the analyzing component may include a module, typically realized as a programmed general computer circuit, for highlighting a selected feature of the internal organs of the patient. The highlighting may be implemented by changing the color or intensity of the selected feature relative to the other features in the displayed image, thus providing a visual contrast of the selected feature with respect to the other features of the displayed image. An intensity chance may be effectuated by essentially blacking or whiting out the other portions of the image so that the selected feature is the only object displayed on the video screen.
[0016] Another ancillary component for enhancing the usefulness of the imaging device or system is voice-recognition circuitry operatively connected to the analyzing computer. Voice recognition circuity is especially beneficial for medical applications in that doctors must frequently have their hands (and even feet) available for operating medical equipment. In conventional medical procedures, voice control is exerted via attendant personnel: the assistants are requested by the lead physician to perform desired tasks. The voice recognition circuitry of the present invention is used, for instance, to request highlighting of a selected organ or removal of an organ from the image on the video screen. The removal of selected organs or tissues enables the user to view underlying organs. Viewing of the patient's internal structures may thus proceed in an ever more deeply penetrating sequence, with successive removal of different layers of tissues.
[0017] Yet another ancillary component is speech synthesis circuitry operatively connected to the analyzing computer. The voice recognition and speech synthesis circuitry together enable the user to interface with the imaging device as if the device were an operating room assistant. These ancillary components also free the physician's eyes to look at the flexible video screen.
[0018] The analyzing computer's tasks may extend well beyond normal image analysis and construction. The computer may be programmed for automated diagnosis based on pattern recognition. For example, the computer may be programmed to recognize a bloated appendix by comparing the image data with prestored data identifying normal and inflamed appendices. The computed diagnosis may be communicated to the physician via the speech synthesis circuitry: “Enlarged appendix—possible appendicitis—recommend immediate removal.”
[0019] The substrate and the video screen are advantageously provided with a plurality of mutually aligned apertures enabling traversal of the substrate and the video screen by medical instruments. The distal ends of the medical instruments, inserted into the patient in the field of view of the imaging system, are displayed on the video screen together with the selected internal organs of the patient. In this way, laparoscopic surgery as well as other invasive operations, whether diagnostic or therapeutic, may be performed with the aid of real-time visual images of the patient's internal organs displayed on the flexible video screen. Laparoscopic surgery is simplified by eliminating the need for a laparoscope. Laparoscope elimination enables a reduction in the number of perforations made in the patient or, alternatively, enables the insertion of another laparoscopic instrument with the same number of perforations. Other operations implemented by inserting instruments through the flexible video screen include liver biopsies, kidney biopsies, and pleural biopsies and the placement of tubular members, including drains and catheters, for such techniques as thoracentesis and abscess drainage.
[0020] An additional ancillary component for enhancing the usefulness of the imaging device or system in accordance with the present invention is a transceiver interface for operatively connecting the scanner, including the analyzing computer, to a long-distance telecommunications link. The image data is transmitted over the telecommunications link to a video monitor at a remote location, thereby enabling observation of the patient's internal organs by specialists in distant cities. These specialists may provide diagnostic and treatment advice to people in the location of the patient. Also, a surgical procedure may be exerted robotically under the control of the distant experts, as disclosed in U.S. Pat. Nos. 5,217,003 and 5,217,453 to Wilk.
[0021] In accordance with a principal embodiment of the present invention, the scanner utilizes ultrasonic pressure waves to collect the three-dimensional structural data from which the organ images are derived or constructed. Such an ultrasonic scanner includes at least one electroacoustic transducer, an a-c current generator operatively connected to the transducer for energizing the transducer with an electrical signal of a pre-established ultrasonic frequency to produce a first pressure wave, and at least one acoustoelectric transducer. The analyzing computer is operatively connected to the acoustoelectric transducer for determining three-dimensional shapes of the objects by analyzing signals generated by the acoustoelectric transducer in response to second pressure waves produced at the objects in response to the first pressure wave.
[0022] In a particular embodiment of the invention, at least one of the ultrasonic transducers is mounted to the substrate. Typically, the electroacoustic transducer is one of a plurality of electroacoustic transducers and the acoustoelectric transducer is one of a plurality of acoustoelectric transducers, all mounted to the substrate. This configuration is especially portable: it is compact and lightweight.
[0023] In accordance with another feature of the present invention, the ultrasonic pressure waves are produced in different frequency ranges. The different frequencies penetrate to different depths. Thus, the multiple frequencies provide different kinds of structural data to the analyzing computer. Accordingly, the imaging device preferably includes multiple electroacoustic transducers each capable of generating a pressure wave in a respective frequency range different from the frequency ranges of the other of the electroacoustic transducers. The a-c current generator is operatively connected to the electroacoustic transducers for energizing the electroacoustic transducers with electrical signals of different pre-established ultrasonic frequencies. The energized electroacoustic transducers produce respective pressure waves in the respective frequency ranges of the electrical signals. Similarly, the imaging device preferentially includes multiple acoustoelectric transducers each capable of sensing a pressure wave in a respective frequency range different from the frequency ranges of the other of the acoustoelectric transducers.
[0024] Where the imaging device is used to diagnose or treat a limb or a joint, the flexible substrate and the video screen attached thereto have predefined shapes which facilitate conformity with the limb or joint. The flexible substrate and video screen may be provided with a preferred shape and a memory for returning to the preferred shaped after deformation, for example, owing to motion of the limb or joint. The invention not only enables a physician or therapist to view an injured limb or joint during motion thereof but to view the motions of internal organs superimposed on the actual, related motion of the limb or joint.
[0025] To facilitate the use of the imaging device in invasive surgical procedures, the image provided on the video screen may be stereoscopic or holographic. Thus, manipulation of a medical instrument so that its distal end engages desired internal tissues is facilitated. The imaging device thus may include elements for providing a stereoscopic or holographic image to a viewer, the scanner including means for energizing the elements to produce the stereoscopic or holographic image.
Brief Description of the Drawings
[0026] FIG. 1 is a block diagram of a medical diagnostic system, which may utilize or incorporate an ultrasonographic imaging device in accordance with the present invention.
[0027] FIG. 2 is a flow-chart diagram illustrating steps in a mode of operation of the diagnostic system of FIG. 1.
[0028] FIG. 3 is a flow-chart diagram illustrating steps in another mode of operation of the diagnostic system of FIG. 1.
[0029] FIG. 4 a block diagram of a further medical diagnostic system.
[0030] FIG. 5 is a diagram showing the composition of a data string or module used in the system of FIG. 4.
[0031] FIG. 6 is a block diagram of a computerized slide scanning system.
[0032] FIG. 7 is a block diagram of a device for measuring a diagnostic parameter and transmitting the measurement over the telephone lines.
[0033] FIG. 8 is a diagram of an ultrasonography device
[0034] FIG. 9 is a diagram showing a modification of the device of FIG. 8.
[0035] FIG. 10 is a block diagram of an ultrasonographic imaging apparatus similar to the device of FIGS. 8 and 9, for use in diagnostic and therapeutic procedures.
[0036] FIG. 11 is a block diagram showing a modification of the apparatus illustrated in FIG. 10.
[0037] FIG. 12 is partially a schematic perspective view and partially a block diagram showing use of an ultrasonographic imaging device in a minimally invasive diagnostic or therapeutic procedure.
[0038] FIG. 13 is a partial schematic perspective view including a block diagram showing use of an ultrasonographic imaging device in another minimally invasive diagnostic or therapeutic procedure.
[0039] FIG. 14 is a schematic perspective view of yet another ultrasonographic imaging device which includes a sensor vest in a closed, use configuration.
[0040] FIG. 15 is a schematic perspective view of the sensor vest of FIG. 14, showing the vest in an open configuration.
[0041] FIG. 16 is partially a schematic perspective view and partially a block diagram of an ultrasonic diagnostic imaging device.
[0042] FIG. 17 is partially a schematic perspective view and partially a block diagram of the ultrasonic diagnostic imaging device of FIG. 16, showing the device in use with a patient.
[0043] FIG. 18 is partially a schematic perspective view and partially a block diagram of another ultrasonic diagnostic imaging device, showing the device in use with a patient.
[0044] FIG. 19 is partially a schematic perspective view and partially a block diagram of the ultrasonic diagnostic imaging device of FIGS. 17 and 18, showing a modification of the device of those figures.
[0045] FIG. 20 is partially a schematic exploded perspective view and partially a block diagram of an ultrasonographic device or system in accordance with the present invention.
[0046] FIG. 21 is a schematic perspective view showing use of the system of FIG. 20 in performing a laparoscopic operation.
[0047] FIGS. 22A and 22B are schematic perspective views showing use of another ultrasonographic device in accordance with the present invention.
[0048] FIG. 23A is a schematic perspective view of a further ultrasonographic device in accordance with the present invention.
[0049] FIG. 23B is a schematic perspective view showing use of the ultrasonocgraphic device of FIG. 23A.
Description of the Preferred Embodiments
[0050] The present invention is directed chiefly to an imaging device and particularly to an ultrasonographic imaging device utilizable in diagnostic and therapeutic procedures. The ultrasonographic imaging device of the present invention is described generally hereinafter with reference to FIGS. 8 et seq. and particularly with reference to FIGS. 20 et seq. The ultrasoniographic imaging device, and particularly image derivation or construction portions thereof, can be employed as an imagine generating apparatus or scanner 42 in the medical diagnostic system of FIG. 1 or a diagnostic image generating apparatus 78a,78b,78iin the medical diagnostic system of FIG. 4. Alternatively or additionally, the ultrasonographic imaging device can be employed in carrying out certain minimally invasive diagnostic or therapeutic operations, examples of which are illustrated schematically in FIGS. 12 and 13.
[0051] As illustrated in FIG. 1, a medical diagnostic system comprises a device 20 for monitoring and measuring a biological or physiological parameter. Monitoring and measuring device 20 is juxtaposable to a patient for collecting individualized medical data about the patient's condition. Device 20 may take the form of an electronic thermometer, an electronic blood pressure gauge, a pulmonary function apparatus, a Doppler study apparatus, an EEG machine, an EKG machine, an EMG machine, or a pressure measurement device, etc., or include a plurality of such components.
[0052] Monitoring and measuring device 20 is connected at an output to a digitizer 22 which converts normally analog type signals into coded binary pulses and transmits the resulting digital measurement signal to a computer 24. Digitizer 22 may be incorporated into a housing (not shown) enclosing all or part of the monitoring and measuring device 20. Moreover, digitizer may be an integral part of monitoring and measuring device 20.
[0053] Computer 24 receives instructions and additional input from a keyboard 26. Keyboard 26 is used to feed computer 24 information for identifying the patient, for example, the patient's age, sex, weight, and known medical history and conditions. Such medical conditions may include past diseases and genetic predispositions.
[0054] Computer 24 is also connected to an external memory 28 and an output device 30 such as a printer or monitor. Memory 28 stores medical data for a multiplicity of previously diagnosed medical conditions which are detectable by analysis of data provided by monitoring and measuring device 20.
[0055] As illustrated in FIG. 2, monitoring and measuring device 20 detects a magnitude of a predetermined biological or physiological parameter in a step 32. Digitizer 22 converts the detected magnitude into a pre-established digital format in a step 34 and transmits the digital signal to computer 24 in a step 36. Computer 24 is operated in a step 38 to compare the digitized data from monitoring and measuring device 20 with the data stored in memory 28 and to derive a diagnosis as to the patient's condition. The diagnosis is then communicated to the user (operator) and to the patient via output device 30 in a step 40.
[0056] If monitoring and measuring device 20 measures a physiological function characterized by a plurality of different variables, for example, the electric potential at different points on the patient's body (EEG, EKG, EMG), these variables may be broken down by computer 24 into one or more parameters, e.g., a frequency packet. The measured values of the pre-established parameters are then compared with parameter ranges stored in memory 28 for the type of parameter and the kind of patient, as characterized by sex, age, weight, etc. If the measured values of the pre-established parameters fall within expected ranges, as stored in memory 28, then computer 28 communicates a “normalcy” finding via printer 30. If, on the contrary, the measured values of one or more parameters fall outside the normal ranges, then a diagnosis of a possible medical condition is printed out.
[0057] As further illustrated in FIG. 1, the medical diagnostic system may comprise, in addition to or alternatively to monitoring and measuring device 20, image generating apparatus or scanner 42 for generating in electrically encoded form a visually readable image of an organic part of the patient. Scanner 42 may take the form of an MRI apparatus, a CAT scanner, an X-ray machine, an ultrasonography apparatus (see FIGS. 8-15 and 20), or a video camera with or without magnification optics for magnifying a sample on a slide. The video camera can be used for obtaining an image of a portion of a patient's skin.
[0058] Scanner 42 is connected via an interface 44 to computer 24.
[0059] As shown in FIG. 3, scanner 42 obtains an image of a tissue or organ in a step 46. The image is digitized, either by scanner 42 or interface 44 in a step 48, and is transmitted to computer 24 in a step 50. Computer 24 is operated in a step 52 to analyze the image from scanner 42 and determine specific values for a multiplicity of predetermined parameters. For example, in the event that scanner 42 takes the particular form of a video camera for dermatological diagnosis, an image of a skin surface of a patient is analyzed by computer 24 to derive such parameters as percentage of skin covered by abnormal condition, the range of sizes of individual ulcers, the range of color variation (e.g., whether bleeding is symptomatic).
[0060] The specific values of pre-established parameters calculated by computer 24 from electrically encoded images transmitted from scanner 42 are compared by computer 24 with previously determined parameter ranges stored in memory 28. For example, if a pregnant woman's fetus is being scanned by ultrasonography, the lengths of the fetal appendages, arms, legs, fingers, etc., are compared with each other and with respective fetal appendage ranges recorded in memory 28 for the stage of pregnancy, weight of the fetus, and possibly weight of the mother. In the event that any appendages are missing or are of abnormal length, a diagnosis as to possible deformity is printed out. Organs internal to the fetus may be similarly examined automatically by scanner 42 and computer 24. In more advanced stages of pregnancy, physiological functions such as the heart rate of the fetus may be automatically monitored for abnormal conditions.
[0061] The analysis performed by computer 24 on the image from scanner 42 will depend in part on the region of the patient's body being scanned. If a woman's breast or a person's cortex is being monitored for tumorous growths, computer 24 is programmed to separate the tissue image into regions of different textures. The different textured regions are parameterized as to size, shape and location and the derived parameters are compared to values in memory 30 to determine the presence of a tumor. Additional analysis is undertaken to detect lines in an image which may indicate the presence of an organic body.
[0062] A similar analysis is undertaken to evaluate a tissue specimen on a slide. The texture and line scanning may be repeated at different magnification levels if, for example, the tissue sample is a slice of an organ wall. On a high magnification level, the texture and line analysis can serve to detect microorganisms in blood.
[0063] Memory 28 may store entire images related to different diseases. For example, memory may store images of skin conditions in the event that scanner 42 takes the form of a video camera at a dermatological diagnosis and treatment facility. In a step 54 (FIG. 3), computer 24 compares the image of a patient's skin with previously stored images in memory 28, for example, by breaking down the current image into sections and overlaying the sections with sections of the stored images, at variable magnification levels.
[0064] In the event that scanner 42 takes the form of an MRI apparatus, a CAT scanner or an ultrasonographic scanner such as those described hereinafter with references to FIGS. 8-15 and 20, the images stored in memory 28 are of internal organic structures. In step 54 (FIG. 3), computer 24 compares images of a person's internal organs with previously stored organ images in memory 28. Computer 24 partitions the image from the MRI apparatus or CAT scanner into subareas and overlays the subareas with sections of the stored images, at variable magnification levels.
[0065] In a final step 40 (FIG. 3), computer 24 communicates the results of its diagnostic evaluation to a user or patient.
[0066] As illustrated in FIG. 4, a medical diagnostic system comprises a plurality of remote automated diagnostic stations 60aand 60bconnected via respective telecommunications links 62aand 62bto a central computer 64. Each diagnostic station 60a,60bmay take the form shown in FIG. 1, local computer 24 communicating via link 62a,62bwith central computer 64. Alternatively, each diagnostic station 60a,60bmay take the form shown in FIG. 4 and include a respective plurality of monitoring and measuring devices 66a,66b,. . . 66noperatively connected to a local computer 68 via respective digitizer output units 70a,70b,. . . 70n.Computer 68 is fed instructions and data from a keyboard 72 and communicates diagnostic results via a monitor 74 or printer 76. As discussed hereinabove with reference to monitoring and measuring device 20 of FIG. 1, each monitoring and measuring device 66a,66b,. . . 66nis juxtaposable to a patient for collecting individualized medical data about the patient's condition. Monitoring and measuring devices 66a,66b,. . . 66nmay respectively take the form of an electronic thermometer, an electronic blood pressure gauge, a pulmonary function apparatus, a Doppler study apparatus, an EEG machine, an EKG machine, an EMG machine, or a pressure measurement device, etc.
[0067] Digitizers 70a,70b,. . . 70nconvert normally analog type signals into coded binary pulses and transmit the resulting digital measurement signals to computer 68. Digitizers 70a,70b,. . . 70nmay be incorporated into the housings or casingy (not shown) enclosing all or part of the respective monitoring and measuring devices 66a,66b,. . . 66n.
[0068] Keyboard 72 is used to feed computer 68 information for identifying the patient, for example, the patient's age, sex, weight, and known medical history and conditions. Such medical conditions may include past diseases and genetic predispositions.
[0069] As further illustrated in FIG. 4, a plurality of diagnostic image generating apparatuses or scanners 78a,78b,. . . 78iare also connected to central computer 64 via respective hard-wired or wireless telecommunications links 80a,80b,. . . 80i.Scanners 78a,78b,. . . 78ieach generate in electrically encoded form a visually readable image of an organic part of the patient. Scanners 78a,78b,. . . 78imay each take the form of an MRI apparatus, a CAT scanner, an X-ray machine, an ultrasonogyraphy apparatus (FIGS. 8-5 and 20), or a video camera with or without magnification optics for magnifying a sample on a slide.
[0070] Because of the enormous quantity of data necessary for storing images, central computer 64 is connected to a bank of memories 82 at a central storage and information processing facility 84. Diagnosis of patient conditions may be undertaken by central computer 64 alone or in cooperation with local computers 24 or 68.
[0071] As illustrated in FIG. 5, local computers 24 and 68 transmit information to central computer 64 in data packets or modules each include a first string of binary bits 86 representing the transmitting station 60a,60b,a second bit string 88 identifying the patient, a bit group 90 designating the parameter which is being transmitted, another bit group 92 coding the particular measured value of the parameter, a set of bits 94 identifying the point on the patient at which the measurement was taken, and another bit set 96 carrying the time and date of the measurement. Other bit codes may be added as needed.
[0072] As shown in FIG. 6, a computerized slide scanning system comprises a slide carrier 100 mountable to a microscope stage and a slide positioning device 102 mechanically linked to the slide carrier 100 for shifting the carrier along a path determined by a computer 104. Computer 104 may be connected to an optional transport or feed assembly 106 which delivers a series of slides (not shown) successively to slide carrier 100 and removes the slides after scanning.
[0073] Computer 104 is also connected to an optical system 108 for modifying the magnification power thereof between successive slide scanning phases. Light emerging from optical system 108 is focused thereby onto a charge coupled device (“CCD”) 110 connected to computer 104 for feeding digitized video images thereto.
[0074] Computer 104 performs a line and texture analysis on the digitized image information from CCD 110 to determine the presence of different organic structures and microorganisms. The different textured regions are parameterized as to size shape, and location and the derived parameters are compared to values in a memory to identify microscopic structures. The texture and line scanning is repeated at different magnification levels.
[0075] Computer 104 may be connected to a keyboard 112, a printer 114, and a modem 16. Modem 116 forms part of a telecommunications link for connecting computer 104 to a remote data processing unit such as computer 64 in FIG. 4.
[0076] Image generating apparatus 42 in FIG. 1 may take the form of the computerized slide scanning system of FIG. 6.
[0077] As shown in FIG. 7, a device for measuring a diagnostic parameter and transmitting the measurement over the telephone lines comprises a monitoring and measuring device 118 which may take the form, for example, of an electronic thermometer, an electronic blood pressure gauge, a pulmonary function apparatus, a Doppler study apparatus, an EEG machine, an EKG machine, an EMG machine, or a pressure measurement device, etc., or include a plurality of such components. Monitoring and measuring device 118 is connected at an output to a digitizer 120 which in turn is coupled to a modulator 122. Modulator 122 modulates a carrier frequency from a frequency generator 124 with the data arriving from monitoring and measuring device 118 via digitizer 120 and transmits the modulated signal to an electroacoustic transducer 126 via an amplifier 128. Transducer 126 is removably attachable via a mounting element 130 to the mouthpiece of a telephone handset (not shown) and generates a pressure wave signal which is converted by a microphone in the handset mouthpiece back to an electrical signal for transmission over the telephone lines. Of course, transducer 126 may be omitted and modulator 122 connected directly to a telephone line.
[0078] The system of FIG. 7 enables the transmission of specialized medical data directly over the telephone lines to a central computer (e.g. computer 64 in FIG. 4) which utilizes the incoming data to perform a diagnostic evaluation on the patient.
[0079] Monitoring and measuring device 118 may include traditional medical instrumentation such as a stethoscope or modern devices such as a CCD.
[0080] FIG. 8 shows an ultrasonographic image generating apparatus which may be used in the medical diagnostic system of FIG. 1 (see reference designation 42) or in the medical diagnostic system of FIG. 4 (see reference designations 78a,78b,. . . 78i). A flexible web 132 carries a plurality of piezoelectric electroacoustic transducers 134 in a substantially rectangular array. Transducers 134 are each connectable to an ultrasonic signal generator 136 via a switching circuit 138. Switching circuit 138 is operated by a control unit 140 to connect tranducers 134 to signal generator 136 in a predetermined sequence, depending on the area of a patient's body which is being ultrasonically scanned.
[0081] Web 132 also carries a multiplicity of acoustoelectric transducers or sensors 142 also arranged in a substantially rectangular array. Sensors 142 are connected to a switching circuit 144 also operated by control unit 140. An output of switching circuit 144 is connected to a sound or pressure wave analyzer 146 via an amplifier 148.
[0082] Web 132 is draped over or placed around a portion of a patient's body which is to be monitored ultrasonically. Control unit 140 then energizes signal generator 136 and operates switching circuit 138 to activate transducers 134 in a predetermined sequence. Depending on the transducer or combination of transducers 134 which are activated, control unit 140 operates switching circuit 144 to connect a predetermined sequence of sensors 142 to pressure wave analyzer 146. Pressure wave analyzer 146 and control unit 140 cofunction to determine three dimensional structural shapes from the echoes detected by sensors 142.
[0083] Control unit 140 is connected to ultrasonic signal generator 136 for varying the frequency of the generated signal.
[0084] FIG. 9 shows a modified ultrasonography web 150 having a limited number of electroacoustic transducers 152 and generally the same number and disposition of sensors 154 as in web 132.
[0085] Web 132 or 150 may be substantially smaller than illustrated and may corresponding carry reduced numbers of transducers 134 and 152 and sensors 142 and 154. Specifically, web 132 or 150, instead of being a sheet large enough to wrap around a torso or arm of a patient, may take a strip-like form which is periodically moved during use to different, predetermined locations on the patient. Control unit 140 and pressure wave analyzer 146 are programmed to detect internal organic structures from the data obtained at the different locations that the web 132 or 150 is juxtaposed to the patient.
[0086] FIG. 10 illustrates a modification of the ultrasonography apparatus of FIGS. 8 and 9 which is employable in diagnostic or therapeutic operations involving the insertion of an instrument into a patient. A control unit 156 for performing operations of control unit 140 is connected at an output to a video monitor 158. As discussed hereinafter with reference to FIGS. 12 and 13, a diagnostician, surgeon or other medical specialist inserts a distal end of a medical instrument into a patient in response to video feedback provided by the ultrasonography apparatus including video monitor 158.
[0087] As further illustrated in FIG. 10, an a-c current or ultrasonic signal generator 160 is connected via a switching circuit 162 to different piezoelectric type electroacoustic transducers 164 in seriatum. Transducers 162 are mounted in interspaced fashion to a flexible web 166 which also carries an array of spaced piezoelectric type acoustoelectric transducers 168.
[0088] Web is placed adjacent to a skin surface of a patient. In some cases, it may be beneficial to provide a layer of fluid between the skin surface of the patient and the web 166 to facilitate ultrasonic wave transmission from web 166 to the patient and from the patient back to the web. In response to the periodic energization of transducers 162, ultrasonic pressure waves are reflected from internal organic structures of the patient and sensed by acoustoelectric transducers 168. Electrical signals generated by transducers 168 in response to the reflected pressure waves are fed via a switching circuit 170 to control unit 156.
[0089] As discussed hereinabove with reference to control unit 140 in FIG. 8, control unit 156 controls switching circuits 162 and 170 to energize emitting transducers 164 in a predetermined sequence and and to selectively couple receiving transducers 168 in a pre-established sequence to a pressure wave or ultrasonic frequency analyzer 172 in control unit 156. The sequencing depends on the portion of the patient being monitored.
[0090] In addition to pressure wave or ultrasonic frequency analyzer 172, control unit 156 includes a view selector 174 and a filter stage 176. View selector 174 is operatively connected at an input to analyzer 172 and at an output to video monitor 158 for selecting an image for display from among a multiplicity of possible images of the internal organs detected by analyzer 172. View selector 174 may be provided with an input 178 from a keyboard (not shown) or other operator interface device for enabling an operator to select a desired view. For example, during the insertion of a medical diagnostic or treatment instrument into the patient or during manipulation of that instrument to effect an operation on a targeted internal organ of the patient, the medical practitioner may sequentially select views from different angles to optimize the practitioner's perception of the spatial relation between the distal tip of the instrument and the patient's internal organs.
[0091] Filter stage 176 is operatively connected to analyzer 172 and video monitor 158 for optionally eliminating a selected organ from the displayed image. Filter stage 176 is provided with an input 180 from a keyboard (not shown) or other operator interface device for enabling an operator to select an organ for deletion from the displayed image. In one example of the use of filter stage 176, blood moving through a vessel of the vascular system is deleted to enable viewing of the blood vessel walls on monitor 158. This deletion is easily effected starting from conventional techniques such as the Doppler detection of moving bodies.
[0092] Filter stage 176 may also function to highlight selected organs. The pattern recognition techniques discussed above are used to detect selected organs. The highlighting may be implemented exemplarily through color, intensity, cross-hatching, or outlines.
[0093] As further illustrated in FIG. 10, control unit 156 is optionally connected at an output to a frame grabber 182 for selecting a particular image for reproduction in a fixed hard copy via a printer 184. In addition, as discussed hereinabove with respect to the telecommunications links 80a,80b. . . 80iin FIG. 4, ultrasonically derived real-time image information may be encoded by a modulator 186 onto a carrier wave sent to a remote location via a wireless transmitter 188.
[0094] FIG. 11 depicts the ultrasonography apparatus of FIG. 10 in a form wherein control unit 156 (FIG. 10) is realized as a specially programmed general purpose digital computer 190. A switching circuit or multiplexer 192 relays signals incoming from respective acoustoelectric transducers 168 (FIG. 10) in a predetermined intercalated sequence to an analog-to-digital converter 194, the output of which is stored in a computer memory 196 by a sampling circuit 198 of computer 190. A wave analysis module 200 of computer 190 retrieves the digital data from memory 196 and processes the data to determine three dimensional organic structures inside a patient. This three-dimensional structural data is provided to a view selection module 202 for deriving two-dimensional images for display on monitor 158 (FIG. 10). A filter module 204 is provided for removing selected organs from the image presented on the visual display or video montiro 158. Sampling circuit 198, wave analysis module 200, view selection module 202, and filter module 204 are program-modified generic digital circuits of computer 190.
[0095] FIG. 12 shows a use of a flexible ultrasonic sensor web 206 which may be any of the flexible ultrasonic sensor webs described herein, except that web 206 is additionally provided with a plurality of apertures or perforations 208. Upon the placement of web 206 in pressure-wave transmitting contact with a skin surface of a patient P, elongate diagnostic or therapeutic instruments such as laparoscopic surgical instruments 210 and 212 are inserted through respective openings 208 to perform a surgical operation on a designated internal organ of the patient P1. This operation is effectuated by viewing a real time image of the distal ends of the instruments 210 and 212 in relation to the patient's internal organic structures as determined by control unit 156 or computer 190. Generally, the image on monitor 158 is viewed during insertion of instruments 210 and 212 to enable a proper employment of those instruments. Also, the video images on monitor 158 are viewed to enable a proper carrying out of the “laparoscopic” surgical operation on the designated internal organ of the patient P1. Strictly speaking, this operation is not a laparoscopic operation, since a laparoscope is not used to provide a continuing image of the patient's internal organic structures and the distal ends of instruments 210 and 212.
[0096] There are multiple advantages to using sonographic web 206 instead of a laparoscope. Fewer perforations need be made in the patient for the same number of surgical instruments. In addition, multiple views of the patient's internal organic structures are possible, rather than a single view through a laparoscope. Generally, these multiple views may differ from one another by as little as a few degrees of arc. Also, particularly if web 206 is extended essentially around patient P1, viewing angles may be from under the patient where a laparoscopic could not realistically be inserted.
[0097] Web 206 may be used to insert tubular instruments such as catheters and drainage tubes, for example, for thoracentesis and abscess drainage. The tubes or catheters are inserted through apertures 208 under direct real time observation via monitor 158.
[0098] In addition to treatment, web 206 may be used to effectuate diagnostic investigations. In particular, a biopsy instrument 214 may be inserted through an aperture 208 to perform a breast biopsy, a liver biopsy, a kidney biopsy, or a pleural biopsy.
[0099] As illustrated in FIG. 13, a flexible ultrasonic sensor web 216, which may be any of the flexible ultrasonic sensor webs described herein, may be used in a diagnostic or therapeutic operation utilizing a flexible endoscope-like instrument 218. Instrument 218 has a steering control 220 for changing the orientation of a distal tip 222 of the instrument. Instrument 218 also has a port 224 connected to an irrigant source 226 and another port 228 connected to a suction source. In addition, instrument 218 is provided a biopsy channel (not shown) through which an elongate flexible biopsy instrument or surgical instrument 230 is inserted.
[0100] Instrument 218 is considerably simplified over a conventional endoscope in that instrument 218 does not require fiber-optic light guides for carrying light energy into a patient P2 and image information out of the patient. Instead, visualization of the internal tissues and organ structures of patient P2 is effectuated via monitor 158 and control unit 156 or computer 190. As discussed above with reference to FIG. 12, the sonographic imaging apparatus if web 216 is extended essentially around patient P2, images may be provided from multiple angles, not merely from the distal tip 222 of instrument 218.
[0101] View selector 174 and organ filter stage 176 or view selection module 202 and filter module 204 may function in further ways to facilitate viewing of internal organic structures. In addition to organ removal and highlighting, discussed above, a zoom capability may be provided. The zoom or magnification factor is limited only by the resolution of the imaging, which is determined in part by the frequency of the ultrasonic pressure waves.
[0102] FIGS. 14 and 15 depict a specialized ultrasonic sensor web 232 in the form of a garment such as a vest. Sensor vest 232 has arm holes 234 and 236, a neck opening 238 and fasteners 240 for closing the vest about a patient. In addition, sensor vest 232 is provided with a plurality of elongate chambers 242 which receive fluid for expanding the vest into conformation with a patient's skin surface, thereby ensuring contact of the vest with a patient's skin surface and facilitating the transmission of ultrasonic pressure waves to and from ultrasonic transducers 244. FIG. 14 shows a computer 246, a video monitor 248 and a printer 250 used as described above.
[0103] Sensor vest 232 may be understood as a container assembly having fluid-filled chambers 242 with flexible inwardly facing walls (not separately designated) which conform to the patient.
[0104] As illustrated in FIG. 16, an ultrasonography apparatus comprises a container assembly 302 including a substantially rigid plate 304 attached to a flexible bladder or bag 306. Bladder or bag 306 is filled with a liquid and is sufficiently flexible to substantially conform to a patient when the container assembly 302 is placed onto a patient PT1, as illustrated in FIG. 17. A liquid may be deposited on the patient prior to the placement of container assembly 302 on patient PT1.
[0105] Plate 304 is provided with multiple ultrasonic pressure wave generators and detectors 308 as described above with respect to FIGS. 8 and 9 and FIGS. 14 and 15. Generators and detectors 308 are connected to a computer 310 having essentially the same functional structures and programming as computer 190 for implementing sequential generator energization and sequential detector sampling, as described above. Computer 310 is connected to a monitor 312 for displaying images of internal organs of patient PT1. Computer 310 has the capability of alternately displaying organ images from different angles, as discussed above.
[0106] FIG. 18 depicts another ultrasonography apparatus useful for both diagnostic investigations and minimally invasive surgical operations. The apparatus comprises a container assembly 314 which includes a fluid-filled sack or bag 316 for receiving a patient PT2. Sack or bag 316 include a flexible upper wall 318 which deforms to conform to the patient PT2 upon placement of the patient onto the bag. Bag 316 is supported on tow or more sides by substantially rigid walls or panels 320 and 322. Panels 320 and 322 are either integral with bag 316 or separable therefrom. Panels 320 and 322, as well as an interconnecting bottom panel 324, may be provided with multiple ultrasonic pressure wave generators and detectors (not shown) as described above with respect to FIGS. 8 and 9, FIGS. 14 and 15, and FIG. 16. These generators and detectors are connected to a computer 326 having essentially the same functional structures and programming as computer 190 for implementing sequential generator energization and sequential detector sampling, as described above. Computer 326 is connected to a monitor 328 for displaying images of internal organs of patient PT2. Computer 326 has the capability of alternately displaying organ images from different angles, as discussed above.
[0107] The ultrasonic pressure wave generators and detectors may be provided in a separate carrier 330 disposable, for example, between bottom panel 324 and bag 316, as shown in FIG. 18.
[0108] As illustrated in FIG. 19, the ultrasonography apparatus of FIG. 19 may be used in conjunction with a flexible web or cover sheet 332 identical to web 132, 150, or 206 (FIGS. 8, 9, or 12). Web or cover sheet 332 is operatively connected to computer 326 for providing ultrasonically derived organ position and configuration data to the computer for displaying organ images on monitor 328. The use of web or sheet 332 enables the disposition of ultrasonic wave generators and detectors in a 360° arc about a patient PT3 (diagrammatically illustrated in FIG. 19), thereby facilitating image production. Where web or sheet 332 takes the form of web 206, the sheet is provided with apertures (see FIG. 12 and associated description) for enabling the introduction of minimally invasive surgical instruments into the patient PT3.
[0109] As discussed above, contact surfaces are advantageously wetted with liquid to facilitate ultrasonic pressure wave transmission over interfaces.
[0110] As discussed hereinafter with reference to FIG. 20, video monitor 158 (FIGS. 10, 12, and 13) or monitor 328 (FIG. 19) may talked the form of a flexible video screen layer attached to web 132, 150, 166 or 206 (FIGS. 8, 9, 10, 12) or web 332 (FIG. 19). This modification of the ultrasonographic imaging devices discussed above is considered to be particularly advantageous in medical diagnosis and treatment procedures. The web or substrate with the video screen is disposed on a selected body portion of a patient, for example, the abdomen (FIGS. 12 and 21) or a shoulder (FIGS. 22A, 22B) or knee (FIG. 23B), so that the substrate and the video screen layer substantially conform to the selected body portion and so that the video screen is facing away from the body portion.
[0111] As shown in FIG. 20, an ultrasonographic device or system comprises a flexible substrate or web 350 which carries a plurality of piezoelectric electroacoustic transducers 352 and a plurality of piezoelectric acoustoelectric transducers 354. A flexible video screen 356 is attached to substrate or web 350 substantially coextensively therewith. Video screen 356 may be implemented by a plurality of laser diodes (not shown) mounted in a planar array to a flexible carrier layer (not separately designated). The diodes are protected by a cover sheet (not separately illustrated) which is connected to the carrier layer. Energization componentry is operatively connected to the diodes for energizing the diodes in accordance with an incoming video signal to reproduce an image embodied in the video signal. In a video monitor, the laser diodes are tuned to different frequency ranges, so as to reproduce the image in color. The protective cover sheet may function also to disperse light emitted by the laser diodes, to generate a more continuous image.
[0112] Substrate or web 350 and video screen 356 comprise an ultrasonic video coverlet or blanket 358 which may be used with the control hardware depicted in FIGS. 10 and 11. Reference numerals used in FIGS. 10 and 11 are repeated in FIG. 20 to designate the same functional components.
[0113] Electroacoustic transducers 352 are connected to a-c or ultrasonic signal generator 160 for receiving respective a-c signals of different frequencies. Generator 160 produces different frequencies which are directed to the respective electroacoustic transducers 352 by switching circuit 162. Pressure waveforms of different ultrasonic frequencies have different penetration depths and resolutions and provide enhanced amounts of information to a digital signal processor or computer 360. As discussed above with reference to computer 190 of FIG. 11, computer 360 is a specially programmed digital computer wherein functional modules are realized as generic digital processor circuits operating pursuant to preprogrammed instructions.
[0114] As discussed above with reference to FIG. 11, switching circuit or multiplexer 192 relays signals incoming from respective acoustoelectric transducers 354 in a predetermined intercalated sequence to analog-to-digital converter 194, the output of which is stored in computer memory 196 by sampling circuit 198. Wave analysis module 200 retrieves the digital data from memory 196 and processes the data to determine three dimensional organic structures inside a patient. This three-dimensional structural data is provided to view selection module 202 for deriving two-dimensional images for display on video screen 256. Filter module 204 serves to remove selected organs, for example overlying organs, from the image presented on video screen 356. Sampling circuit 198, wave analysis module 200, view selection module 202, and filter module 204 are program-modified generic digital circuits of computer 360.
[0115] Computer 360 contains additional functional modules, for example, an organ highlighter 362 and a superposition module 364. The functions of organ highlighter 362 are discussed above with reference to organ filter 176 and 204 in FIGS. 10 and 11. Organ highlighter 362 operates to provide a different color or intensity or cross-hatching to different parts of an image to highlight a selected image feature. For example, a gall bladder or an appendix may be shown with greater contrast than surrounding organs, thereby facilitating perception of the highlighted organ on video screen 356. After organ filter 204 has removed one or more selected organs from an electronic signal representing or encoding an image of internal organs, highlighter 362 operates to highlight one or more features of the encoded image.
[0116] Superposition module 364 effects the insertion of words or other symbols on the image displayed on video screen 356. Such words or symbols may, for example, be a diagnosis or alert signal produced by a message generator module 366 of computer 360 in response to a diagnosis automatically performed by a determination module 368 of computer 360. Module 368 receives the processed image information from waveform analysis module 200 and consults an internal memory 370 in a comparison or pattern recognition procedure to determine whether any organ or internal tissue structure of a patient has an abnormal configuration. The detection of such an abnormal configuration may be communicated to the physician by selectively removing organs, by highlighting organs or tissues, or superimposing an alphanumeric message on the displayed image. Accordingly, message generator 366 may be connected to organ filter 204 and organ highlighter 362, as well as to superposition module 364. The communication of an abnormal condition may be alternatively or additionally effectuated by printing a message via a printer 372 or producing an audible message via a speech synthesis circuit 374 and a speaker 376.
[0117] As discussed above, the ultrasonically derived three-dimensional structural information from waveform analysis module 200 may be transmitted over a telecommunications link (not shown in FIG. 20) via a modulator 378 and a transmitter 380. The transmitted information may be processed at a remote location, either by a physician or a computer, to generate a diagnosis. This diagnosis may be encoded in an electrical signal and transmitted from the remote location to a receiver 382. Receiver 382 is coupled with message generator module 366, which can communicate the diagnosis or other message as discussed above.
[0118] Computer 360 is connected at an output to a video signal generator 384 (which may be incorporated into the computer). Video signal generator 384 inserts horizontal and vertical synchs and transmits the video signal to video screen 356 for displaying an image of internal patient organs thereon.
[0119] FIG. 21 diagrammatically depicts a step in a “laparoscopic” cholecystectomy procedure utilizing the ultrasonographic device or system of FIG. 20. Coverlet or blanket 358 is disposed on the abdomen of a patient P2 in pressure-wave transmitting contact with the skin. The skin is advantageously wetted with liquid to facilitate ultrasonic pressure wave transmission. Laparoscopic surgical instruments 210 and 212 (same as in FIG. 12) are inserted through respective openings 386 in coverlet or blanket 358 to perform a surgical operation a gall bladder GB of the patient P2. This operation is effectuated by viewing a real time image of the distal ends of the instruments 210 and 212 in relation to the patient's internal organic structures as determined by computer 360. Generally, the image on video screen 356 is viewed during insertion of instruments 210 and 212 to enable a proper employment of those instruments.
[0120] As illustrated in FIG. 21, the gall bladder GB is highlighted (e.g., with greater contrast in screen intensities) relative to other organs such as the liver LV, the stomach ST and the large intestine LI. One or more of these organs may be deleted entirely by organ filter 204. Computer 360 is instructed as to the desired display features via a keyboard (not illustrated in FIG. 20) or a voice recognition circuit 388 operatively connected to various modules 202, 204 and 362. (It is to be noted that speech synthesis circuit 374 and voice recognition circuit 388 enable computer 360 to carry on a conversation with a user. Thus the user may direct the computer to answer questions about the appearance of certain organs selected by the user.)
[0121] Generally, the images of the different organs GB, LV, ST and LI, etc., are displayed on video screen 356 so as to substantially overlie the actual organs of the patient P2. To effectuate this alignment of image and organ, markers 390, 392, 394 are placed on the patient P2 at appropriate identifiable locations such as the xyphoid, the umbilicus, the pubis, etc. The markers are of a shape and material which are easily detected by ultrasonic wave analysis and provide computer 360 with a reference frame for enabling the alignment of organ images on screen 356 with the corresponding actual organs. During an operation, view selector 202 may be utilized (via keyboard command or voice recognition circuit 388) to adjust the relative positions of image and organs to facilitate the performance of an invasive surgical operation. As discussed above with reference, for example, to FIG. 13, the ultrasonographic device or system of FIG. 20 may be used in other kinds of procedures.
[0122] As illustrated in FIG. 22A, an ultrasonographic coverlet or blanket 396 with attached video screen (not separately designated) and connected computer 398 has a predefined shape conforming to a shoulder SH. The coverlet or blanket 396 is flexible and thus deforms upon motion of the shoulder (FIG. 22B). The coverlet or blanket 396 has a memory so that it returns to the predefined shape when it is removed from the shoulder SH. The flexibility of the coverlet or blanket 396 enables the display in real time of a filtered video image showing the shoulder joint SJ during motion of the shoulder. This facilitates a diagnostic appraisal of the joint.
[0123] FIG. 23A illustrates an ultrasonic video cuff 400 with a computer 402. The cuff is attachable in pressure-wave transmitting contact to a knee KN, as depicted in FIG. 23B. Cuff 400 conforms to the knee KN and follows the knee during motion thereof. A knee joint KJ is imaged on the cuff during motion of the knee KN, thereby enabling a physician to study the joint structure and function during motion. Cuff 400 has a memory and returns to its predefined shape (FIG. 23A) after removal from knee KN.
[0124] Video screen 356, as well as other video monitors disclosed herein, may be a lenticular lens video display for presenting a stereographic image to a viewer. The ultrasonic processor, e.g., computer 190 or 360, operates to display a three-dimensional image of the internal organs on the lenticular lens video display 118. Because of the stereoscopic visual input a surgeon is provided via video display 356, he or she is better able to manipulate instruments and 212 during a surgical procedure.
[0125] Electroacoustic transducers 134, 164, 352 in an ultrasonographic coverlet or blanket 132, 166, 206, 216, 358 as described herein may be used in a therapeutic mode to dissolve clot in the vascular system. The coverlet or blanket is wrapped around the relevant body part of a patient so that the electroacoustic transducers surround a target vein or artery. First, a scan is effectuated to determine the location of the clot. Then, in a clot dissolution step, the electroacoustic transducers are energized to produce ultrasonic pressure waves of frequencies selected to penetrate to the location of the clot. With a sufficiently large number of transducers transmitting waves to the clot site simultaneously, the clot is disrupted and forced away from the clot site. It is recommended that a filter basket be placed in the pertinent blood vessels downstream of the clot site to prevent any large clot masses from being swept into the brain or the lungs where an embolism would be dangerous.
[0126] The monitors disclosed herein, such as monitors 158, 248, 312, 328 and video screen 356, may be provided with a lenticular lens array (not shown) for generating a three-dimensional or stereoscopic display image when provided with a suitable dual video signal. Such a dual signal may be generated by the waveform analysis computer 190, 310, 326, 360 with appropriate programming for the view selection module 202 to select two vantage points spaced by an appropriate distance. Lenticular lens video displays, as well as the operation thereof with input from two cameras, are disclosed in several U.S. patents, including U.S. Pat. No. 4,214,257 to Yamauchi and U.S. Pat. No. 4,164,748 to Nagata, the disclosures of which are hereby incorporated by reference.
[0127] It is to be noted that any of the ultrasonography devices or systems disclosed herein may be used in a robotic surgical procedure wherein one or more surgeons are at a remote location relative to the patient. The performance of robotic surgery under the control of the distant experts is disclosed in U.S. Pat. Nos. 5,217,003 and 5,217,453 to Wilk, the disclosures of which are hereby incorporated by reference. Video signals transmitted to the remote location may be generated by the analysis of ultrasonic waves as disclosed herein.
[0128] The ultrasonography devices or systems disclosed herein may be used in conjunction with other kinds of scanning devices, for example, spectral diagnosis and treatment devices described in U.S. Pat. No. 5,305,748 to Wilk and U.S. Pat. No. 5,482,041 to Wilk et al. (those disclosures incorporated by reference herein). It may be possible to incorporate the electromagnetic wave generators and sensors of those spectral diagnosis and treatment devices into the coverlet or blanket of the present invention.
[0129] Although the invention has been described in terms of particular embodiments and applications, one of ordinary skill in the art, in light of this teaching, can generate additional embodiments and modifications without departing from the spirit of or exceeding the scope of the claimed invention. Accordingly, it is to be understood that the drawings and descriptions herein are preferred by way of example to facilitate comprehension of the invention and should not be construed to limit the scope thereof.
Claims
What is claimed is:
1. An imaging device comprising:
a flexible substrate;
a flexible video screen disposed on said substrate; and
a scanner operatively connected to said video screen for providing a video signal thereto, said video signal encoding an image of objects located near said substrate,
wherein said scanner is provided with an analyzing component for analyzing scanner sensor signals and determining therefrom three-dimensional shapes of said objects.
2. The imaging device defined in claim 1 wherein said analyzing component includes means for highlighting a selected feature of said objects.
3. The imaging device defined in claim 2 wherein said means for highlighting includes means for varying video image intensity.
4. The imaging device defined in claim 1, further comprising voice-recognition circuitry operatively connected to said analyzing component.
5. The imaging device defined in claim 1 further comprising speech synthesis circuitry operatively connected to said analyzing component.
6. The imaging device defined in claim 1 wherein said analyzing component includes means for performing automated diagnoses based in part on image information derived from said scanner sensor signals.
7. The imaging device defined in claim 1 wherein said substrate and said video screen are provided with a plurality on mutually aligned apertures enabling traversal of said substrate and said video Screen by medical instruments.
8. The imaging device defined in claim 1, further comprising a transceiver interface for operatively connecting said scanner, including, said analyzing component, to a long-distance telecommunications link.
9. The imaging device defined in claim 1 wherein said scanner includes a view selector operatively connected to said analyzing means and said video screen for selecting said image from among a multiplicity of possible images of said objects.
10. The imaging device defined in claim 1, further comprising a filter stage operatively connected to said analyzing means and said video screen for eliminating a selected object from said image.
11. An imaging device comprising:
a flexible substrate;
a flexible video screen disposed on said substrate; and
a scanner operatively connected to said video screen for providing a video signal thereto, said video signal encoding an image of objects located near said substrate,
wherein said scanner includes at least one electroacoustic transducer, an a-c current generator operatively connected to said transducer for energizing said transducer with an electrical signal of a pre-established ultrasonic frequency to produce a first pressure wave, at least one acoustoelectric transducer, and an analyzing component operatively connected to said acoustoelectric transducer for determining three-dimensional shapes of said objects by analyzing signals generated by said acoustoelectric transducer in response to second pressure waves produced at said objects in response to said first pressure wave.
12. The imaging device defined in claim 11 wherein at least one of the transducers are mounted to said substrate.
13. The imaging device defined in claim 11 wherein said electroacoustic transducer is one of a plurality of electroacoustic transducers each capable of generating a pressure wave in a respective frequency range different from the frequency ranges of the other of said electroacoustic transducers, said a-c current generator being operatively connected to said electroacoustic transducers for energizing said electroacoustic transducers with electrical signals of different pre-established ultrasonic frequencies to produce respective first pressure waves in the respective frequency ranges, said acoustoelectric transducer being one of a plurality of acoustoelectric transducers capable of sensing pressure waves in a plurality of different frequency ranges.
14. The imaging device defined in claim 1 wherein said substrate and said video screen have shapes conforming in part to a human limb.
15. The imaging device defined in claim 1 wherein said video screen includes elements for providing a stereoscopic image to a viewer, said scanner including means for energizing said elements to produce said stereoscopic image.
16. An imaging device comprising:
a flexible substrate;
a flexible video screen disposed on said substrate; and
a scanner operatively connected to said video screen for providing a video signal thereto, said video signal encoding an image of objects located near said substrate,
wherein said substrate carries a plurality of electroacoustic transducers attached to said substrate in a predetermined array, said scanner including means for energizing said electroacoustic transducers in a predetermined sequence.
17. An imaging device comprising:
a flexible substrate;
a flexible video screen disposed on said substrate; and
a scanner operatively connected to said video screen for providing a video signal thereto, said video signal encoding an image of objects located near said substrate,
wherein said substrate carries a plurality of acoustoelectric transducers attached to said substrate in a predetermined array, said scanner including means for receiving signals from said acoustoelectric transducers in a predetermined sequence.
18. An imaging device comprising:
a flexible substrate;
a flexible video screen disposed on said substrate; and
a scanner operatively connected to said video screen for providing a video signal thereto, said video signal encoding an image of objects located near said substrate,
wherein said substrate and said video screen comprise a dual layered blanket member provided with a plurality of apertures each enabling traversal of said blanket member by a medical instrument.
19. A medical system, comprising:
a carrier disposable in pressure-wave-transmitting contact with a patient;
a plurality of electroacoustic transducers attached to said carrier;
an a-c current generator operatively connected to said transducers for energizing said transducers with respective electrical signals of different pre-established ultrasonic frequencies to produce first pressure waves at said frequencies;
a plurality of acoustoelectric transducers for detecting pressures waves in different frequency ranges; and
analyzing means operatively connected to said acoustoelectric transducers for determining three-dimensional shapes of internal organs of the patient by analyzing signals generated by said acoustoelectric transducers in response to second pressure waves produced at internal organs of the patient in response to said first pressure waves.
20. The medical system defined in claim 19 wherein said acoustoelectric transducers are attached to said carrier.
21. The medical system defined in claim 19 wherein said carrier is a flexible web conformable to body contours of the patient.
22. A medical method comprising:
providing an imaging device including a flexible substrate, a flexible video screen disposed on said substrate, and a scanner operatively connected to said video screen;
disposing said substrate with said video screen on a body portion of a patient so that said substrate and said video screen substantially conform to the body portion of the patient and so that said video screen is facing away from the body portion of the patient; and
after the disposition of said substrate and said video screen on the body portion of the patient, operating said scanner to provide a video signal to said video screen, said video signal encoding an image of internal tissues of the patient.
23. The method defined in claim 22, further comprising operating said video screen to reproduce said image so that internal tissue representations as displayed on said video screen substantially overlie respective corresponding actual tissues of the patient.
24. The method defined in claim 23, further comprising placing markers on the patient for facilitating the reproducing of said image so that the internal tissue representations on said video screen substantially overlie respective corresponding actual tissues of the patient.
25. The method defined in claim 22 wherein the operating of said scanner to provide said video image includes automatically analyzing scanner sensor signals and determining therefrom three-dimensional shapes of the internal tissues of the patient.
26. The method defined in claim 25, further comprising highlighting a selected feature of the internal tissues of the patient on said video screen.
27. The method defined in claim 22 wherein said substrate and said video screen are provided with a plurality of mutually aligned apertures, further comprising:
providing a medical instrument;
inserting a distal end portion of said instrument into the patient through one of said apertures;
after insertion of said distal end portion, manipulating said instrument from outside the patient to perform an operation on at least one of the internal tissues of the patient, said image being viewed on said video screen while said instrument is being manipulated.
28. The method defined in claim 22 wherein said scanner includes at least one electroacoustic transducer, an a-c current generator operatively connected to said transducer, at least one acoustoelectric transducer and an analyzing component operatively connected to said acoustoelectric transducer, the disposing of said substrate with said video screen on the body portion of the patient including placing said substrate in pressure-wave-transmitting contact with the body portion of the patient, the operating of said scanner including:
transmitting a first electrical signal of a pre-established ultrasonic frequency from said current generator to said electroacoustic transducer for energizing said electroacoustic transducer to produce a first pressure wave;
transmitting said first pressure wave into the body portion of the patient;
transmitting, from said acoustoelectric transducer to said analyzing component, a second electrical signal corresponding to a second pressure wave produced at the internal tissues of the patient in response to said first pressure wave; and
operating said analyzing component to determine three-dimensional shapes of the internal tissues of the patient by analyzing said second electrical signal.
29. The method defined in claim 28 wherein said electroacoustic transducer is one of a plurality of electroacoustic transducers and said acoustoelectric transducer is one of a plurality of acoustoelectric transducers, further comprising transmitting a plurality of electrical signals of different pre-established ultrasonic frequencies from said current generator to said electroacoustic transducers for energizing said electroacoustic transducers to produce pressure waves in different ultrasonic frequency ranges, also comprising transmitting, from said acoustoelectric transducers to said analyzing component, electrical signals corresponding to pressure waves produced at the internal tissues of the patient in response to the pressure waves in the different ultrasonic frequency ranges, the operating of said analyzing component to determine three-dimensional shapes of the internal tissues of the patient including analyzing electrical signals from said acoustoelectric transducers.
30. A medical imaging method, comprising:
providing a thin video screen;
disposing video screen adjacent to a patient so that said video screen overlies selected internal tissues of the patient;
operating an ultrasonic scanner operatively connected to said video screen to provide a video signal thereto, said video signal encoding an image of the selected internal tissues of the patient; and
operating said video screen in response to said video signal to reproduce said image so that internal tissue representations as displayed on said video screen substantially overlie respective corresponding ones of the selected internal tissues of the patient.
31. The imaging method defined in claim 30 wherein said video screen is connected to a substrate containing ultrasonic transducers of said ultrasonic scanner, also comprising disposing said substrate in operative contact with the patient to enable transmission of ultrasonic pressure waves between the transducers and the selected internal tissues of the patient.
32. The method defined in claim 30 wherein the operating of said ultrasonic scanner to provide said video image includes automatically analyzing scanner sensor signals and determining therefrom three-dimensional shapes of the selected internal tissues of the patient.
Patent Citations (34)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3552382 | 1971-01-01 | Mount | Applicant |
| US3668106 | 1972-06-01 | Ota | Examiner |
| US3927662 | 1975-12-01 | Ziedonis | Applicant |
| US4048616 | 1977-09-01 | Hart et al. | Applicant |
| US4315514 | 1982-02-01 | Drewes et al. | Applicant |
| US4623219 | 1986-11-01 | Trias | Applicant |
| US4646158 | 1987-02-01 | Ohno et al. | Applicant |
| US4757820 | 1988-07-01 | Itoh | Applicant |
| US4771786 | 1988-09-01 | Iinuma | Applicant |
| US4819649 | 1989-04-01 | Rogers et al. | Applicant |
| US4953031 | 1990-08-01 | Katoh et al. | Examiner |
| US4991604 | 1991-02-01 | Wurster et al. | Applicant |
| US5019807 | 1991-05-01 | Stapleton et al. | Examiner |
| US5078143 | 1992-01-01 | Okazaki et al. | Applicant |
| US5091893 | 1992-02-01 | Smith et al. | Applicant |
| US5099459 | 1992-03-01 | Smith | Applicant |
| US5099848 | 1992-03-01 | Parker et al. | Applicant |
| US5135001 | 1992-08-01 | Sinofsky et al. | Applicant |
| US5163436 | 1992-11-01 | Saitoh et al. | Applicant |
| US5167231 | 1992-12-01 | Matsui | Applicant |
| US5203336 | 1993-04-01 | Iida et al. | Applicant |
| US5391140 | 1995-02-01 | Schaetzle et al. | Applicant |
| US5394877 | 1995-03-01 | Orr et al. | Applicant |
| US5435311 | 1995-07-01 | Umemura et al. | Applicant |
| US5437278 | 1995-08-01 | Wilk | Applicant |
| US5448994 | 1995-09-01 | Iinuma | Applicant |
| US5488952 | 1996-02-01 | Schoolman | Applicant |
| US5526812 | 1996-06-01 | Dumoulin et al. | Applicant |
| US5526815 | 1996-06-01 | Granz et al. | Applicant |
| US5611343 | 1997-03-01 | Wilson | Applicant |
| US5611345 | 1997-03-01 | Hibbeln | Applicant |
| US5619999 | 1997-04-01 | Von Behren et al. | Applicant |
| US5984882 | 1999-11-01 | Rosenschein et al. | Applicant |
| US6118426 | 2000-09-01 | Albert et al. | Examiner |