US 7,295,226 B1Grant
Method for activating an image collecting process
Issue Date:2007-11-13
•4 Claims
•3 Drawing Sheets
Abstract
The present invention is a method for activating an image collecting process (step 34), comprising the steps of releasing the power source of a component essential to the image collecting process from an inhibition imposed by an external magnet, wherein the invention also provides suitable packaging for storing the imaging system having a magnet, designed for the inside of a body lumen.
Metadata
Assignee
- Given Imaging Ltd.
Inventors
- Gavriel Meron
- Arkady Glukhovsky
- Jerome Avron
- Doren Adler
Application Information
Application Number:US 10/130,326
Filing Date:2000-11-15
Priority Date:1999-11-15
Art Unit:2165
Classifications
IPC:
H04N7/18A61B1/04A61B1/06
Patent Drawings (3 sheets)
Description
Cross-Reference to Related Applications
[0001] The present application is a national phase application of International Application Serial No. PCT/IL00/00752, entitled “METHOD FOR ACTIVATING AN IMAGE COLLECTING PROCESS”, filed Nov. 15, 2000, which is hereby incorporated by reference and which in turn claims priority from IL application 132944, filed on Nov. 15, 1999.
Field of the Invention
[0002] The present invention generally relates to a method for the activation of an image collecting process. More specifically, the method of the present invention can be applied to an image collecting process meant for imaging the inside of body lumens.
Background of the Invention
[0003] Single chip imaging devices such as charge coupled devices (CCD) and CMOS type image sensors can operate using small power sources and relatively little energy. Such imaging devices are implemented in applications as diverse as star tracking applications and imaging the inside of the gastrointestinal tract.
[0004] For example, U.S. Pat. No. 5,604,531, assigned to the common assignee of the present invention, describes a swallowable capsule for imaging the full length of the gastrointestinal tract. The swallowable capsule includes a camera system, an optical system for imaging an area of interest onto the camera system and a transmitter which transmits the video output of the camera system.
[0005] In some instances the imaging devices are inaccessible to an operator at the appropriate time for activation, such as for reasons of sterility, and must be activated by remote control such as by IR or radio.
[0006] A method for activating a battery, though not a battery of an imaging device, is exemplified in PED Inc's swallowable temperature pill. PED Inc. advertises a swallowable temperature pill for tracking core body temperature. The temperature pill is powered by a silver oxide battery. The battery is kept turned off during storage by a small magnet that is taped to the pill package and is activated by removing this magnet.
Summary of the Invention
[0007] The present invention relates to a method for activating an image collecting process, comprising the step of releasing the power source of a component essential to the image collecting process from an inhibition imposed by an external magnet. The method enables facile and sterile activation of the image collecting process, since activation of the process does not require directly handling any component participating in the process and does not require a third party, such as a remote control operator.
[0008] An image collecting process is a process in which images are obtained and components essential to the image collecting process are those power source driven components whose operation is necessary for obtaining an image. Components essential to the image collecting process may be an imaging device, such as low energy imaging devices, i.e., a CCD camera or a CMOS type image sensor, a light source for illuminating the target to be imaged, etc.
[0009] The term power source of a component essential to the image collecting process includes a motor or an engine which utilize a power source for operating the component.
[0010] The term “external magnet” in the present invention refers to a magnet positioned relatively to the component or components essential to the image collecting process, such that it is capable of inhibiting the essential component or components power source.
[0011] In an embodiment of the invention the image collecting process is designed to image the insides of a body lumen. The essential components can be a part of or attached to a medical device that is inserted into the body lumen, such as a needle, stent, endoscope or a swallowable capsule. The external magnet is part of or attached to the medical device package and is removed once the device package is removed.
[0012] The present invention further relates to a packaging suitable for storing therein an imaging system, said package comprising a magnet. The imaging system comprises components essential to an image collecting process, said components operable in accordance with the invention.
[0013] The present invention still further relates to a method for imaging a body lumen comprising the steps of:
-
- [0014] a) providing an imaging system inserted in a balancing cup, said imaging system comprising a camera system having video output; an optical system for imaging an area of interest onto said camera system; a transmitter which transmits the video output of said camera system;
- [0015] b) activating within the imaging system an image collecting process;
- [0016] c) releasing the imaging system from the balance cup; and
- [0017] d) inserting the imaging system into a body lumen.
[0018] The imaging system may also comprise other components such as a light source for illuminating an area of interest, a reception system which receives the transmitted video output, etc.
Brief Description of the Drawings
[0019] The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the appended drawings in which:
[0020] FIG. 1 is a schematic illustration of a prior art swallowable capsule comprising an imaging device;
[0021] FIG. 2 is a schematic illustration of an imaging device in a package in accordance with an embodiment of the invention; and
[0022] FIG. 3 is a side view of the imaging device and package illustrated in FIG. 2 .
[0023] FIG. 4 is a block diagram of the method of the invention according to an embodiment of the invention.
Detailed Description of the Invention
[0024] The method of the present invention comprises the step of releasing the power source of any component essential to an image collecting process, of an inhibition imposed by an external magnet.
[0025] The essential components are those power source driven components whose operation is necessary for obtaining images. Essential components for obtaining images are, for example, an imaging device or an illumination source (depending on the requirements and sensitivity of the imaging device). The imaging device can be any image sensor suitable for use in the method of the present invention, such as CCD cameras or CMOS image sensors. The energy for the imaging device is usually supplied through a low energy motor comprising either an electrical or permanent magnet.
[0026] The external magnet can be either more powerful than the essential component motor magnet or aligned with the essential component motor magnet such as to neutralize its magnetic field. Thus, proximity of the external magnet to the essential component power source or motor acts to inhibit the activation of the image collecting process since components essential for the image collecting process are not operative.
[0027] The external magnet may be distanced from the essential component power source or motor, so as to enable the essential component operation, directly by an operator or by mechanical or other means, suitable for distancing the external magnet from the essential component power source or motor.
[0028] In one embodiment of the invention an imaging device is attached to or is a part of a medical device that is suitable for imaging the inside of body lumens, such as blood vessels, the gastrointestinal tract, etc. The medical device may be a stent, needle, endoscope or swallowable capsule, or any other device suitable for being inserted into body lumens.
[0029] Reference is now made to FIG. 1 which shows a schematic illustration of a prior art swallowable capsule comprising an imaging device. Such a swallowable capsule is described in U.S. Pat. No. 5,604,531. U.S. Pat. No. 5,604,531, which is assigned to the common assignees of the present invention, is hereby incorporated by reference.
[0030] Swallowable capsule 10 typically comprises a viewing unit 11 and a unit 12 housing the electrical elements of the capsule. The viewing unit 11 contains an imaging system which includes a light source 18, a viewing window 14 through which the light illuminates the inner portions of the digestive system, the image collector component of an imaging device 16, such as a charge coupled device (CCD) camera, which detects the images, an optical system (not shown) which focuses the images onto the image collector component of the imaging device 16, and means for transmitting the video signal of the imaging device. The imaging system may also include a reception system which is in communication with the imaging device and which receives the transmitted video output.
[0031] The unit 12 typically includes the electronics and power source for producing a video signal from the output of the CCD device and a power source, such as a battery, which provides power to the entirety of electrical elements of the capsule.
[0032] Reference is now made to FIGS. 2 and 3 which are schematic overview and side views of a swallowable capsule 20 in a package 22 in accordance with an embodiment of the invention. Capsule 20 is similar to the capsule described in FIG. 1 . The viewing unit of the capsule 20 is inserted in a white balance cup 26, which in turn is attached to a holder 28, for sterile handling of the capsule 20. Capsule 20, holder 28 and balance cup 26 are encased in package 22 which comprises a magnet 24. The package 22 also includes a base 23 (FIG. 3 ) and a transparent sterile upper plastic cover 21 (FIG. 3 ). The magnet 24 is positioned in alignment with the encased capsule 20 such that the magnet 24 inhibits the imaging device power source or inhibits the battery which provides power to the entirety of electrical elements of the capsule.
[0033] The magnet 24 may be ring shaped or curved (as illustrated in FIG. 2 ) so that no specific directionality of the capsule, in relation to the magnet, is required.
[0034] The imaging system in capsule 20, while the capsule 20 is still in the package 22, is inactive due to the proximity of the magnet 24. The imaging device and/or other power source driven components of the capsule 20 are activated once the capsule is distanced from the magnet 24, namely by removing the capsule 20 from the package 22. The capsule 20 may be removed from the package 22 by peeling off either base 23 or cover 21 in the direction shown by arrow 25 and extracting the holder 28, balance cup 26 and capsule 20 inserted therein.
[0035] The package 22 may be made of any material suitable for storing capsule 20. For example, package 22 may be a blister type package in which cover 21 is made of a firm but flexible plastic and base 23 is a foil of material which can be ruptured by pressure applied by a user. Capsule 20 is released from the package 22 by exerting pressure on it, through the cover 21 in the direction of the base 23 of the package 22, until the base 23 is ruptured, releasing the holder 28, balance cup 26 and capsule 20 inserted therein.
[0036] Once the capsule 20 is released from package 22 it is distanced from magnet 24 and the imaging device and/or other components essential for the imaging collecting process in capsule 20 are activated and the imaging system begins capturing images. Having the viewing unit of the capsule 20 inserted in a white balance cup 26, ensures that the first images captured and transmitted are white, thus enabling automatic white balance. The capsule 20 can be snapped out of the balance cup 26 to be swallowed by the patient.
[0037] In another embodiment the balance cup is marked on its inner wall, which is the wall being imaged once the image collecting process initiates. The image collecting process is operated for a predetermined initial period, prior to being released from the balance cup, during which identification of the mark is preformed. The image collecting process will be allowed to proceed only if identification of the mark is positive.
[0038] The mark may be a company logo or any other emblem or string of characters. The mark may be used, inter alia, to ensure that all parts of the imaging system are compatible, for example, that the capsule and its imaging device are compatible with the reception system and its software.
[0039] This point is demonstrated by the block diagram presented in FIG. 4 .
[0040] Inhibition of the power source of any component essential to the image collecting process is removed (32) and the image collecting process initiates (34). As discussed above, the first images collected will be images of the balance cup inner walls and of any mark on the balance cup inner wall. This initial data received from the imaging device is perceived by a reception system which is in communication with the imaging device and a process of identification of the mark (36) is initiated. The following factors, for example, might require adjustment for accurate identification of the mark:
-
- [0041] a) The light conditions might vary between different capsules due to environment light and due to differences in the electronic components of the capsule (such as the light source and sensor);
- [0042] b) The capsule and balance cup are not necessarily aligned, which will cause the image of the mark to appear in a different rotation angle each time;
- [0043] c) The distance from the actual image is not accurate which results in different sizes of the object in the image; and
- [0044] d) The image of the mark needs to be compared to a reference image and similarity needs to be confirmed.
[0045] Various algorithms may be executed to ensure accurate identification of the mark. For example, the following algorithms are executed in order to overcome the above:
[0046] Light correction (36a) is performed using an algorithm similar to AGC (Automatic Gain Control). This algorithm measures some statistical parameters of the input image. (The image is divided into 8×8 blocks and the average intensity is calculated. From this array average intensity and minimum and maximum block intensity are calculated.) Next, the brightness and contrast of the image are changed in order to bring the statistical parameters to a reference value.
[0047] In order to correct rotation (36b) the image is converted from Cartesic coordination into polaric coordination (from X,Y plane into R, Theta plane), where R=SQRT (X*X+Y*Y) and Theta=ATAN(X/Y).
[0048] After the conversion of the image into R, Theta plane, the magnification is corrected (36c) by applying a LOG function to the image. This function converts magnification, which is actually multiplication by a factor, into a bias/shift difference.
[0049] The identification of the mark is done by an image identification process (36d) in which the cross correlation function between a reference image and the input image is calculated and the maximum value of this cross correlation function is calculated. This maximum value is compared to a threshold. If it is higher than the threshold then the conclusion is that the images are similar.
[0050] If the result is that the images are similar (identification is positive), the image collecting process is allowed to proceed (35). If the result is that the images are not similar (identification is negative), the image collecting process is terminated (37).
[0051] Thus, the system will operate initially, for a predetermined time or to collect a predetermined number of frames, but the image collecting process will be allowed to continue further than the initial operation only if identification of the mark is positive. This mode of operation can be utilized to ensure that the system will only operate when all its components are the original components. For example, an original reception system that is used with a swallowable capsule from a different make (that does not have a marked balance cup) will not operate after the initial operation, because there will not be a positive identification of the mark.
[0052] The patient may be alerted if the image collecting process has terminated before swallowing the capsule.
[0053] The fact that the system is inoperable when unauthorized components are being used and the fact that the patient is warned greatly contributes to the patient's safety.
[0054] It will be appreciated that algorithms and calculations are carried out by software or software means executable on computing means such as a computer or similar data processors, microprocessors, embedded processors, microcomputers, micrcontrollers etc.
[0055] The capsule may be utilized for diagnostic purposes or can be implemented in therapeutic processes. The capsule can also include any known system for collecting or releasing substances from or into the gastrointestinal tract environment, such that samples may be collected or medicaments may be released from the capsule at required points along the gastrointestinal tract. It will be appreciated that the image collecting process enables precise identification of required points and accurate localization of the capsule along the tract.
[0056] The method and packaging of the present invention enable safe activation of an image collecting process directly prior to use thereby providing safe, economic and facile use of components in an image collecting process.
[0057] It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described herein above. Rather the scope of the invention is defined by the claims which follow:
Claims
The invention claimed is:
1. A method for operating a swallowable imaging capsule, the method comprising:
providing a swallowable imaging capsule inserted into a cup such that a portion of the swallowable imaging capsule is held by the cup and a portion of the swallowable imaging capsule protrudes from the cup such that the swallowable imaging capsule can be released from the cup by a user;
magnetically activating a light source of the swallowable imaging capsule while the swallowable imaging capsule is in the cup to illuminate at least once from outside a patient's body for ensuring proper operation of the swallowable imaging capsule;
providing a reception system outside the patient's body which receives output transmitted from the swallowable imaging capsule;
and transmitting an image of the area of interest to the reception system.
2. A method according to claim 1, wherein the capsule comprises an imaging device, wherein the imaging device is a CCD camera or a CMOS type image sensor.
3. A method according to claim 1, wherein the capsule is designed to image the insides of body lumens.
4. The method of claim 1, wherein the cup is to provide white balance.
Patent Citations (62)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3683389(A) | 1972-08-01 | Hollis | Applicant |
| US3931636(A) | 1976-01-01 | Schneider | Examiner |
| US3971362(A) | 1976-07-01 | Pope et al. | Applicant |
| US4135512(A) | 1979-01-01 | Godsey | Applicant |
| US4172640(A) | 1979-10-01 | Land | Applicant |
| US4177800(A) | 1979-12-01 | Enger | Applicant |
| US4273431(A) | 1981-06-01 | Farmer et al. | Applicant |
| US4278077(A) | 1981-07-01 | Mizumoto | Applicant |
| US4646724(A) | 1987-03-01 | Sato et al. | Applicant |
| US4689621(A) | 1987-08-01 | Kleinberg | Applicant |
| US4741327(A) | 1988-05-01 | Yabe | Applicant |
| US4844076(A) | 1989-07-01 | Lesho et al. | Examiner |
| US5187572(A) | 1993-02-01 | Nakamura et al. | Applicant |
| US5257636(A) | 1993-11-01 | White | Applicant |
| US5267033(A) | 1993-11-01 | Hoshino | Applicant |
| US5279607(A) | 1994-01-01 | Schentag et al. | Applicant |
| US5414405(A) | 1995-05-01 | Hogg et al. | Applicant |
| US5495114(A) | 1996-02-01 | Adair | Applicant |
| US5604531(A) | 1997-02-01 | Iddan et al. | Examiner |
| US5819736(A) | 1998-10-01 | Avny et al. | Applicant |
| US5833603(A) | 1998-11-01 | Kovacs et al. | Applicant |
| US5886353(A) | 1999-03-01 | Spivey et al. | Applicant |
| US5909026(A) | 1999-06-01 | Zhou et al. | Applicant |
| US5929901(A) | 1999-07-01 | Adair et al. | Applicant |
| US5967979(A) | 1999-10-01 | Taylor et al. | Applicant |
| US5986693(A) | 1999-11-01 | Adair et al. | Applicant |
| US5993378(A) | 1999-11-01 | Lemelson | Applicant |
| US6043839(A) | 2000-03-01 | Adair et al. | Applicant |
| US6106457(A) | 2000-08-01 | Perkins et al. | Applicant |
| US6117529(A) | 2000-09-01 | Leising et al. | Applicant |
| US6240312(B1) | 2001-05-01 | Alfano et al. | Examiner |
| US6371927(B1) | 2002-04-01 | Brune et al. | Examiner |
| US6393431(B1) | 2002-05-01 | Salvati et al. | Applicant |
| US6594036(B1) | 2003-07-01 | Wong et al. | Applicant |
| US6764440(B2) | 2004-07-01 | Iddan et al. | Examiner |
| US6934573(B1) | 2005-08-01 | Glukhovsky et al. | Applicant |
| US2001/0035902(A1) | 2001-11-01 | Iddan et al. | Applicant |
| US2002/0103417(A1) | 2002-08-01 | Gazdzinski | Applicant |
| US2003/0028078(A1) | 2003-02-01 | Glukhovsky | Applicant |
| DE3440177 | 1986-05-01 | Applicant | |
| JP5745833 | 1982-03-01 | Applicant | |
| JP3289779 | 1991-12-01 | Applicant | |
| JP4109927 | 1992-04-01 | Applicant | |
| JP1992-144533 | 1992-05-01 | Applicant | |
| JP4180736 | 1992-06-01 | Applicant | |
| JP5015515 | 1993-01-01 | Applicant | |
| JP6285044 | 1994-10-01 | Applicant | |
| JP9-327447 | 1997-12-01 | Applicant | |
| JP2005003829 | 2005-01-01 | Applicant | |
| WO92/21307 | 1992-12-01 | Applicant | |
| WO98/11816 | 1998-03-01 | Applicant | |
| WO/22975 | 2000-04-01 | Applicant | |
| WO/76391 | 2000-12-01 | Applicant | |
| WO1/08548 | 2001-02-01 | Applicant | |
| WO1/35813 | 2001-05-01 | Applicant | |
| WO1/50941 | 2001-07-01 | Applicant | |
| WO2/080376 | 2002-10-01 | Applicant | |
| WO2/094337 | 2002-11-01 | Applicant | |
| WO2/095351 | 2002-11-01 | Applicant | |
| WO3/003706 | 2003-01-01 | Applicant | |
| WO3/011103 | 2003-02-01 | Applicant | |
| WO3/028224 | 2003-04-01 | Applicant |
Non-Patent Literature (14)
- U.S. Appl. No. 10/724,109, filed Dec. 1, 2003, Glukhovsky et al.Applicant
- BBC News Online—Pill camera to ‘broadcast from the gut’, Feb. 21, 2000, www.news.bbc.co.uk.Applicant
- International Search Report—PCT application No. PCT/IL01/00215, Dated Sep. 28, 2001.Applicant
- Manual of Photogrammetry, Thompson (Ed.), Third Edition, vol. Two, American Society of Photogrammetry, 1966.Applicant
- The Radio Pill, Rowlands, et al., British Communications and Electronics, Aug. 1960, pp. 598-601.Applicant
- Video Camera to “TAKE”—RF System lab.Applicant
- Wellesley company sends body monitors into space—Crum, Apr. 1998.Applicant
- Wireless transmission of a color television moving image from the stomach using a miniature CCD camera, light source and microwave transmitter. Swain CP, Gong F, Mills TN. Gastrointest Endosc 1997;45:AB40.Applicant
- www.jason.net—Tiny cam © 2000.Applicant
- www.pedinc.com—Personal Electronic Devices, Inc. © 1997.Applicant
- Office Action dated, Aug. 4, 2005 U.S. Appl. No. 09/800,470.Applicant
- Office Action dated, Sep. 27, 2004 U.S. Appl. No. 09/800,470.Applicant
- “John Hopkins Device Takes John Glenn's Temperature in Space”, The John Hopkins University Applied Physics Laboratory, Nov. 4, 1998, www.jhuapl.edu/newscenter/pressureleases/1998/glenn.htm.Applicant
- “PED uses PICMicro® Device to Monitor John Glenn During Space Shuttle Mission”, www.microchip.com, retrieved Sep. 8. 2005.Applicant