Image processing apparatus, method and storage medium therefor

[0001] 1. Field of the Invention

[0002] The present invention relates to an image processing apparatus capable of image taking, a method and a storage medium therefor.

[0003] In the medical field, the diagnosis with image has meant observation of the image recorded on the X-ray film on the film viewing light box (schaukasten).

[0004] However, the ordinary X-ray film is so designed as to have a high image contrast in an easily observable density range of about 1.0 to 1.5 D in order to facilitate the observation of the body part to be diagnosed, so that even a slight aberration in the image taking condition results in an overexposure or an underexposure, thus detrimentally affecting the diagnosis by image reading.

[0005] Particularly in case of divided image taking, the image contrast and object of diagnosis are different respectively for the diagnosed parts recorded in the divided areas on the film, so that various efforts have been made for obtaining the desired images.

[0006] On the other hand, with the recent progress in computer technology, computerization has been introduced also in the medical field. This trend is evident also in the diagnosis with image, including remarkable progress in the computed tomography (CT), ultrasonic diagnostic equipment and equipment for radio isotope diagnosis. Further, there has been developed a concept “comprehensive diagnostic imaging (or integrated image diagnosis)” of connecting various diagnostic equipment with a computer and integrally diagnosing the images of different modalities.

[0007] However, the image on the X-ray image is basically an analog image and cannot be satisfactorily incorporated in the integrated image diagnosis, thus retarding the computerization in the image diagnosis field, though it is most frequently utilized and considered most important in the image diagnosis.

[0008] Nevertheless, the X-ray image taking with a solid-state image taking device is recently developed, and the image taking with the computerized digital X-ray image reading apparatus has gradually started in the X-ray image field. Such image taking method is featured in that the image can be confirmed immediately after the image taking.

[0009] In such digital X-ray image taking, the blur in the taken image caused by the movement of the subject patient can be found immediately after the image taking operation, so that there is frequency executed the image re-taking operation, which is not often executed in the conventional analog image taking. In such case, regardless of the number of the image re-taking operations, the image finally outputted from the apparatus has to be arbitrarily selected among thus taken images.

[0010] Also the last taken image is not necessarily the best image in the final judgment, and there may be encountered a situation where, despite of the image re-taking, the image prior to the re-taking is better. It has therefore been desired to meet such requirements.

[0011] In an embodiment of the present invention, there is provided an image processing apparatus comprising designation means for designating the image taking conditions relating to the image taking, image taking means for taking an image under the image taking conditions designated by the designation means, storage means for storing the image, taken by the image taking means, as an already taken image, discrimination means for discriminating whether the storage means contains an already taken image taken under the same image taking condition, and output control means for effecting control in such a manner, in case the discrimination means identifies that an already taken image taken under the same image taking condition is present, as to the later taken image as the re-taken image.

[0012] FIG. 1 is a block diagram showing the configuration of an X-ray image collection apparatus;

[0013] FIG. 2 is a view showing the functional configuration of the X-ray image collection apparatus;

[0014] FIG. 3 is a view showing an example of the image on a display portion 11 in an embodiment of the present invention;

[0015] FIG. 4 is a view showing the state of the display portion 11 after image re-taking;

[0016] FIG. 5 is a view showing the functional configuration relating to the image re-taking operation of the X-ray image collection apparatus;

[0017] FIG. 6 is a view showing the attributes of a study ID 63, a serial number 62 and an image number 63;

[0018] FIG. 7 is a view showing the conventional study attribute, serial attribute and image attribute;

[0019] FIG. 8 is a view showing an example of image management in an embodiment of the present invention;

[0020] FIG. 9 is a view showing an example of the mode 1;

[0021] FIG. 10 is a view showing an example of the mode 2;

[0022] FIG. 11 is a flow chart of an image re-taking process by a part setting button 309;

[0023] FIG. 12 is a flow chart of an image re-taking process in case an image-retaking is designated; and

[0024] FIG. 13 is a flow chart of an overview image selection process.

[0025] In the following there will be explained an X-ray image taking apparatus.

[0026] FIG. 1 is a block diagram showing the configuration of the X-ray image taking (sensing) apparatus.

[0027] The X-ray image taking apparatus 1 receives the ordering information from an external network 3. The present embodiment has two modes, namely a mode of automatically entering an image taking start procedure simultaneously with the reception of the ordering information and another mode of entering the image taking start procedure with the received ordering information through a user interface. These modes will not be explained here since they will be explained later with reference to FIG. 2.

[0028] At first the operator places a subject to be taken between a solid-state image taking element 6 and an X-ray tube 9. Then a part setting button, for setting the part to be taken, assumes a state selected according to the ordering information. Subsequently, based on a solid-state image taking element drive control signal, the system applies a voltage to the solid-state image taking element thereby preparing the solid-state image taking element for image input.

[0029] Also a grid operating speed parameter is adjusted. An exposure button 4 serves as a trigger for generating the X-ray. An exposure signal a generated by the exposure button 4 is entered into an image reading control portion 20 of the image collection apparatus 1. The image reading control portion 20, after confirming whether the solid-state image taking element 6 is in a state of forming an image upon receiving the X-ray by the state of a drive information signal, generates an exposure enabling signal. The exposure permission signal turns on an exposure enabling switch 10, thereby passing the exposure signal a as an exposure signal b. The switch employed for this purpose is called a second switch of the exposure button. The exposure signal b is transferred to an X-ray generation control portion 5.

[0030] As soon as the preparation for X-ray exposure is completed, such as a grid 8 starts movement and reaches an optimum speed, the X-ray generation control portion 5 generates an exposure signal c to generate X-ray from the X-ray tube 9. After the exposure, the transmitted X-ray is entered, through the grid 8 and a scintillator 7, as an image into the solid-state image taking element 6. This image is read and digitized in an A/D converter 10 and transferred to an image reading control portion 20.

[0031] The image reading control portion 20 is controlled by a CPU 17, which is also connected, through a bus 21, to a RAM 13, a ROM 14, a LAN/IF 15, a DISK/IF 16, a control panel, a non-volatile storage device 19 and a user IF 18. The non-volatile storage device 19 in the present embodiment is composed of a hard disk. The user IF 18 is provided with a display 11 and a keyboard/mouse 12 for interfacing with the user. Naturally there may be employed a touch panel. The image transferred to the image reading control portion 20 is stored in the ROM 13 and is subjected to various processing to be explained later in the CPU.

[0032] FIG. 2 is a view showing the functional configuration of the X-ray image collection apparatus.

[0033] Order information from the ordering device 33 is received by an order reception portion 31. Upon reception of the order, the arrival of the order is informed to an image taking start instruction portion 30. In the present embodiment, the image taking start instruction portion 30 has two modes, namely a mode of automatically entering the image taking start procedure simultaneously with the reception and a mode of entering the image taking start procedure with the received ordering information through a user interface. In the latter mode the user interface portion 18 displays a list of the received order and there is provided an advantage that the order can be selected from such list. In such case, prior to the reception of the order information, a request is given to the ordering device 33 for transmitting the list of orders.

[0034] In either case, when the image taking start procedure is started, the order is interpreted in the order reception portion 31 and the personal information of the order, such as the name and birth date of the subject to be inspected, is transferred from the order reception portion 31 to the user interface 18 together with the instruction for starting the image taking. The user interface 18 displays the name of the subject whereby the subject to be inspected can be confirmed.

[0035] At the same time, the part information a 1st body part ordered for inspection is transferred from the order reception portion 31 to a part button selection portion 29 together with the instruction for starting the image taking. Thus the part button selection portion 29 enables a part button of the corresponding part for selection. Also the user interface 18 displays the image taking condition according to the ordered image taking information. As will be clarified in the following description, as soon as the image taking of the ordered 1st part is completed, the image taking procedure is started according to the part information of a 2nd body part.

[0036] Then the image taking condition is transferred from the order reception portion 31 to an image taking condition setting portion 26, together with the instruction for starting the image taking. The image taking condition setting portion 26 sets the conditions of the X-ray tube, such as the tube voltage and the focus size, in the X-ray generator 5 according to the ordered image taking condition.

[0037] Then the image taking condition is transferred from the order reception portion 31 to a drive instruction portion 27 together with the instruction for starting the image taking. The drive instruction portion 27 applies a voltage to the solid-state image taking element 6 thereby shifting it to a driven state. The driven state is not an image taking state but a state in which the voltage required for image collection is not applied in order to extend the service life of the solid-state image taking element 6. The driven state expires after 1 minute if the image taking procedure is not executed, and returns to a non-driven state.

[0038] Then the image taking condition is transferred from the order reception portion 31 to a grid operation setting portion 28 together with the instruction for starting the image taking. The grid operation setting portion 28 determines the grid speed parameter, preset depending for example on the information of the body part for which the image taking is to be executed. For example, the grid speed is lowered or elevated respectively for a part requiring a long exposure time and a part requiring a short exposure time.

[0039] Then the image taking condition is transferred from the order reception portion 31 to an image taking condition storage portion 24, together with the instruction for starting the image taking. In order to manage the history of the image taking information, the storage is made in the RAM and the hard disk of the system.

[0040] In the following there will be explained a case where the tube setting is changed X-ray generator 5.

[0041] In the present embodiment, the operator can arbitrarily set, in the X-ray generator 5, a condition such as the tube voltage or the focus size different from the ordered image taking condition, according to the health state of the subject. In such case, the X-ray image collection apparatus 1 accepts the change of the image taking condition from an image taking condition change receiving portion 22. The drive instruction portion, the grid operation setting portion 28 and the image taking condition storage portion 25 executes the above-described procedures again since the image taking condition is reset. Also the user interface 18 displayed the changed image taking condition.

[0042] In response to the depression of the exposure button 4, the X-ray tube 9 executes the exposure. The data flow in this procedure will not be explained since it is already illustrated in FIG. 1, but a signal is sent to the X-ray image collection apparatus 1 to send an operation signal to the grid and the solid-state image taking element 6.

[0043] In response to the depression of the exposure button 4 by the operator, the X-ray is generated to execute the image taking. Thereafter, the image taking operation condition, such as the image taking time and the mAs value, is generated by the X-ray generator 5, and is received by the image taking operation condition receiving portion 23 and transferred to an image taking operation condition storage portion 24. The storage is made in the RAM and the hard disk of the system in order to manage the history of the image taking operation.

[0044] When the image taking sequence is completed, a next image taking sequence is started to repeat the above-described procedures.

[0045] When the inspection consisting of single or plural image taking sequence is completed, the information in the image taking condition storage portion 24 and the image taking operation condition storage portion 25 is transmitted to an order reply portion 32, which informs the completion of the inspection according to a communication protocol determined in advance with the ordering device 33. In this operation, there are transmitted the image taking condition and the image taking operation condition under which the image taking was executed.

[0046] One of the features of the present embodiment lies in a fact that the X-ray generator 5 is provided for setting the solid-state image taking element 6 in the driven state. Therefore, even if the image taking element is shifted to the non-driven state upon expiration of 1 minute, it can be reset to the driven state by an instruction for changing the parameter from the X-ray generator 5. Therefore, the instruction for change is given from the X-ray generator 5 even if the parameter remains same before and after the change. This function allows the operator to execute the image taking operation even without looking at the display on the X-ray image collection apparatus 1.

[0047] FIG. 3 shows an example of the display of a display portion 11 in the present embodiment.

[0048] At the image taking operation, the operator depresses an image taking start button 302 to request that the ordering device 33 transmits the order list, whereby the received order list is displayed to enable selection an order therefrom. In case the transmission of the order list is not requested, and if the order is transmitted from the ordering device 33 to the X-ray image collection apparatus 1, the image taking start procedure is initiated according to the received ordering information. When the image taking procedure is started, a “chest PA” button 310 indicating the initial image taking part is rendered selectable as illustrated. Also as the image taking condition, there is displayed a tube voltage of 125 kV is displayed. This value can be changed in the X-ray generator 5, and is changed on real-time basis according to the change in the X-ray generator 5. The image taking operation is thereafter executed, and the image taking operation condition of 30 mAs is displayed on the user interface. When all the image taking operations are executed, the inspection is terminated either by the depression of an inspection end button 311 or automatically by time-out. Upon completion of the inspection, the image taking information and the image taking operation information are returned to the ordering device 33 as explained in the foregoing. Also the collected images are externally transferred through the network.

[0049] In the foregoing there has been explained the method collecting the images according to the ordering information, by image taking operation in succession on the designated parts under pre-designated conditions, but the image taking may not be successful in one operation, mostly because of the movement of the subject. The movement of the subject causes a blur in the obtained image, eventually causing a difficulty in the diagnosis.

[0050] However, in case of image taking again, the re-taking is not required for all the images collected prior to the re-taking according to the order from the HIS (hospital information system) but is often required for a body part under the designated condition. This invention is to meet such requirement.

[0051] FIG. 4 is a view showing the state of the display portion 11 after image re-taking.

[0052] In case the image re-taking becomes necessary because of an image blur at the image taking of the head portion, an image re-taking button 306 is depressed, whereby there is reached a state ready for image re-taking. In such case, there is usually used the same image taking condition, but the image taking condition may also be changed if the operator judges that the image taking cannot be properly executed under the same image taking condition, for example because of the body size of the subject.

[0053] Then the exposure button 4 is depressed to execute the image re-taking, whereupon the re-taken image is displayed as illustrated. The previous image, which is now regarded as an already collected image because of the image re-taking, is to be replaced by the re-taken image in the default condition, and is therefore displayed with a cross mark thereon. FIG. 5 shows a case where the image re-taking is executed twice.

[0054] The operator may execute the image re-taking plural times, but the image transferred externally as the ordered image is not necessarily the one taken last. When the already collected image 1 in FIG. 4 is selected with the mouse, such image becomes the representative image and the cross mark is removed from such image while the last taken image is displayed with a cross mark. In this manner the selected image alone becomes the image constituting the result of the order while other images are regarded as failure.

[0055] Also the taken images are stored in the non-volatile storage device shown in FIG. 1 even after the image re-taking, and can be read and transferred in case there is required an image other than the image constituting the result of the order.

[0056] FIG. 5 is a view showing the functional configuration relating to the image re-taking process of the X-ray image collection apparatus.

[0057] When the operator depresses the image re-taking button 306 for executing the image re-taking, a notice is given to a user input/output portion 51 and further from an image re-taking portion 52 to an image taking/system control portion 56 controlling the image taking operation. The image taking/system control portion 56 prepares for the image taking, and the image taking operation is executed when the operator depressed the exposure button (not shown in FIG. 5).

[0058] Subsequently the taken image is transferred through an image addition portion 54 to a display portion 53, which thus displays the image on the display through the user input/output portion 51. (Image addition means adding an image to an overview list.)

[0059] When the user re-selects, on the user input/output portion 41, the representative image from the images obtained by image re-taking, a notice is given to a collection image re-selection portion 55 and further to the display portion 53 and the image taking/system control portion 56. The display portion 53 executes erasure and setting of the cross marks, while the image taking/system control portion 56 maintains the representative image, and transfers the representative image only to the network when the inspection is terminated.

[0060] In the following there will be explained the image re-taking process, with reference to flow charts shown in FIGS. 11 to 13.

[0061] FIG. 11 is a flow chart of the image re-taking process by the actuation of the part setting button 300.

[0062] A step S1101 discriminates whether the part setting button 300 has been depressed, and, if depressed, the sequence proceeds to a step S1102. The step S1102 discriminates whether an image with the same unique ID is present in the already taken images, namely the already collected images, and the sequence proceeds to a step S1103 or S1107 respectively such image is present or absent. The unique ID is information for specifying the image taking information such as the subject name, body part to be taken, image taking direction, image taking condition etc.

[0063] A step S1103 enters a stand-by state for executing the image taking operation, and, when the image taking operation is executed, the sequence proceeds to a step S1104. Also a step S1107 enters a stand-by state for executing the image taking operation, and, when the image taking operation is executed, the sequence proceeds to a step S1105.

[0064] A step S1104 attaches cross marks on all the images of the same unique ID in the already collected images. In this state, the already collected images 1, 2 are displayed with the cross marks, as shown in FIG. 4. Then a step S1105 sets, on the last taken image, namely the re-taken image 403 in FIG. 4, a unique IID same as that of the already collected images 1, 2. Then a step S1106 displays the re-taken image in an overview 305 whereupon the image re-taking process is terminated.

[0065] In the following there will be explained, with reference to FIG. 12, the image re-taking process when the image re-taking is instructed.

[0066] The sequence of FIG. 12 is initiated when the image re-taking is instructed for example by the image re-taking button 306. A step S1201 enters a state for waiting for a re-taking object image to be re-taken, and, when the re-taking object image is displayed on the display portion 11, the sequence proceeds to a step S1202. A step S1202 discriminates whether the re-taking object image is designated among the object images displayed in the step S1201, and, if designated, the sequence proceeds to a step S1203. A step S1203 attaches a cross mark to the designated re-taking object image, namely the already collected image. This state is illustrated in FIG. 4.

[0067] Then a step S1204 enters a stand-by state for executing the image re-taking operation. When the image re-taking operation is executed, the sequence proceeds to a step S1205. A step S1205 sets a same unique ID to the already collected image and the re-taken image. The unique ID is same as that explained in relation to FIG. 11 and will not be explained further. Then a step S1206 displays the re-taken image on the overview 305, whereupon the image re-taking process is terminated.

[0068] FIG. 13 is a flow chart of a process for selecting the overview images, which is to be executed after the image re-taking process according to FIGS. 11 and 12, as will be explained in the following.

[0069] A step S1301 discriminates whether any of the overview images 305 as shown in FIG. 4. If selected, a step S1302 discriminates whether a cross mark is present on the selected overview image, and, if present or absent, the sequence respective proceeds to a step S1303 or S1305. A step S1303 displays the selected overview image by detaching the cross mark. A step S1304 searches an image of a unique ID same as that of the overview image from which the cross mark is detached in the step S1303, and attaches a cross mark to the overview image of the same ID. It is thus rendered possible to select only one image without the cross mark among the overview images of a same ID and to transfer the one selected image only to the exterior. In the present embodiment, there is selected only one image, but it is naturally possible also to select and transfer plural images.

[0070] A step S1302 identifies that the selected overview image does not bear the cross mark, the sequence proceeds to a step S1305 for attaching a cross mark on the selected overview image.

[0071] As explained in the foregoing with reference to FIG. 13, an image suitable for inspection can be selected from a group of images obtained by image re-taking and transferred to the exterior, so that the image re-taking can be executed relatively easily. Also this configuration can flexibly adapt to a situation where the already taken image is found, after the image re-taking, better than the re-taken image.

[0072] There is already defined a standard communication protocol called DICOM, which manages the taken images by handling a plurality of taken images as a series, also handling a plurality of the series as a study, and executing the image taking operation in succession in the unit of such study.

[0073] FIG. 6 shows the attributes of a study ID 63, a series number 62 and an image number 63.

[0074] Since this protocol is applicable to the inspection of any modality, and is therefore dependent on the condition of preparation of a new series and the condition of image taking condition of the modality. In the digital image collection apparatus of the present embodiment, each image is generally managed as a series.

[0075] FIG. 7 shows the relationship of the study attribute, series attribute and image attribute in the conventional digital image collection apparatus.

[0076] In case a new series is added where a series 1 is already present, there is generated a new series with an assigned series number 2 even if the serial attribute is same, and is attached to a study 1234. In this method, a series is newly assigned when an image is formed in any of all the taken images.

[0077] In certain image taking methods, plural images may be taken from a same direction, such as in II-DR still image taking. In such case, there are generated plural images with a same series attribute, so that the serially taken images can be added while fixing the study and the series. The present embodiment can dynamically adapt to such case.

[0078] In the following there will be given further explanation with reference to FIG. 8.

[0079] FIG. 8 is a view showing an example of image management in the present embodiment.

[0080] At first the image taking operation is executed in a study of an attribute different from that of the past study, there is generated a new study. There is illustrated the generation of a study with the study attribute 5678. The initial image in this study constitutes a new series and a new image, so that a series with the series number 1 is added to the study and a taken image with the image number 1 is added to the series of the series number 1. In FIG. 8, alphabets AAAA, OOOO etc. schematically indicate various attributes.

[0081] If a next image taking is executed with the same series attribute, namely with the same image taking protocol, inspected part and viewing direction, the taken image is added with an image number 2 to the series 1.

[0082] Then, if a next image taking is executed with at least a different series attribute, namely if any of the image taking protocol, inspected part and viewing direction is made different, a series 2 is newly generated and added to the study of the study number 5678, and the taken image is added as a new image of an image number 1 to the series 2.

[0083] The present embodiment is also featured by a fact that the operation can be varied by two modes, in case the image taking is again executed with the attribute of the series 1 after the above-mentioned 3 image takings.

[0084] FIG. 9 shows an example of the mode 1.

[0085] This mode searches a past series of the same series attribute, and, if such series is present, adds the taken image to such searched series. In the illustrated example, the taken image is added with an, image number 3 to the series of the series number 1.

[0086] FIG. 10 shows an example of the mode 2.

[0087] This mode does not search the past series of the same series attribute, but generates a new series and adds the taken image thereto. In the illustrated example, the taken image is added with an image number 1 in a new series generated with a series number 3.

[0088] Such process is advantageous in the image management, since the serial images of similar attributes can be collectively managed.

[0089] In the foregoing embodiment, there has been explained a case of storing the programs in the ROM, but such configuration is not restrictive and there may be employed any arbitrary storage medium. Also there may be adopted a circuit capable of similar functions.

[0090] The present invention may be applied to a system consisting of plural equipment or an apparatus consisting of a single equipment. Also the present invention includes a case where a storage medium recording the program codes of a software realizing the functions of the aforementioned embodiments is supplied to a system or an apparatus and the functions of the aforementioned embodiments are realized by reading and executing the program codes stored in the storage medium by a computer (CPU or MPU) of the above-mentioned system or apparatus. In such case the program codes themselves read from the storage medium realize the functions of the aforementioned embodiments, and the storage medium storing the program codes constitutes the present invention.

[0091] The storage medium storing such program codes can be, for example, a floppy disk, a hard disk, an optical disk, a magnetooptical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card or a ROM.

[0092] The present invention also includes such program codes not only in a case where the functions of the aforementioned embodiments are realized by the execution of the read program codes by the computer but also a case where an operating system or the like functioning on the computer executes all or a part of the actual processes under the control of such program codes thereby realizing the functions of the aforementioned embodiments.

[0093] The present invention further includes a case wherein the program codes read from the memory medium are once stored in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, and a CPU provided in the function expansion board or the function expansion unit executes all the process or a part thereof according to the instructions of such program codes, thereby realizing the functions of the aforementioned embodiments.

[0094] As explained in the foregoing, the present invention allows to arbitrarily select the image adapted for inspection from the group of images obtained by image taking.