Coordinate transforming method in position setting means of observation device and observation device equipped with coordinate transforming means

[0003] The present invention relates to a coordinate determination method of an observation apparatus, such as a microscope with an automatic sweep unit, having its own coordinates determined within an observation range so that an object to be observed can be positioned and observed at any of the coordinates, and more particularly to a coordinate determination method by which a specified position in a sample which position is observed by an apparatus A and checked using the coordinates of the apparatus A can be determined easily in an apparatus B having coordinates different from those of the apparatus A when the same sample is observed by the different observation apparatus having their respective own coordinates.

[0004] A rapid microorganism detection system using an ATP-luciferase method, for example, observes the presence of microorganisms by causing a luciferin-luciferase reaction using adenosine triphosphate (ATP), which exists peculiarly in a mass in a living cell, so as to detect faint luminescence generated in proportion to the content of ATP by means of a photodetector. This state of luminescence is imaged by means of an image acquisition unit such as a charge coupled device (CCD) so as to be visually observed. However, according to this method, although the presence of the microorganisms can be observed to a slight extent, the kinds of the observed microorganisms cannot be recognized.

[0005] Therefore, in order to accurately specify the microorganisms whose presence is observed by the above-described method, it is necessary to observe a sample used in the above-described method by a microscope. In order to make these two observations skillfully and efficiently, it is important to specify, with ease in a short time, positions at which the microorganisms exist in the sample and designate the positions by means of an automatic sweep unit for examination position provided to the microscope so that the objective microorganisms can be observed immediately.

[0006] However, when the sample is checked by the above-described rapid microorganism detection system (hereinafter referred to as an RMDS) and further observed by the microscope with the automatic sweep unit (hereinafter referred to as an SFDS), the coordinates of the RMDS, as they are, cannot be used as those of the SFDS. Therefore, the microscope separately requires an adjustment, thus forcibly requiring time and complicated operations.

[0007] In other words, the coordinates of the RMDS and the SFDS do not have a direct correlation, and the respective units of the coordinate axes thereof do not have any correlation, not to mention the origins thereof. (For example, the coordinate axes provided for the RMDS for position confirmation employs as a scale unit one pixel of an image acquisition unit employed. On the other hand, the scale unit of the coordinate axes provided for the sweep unit of the SFDS is millimeters.) For example, if a sample of the RMDS were a filter 47 mm in diameter, on which filter an enzyme of one cell exists, it would be necessary to observe a visual field of 3,000 with a magnification of 100 and that of 6,000 with a magnification of 200 when the sample is observed by the microscope. However, practically, the observations cannot be made in this way. (In this case, the areas of the visual fields of the respective magnifications would be 0.76×0.76 mm and 0.53×0.53 mm.)

[0008] This problem is not limited to the usages of the RMDDS and the SFDS, but is in common with the usages of observation apparatus having means for determining their own coordinates within observation ranges and for indicating and designating the specified positions of objects to be observed by means of the coordinates.

[0009] The present invention eliminates the above-described conventional disadvantages, and the object thereof is to obtain a coordinate transformation method in which a correlation is established between the coordinates of observation apparatus having their respective coordinates for position designation so that a position in one observation apparatus is specified based on position data from the other when the same sample is observed by the observation apparatus.

[0010] The present invention is made in the light of the above-described disadvantages and eliminates the disadvantages by adopting the following processes.

[0011] In other words, the present invention is a method of transforming a first coordinate system for position designation of a first observation apparatus into a second coordinate system for position designation of a second observation apparatus. The first and second coordinate systems are different from each other. The present invention is characterized by adopting the following processes.

[0012] (1) Preparing a sample for coordinate determination in which sample at least three observation points are set in random positions.

[0013] (2) Placing the sample on the sample base of the first observation apparatus to observe the above-mentioned observation points and read the coordinates thereof ((X1, Y1), (X2, Y2), and (X3, Y3)).

[0014] (3) Marking randomly the sample and the sample base so as to determine the relative positions thereof.

[0015] (4) Removing the sample from the first observation apparatus and setting the sample in the second observation apparatus. Putting randomly a mark on a holding unit (for example, a slide glass) for holding the sample so that the mark corresponds to the marked position in the sample when the sample is placed on the sample base (including the original coordinates of the second observation apparatus) or the sample holding unit of the second observation apparatus. Setting the sample in the second observation apparatus so that the marked position in the sample corresponds to the mark. Hereafter, setting the sample so that the marked position corresponds to the mark whenever the sample is observed by the second observation apparatus after being observed by the first observation apparatus.

[0016] (5) Reading the coordinates ((x1, y1), (x2, y2), and (x3, y3)) of the positions of the observation points set in the sample by using the original coordinates of the second observation apparatus.

[0017] (6) Letting one of the above-described observation points serve as temporary origins (for example, (x1, y1) and (X1, Y1)).

[0018] (7) Calculating a, b, c, and d of coordinate transformation formulas xn=aXn+bYn and yn=cXn+dYn by substituting the coordinates of the other two observation points into the above-described formulas. Substituting obtained values into the above-described formulas to determine the coordinate transformation formulas. Correcting the values of xn, yn, Xn, and Yn to be substituted thereinto to values based on the respective temporary origins (to give a correlation).

[0019] (8) Correcting the determined transformation formulas so that the determined transformation formulas are adapted to the original coordinate system of the second observation apparatus (correcting the first coordinate system based on the temporary origin thereof to the original coordinate system of the second observation apparatus) (xn=aXn+bYn+x1 and yn=cXn+dYn+y1).

[0020] (9) Observing the sample by the first observation apparatus and reading the value of an observation point in the sample ((X4, Y4).) . . . ).

[0021] (10) Calculating (x4, y4) by substituting the value confirmed in the process (9) into the coordinate transformation formulas determined in the process (8).

[0022] (11) Moving the sample to the second observation apparatus and inputting the value of the above-mentioned coordinates to the position determination means (a sweep unit) thereof so as to designate a position.

[0023] Through the above-described processes, the coordinates of the observation points in the sample confirmed by the first observation apparatus can be transformed into the coordinates of the observation points in the second observation apparatus. Further, by providing the second observation apparatus with the above-described coordinate transformation function, the coordinates of the observation points confirmed by the first observation apparatus, as they are, can be used to designate positions in the second observation apparatus.

[0024] Moreover, the observation apparatus according to the present invention is characterized by having a position determination means including a first coordinate system, which means includes a coordinate transformation means for transforming a second coordinate system of the position determination means of another observation apparatus into the first coordinate system, which is different from the second coordinate system.

[0025] According to the observation apparatus of the present invention, a coordinate value confirmed by another observation apparatus is directly input to the observation apparatus of the present invention to be transformed into an original coordinate value thereof and output to the position determination means thereof.

[0026] FIG. 1 is a diagram showing a structure of a rapid microorganism detection system;

[0027] FIG. 2 is a diagram illustrating coordinates employing a pixel of a camera tube as its unit in an image of the rapid microorganism detection system;

[0028] FIG. 3 is a diagram showing a system structure of a microscope with an automatic sweep unit;

[0029] FIG. 4 is a diagram illustrating a mechanism for moving a sample stage of the microscope with the automatic sweep unit;

[0030] FIG. 5 is a block diagram illustrating a control device of the microscope with an automatic sweep unit;

[0031] FIG. 6 illustrates coordinate systems of the RMDS and the SFDS; and

[0032] FIG. 7 shows an experiment of a transformation of the RMDS coordinate system into the SFDS coordinate system.

[0033] Next, a description will be given, with reference to the accompanying drawings, of an embodiment of the present invention.

[0034] In this embodiment, the description will be given by taking the case in which a rapid microorganism detection system (RDMS) using the ATP-luciferase method, which is effective in confirming the presence of microorganisms, is a first observation apparatus, and a microscope with an automatic sweep unit (SFDS), which is effective in confirming the details of the microorganisms, is a second observation apparatus.

[0035] First, a description will be given of the outlines of the rapid microorganism detection system (RDMS) and the microscope with the automatic sweep unit (SFDS).

[0036] According to the examination of microorganisms made by the RDMS, a specimen liquid is first filtered so as to isolate live cells on a filter, and the filter is detected by means of a microbial luminescence image analyzing system. According to the system, the filter, on which the live cells are isolated, is processed with an extractant and a luminescent reagent, and is set on a specimen holder. Then, a television camera including an optical system and an image acquisition unit such as a charge coupled device is set as closely to the filter as possible in order to acquire the image of the state of luminescence of the filter. Data for the acquired image is shown on a display for observation through an image processing device and a data-analyzing device, and the results of the analysis are printed out.

[0037] FIG. 1 is a schematic diagram of a system of a rapid microorganisms detection system (RDMS) 10, which includes a high-sensitivity television camera 1 including a tapered fiber, an optical amplifier section and a camera tube (a charge coupled device), a camera controller 2, an image processor 3, a data-analyzing device 4 and a television monitor 5. The measurement is made as follows: A filter 6 holding the live cells subjected to luminescence treatment is set closely to the high-sensitivity television camera 1. The image of luminescence from the live cells is acquired by accumulating two-dimensional photons for a predetermined period of time, for example, 30 to 180 seconds, using the camera controller 2 and the image processor 3. Luminescence noises are erased by the data-analyzing device 4, so that only intense luminescence from the live cells remains to be displayed on the television monitor 5. This process erases, as noise, luminescence other than that from the live cells, and the number of measured luminous points becomes the number of the live cells. The luminous points originating in the microorganisms, for example, as shown in FIG. 2, can be shown by means of coordinates using a pixel of the camera tube as its unit (in FIG. 2, “1”s indicate the luminous points originating in the microorganisms), and the luminous points can be confirmed using the positions in the filter 6 by relating the positions in the filter 6 with those in the camera tube.

[0038] Next, a description will be given of the outline of the microscope with the automatic sweep unit (SFDS).

[0039] FIG. 3 is a schematic diagram of a structure of an SFDS 20, which includes a microscope 21, a control box 31 for controlling a position of a holder for holding a slide glass, and an operation panel 41 for inputting necessary data to the control box 31 and outputting the examination results by the microscope.

[0040] The microscope 21 includes a stage 22 for supporting a sample filter 100 and x-axis and y-axis moving mechanisms 24A and 24B. The x-axis and y-axis moving mechanisms 24A and 24B, which are provided to the stage 22, move the filter 100 in directions indicated by arrows x and y, respectively, under objective lenses 23.

[0041] The control box 31 includes x-axis and y-axis drive motors 32A and 32B for driving the x-axis and y-axis moving mechanisms 24A and 24B of the microscope 21, respectively, and display units 34A and 34B indicating positions of the filter 100 in x-axial and y-axial directions, respectively. The drive forces of the x-axis and y-axis drive motors 32A and 32B are transmitted to the x-axis and y-axis moving mechanisms 24A and 24B via flexible axes 33A and 33B, respectively.

[0042] The operation panel 41 includes a power supply switch 42A, a group of switches 42B for other operations, and a group of input switches 43 for inputting a variety of data for designating positions to which the filter 100 is moved. In addition to switches for inputting coordinate data for designating the positions to which the filter 100 is moved, the group of the input switches 43 includes a coordinate switching switch (not shown) which switches a coordinate system for inputting coordinates from an RMDS mode to an FSDS mode. The operation panel 41 further includes an output device 45 so that a specified one of the positions of the filter can be not only stored but also printed out from the output device 45.

[0043] FIG. 4 shows details of the respective x-axis and y-axis moving mechanisms 24A and 24B for moving the filter 100. The mechanisms 24A and 24B are provided to the stage 22 of the microscope 21.

[0044] The stage 22 includes a holder 51 for holding the filter. The holder 51 is movably supported in X directions in FIG. 4 by a guide shaft 53, which is attached to a movable plate 52 through an attachment portion 51A of the holder 51. The attachment portion 51A includes a threaded hole through which a screw 54 penetrates. The screw 54 is rotated by the above-described drive motor 32A so that the holder 51 is moved in the X directions.

[0045] On the other hand, the movable plate 52 is movably supported in Y directions in FIG. 4 with respect to the stage 22. A screw 55 penetrates through an edge portion of the movable plate 52. The screw 55 is rotated by the drive motor 32B so that the movable plate 52 is moved in the Y directions.

[0046] FIG. 5 is a block diagram showing a control system of the operation of the SFDS 20. The control box 31 includes a control device 33 and performs a variety of operations based on input signals from the switches of the operation panel 41 so as to output a control signal to the x-axis and y-axis drive motors 32A and 32B and required data to the output device 43 of the operation panel 41.

[0047] In the case of making an observation using the SFDS 20 having the above-described structure, after placing the prepared sample filter on the holder 51 provided on the stage 22 of the microscope 21, the holder 51 is moved so that a required position in the sample filter can be observed by inputting the coordinates through the input switches 43 of the operation panel 41. If there are observation points to be recorded present during the observation, the coordinates of the observation points are stored by operating a required one of the switches 42. After the observation is over, the stored coordinates are printed out from the output device 45 as required.

[0048] The SFDS according to this embodiment further includes a function to transform directly input coordinates of the RMDS into coordinates of the SFDS so that the coordinates of the SFDS do not have to be input in the case of inputting coordinates to determine positions to which the holder 51 is moved. In other words, the control device 33 of the control box 31 contains a program for performing a later-described operation for transforming coordinates of the RMDS input from the operation panel 41 into coordinates of the SFDS. Therefore, by switching the coordinate switching switch of the input switches 43 to the RMDS mode, the control device 33 automatically transforms coordinates of the RMDS input directly from the input switches 43 into coordinates of the SFDS through the operation using predetermined transformation formulas.

[0049] Next, a description will be given of processes of transforming the coordinate system of the filter image obtained by the RMDS into the coordinate system of the SFDS. FIG. 6 shows 1) the RMDS coordinate system and 2) the SFDS coordinate system.

[0050] (1) Preparing a sample for coordinate determination by mixing an ATP solution with a pigment and dropping the ATP solution into spots on the filter.

[0051] (2) Marking correspondingly a random position in the sample and a random position in the sample base of the RMDS when the sample is placed on the sample base, and confirming, by the RMDS, the coordinates (x, y) of luminous points produced by dropping the above-described ATP solution into the spots.

[0052] (3) Setting the filter on the SFDS. Putting a mark on the sample base of the SFDS or on the sample holding unit thereof and placing the filter so that the marked position in the above-mentioned filter corresponds to the above-described mark. Recording coordinates (X, Y) at which the pigment of the spots formed on the filter is brought within the visual field of the microscope.

[0053] (4) Observing at least three different spots in this operation to obtain their respective coordinates, and letting one of the three spots serve as temporary origins ((x0, y0) and (X0, Y0)) and the other two be coordinates ((x1, y1) and (X1, Y1)) and ((x2, y2) and (X2, Y2)) for making the transformation formulas.

[0054] (5) Substituting the coordinates ((x1, y1) and (X1, Y1)) and ((x2, y2) and (X2, Y2)) into the following formula (1) to obtain formulas (2).

[0055] The coordinates ((x, y) and (X, Y)) to be substituted are always relative values to the respective temporary origins ((x0, y0) and (X0, Y0)). Therefore, it is necessary to subtract the coordinate values of (x0, y0) and (X0, Y0) from the respective coordinate values. $\begin{array}{cc}\left(\begin{array}{c}X\\ Y\end{array}\right)=\left(\begin{array}{cc}a& b\\ c& d\end{array}\right)\left(\begin{array}{c}X\\ Y\end{array}\right)& \left(1\right)\\ \begin{array}{c}\begin{array}{c}\begin{array}{c}\mathrm{X1}=a·\mathrm{x1}+b·\mathrm{y1}\\ \mathrm{Y1}=c·\mathrm{x1}+d·\mathrm{y1}\end{array}\\ \mathrm{X2}=a·\mathrm{x2}+b·\mathrm{y2}\end{array}\\ \mathrm{Y2}=c·\mathrm{x2}+d·\mathrm{y2}\end{array})& \left(2\right)\end{array}$

[0056] (6) Finding a, b, c, and d from the following formulas (3) to determine transformation formulas (4). $\begin{array}{cc}\begin{array}{c}\begin{array}{c}\begin{array}{c}\begin{array}{c}a=\left(\mathrm{X1}-b·\mathrm{y1}\right)/\mathrm{x1}\\ c=\left(\mathrm{Y1}-d·\mathrm{y1}\right)/\mathrm{x1}\end{array}\\ \mathrm{X2}=\left\{\left(\mathrm{X1}-b·\mathrm{y1}\right)/\mathrm{x1}\right\}·\mathrm{x2}+b·\mathrm{y2}\end{array}\\ b=\left\{\mathrm{X2}-\mathrm{X1}·\mathrm{x2}/\mathrm{x1}\right\}/\left\{-\mathrm{y1}·\mathrm{x2}/\mathrm{x1}+\mathrm{y2}\right\}\end{array}\\ \mathrm{Y2}=\left\{\left(\mathrm{Y1}-d·\mathrm{y1}\right)/\mathrm{x1}\right\}·\mathrm{x2}+d·\mathrm{y2}\\ d=\left\{\mathrm{Y2}-\mathrm{Y1}·\mathrm{x2}/\mathrm{x1}\right\}/\left\{-\mathrm{y1}·\mathrm{x2}/\mathrm{x1}+\mathrm{y2}\right\}\end{array})& \left(3\right)\end{array}$

[0057] (7) RMDS coordinates (x3, y3) can be transformed into SFDS coordinates (X3, Y3) by substituting the coordinates (x3, y3) into the following formulas (4).

[0058] In this case, the coordinates (x3, y3) are corrected to a value based on the temporary origin of the RMDS coordinates, and the coordinates (X3, Y3) obtained by the calculation are corrected to a value based on the temporary origin of the SFDS coordinates (by adding the temporary origin (X0, Y0) thereto). $\begin{array}{cc}\begin{array}{c}\mathrm{X3}=a·\mathrm{x3}+b·\mathrm{y3}\\ \mathrm{Y3}=c·\mathrm{x3}+d·\mathrm{y3}\end{array})& \left(4\right)\end{array}$

[0059] Next, a description will be given of an embodiment in which the transformation formulas are obtained by using specific values of the coordinates of the RMDS and the SFDS.

[0060] (1) First, with respect to three selected spots on the filter, measured values shown in TABLE 1 are obtained according to the above-described processes (1) through (3). Among those three spots, a temporary origin corresponds to points (226, 94) and (34.96, 12.63), and the other two spots are taken as points for determining the transformation formulas.

[0061] (2) Next, the measured values of the respective coordinates are expressed as relative values to the respective temporary origins as shown in TABLE 2 according to the above-described process (4). The units of the RMDS and SFDS coordinate systems are a pixel and millimeters, respectively.

[0062] (3) The coefficients a, b, c, and d are obtained according to the above-described process (6) by using the coordinate values of ((x1, y1) and (X1, Y1)) and ((x2, y2) and (X2, Y2)) shown in TABLE 2. The results are as shown in TABLE 2.

[0063] (4) According to the above-described results, the transformation formulas by which the RMDS coordinates (x3, y3) are transformed into the SFDS coordinates (X3, Y3) become as follows.

[0064] X3=0.099018 x3+0.000179 y3

[0065] Y3=−0.00207 x3+0.101048 y3

[0066] Next, a description will be given of an experiment conducted to examine the accuracy of the coordinate transformation by the above-described formulas.

[0067] (1) Filtration was performed with ten yeasts or so added to the filter.

[0068] (2) The filter was examined and observed by the RMDS so that image data shown in FIG. 7(A) was obtained.

[0069] (3) The coordinates of luminous points generated in the RMDS were measured (FIG. 7(B), (a)).

[0070] (4) Relative coordinates (b) were obtained from the measured values (a) based on the coordinates of a temporary origin.

[0071] (5) The corrected estimated coordinates of the SFDS (c) were obtained by the coordinate transformation formulas.

[0072] (6) The estimated coordinates of the SFDS (e) were obtained by adding the coordinate value of a temporary origin to the corrected estimated coordinates.

[0073] (7) The filter was stained with acridine orange so that the surroundings of the measured points were observed by a fluorescence microscope having a magnification of 200. As a result, yeast-like matters were observed at the coordinates (e).

[0074] (8) The accuracy of the coordinate transformation formulas was evaluated by calculating differences (f) between the estimated values (d) and the measured values (e).

[0075] As shown in the evaluation results, the maximum errors were 1.6 mm and 0.53 mm with respect to the x-axial and y-axial directions, respectively. In other words, the luminous points generated in the RMDS can be observed by observing the visual field of the range of ±1.6×10.5 mm of the entire surface of the filter (whose diameter is 47 mm).

[0076] The embodiment of the present invention has been described above with reference to the case in which the sample filter is moved for observation between the two different observation apparatus, that is, from the rapid microorganism detection system to the microscope with the automatic sweep unit. However, observation apparatus are not necessarily limited to the above-described two types, and it will be apparent that the present invention can be applied to any observation apparatus between which a sample is moved if the apparatus have their respective coordinate systems different from each other.

[0077] As described above, according to the present invention, in the case of observing a sample by two observation apparatus having their respective different coordinate systems for position designation, a position in the sample, which position is confirmed by one of the observation apparatus, can be accessed easily by the other for the observation thereof. This allows rapid observations by the two observation apparatus.