US 4,000,417 AGrant
Scanning Microscope System With Automatic Cell Find and Autofocus
Issue Date:1976-12-28
•32 Claims
•45 Drawing Sheets
Abstract
A scanning automated microscope system is designed as a clinical laboratory instrument which will aid and speed the task of the medical technologist in performing leukocyte differential count and red blood cell morphology studies. The microscope system has automatic stage drive which operates along the x, y, and z axes and an automated cell find system such that the leukocytes on normally prepared Wright stained slides are located automatically along a conventional meander search pattern, the found leukocytes are centered in the field of view, and are focused automatically. These cells can be observed on a color TV monitor and/or through the microscope oculars.
Metadata
Assignee
- Honeywell Inc.
Inventors
- William M. Adkisson
- Gerald D. Hunter
- William M. Papic
- Wayne L. Walters
Application Information
Application Number:US 6077412
Filing Date:1975-08-25
Priority Date:1975-08-25
Art Unit:256
Classifications
IPC:
G01J 120G05B 100
Field of Search:
35625023531839;125;40201;202;222 PC;461 B92 PC565;577
Patent Drawings (45 sheets)
Description
Background of the Invention
This invention relates to the field of microscopic examination of objects, one important example of which is leukocyte differential counts, i.e., the identifying and counting of the different types of white blood cells as well as red blood cell morphology studies. Since the task of finding or locating the desired blood cells on the slide is time consuming and tedious, there has been considerable effort expended previously in the area of automatically searching for and finding blood cells. One such reference is the Smithline U.S. Pat. No. 3,315,229, and there are other patents disclosing various details of automated blood study, for example, the Preston, Jr. et al U.S. Pat. No. 3,503,684, and Amos U.S. Pat. No. 3,806,257, and the Adkins U.S. Pat. No. 3,864,564.
Summary of the Invention
Generally stated, the instrument is an automated computerized scanning system that enables the operator to perform leukocyte differential counts, red blood cell morphology studies, and platelet sufficiency estimates with greater speed and less fatigue than in previous methods. Although primarily designed for differential counts, the system also can be used for other blood examinations; for example, reticulocyte counts and bonemarrow studies. It may also be used to perform microscopic examinations in histology, cytology, microbiology, and clinical cytogenetics.
It automates routine functions, allowing the operator to concentrate on cell identification. The instrument finds white cells automatically and displays them on a color TV monitor for easy viewing and identification. Identification is made easy because the cells are presented several thousand times their actual size on a color TV monitor. The white cells appear as fast as the operator can identify them. As a teaching aid, the color TV provides medical students and technologists with a magnified view of the cells. It allows the instructor to point out specific cell characteristics to the entire class.
Data for each slide is stored in the memory system until the count is complete and printed out on the report form. Automatic recall, built into the instrument relocates specific cells on command. If suspect cells need further examination, the operator simply notes the displayed x-y co-ordinates. The slide then may be removed. When the supervisor or pathologist is ready to review the slide, it is re-inserted and the co-ordinate position recalled by pressing the appropriate keys. The cell in question is automatically found for review. Work in the hematology lab flows along smoothly and the pathologist or supervisor doesn't have to be interrupted frequently for critical studies of abnormal cells. Because of this unique recall ability, slides may be transferred from one instrument to another.
In system operation generally, we place a conventionally prepared slide on the stage, position the slide over the good area and enter the specimen identification number using the data entry keys. The instrument is now ready for automatic function. Cells are automatically located and focused for the operator to identify. After the operator makes the identification, the next cell is presented in three-tenths of a second. The leukocyte count is stored in the instrument computer for later printing. At any time, complete RBC morphology comments and platelet sufficiency estimates may be entered into the instrument computer. After completing the differential, the results are printed on the report form.
In this invention a light source and microscope optics direct a light beam through a laboratory slide to a color TV camera. A first beam splitter directs a portion of the beam to the observer's oculars and a second beam splitter directs a further portion of the beam to automatic cell-find and automatic focus apparatus. An oscillating optical scanner in the path of the last mentioned beam portion provides a continuing sweep or scan across the field of view and presents the scanned light intensity representing the optical image to light responsive means such as photodiodes in the automatic cell-find and focus apparatus so that the light contrast of the scene is received. In the cell-find mode, the microscope "stage" carrying the slide is automatically driven along a traditional meander path or search pattern by the x and y stage drive motors. The cell-find apparatus makes use of the oscillating optical scanner during the stage automatic meander motion. The light responsive means and electronic circuit operate in conjunction with a digital computer to identify and store the x-y address of leukocytes. Upon acquisition of a leukocyte in the meander path, the stage is caused to center the optic axis over the leukocyte address. When the stage stops over a leukocyte, the automatic focus apparatus activates to make use of the ocsillating optical scanner sweep, light responsive means, circuit and z-axis stage drive to automatically focus on high contrast objects (such as red cell edges) which lie in the observed region of the sweep and in the plane of the leukocyte. After the observer recognizes and identifies the type of leukocyte, the stage drive is directed to resume the prescribed meander search pattern to find the next leukocyte.
Brief Description of the Drawings
FIG. 1 is a functional block diagram of the scanning automated microscope system;
FIG. 2 is a twice exploded view of the microscope slide, search meander path, optical field of view and TV display;
FIGS. 2a and 2b are representative electrical wave forms related to FIG. 2;
FIG. 3, including FIGS. 3a, 3b, 3c, and 3d, is a more detailed block diagram of the auto-focus and cell-find apparatus;
FIG. 4, including FIGS. 4a and 4b, is a graphical presentation of wave forms as related to the cell-find apparatus of FIG. 3, (i.e., a timing diagram);
FIG. 5 is a graphical reproduction of an oscilloscope view of the auto-focus operation;
FIG. 6, including FIGS. 6a, 6b, and 6c, is a graphical presentation of wave forms as related to the auto-focus apparatus of FIG. 3, (i.e., a timing diagram);
FIGS. 7a and 7b is a block diagram of pertinent portions of the microprocessor shown in FIGS. 1 and 3;
FIG. 8, including FIGS. 8a, 8b, 8c, and 8d, is a general flow diagram of the systems operation;
FIG. 9, including FIGS. 9a, 9b, 9c, 9d, 9e, and 9f, is a flow of x and y coordinate entry routines;
FIG. 10, including FIGS. 10a, 10b, 10c, 10d, 10e, and 10f, is a flow diagram of keyboard 1: differential count routine;
FIG. 11, including FIGS. 11a, 11b, 11c, 11d, 11e, 11f, 11g, 11h, is a flow diagram of automatic cell-find routine (Part 1);
FIG. 12, including FIGS. 12a, 12b, 12c, and 12d is a flow diagram of automatic cell-find routine (Part 2);
FIG. 13, is a pictorial view of the instrument; and
FIG. 14 is a pictorial view of the keyboard.
Description of the Preferred Embodiments
Referring to FIG. 1, there is a disclosed a system for automatically scanning, stopping and focusing on desired blood cells on a blood slide. The light from a light source 10 passes through microscope condenser lenses 11 and through a slide 12 which is positioned on a microscope stage 13. Standard objective lenses 14 collect the light which then passes through a beam splitter 15, through imaging lens assembly 16, mirror 17, and through a second beam splitter 18 to a color vidicon TV camera 19 which together with a monitor provides a real time presentation to the observer. The TV camera may be a Toshiba Model 1K-12, and the TV monitor may be a Sony Model KV-5000. The first beam splitter 15 reflects a portion of the light to operator oculars 20. The beam splitter 18 reflects a further portion of the light beam to an optical scanner 21, which may be an oscillating galvanometer mirror, and then through a pinhole aperture or apertures 22 and 23 to light responsive means 24 and 25, here shown as photodiodes. The oscillating optical scanner provides a continuously recurring scan across the optical field of view to the cell-find diode 24 and the focusing diode 25. Although the photodiodes 24 and 25 have been shown relatively far apart in FIG. 1 for clarity, it will be understood that they may be placed in close proximity. If desired, a single photodiode may be the light responsive means for both cell-find and auto-focus operations.
A keyboard 30 (shown pictorially in FIGS. 13 and 14) allows the medical technologist or observer to control all scanning automated microscope system operations and to make extra data entries. Some of these operations include entry of initial test related information, automatic leukocyte finding and focus, manual stage control and manual control focus, display 30A and data printout at printer 30B. The printer may be of the general type of Model No. C-8304 by ITT-General Controls. The color vidicon TV camera 19 is a part of a color TV subsystem which also includes a camera control unit and a color TV monitor 31, the color TV in conjunction with the microscope providing real time, and true color representation of the cells being observed.
The electrical output of photodiode 24 is passed on to a cell-find processor 32, the output of which is connected to the x-y stage drive 34. The electrical signal from auto-focus diode 25 is utilized by auto-focus processor 33 to actuate the z-axis of the stage drive 34 and to bring into proper focus a cell which has been found, centered and stopped over. The auto-focus system is inhibited during the cell-find operation.
Referring now to FIG. 2, there is disclosed a twice exploded or enlarged view of a blood smeared glass slide. The lower right hand portion of the figure depicts the standard 1 inch by 3 inches glass slide 40 which has superimposed thereon a line representing a typical meander pattern 41 followed by the microscope stage as the cell-find mode progresses while looking for leukocytes. Of course, the meander pattern can continue to the right as far as desired or other meander patterns can be chosen. The circular area 42 on the slide represents a typical field of view of the optical system as a particular period of time and can be seen by the observer looking through the oculars 20.
At the left of FIG. 2, the circular field of view 42 is magnified or enlarged to show a number of red cells 42a (small circles) and a leukocyte 42b (larger circle) which are in view at this point of the meander. In the center of the field of view is a rectangular area 43 which represents the more limited field of view of the TV camera. A horizontal line 44 across the center of the field of view represents the portion of the scene which is being optically scanned (i.e., an optical sweep) by the oscillating optical scanner 21 and presented to the cell-find photodiode 24. A similar line 45 may represent the portion of the field of view scanned for the auto-focus. Although line 45 is shown as dimensionally separated from line 44 and as scanning a different portion of the field of view for illustrative purposes, the photodiodes can equally as well be positioned so that the two lines 44 and 45 observed by the two photodiodes overlie one another. The field of view 43 is further magnified or enlarged in the upper right of FIG. 2 to reproduce a photograph taken of the TV presentation in which a leukocyte is centered and is surrounded by a number of red blood cells.
The observer has the option of viewing the blood cells by means of the color TV monitor 31 and/or the osculars 20. The optical scans 44 and 45 when projected to the light responsive means 24 and 25 and the associated control circuits are converted to electrical signals representing the optical characteristics of the cells encountered. FIGS. 2a and 2b at the center right are examples of such converted signals for cell-find and for auto-focus, respectively. It will be observed from FIG. 2a that the dark nucleus portion of the leukocyte results in a larger signal amplitude change which can be recognized by the cell-find circuit.
Referring now to FIG. 3, which is an assembly of FIGS. 3a, 3b, 3c, and 3d, the automatic focus processor 33 and cell-find processor 32 is shown along a more detailed block diagram form. As previously described more generally, a light source 10 provides a beam through the microscope and a portion of the beam reaches the oscillating optical scanner mirror 21'; and is transmitted through the apertures 22 and 23 to the photodiodes 24 and 25 so that the photodiodes receive a continuing series of optical sweeps as represented by lines 44 and 45 of FIG. 2.
During the cell-find operation for leukocytes, the y axis motor drives continuously until a leukocyte is found, to advance the slide in the y direction along the prescribed meander path about 4.mu. (microns) per sweep. When a leukocyte is located, the y motor stops, the x motor drives the stage left or right to center over it optically and stops, whereupon automatic focus then occurs, the z-axis motor then operative to drive the stage in the z-axis or vertical direction. Cell-find only occurs during y motor and during the time increment when the x motor is transferring the stage to a new meander line there is no cell-find occurring. When a cell has been located and the x motor drives from the meander line to center the cell in the optics, the microcomputer retains the meander line position information and returns the stage to it before search starts again. During the auto-focus, a sawtooth scan (FIG. 6, curve f) of the optical scanner directs to the auto-focus diode an optical sweep which includes a number of red cells providing rate of changes in light intensity (FIG. 2b) across the sweep. The more accurately the microscope is focused, the sharper the rate of change signal becomes. Said another way, the automatic focus system depends on traversing cell edges which fall in the observed scan line to obtain rate of change signals.
The x, y, z axis stage drive comprises three servo motors of a known type such as Honeywell Inc., Microswitch Division, motor-tachometer. Identification No. 91929 (catalog listing 2VM61-033-4). Encoders are mounted on the servo motors to provide precise x-y coordinates of the location of particular leukocytes into the microprocessor storage and to provide capability for automatic return of the stage of these coordinates to represent selected leukocytes for further visual observation. The x-y coordinates of the current stage position are visually presented on the operator's display panel. Encoders being used on this apparatus are Model 992-200-O-C-L-P by Disc Instruments Inc. of Costa Mesa, California, installed on the Honeywell servometers.
The Display Panel 30a provides indication of numerous items including the (1) Cell Count which indicates the total number of cells counted; (2) NRBC/100WBC indicating the number of normal red blood cells counted or the NRBC's per 100 white blood cells when the Convert to % key is pressed or the cell count limited is reached; (3) Differential Tally which indicates the number of leukocytes counted for each of the twelve leukocyte types, or percent when the Convert to % key is pressed or when cell count limit is reached; and, (4) coordinates which indicate the current stage position through x-y coordinates.
The automatic cell-find and auto-focus circuits operate either in an auto-focus mode or in a cell-find mode but not both simultaneously. Mode switching is provided by the microprocessor 70 to allow multiplexing of some of the electronic circuit such as the analog/digital converter 55, the analog/digital output register 58 and the microprocessor interface circuits as well as the optical scanner 21 and its drive electronics 85. The auto-focus mode and the automatic cell-find mode are selected at the keyboard, and this selection puts mode switching under control of the microprocessor.
To control the operation of the auto-focus and automatic cell-find circuits from the microprocessor 70, an enable line 71, shown in FIG. 3c, provides a pulse to engage digital inverter latch 72. When the digital inverter latch is so activated, a logic 0 at the input 73 of the latch provides a logic 1 out and causes the auto-focus circuits to be active, while a logic 1 at terminal 73 causes the automatic cell-find circuits to be active.
Auto-Focus
Automatic focus routine after every cell-find even though the last good focus position, i.e., the focus setting from the previous auto-focus, may be adequate. The slide-stage is driven down (-z direction) two microns. The slide stage is then driven up (+z direction) four microns while the focus A/D value is read at every half micron interval, i.e. scan coincides with a half micron advance in the z direction. The maximum A/D value and its location are noted in the microprocessor 70. The maximum A/D value is compared against an upper and lower threshold and if the A/D value is within limits, the slide stage is driven down to the selected new good focus location. If the A/D value fails the threshold test, the slide stage is driven down to the last good or optimum focus position. This automatic focus routine occupies about 100 milliseconds.
Referring first to the auto-focus processor, the flow of the electrical signal is as follows: The light falling on photodiode 25 is converted to an electrical signal which is connected to amplifier means 50, the output of which is differentiated at differentiator 51, full-wave rectified at 52, and the resulting pulses are integrated at reset integrator 53. The aperture 23, light responsive means 25, preamp 50, differentiator 51, integrator 53, and A/D converter 55 work together to provide an optical to electrical transducer, or more specifically, a light intensity rate of change to voltage transducer. In the normal auto-focus mirror scan, many red cells are crossed (only two of which are shown in FIG. 2, scan line 45), each cell edge providing a rapid rate-of-change in light intensity reaching light responsive means 25.
The plasma surrounding the red cells is much more transparent then the red cells so that as the scan crosses cell edges, a rapid rate of change of light intensity is seen by the light responsive means 25. The more closely optimum focus is achieved, the sharper is the cell edge produced rate-of-change signal. The aperture 23 used for auto-focus is very small, i.e. .apprxeq. 0.5 micron diameter compared to red cell diameter of .apprxeq. 4 microns, so that the cell edge sharpness is accentuated. The sharper the rate-of-change of light intensity at sensor 25, the larger will be the output pulses of differentiator 51 to be integrated. The integrated signal is further amplified as needed at gain adjustable integrator amplifier 54 (FIG. 3b), coupled through analog switch 75B and converted to a digital value in the A/D converter 55 when switch 75B is in position to transmit auto-focus data. The control of switch 75 is further discussed below. Analog switch 75 comprises block 75a with its two inputs I.sub.1 and I.sub.2 and block 75b with its two inputs I.sub.3 and I.sub.4. The analog switch 75 may be operated to one position in which the inputs I.sub.2 and I.sub.4, respectively, are connected through to their respective outputs, or to the opposite switched condition in which inputs I.sub.1 and I.sub.3 are connected to their respective switch outputs.
Thus, as will be described further, the analog switch 75a accepts a 160 Hz sawtooth drive during auto-focus and accepts a 1000 Hz sine wave drive during cell-find to provide two different drives to the optical scanner 21. At the same time, the analog switch 75B provides auto-focus scanning information to the converter 55 during auto-focus, and provides scanner mirror position information to the converter during cell-find.
Referring now to the A/D converter 55 in FIG. 3B, the converter has terminals IN, clock and strobe. The A/D converter input is connected to receive the auto-focus integrator output by the analog switch 75B when in the auto-focus mode, and to receive the optical scanner mirror position voltage when in the cell-find mode. An A/D start conversion in initiated at the end of each auto-focus optical scan in the auto-focus mode. It also occurs when a white cell is detected during cell-find.
The optical scanner drive electronics includes both a 1 KHz sine wave generator and a sawtooth generator 83 (FIG. 3c) which sawtooth generator drives the oscillating optical scanner mirror 21' for auto-focus at a repetition rate of about 160 Hz. Specifically, in FIG. 3c, a 19.3 KHz square wave oscillator or clock 80 (FIG. 6, curve a) is connected through a frequency divider 81 to provide a 160 Hz output on conductor 82. This frequency division (FIG. 6, curves b and c) may be done by conventional tandem connected divide-by-11 counters. The 160 Hz output or blanking signal on line 82 is preferably in the form of a positive going pulse (FIG. 6, curve c), having a width of 570 microseconds. The pulse is applied to the input of the sawtooth generator 83. The sawtooth is sent to the input I.sub.1 of analog switch 75a by way of an auto-focus optical scan adjust amplifier 84, and when the analog switch is in the auto-focus mode, the sawtooth provides the input to optical scanner drive circuit 85, the output signal of which drives optical scanner 21. The optical scan in one embodiment is about four microns wide and about 150 microns long. An electrical signal representative of the position of scanner 21 is taken from the scanner and fed to a scanner position amplifier 141. The sawtooth wave form, as taken from the input to scanner position amp 141, is shown diagrammatically in FIG. 6, curve f. In one specific embodiment, the scanner 21 is a galvanometer, the sawtooth current from drive circuit 85 flow through the galvanometer coil to oscillate the mirror fastened to the movement. A small resistor in series with the galvanometer coil, and which also receives the drive current, provides a signal on lead 140 to mirror position amp 141.
During the fly-back portion of the sawtooth wave form, the auto-focus blanking pulse on line 82 is also inverted 91 and sent to an integrator reset delay one-shot (0/S) 88 which has a 162 microsecond time out. The trailing edge of the pulse output from the delay 88 (FIG. 6, curve d) triggers an integrator reset one-shot 89 (FIG. 6, curve e) which closes the integrator reset analog switch 57 and discharges or resets the integrator 53. Each sweep of the optical scanner provides to the photodiode 25 the optical contrast across the scene. A simulated signal is shown in FIG. 6, curve g. These optical contrasts are amplified, differentiated, rectified and then the electrical pulses are combined in an integrator 53 to provide an analog output of the general type as shown in FIG. 6, curve j.
An additional connection of the output of frequency divider 81 is by conductors 82 and 90 (FIG. 3d) to the upper input of "nand" gate 77. Whenever the inverter latch 72 is enabled and is providing a logic 1 on conductor 74 (the auto-focus mode) to "nand" gate 77, this voltage together with the positive going pulse on line 90 to the "nand" gate 77 provides a logic zero out on line 91 to one input of an "or" gate 92 and to one input of an "or" gate 93. The output of "or" gate 92 is connected to a D-flop 94. The D-flop 94 also has a clock input from a 1.24 MHz oscillator 95. The D-flop also includes a Q output which is connected to trigger a one microsecond start conversion O/S 96 which provides a strobe pulse to the 8-bit A to D converter 55. When the clock 95 goes to logic 1, the logic 1 at the D-flop input results in a logic 1 at the Q output to fire the one-shot 96 and strobe the A to D converter.
The output of "or" gate 93 provides an auto-focus blanking signal which is connected to the microprocessor 70 on a conductor 100 and is also connected on conductor 101 to counters A and B clear one-shot 102. The Q output (FIG. 6, curve g) of the one-shot 102 is connected by a conductor 103 to the clear input of two bit counter A (read) 104 and a two bit counter B (write) 105. The auto-focus blanking pulse fires the counter clear one-shot 102 which clears the read counter 104 and the write counter 105 at the beginning of each auto-focus optical scan. Each of the counters, 104 and 105, has a pair of outputs W.sub.B, W.sub.A, R.sub.B, and R.sub.A which are connected to the four inputs B.sub.1, B.sub.0, A.sub.1 and A.sub.0 of a digital comparator 100, the output of which is connected to a tri-state buffer 107 which provides a cell-find or auto-focus ready signal to the microprocessor 70 on a line 110. The two bit counter B (write) 105 receives an input from an end of conversion one-shot 111 which in turn is triggered by an end of conversion signal carried on a line 112 from the eight bit A/D converter 55. The signal output from the one-shot 111 is also carried on a line 113 to provide an enable input to the 4 .times. 8 bit register 58. The outputs W.sub.B, W.sub.A, R.sub.B, and R.sub.A of the counters 104 and 105 are also connected to indicate the count to the 4 .times. 8 bit register 58.
In operation, the stage advances continuously in the z direction during successive sweeps of the optical scanner and as focus is approached, the light intensity rate of change become better defined, the differentiated pulses (FIG. 6, curve h) become better defined, the differentiated pulses (FIG. 6, curve h) become sharper and higher and the analog ouput of the integrator 53 increases, as shown graphically in FIG. 5. The advance in the z -axis is 0.5.mu./ sweep or scan. When the optimum focus is reached, the signals no longer increase and begin to decrease as the focus point is passed. A conventional comparator (not shown) in the microprocessor 70 compares the signal level of each sweep with that of the previous sweep and saves the maximum signal of the plurality of scans. The z address of the maximum level has been recorded in the microprocessor and the z -axis position is returned to this address and adjustment stops. The blood cell is then in the optimum focus for viewing either from the TV monitor screen or from the microscope oculars.
The auto-focus timing diagram (FIGS. 6a, b, and c) which illustrates the progression of events during auto-focus, shows in curve a the output of the 19.3 KHz oscillator which is divided by 11 in curve b and again in curve c to therein provide a 160 Hz output, the elevated 570.mu. s portion of which in curve c is called the auto-focus blanking pulse 160. The leading edge of the blanking pulse 160 triggers several events including the integrator reset delay 88 which produces 162.mu. s pulse shown in curve d, it starts the retrace of the sawtooth generator shown as portion 161 of curve f, and it also starts the A/D conversion, curve k. 162.mu. s later in time is the falling edge of the integrator reset delay pulse which triggers integrator reset one-shot 89 to provide a 638 integrator reset pulse 162 shown in curve 3. Curve j shows the integrator 53 output falling to zero and being held at zero until the end of the reset pulse 162. Meanwhile, before the integrator 53 is discharged, the A/D conversion of the voltage level at 163 of curve j is complete, the end-of-conversion EOC pulse being shown in curve 1. The information in the converter 55 is transferred to register 58 when enabled by the pulse, curve n, on line 113. The trailing edge of the EOC pulse triggers or docks the counter B, curve n, which updates the counter B, and provides to the microprocessor 70 on A.F. ready pulse 164, curve o. When the microprocessor can accept the data from the register 58 for storage, an input channel strobe pulse, curve p, read enables the register 58 and buffer 59 to transfer the data into microprocessor storage, the pulse also clocking counter A so that the digital comparator 106 is satisfied.
Next in order of time, the trailing edge of the blanking pulse 160 allows the sawtooth generator 83 to begin a sweep, curve f, thus commencing a new auto-focus sweep. Also, at this time, the A.F. ready pulse, curve o, terminates and the 130ns counters A and B clear pulse occurs. Finally, the integrator reset pulse, curve e, terminates allowing the integrator 53 to operate. A simulated signal output from A.F. preamp 50 is shown in curve g, which, when differentiated by differentiator 51, provides pulses such as curve h, and when full wave rectified appears as curve i to be integrated. The stairstep output of the integrator is shown at curve j. In FIG. 5, the integrator output on succeeding sweeps is shown as adjacent vertical lines increasing in amplitude as optimum focus position is determined and attained.
Cell-Find
The cell-find operation which has been mentioned briefly above will now be considered further in connection with FIG. 3. Basically stated, during cell-find, the microscope state is caused to move in a predetermined meander pattern to locate leukocytes, and when found, to stop over the leukocyte so that it can be observed. The light source 10 provides a beam through the microscope and a portion of the beam reaches the oscillating optical scanner 21 and is transmitted through the aperture 22 to the photodiode 24 so that the photodiode receives a continuing series of optical sweeps as represented by line 44 of FIG. 2. The output of photodiode 24 is connected to cell-find pre-amplifier 60. An example of the electrical signal output wave form of the amplifier which results from sweep 44 is shown in FIG. 2a and in FIG. 4, curve h. The output of cell-find preamp 60 is connected by a line 143 (FIG. 3c) to the input of a negative peak-and-hold detector 144, the output of which is coupled to a cell-find threshold amplifier 145 and then to the negative input of a cell-find detect comparator 146. The line 143 is also directly connected to the positive input of cell-find detect comparator 146. The negative peak-and-hold circuit develops a D/C voltage which is a function of the plasma level when scanning a standard blood slide. The amplifier 145 is adjustable to provide an adjustable cell-find threshold voltage that is some percentage of the plasma level. This threshold level is then compared with the cell-find preamp output at comparator 146 and any signal coming from the cell-find preamp which is less negative then the threshold level (i.e., the signal from a nucleus of white cell) will cause a logic 1 to occur at the output of the comparator.
The level detector 61 which comprises negative peak-and-hold detector 144, threshold adjustable amp 145, and comparator 146 responds to the larger signal level produced by the dark nucleus of the leukocytes (FIG. 4, curve h) to provide a signal output (see FIG. 4, curve i) from comparator 146.
The output signal of the comparator 146 is effective to strobe A/D convertor 55, which convertor also receives, by way of analog switch 75B, an analog input signal which is a function of the optical scanner driving current and thus of the position of the sweep line. Since the optical scanner driving current wave form is generally in the form of a linear ramp which increases (or decreases) with time causing the optical sweep to advance across the field of view, the analog input to the convertor 55, likewise increases, and when the convertor is strobed indicating the presence of a leukocyte in the sweep, the digital output is indicative of the leukocyte address or coordinate along the sweep line. This information is fed to the 4 .times. 8 bit register 58. This register 58 which is actually four registers has the capacity to handle information on up to three leukocytes in a single scan. This information is subsequently transferred to the microprocessor 70 which stores the location of leukocytes.
Specifically, the leading edge of the logic 1 signal from the comparator 146 triggers cell detect delay O/S 130, the cell detect delay 130 providing a 13.5 microsecond delay (FIG. 4, curve j) which allows the cell detect to occur more near the center of the white cell nucleus, rather than at the cell edge. When the output of one-shot 130 goes to logic 0 it triggers the cell detect lockout one-shot 131, providing a time out of 57 microseconds (FIG. 4, curve k). The Q output of 131 is fed back to the input of delay 130, preventing detection of the second of two adjacent cells that are less than 20 microns apart. When the Q output of lockout 131 goes to a logic 0, it initiates the cell-find A/D conversion (FIG. 4, curve l) by way of "or" gate 92, D-flop and start conversion one-shot 96. Therfore, when either input of "or" gate 92 goes to a logic 0, the output goes to logic 1 and this level connects to the D-flop 94. When the 1.24 MHz clock goes high, the 1 at the D-input results in the D-flop Q output going to a high causing the A/D start conversion one-shot 96 to fire and strobe the A/D converter 55. Because of the clock 95, there can be a maximum 18.mu.s delay for conversion start.
At the end of conversion (EOC) at A/D converter 55, the signal on line 112 goes low and fires end of conversion one-shot 111, its Q output drops low, the signal on line 113 thereby enabling write register 58, and allows the converter 55 data to be transferred to the A/D converter output register 58. When the Q output of one-shot 111 returns to a logic 1 after 1.3 microseconds, it latches the data in register 0, and advances counter 105 to a count of 1. Read counter 104 is at a count of 0 and since 104 count is less than 105, the comparator 106 is satisfied. The CF/AF ready line 110 goes high, telling the microprocessor that data is available. The microprocessor then issues a strobe pulse on conductor 150 which enables read register 58 and tri-state latch or buffer 59 to transfer the data to the microprocessor data bus. When the strobe pulse on line 150 returns high, it advances read counter 104 to a count of 1. When read counter 104 equals write counter 105, the A<B requirement of comparator 106 is not satisfied, and the CF/AF ready signal at line 110 returns to 0 advising the microprocessor that no more data is available.
The oscillating optical scanner 21, 21' is driven at 1000 Hz during cell-find. In one successful embodiment of the present invention a sine wave generator 120 (FIG. 4, curve a) is used to drive the optical scanner during cell-find, a relatively linear portion of the wave being used to generate the sweep.
A sine wave oscillator 120 generates a 1 KHz cell-find optical scan wave form which is amplified to a desired level in a cell-find optical scan adjust amplifier 121, the output of which is connected by a line 122 to the I.sub.2 input of the analog switch 75a and thereby to the optical scanner drive circuit 85. The sine wave output is also connected by a line 123 to a zero detect comparator 124 which generates a 1 KHz squarewave (FIG. 4, curve b). The squarewave output of 124 is connected to a 220.mu.s cell-find blanking delay one-shot 125. The falling edge of the squarewave (FIG. 4, curve b) triggers the one-shot 125, the output of which (FIG. 4, curve d) is connected to a 600.mu.s cell-find blanking period one-shot 126. The Q output of one-shot 126 (FIG. 4, curve e) is connected by a line 127 to the other input of "or" gate 93 so that the cell-find blanking and the auto-focus blanking are both fed to the "or" gate 93. The blanking signals at the output of "or" gate 93 in addition to being fed to the microprocessor 70 on line 100, are also applied to the input of counters A and B clear one-shot 102. The Q output goes low for 130 ns and clears read counter A and write counter B at the beginning of each cell-find optical scan or auto-focus optical scan. The Q output of cell-find blanking one-shot 126 on line 127 is connected to the clear input of cell-find detect delay one-shot 130 and this operation insures that no cell is detected during the cell-find retrace.
Referring now briefly to the optical scanner 21, 21' the position of the scanner, is indicated by a current magnitude on a line 140 which inputs to an optical scanner position amplifier 141, the output of which is connected to input I.sub.4 of the analog switch 75B. The amplifier 141 provides a phase shift correction between the optical scanner current and the optical scanner mirror position, and provides an adjustable gain allowing the optical scanner position voltage to be adjusted within the dynamic range of the A/D converter 55.
An important feature of the system is that it is possible to record the addresses of a plurality of leukocytes which are encountered on a single scan. If the leukocytes are contiguous or nearly so (that is, less then about 20 microns between leukocytes) the system picks a single address which places all the contiguous leukocytes on the TV screen. When the multiple leukocytes are not contiguous, the individual addresses are stored in the micro computer and are presented sequentially.
Let us assume a cell-find search mode in which three non-contiguous cells are found on a single sweep so that each is detected and the coordinates are all stored in register 58. A count of three has been entered in the counter B105, the digital comparator has provided an output indicating information to be entered in the microprocessor, the cell-find ready signal on line 110 has been issued to the microprocessor 70, the y motor stops, the microprocessor takes the x sweep location data on the first of the three cells from register 48, (counter A104 directing access to the cell No. 1 data), and the process to enter each of the cells on the TV monitor begins. The number of encoder pulses (i.e., the distance), the first cell lies off the meander path is calculated by the microprocessor. If the cell is not already at center position on the TV monitor, the position of the cell relative to the meander path is used to determine the x command; the x motor drives to center the cell on the TV monitor and the slide motion is stopped; the current x and y co-ordinates are displayed; the auto-focus routine is accomplished and the cell is ready for observation and identification. As the identity of the first cell is entered by the observer on the keyboard, normal meander search for the next cell would commence but for the fact that the ready signal on line 110 to the microprocessor is still high indicating the register has information on another cell. The microprocessor issues another pulse on line 150, again enabling register 58, buffer 59, advancing counter A 104 a second time so that the microprocessor can take the data on the second of the three cells. The centering on the second cell proceeds as before. Counter B105 stands with a count of three and counter A104 has now advanced to a count of two. Since the count on A is less than the count on B, the cell-find ready signal remains high indicating yet another cell recorded in register 58. The above procedure repeats to record the location of cell three, center on it and refocus so that the third cell of the scan being described may be identified. Both counters 104 and 105 are now equal in count, the digital comparator recognizes no more unconsidered cells in the register 58 and the ready signal drops. Conventional cell-find now resumes.
The meander search advance for each sweep is about 4 microns. This compares with a typical leukocyte diameter of about 6 microns to about 10 microns, so that a leukocyte is normally recognized before it has passed the center of the field of view of the optics. The z-axis motor which is driving during cell-find is able to stop nearly instantaneously when a leukocyte is found. Since the advancing edge of the leukocyte is normally intercepted and recognized, and since the leukocytes have a relatively uniform size, a fixed y-axis correction from the computer together with an x-axis correction obtained from the leukocyte address in the sweep, adjusts the microscope stage position to bring the leukocyte into the approximate center of the optical axis and the TV monitor. The microprocessor does the calculation to determine how far the white cell is off center in the x direction. If the cell is already roughly at monitor center, no x correction occurs. Otherwise, the position of the cell relative to the meander path is used to determine the x command, the microprocessor then starts the x motor, counts encoder pulses until it gets the required number of encoder pulses and then it stops the x motor. The cell is centered on the TV monitor and the slide is stopped. The current x and y co-ordinates are read and displayed. The microprocessor uses those same numbers to get the system back on the original meander line. Speaking of x position, 1 micron of x position is equal to one A/D level. This provides an x resolution of one micron. The resolution of the encoder presently used is equal to four microns per encoder pulse, providing an effective x resolution of four microns.
A typical progression through the cell-find timing diagram will now be described. The cell-find timing diagram, FIGS. 4a and b are based on a 1 KHz sine wave, curve a, from osc. 120. This sine wave drives optical scanner 21 by way of amp 121, switch 75a, and drive circuit 85. Comparator 124 detects the zero voltage crossover of the sine wave to provide as output a 1 KHz squarewave shown in curve b. The falling edge 170 of the squarewave triggers 220.mu.s blanking delay one-shot 125 which provides an output pulse 171 as shown in curve d. The blanking delay can be adjusted by a potentiometer in the one-shot multivibrator to get the blanking in proper phase relation with the mirror 21'. At 1000 Hz a 90.degree. phase shift is 225.mu.s. The optical scan sweep is 500.mu.s and 400.mu.s of that is used for cell detect. The trailing edge of the delay pulse 171 triggers C.F. blanking period one-shot 126 which produces a squarewave, curve e, having .apprxeq. 600.mu.s disable time and .apprxeq. 400.mu.s cell-find enable time. The 400.mu.s cell-find enable time is centered about the optical center of the mirror 21' swing. At the leading edge 172 of the enable time, curve f, the 130 ns counters clear one-shot 102 is pulsed, curve g, to reset counts 104 and 105. The cell-find scan which was discussed in connection with FIGS. 2 and 2a presents a light intensity to the photocell which is greatest when only plasma is scanned, which is less when crossing red cells and which intensity is least when intercepting leukocytes. FIG. 4, curve h, shows a curve of voltage level out of C.F. preamp 60 corresponding to light intensity at photocell 24. During the cell detect time of the particular sweep represented by curve h, two leukocytes are indicated and detected. The first to exceed the threshold level provides an output pulse 174, curve i, from the cell detect comparator 146. The pulse width is variable depending on the size of the cell which has been intercepted. The resulting cell detect delay one-shot 130 pulse 175 is shown in curve j, the trailig edge of which triggers cell detect lockout one-shot 131 which produces pulse 176 shown in curve k. This pulse by way of "or" gate 92 and D-flop 94 is effective to trigger start conversion one-shot 96 which provides the 1.mu.sec pulse shown in curve 1. The analog electrical signal from mirror position amp 141 which is connected through switch 75B to the input of the converter 55 is converted to digital to indicate the x coordinate of the detected leukocyte. At the end-of-conversion, the EOC pulse 178, shown in curve m, triggers one-shot 111, which updates the counter 105 to a count of one and write enables the register 58 so that the information in converter 55 is transferred to register o in the register 58. The count in counter B is connected by lines W.sub.B and W.sub.A to the register 58 and provides the proper coding into the register to load the information from the converter into the correct one of the 4 registers in register 58. Also at this time, a C.F. ready pulse, curve o, is provided to the microprocessor 70. When the microprocessor can accept the data from the register 58 for storage, and input channel strobe pulse 180, curve p, read enables the register 58 and buffer 59 to transfer the data into microprocessor storage.
Consider again the curve h of FIG. 4, showing the output of preamp 60 during a single scan and it will be seen that a second leukocyte is indicated. Again, the comparator 146 provides a pulse 181, curve i, which results in a delay pulse 182, curve j, a cell detect lockout pulse 183, curve k, followed by the same sequence described above. The 2 bit counter B105 is now advanced to the count of two so that the new information in converter 55 is stored in register 1 in the register 58. Curve p, pulse 184, indicates that the software does not have to accept the information as fast as it is put into the hardware and that, therefore, it may be a number of microseconds later that the microprocessor is ready to accept this data. Two leukocytes have been shown in the sweep, curve h, however, three separated leukocytes in a single sweep can be recorded by register 58 and transferred to the microprocessor. When there are two leukocytes close together in a sweep, the cell-find lockout 131 prevents the recording of the second cell coordinates, however, the operator sees both cells on the monitor when looking at the first cell that was detected. Immediatly after the cell number two data is strobed to the computer, the computer updates the counter A so that it is the same as counter B and then the digital comparator is satisfied which causes a cell-find ready signal to go low indicating only two cells were detected on that sweep.
Keyboard
The keyboard 30 as detailed in FIG. 14 includes a numeric keyboard which is used to enter various numeric codes, platelet sufficiency code, abnormal RBC morphology severity codes and X-Y stage position coordindates. To the left of the numeric portion of the keyboard, the next set of keys includes Specimen ID Clear used to clear old data before data entry on a new slide; X to enable entry of a three-digit X-coordinate code through the numeric keyboard which causes stage to move to that coordinate; Y, same as X for the Y-coordinate; Tech No. to enable entry of an operator identification code through numeric keyboard; Date, to enable entry of date code through numeric keyboard; Comment, to enable entry of a three-digit comment code through numeric keyboard; and, Calibrate to enable calibration of X-Y coordinates.
The next set of keys includes Automatic Cell-Find key which places the instrument in automatic mode and immediately below a Manual key which places the instrument in a manual mode for cell-find; Automatic Focus key which selects automatic focus when in manual mode; Computer Entry key to enter stored data into a computer; and, Print key to print stored data on a ticket.
The next set of keys includes a Differential Count key to enable entry of leukocyte differential count through cell counting keys; a Norm RBC Morphology key to enter normal red blood cell morphology comment; Abnorm RBC Morphology key to enable entry of abnormal RBC morphology comments through cell counting keys and severity comments through numeric keyboard; Platelet key to enable entry of platelet sufficiency comment through the numeric keyboard; and, Retic Count key to enable entry of reticulocyte count through cell counting keys.
The Cell-Counting keys are used to count leukocytes in differential count, red blood cells in abnormal RBC morphology studies, and reticulocytes in reticulocyte count. The Skip key allows for moving the stage off a cell without counting the cell. The Convert to % key enables conversion of display panel information from number of cells counted to percent of total cells counted; the Mult Entry key causes the stage to remain stationary over the last cell so that more than one cell can be counted.
Microprocessor
The microprocessor shown as a block in FIGS. 1 and 3 has been referred to a number of times heretofor. Pertinent portions of the microprocessor 70 are shown in a more detailed block diagram form in FIGS. 7A and 7B. The heart of the microprocessor shown in FIG. 7A is a conventional Central Processor Unit (CPU) 200 which is a Model Intel 8008-1, sold by Intel Corporation. The 8008-1 is a single chip MOS 8-bit parallel CPU. This 8008-1 is described in the Intel Corp. literature such as "Intel MSC-8 User's Manual," Nov., 1974). The four basic function blocks of the 8008-1 processor are an instruction register, memory, arithmetic-logic unit and I/O buffers. It includes six 8-bit data registers, an 8-bit accumulator, two 8-bit temporary registers, four flag bits, and an 8-bit parallel binary arithmetic unit which implements addition, substraction, and logical operations. A memory stack containing a 14-bit program counter and seven 14-bit words is used internally to store program and subroutine addresses. The 14-bit address permits the direct addressing of 16K words of memory. More detailed explanation of and instructions for the 8008-1 may be found in the manual listed above. The program of the system is stored in a conventional memory array 201. The remainder of the blocks in FIGS. 7A and 7B may be considered as conventional peripherals to the 8008-1 CPU 200.
Program
The tables A, B, C, D, and E below detail the program used for cell recall routine, differential count routine, cell-find routine, return to meander line routine, and automatic focus routine. Complementing the program are flow diagrams shown in FIGS. 8 through 12. PL/M program language is used.
The flow diagram of FIG. 8 comprising FIGS. 8A to 8D is a general diagram showing the overall software operating system and showing functional names for the many routines. Of these routines, several are pertinent to the claimed invention and are shown in FIGS. 9 through 12. FIG. 9 is a flow diagram entitled "X and Y Coordinate Entry Routine" and complements the program routine of Table A which includes the X coordinate entry mode of operation routine (routine to accept 3 digit coordinate and drive to the specified location) and Y coordinate entry mode of operation routine (routine to accept 3 digit coordinate and drive to the specified location).
FIG. 10 comprising FIGS. 10A to 10F is a flow diagram entitled "Keyboard 1: Differential Count Routine" and complements the program routine of Table B which is the Differential Count Mode of Operation Routine.
FIG. 11 comprising FIGS. 11A to 11H is a flow diagram entitled "Automatic Cell-Find Routine (Part 1)" and complements the program routine of Table C which is the "Automatic Cell-Find Routine Capable of Centering on 3 separate cells encountered in any given scan swath."
FIG. 12 comprising FIGS. 12A to 12D is a flow diagram entitled "Automatic Cell-Find Routine (Part 2)" and complements the program routine. "Cell-Find Routine, Part 2, used when one or more restricted zones currently exist, Y motor is being driven at slow speed." 31
Claims
The embodiments of the invention in which an exclusive property or right is claimed are defined as follows:
1. An automatic cell-find and automatic focus system for use in a scanning microscope which includes both an objective lens and an adjustable stage means, said system operating at alternate times in a cell-find mode and in an automatic focus mode, the system comprising: slide supporting stage means adjustable in the x, y, and z axis; light source means providing a light beam through said stage means and said objective lens to beam utilizing means; light responsive means providing an electrical output level which is a function of the light falling thereon; optical scanning means comprising an oscillating mirror, said mirror oscillating in the x axis and intercepting at least a part of the light beam, to repetitively scan across the scene of the microscope slide in the x direction, and directing the intercepted light beam on to said light responsive means, said scanning means being operative during both of said modes; means driving said scanning means at a slower speed during the automatic focus mode than during cell-find mode; stage traverse control means connected to said stage means to cause said stage means to traverse along a predetermined meander path in the y axis while in cell-find mode until an area of desired optical density appears in view, said traverse control means being further connected to and controlled by said light responsive means to interrupt stage traverse upon appearance of the area of desired optical density in said scan; means including switching means responsive to the appearance of the area of desired optical intensity in the scanned view for switching said system from the cell-find mode to the automatic focus mode, said y traverse being stopped during automatic focus mode; focus control means for adjusting the position of said stage in the z axis after appearance of a desired area to provide proper focusing comprising, means sequentially activating said focus control means, after interruption of said traverse, for the period of time required to accomplish focus, z axis actuator means connected to said slide supporting stage means for adjusting said stage means in the z axis direction, control means causing said actuator means to adjust the position of said stage means in a predetermined sequence during focus mode so that said position is changing while the plurality of scans is simultaneously occuring, light intensity to electrical signal level transducer means including said light responsive means, to provide an output signal with each of said plurality of scans, and comparator-controller means connected to receive and compare the magnitude of each output signal from said transducer means with the signal magnitude of the highest previous scan, to select the highest magnitude signal of said plurality of scans and instruct said focus control means so that said actuator means returns said stage means to the z position of highest signal representing optimum focus.
2. The invention according to claim 1 in which said predetermined sequence of stage adjust during auto-focus further comprises: said control means first causing the z axis actuator means to drive the stage slightly away from the previous optimum focus position, then to drive the stage back to and through the previous optimum focus position while the scanner provides repetitive auto-focus scans to determine a new optimum focus, means recording the signal indicative of focus from each of the successive scans, the maximum amplitude signal indicating the new optimum focus position being kept, said control means in response to the maximum amplitude signal, then causing the z axis actuator means to move to the new optimum focus position.
3. The invention according to claim 1 in which said light intensity to electrical signal level transducer means is a light intensity rate of change to electrical signal level transducer means and is responsive only to light intensity rate of change to provide an output signal, the magnitude of which signal is a function of the rate of change in light intensity received by said light responsive means.
4. The invention according to claim 3 in which said light intensity rate of change to voltage transducer means further includes, differentiating means responsive to each rate of change in the level of electrical output, the differentiating means providing output pulses the magnitudes of which are a function of the light intensity rate of change during a scan.
5. The invention according to claim 4 in which said light intensity rate of change to voltage transducer means further includes integrating means connected to said differentiating means output to receive and integrate the differentiated pulses of each auto-focus scan.
6. The invention according to claim 5 in which said light intensity rate of change to voltage transducer means further includes integrator reset means for reseting said integrating means before commencing each auto-focus scan.
7. The invention according to claim 1 in which said light responsive means comprises a first and a second light responsive element, the first light responsive element being connected to said stage traverse control means and the second light responsive element being included in said light intensity rate of change to voltage transducer means.
8. The invention according to claim 7 in which said light responsive elements are silicon photodetectors.
9. The invention according to claim 1 in which said area of desired optical density is a leukocyte.
10. The invention according to claim 1 in which said comparator-controller means is a microprocessor.
11. In a scanning automated microscope system, a process of centering a leukocyte in the optics comprising the steps of: a. reading the location of the leukocyte along the scan line and converting the read value to a digital number; b. storing the digital number location in the memory; c. subtracting x/2 from the digital number, where numbers across the scan increase from 0 to x and x/2 represents mid-position, the subtracted remainder being positive (+), negative (-), or zero (0) depending upon the magnitude of the number relative to x/2, and d. driving the motor a distance equal to the number of counts of the remainder and in the direction indicated by the scan of the remainder.
12. An automatic cell-find and automatic focus system for use in a scanning microscope which includes both an objective lens and an adjustable stage means, said system operating at alternate times in a cell-find mode and in an automatic focus mode, the system comprising: slide supporting stage means adjustable in the x, y, and z axis by x, y, and z motors; light source means providing a light beam through said stage means and said objective lens to beam utilizing means; an optical scanner intercepting a part of the light beam and directing it onto light responsive means, said scanner comprising a mirror adapted to be oscillated in the x direction scanning across the scene of a microscope slide to scan for information for cell-find and for focus; mirror position sensing means connected with said optical scanner for providing an electrical signal output representative of mirror position; first light responsive means receiving the light beam from said mirror and providing a first electrical output signal representative of light received, said electrical signal having a rate of change component which results from abrupt light intensity variation during a sweep such as crossing cell edges; electrical means connected to receive the first electrical signal from said light responsive means, said electrical means being responsive only to said rate of change component in said electrical signal, said electrical means providing each sweep an electrical focus signal the magnitude of which increases as the light intensity rate of change component increases; analog to digital converter means; said converter means having a signal input terminal and having a strobe terminal for actuating said converter to accept the analog information at said converter to accept the analog information at said signal input terminal upon the occurrence of a strobe pulse; mode switchover means connecting said mirror position signal to said converter means signal input terminal during cell-find mode and connecting said focus signal to said signal input terminal during auto-focus mode; means causing said x and y motors to drive said stage in a predetermined meander path during cell-find mode; second light responsive means receiving the light beam from said mirror and providing a second electrical output signal the level of which is representative of light intensity received; signal level comparator means receiving said second electrical output signal and providing an output pulse when said sweep crosses an area of desired optical density such as a leukocyte; means for applying a strobe pulse to said converter means during cell-find mode scanning upon the occurrence of a leukocyte produced pulse so that the mirror position and thereby the leukocyte x coordinate position long the sweep is recorded; means for applying a strobe pulse to said converter means during auto-focus mode at the end of sawtooth sweep so that the signal indicative of focus can be obtained with each sweep; and control means active during auto-focus mode first causing the z motor to drive the stage slightly away from the previous optimum focus position, then to drive the stage back to and through the previous optimum focus position and slightly beyond while the scanner provides repetitive auto-focus sweeps to determine a new optimum focus, means recording and comparing the signal indicative of focus from each of the successive sweeps, keeping the maximum amplitude signal of the compared signals indicating the new optimum focus position, said z motor control means in response to the selected signal, then causing the z motor to move to the new optimum focus position.
13. The invention according to claim 12 and further comprising: sine wave generator means; sawtooth wave generator means; and said mode switchover means connecting said sine wave generator means to energize said optical scanner to sweep said mirror in a sine wave motion for cell-find mode, and connecting said sawtooth wave generator means to energize said optical scanner to sweep said mirror in a sawtooth motion for auto-focus mode.
14. The invention according to claim 12 in which said control means is a microprocessor.
15. An automatic cell-find system for use in a scanning microscope which includes both an objective lens and an adjustable stage means, the system comprising: slide supporting stage means adjustable in the x and y axis by x and y motors; light source means providing a light beam through said stage means and said objective lens to beam utilizing means; an optical scanner intercepting a part of the light beam and directing it onto light responsive means, said scanner comprising a galvanometer movement having a mirror attached, said mirror pivoted to be oscillated in the x direction scanning across the scene of a microscope slide to scan for information for cell-find; sine wave generator means connected to energize said optical scanner galvanometer movement with sine wave energy; mirror position sensing means connected with said optical scanner for providing an analog electrical signal output representative of mirror position; analog to digital converter means, said converter means having a signal input terminal and having a strobe terminal for actuating said converter to accept the analog information at said signal input terminal upon the occurrence of a strobe pulse; means connecting said mirror position signal to said converter means signal input terminal; means causing said x and y motor to drive said stage in a predetermined meander path during cell-find; light responsive means receiving the light beam from said mirror and providing an electrical output signal the level of which is representative of light intensity received; signal level comparator means receiving said second electrical output signal and providing an output pulse when said sweep crosses an area of desired optical density such as a leukocyte; and means for applying a strobe pulse to said converter means upon the occurrence of a leukocyte produced pulse so that the mirror position and thereby the leukocyte x coordinate position along the sweep is recorded.
16. The invention according to claim 15 in which the center of the x-direction scan lies on the meander path and further having apparatus for automatic centering of a leukocyte in the scan by adjusting the position of the microscope stage means, comprising: means for calculating the distance the leukocyte x coordinate position lies off the meander path; means for issuing a command to said x motor to drive away from the meander path the calculated distance to thereby center the leukocyte in the scan; means for storing the calculated distance for use in returning to said meander path; and means for using the stored calculated distance to return the system to the meander path before cell-find recommences.
17. The invention according to claim 16 in which the means for calculating comprises: means for subtracting from a number m indicating scan center the leukocyte x coordinate position n, the subtracted remainder (m-n) being positive (+), negative (-), or zero (0) depending on the magnitude of the number relative to m, the sign of the remainder indicating the direction the motor is to be driven and the number of the remainder indicating the distance.
18. An automatic focusing system for use with an optical system which includes both an objective lens means and mounting means for an object to be viewed, said automatic focusing system comprising: light responsive means providing an electrical signal which is a function of the light intensity falling thereon; oscillating galvanometer mirror scanning means, said mirror oscillating in the x axis intercepting at least a part of the light beam collected by said objective lens means and directing it to said light responsive means, said scanning means providing a repetitive scan across the field of view of said objective lens means; aperture means comprising a light shield having a single aperture mounted in front of said light responsive means between said scanning means and said light responsive means; sawtooth wave generator means; means connecting said sawtooth wave generator means to said oscillating galvanometer mirror scanning means in energizing relation thereto to repetitively oscillate said mirror in a sawtooth motion; light intensity to electrical signal level transducer means including said light responsive means to provide an output signal with each optical scan; actuator means controllable to adjust the distance between said mounting means and said objective lens means to accomplish proper focus, said actuator means being caused to adjust said distance through a scheduled range while said repetitive scans are proceding; and comparator - controller means connected to compare succeding output signals of said transducer means with the previous signal, said means comprising: means for sampling and temporarily storing said plurality of transducer means output signals as well as the lens means - mounting means distance associated with each signal; means for comparing the magnitude of each sampled transducer means output signal with the previous signal and for keeping the signal of maximum magnitude which represents optimum focus position; and means for resetting to the lens means - mounting means distance position of maximum signal representing optimum focus.
19. The invention according to claim 18 in which said scanning means is an optical scanning means comprising an oscillating mirror, said mirror oscillating in the x axis and directing the intercepted light beam on to said light responsive means.
20. The invention according to claim 19 in which said oscillating mirror is part of a galvanometer structure.
21. The invention according to claim 18 in which said light intensity to electrical signal level transducer means is a light intensity rate of change to electrical signal level transducer means and is responsive only to light intensity rate of change to provide an output signal, the magnitude of which signal is a function of the rate of change in light intensity received by said light responsive means.
22. The invention according to claim 21 in which said light intensity rate of change to voltage transducer means further includes, differentiating means responsive to each rate of change in the level of electrical output, the differentiating means providing output pulses the magnitudes of which are a function of the light intensity rate of change during a scan.
23. The invention according to claim 22 in which said light intensity rate of change to voltage transducer means further includes integrating means connected to said differentiating means output to receive and integrate the differentiated pulses of each auto-focus scan to provide an output voltage at the end of each scan which is a summation of the differentiated pulses during said scan.
24. The invention according to claim 23 in which said light intensity rate of change to voltage transducer means further includes integrator reset means for reseting said integrating means before commencing each auto-focus scan.
25. The invention according to claim 23 in which said light intensity rate of change to voltage transducer means also includes an analog to digital converter receiving the integrated output voltage and converting it to a digital value at the end of each scan.
26. The invention according to claim 18 in which said actuator means further comprises: control means causing the actuator to first drive the mounting means slightly away from the last good-focus-position, then to drive the stage back through the last good-focus-position and slightly beyond while the scanner provides repetitive auto-focus sweeps to determine focus, means recording the signal indicative of focus from each of the successive sweeps, the maximum amplitude signal indicating good-focus-position, said z actuator control means in response to the recorded signals, then causing the z actuator to move to the new good-focus-position.
27. In a scanning automated microscope system, in which the center of the x-direction scan lies on the meander path, a process of centering a slide mounted leukocyte in the microscope optics by adjusting the position of a microscope stage comprising the steps of: a. providing an electrical signal which changes in magnitude as a function of scan position, center scan having a signal magnitude m; b. determining leukocyte position along the scan line by measuring the signal magnitude at leukocyte intercept; c. calculating the distance the position of the leukocyte lies off the meander path; d. using the calculated number from step c. to determine the command necessary to move from the meander path to leukocyte centered position; and e. issuing a command to slide stage adjusting motor means.
28. A process according to claim 27 in which step a. is in providing an analog signal and the process further including the step of: a. converting the analog signal to a digital value representative of leukocyte position.
29. The process according to claim 28 in which the center scan position m is a digital number, and the calculating step c comprises: subtracting magnitude m from the digital value representative of leukocyte position, the subtracted remainder being positive (+), negative (-), or zero (0) depending upon the magnitude of the number relative to m.
30. In a scanning automated microscope system, having slide mounting means adjustable in the x and y axis for positioning the slide under the microscope and in the z axis for focus, and in which a light beam is directed through the microscope optics and slide, a process of cell-find, cell centering, and auto-focus comprising the steps of: 1. cell-find comprising the steps of; a. driving the stage in the y axis along a meander path while searching for leukocytes; b. scanning repetitively across the light beam in the x axis as step a. above is occurring, said scanning being astride said meander path and projecting said scanned beam on light responsive means; c. providing an electrical signal level ramp proportional to scan position; d. identifying a found leukocyte by reason of the opacity of its nucleus causing a diminution of the light reaching said light responsive means; e. determining leukocyte position along the scan line by measuring the signal level at leukocyte intercept; f. stopping the y axis drive upon identifying a leukocyte; 2. cell centering comprising the steps of; a. calculating the distance the leukocyte lies off the meander path; b. using the calculated distance from step a. to determine the command necessary to move from the meander path to leukocyte centered position; and c. issuing a command to x axis stage adjusting motor means if the cell is not already approximately centered; 3. and, auto-focus comprising the steps of: a. adjusting the position of the slide mounting means in the z axis in a predetermined sequence during focus so that said position is changing, while; b. scanning repetitively the same slide location and providing an output signal with each of said scans while said predetermined sequence of adjusting is occurring; c. comparing the magnitude of the output signal of each succeeding scan with the magnitude of the previously preserved scan and preserving only the largest of the two newly compared signals; d. recording the z coordinate location of the preserved scan of step c. above; and e. readjusting the position of the slide mounting means to the z coordinate location of the preserved scan representing the position of optimum focus.
31. A process according to claim 30 wherein step 3.b. comprises the steps of: a. differentiating signal intensity rate of change to provide an output pulse with each rate of change, and b. integrating said differentiated pulses to provide said output signal with each of said scans.
32. The process according to claim 30 and further including a process of accepting a plurality of leukocytes in a single scan comprising after step 1.e., the additional steps of: g. loading the leukocyte position into a register; h. repeating steps 1.d., 1.e., and g. for each of said additional luekocytes; i. storing in a counter the number of leukocytes identified; j. selecting one of said leukocytes, centering on it according to step 2 and auto focusing according to step 3; and, k. repeating step j. until the selected leukocytes equal in number the number stored in the counter.
Patent Citations (7)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US3622797 | 1971-11-01 | Bragg | |
| US3780298 | 1973-12-01 | Agadzhanian et al. | |
| US3783269 | 1974-01-01 | McConnell | |
| US3851972 | 1974-12-01 | Smith et al. | |
| US3864564 | 1975-02-01 | Adkins | |
| US3896304 | 1975-07-01 | Aoki et al. | |
| US3916205 | 1975-10-01 | Kleinerman |