Method for determining a desired response to detection of an obstacle

[0002] This invention relates generally to a method for responding to the detection of an obstacle in the path of a mobile machine and, more particularly, to a method for determining a desired response to detection of an obstacle as a function of zones of distance between the obstacle and the mobile machine.

[0003] Mobile machines are used to perform a variety of tasks. As an example, in an earthworking environment such as a mining site, mobile machines, e.g., off-road mining trucks, haul material throughout the site.

[0004] For repetitive tasks such as above, it is becoming advantageous and desirable to operate the mobile machines autonomously. The environment in which the trucks operate may be harsh, and more efficient operations may be attained if the human fatigue factor is eliminated.

[0005] As an example of using off-road mining trucks autonomously, U.S. Pat. No. 5,612,883, issued to Shaffer et al., provides an exemplary disclosure of a system for autonomous operations of mobile machines. In this patent, Shaffer et al. disclose a fleet of off-road mining trucks operating autonomously at a mining site. Parameters such as position determination, navigation, path planning, and machine control are performed without the aid of human operators.

[0006] An important factor in enabling a mobile machine to operate autonomously is the ability to detect obstacles in the machine's path of travel, and to respond in an acceptable manner when obstacles are detected. The normal course of action when encountering an obstacle is to stop the mobile machine and notify a fleet manager to remove the obstacle. However, this is not always the most efficient course of action. Under some circumstances, stopping the mobile machine may not be necessary, particularly when the obstacle is moving and may soon be out of the path of the mobile machine.

[0007] An appropriate response to the detection of an obstacle may vary dependent on the location of the obstacle relative to a mobile machine. A more efficient method for responding to a detected obstacle would be to vary the response as a function of the detected obstacle being in one of a plurality of zones relative to the location of the mobile machine. As an example of using zones of detection, in U.S. Pat. No. 5,521,633, Nakajima et al. disclose the use of a series of zones in the scan pattern of an obstacle detector, each of the zones having a corresponding “rate of danger” of an obstacle detected in the zone. A method for alerting an operator to the presence of an obstacle varies in response to a determination of which zone the obstacle is in.

[0008] However, the disclosure of Nakijima et al. does not account for the detected obstacle moving from one zone to another, or to predicting the movement of the obstacle between zones. Responding appropriately and efficiently to the detection of an obstacle, more particularly a moving obstacle, would improve greatly if the movements of the detected obstacle were predictable and could be responded to prior to the obstacle entering a zone.

[0009] The present invention is directed to overcoming one or more of the problems as set forth above.

[0010] In one aspect of the present invention a method is disclosed for responding to the detection of an obstacle in the path of a mobile machine as the mobile machine traverses the path at a work site. The method includes the steps of scanning a field of interest, detecting the presence of an obstacle, and determining a set of parameters as a function of the mobile machine, the obstacle, and the work site. The method also includes the steps of determining a level of predictability of motion of the obstacle, defining ranges of a plurality of zones as a function of the level of predictability and the parameters, and initiating an action in response to the obstacle being in one of the zones.

[0011] FIG. 1 is a diagrammatic illustration of a mobile machine shown as an off-road mining truck;

[0012] FIG. 2 is a block diagram illustrating an aspect of the present invention at a work site;

[0013] FIG. 3 is a diagrammatic illustration of an application of the present invention;

[0014] FIG. 4 is a side view of an application of the present invention;

[0015] FIG. 5 is a diagrammatic illustration of another aspect of an application of the present invention; and

[0016] FIG. 6 is a flow diagram illustrating an embodiment of the present invention.

[0017] The present invention is, in the preferred embodiment, a method for responding to the detection of an obstacle in the path of a mobile machine at a work site and, as an example, is described below with reference to a fleet of mobile machines at an earthworking site, such as an open pit mining site. However, other work sites, e.g., a warehouse, a logging site, a construction site, and the like, may benefit from application of the present invention.

[0018] Referring to the drawings and, in particular, to FIG. 1, a mobile machine 102 is shown. The mobile machine 102 of FIG. 1 is depicted as an off-road mining truck, which travels on a path 104 at a mining site. Fleets of off-road mining trucks are used extensively at open pit mining sites to haul materials throughout the site. Recent developments in technology allow fleets of mining trucks to operate autonomously, thus freeing human operators from working long shifts in harsh environments.

[0019] A major concern in operating mobile machines autonomously is the ability to detect obstacles in the path of the mobile machine 102 accurately, in a harsh and constantly changing environment. Examples of obstacles include rocks and boulders, and other mobile machines that traverse the same path.

[0020] Although the mobile machine 102 in FIG. 1 is shown as an off-road mining truck, other types of mobile machines may use the present invention. Examples of mobile machines include fork lift trucks, logging trucks, wheel loaders, track-type tractors, and the like.

[0021] Referring now to FIG. 2, a block diagram of operations at a work site 204 as depicted in a preferred embodiment of the present invention is shown. The mobile machine 102 traverses the work site 204 and communicates with a fleet manager 202 through a communications link 210. The communications link 210 provides two way communications between the mobile machine 102 and the fleet manager 202. The communications link 210 may be any type of wireless communications system, such as RF radio, satellite, telephony, and the like. Communications links are well known in the art and will not be discussed further.

[0022] The work site 204 is also traversed by one or more additional mobile machines, known in a preferred embodiment of the present invention as a predictable moving obstacle 206. The predictable moving obstacle 206 also communicates with the fleet manager 202 through the communications link 210. The mobile machine 102 and the predictable moving obstacle 206 are each configured to communicate location, heading, and velocity information to the fleet manager 202.

[0023] The mobile machine 102 and the predictable moving obstacle 206 may be configured to communicate directly with each other through an alternative communications link 212, either alternatively or in addition to the communications link 210 to the fleet manager 202.

[0024] At the work site 204, an additional type of mobile machine, known in a preferred embodiment of the present invention as a non-predictable moving obstacle 208, may be found. The non-predictable moving obstacle 208 does not have a communications link with the fleet manager 202, and therefore is not able to communicate location, heading, and velocity information to the fleet manager 202. Examples of non-predictable moving obstacles 208 in a preferred embodiment of the example of a mining site include water trucks used to water the roads to reduce the amount of dust being generated, and trucks being driven by supervisors and service people.

[0025] With reference to FIGS. 3-5, diagrammatic illustrations of a mobile machine 102 on a path 104 and operating in a preferred embodiment of the present invention is shown.

[0026] In FIG. 3, the mobile machine 102 is shown traversing a path 104. The mobile machine 102 scans for obstacles using an obstacle scanning sensor system (not shown). The mobile machine 102 in FIG. 3 is shown scanning in a far range scan pattern 302 and a near range scan pattern 304. However, any variety and combination of scan patterns may be generated by the mobile machine 102 without deviating from the spirit of the invention.

[0027] The scan pattern in FIG. 3 is divided into three zones. A first zone 306 extends from the mobile machine 102 to a first distance from the mobile machine 102. A second zone 308 extends from the first distance to a second distance from the mobile machine 102. A third zone extends from the second distance to a third distance from the mobile machine 102. The use of the three zones 306,308,310 are discussed in more detail below.

[0028] The preferred embodiment of the present invention is discussed with reference to the use of three zones 306,308,310. However, the spirit of the present invention allows for any number of zones to be used. For example, the present invention may be configured to use two zones, four zones, or any number of zones that may be deemed necessary.

[0029] FIG. 4 illustrates a side view of the preferred embodiment shown in FIG. 3. The three zones 306,308,310 divide the far and near range scan patterns 302,304 into three sections. Preferably, the third zone 310 extends from the second zone to the far end of the scan pattern 302. Thus, the entire area covered by the scan patterns 302,304 is included in at least one zone 306,308,310.

[0030] In FIG. 5, the mobile machine 102 is shown moving around a stationary obstacle 502, e.g., a rock or boulder. As the mobile machine 102 alters course to move around the obstacle 502, the far and near range scan patterns 302,304 must shift to allow the mobile machine 102 to continue to scan for obstacles. In a preferred embodiment of the present invention, the zones 306,308,310 must also shift to maintain position relative to the mobile machine 102.

[0031] Referring now to FIG. 6, a flow diagram illustrating detailed operation of a preferred embodiment of the present invention is shown.

[0032] In a first control block 602, the mobile machine 102 scans for obstacles in a field of interest in the path 104 being traversed by the mobile machine 102. In a second control block 604, an obstacle is detected and the mobile machine 102 determines the location, heading, and velocity of the detected obstacle. If the obstacle is stationary, e.g., a rock, boulder, or other non-moving mobile machine, the determined heading and velocity will be zero. The location, heading, and velocity of a moving obstacle is determined using methods of obstacle detection systems that are known in the art.

[0033] In a third control block 606, at least one parameter is determined by the mobile machine 102. Parameters are determined as a function of at least one of the mobile machine, the detected obstacle, and the work site. The parameters that are determined affect the ability of the mobile machine 102 to avoid the detected obstacle. For example, parameters determined as a function of the mobile machine 102 include the velocity of the mobile machine 102, the weight of the load being carried by the mobile machine 102, and other factors that affect the minimum stopping distance of the mobile machine 102.

[0034] Examples of parameters that are determined as a function of the detected obstacle include the velocity and heading of the obstacle with respect to the velocity and heading of the mobile machine 102. Additional examples of parameters that are determined as a function of the detected obstacle include the minimum stopping distance of the moving obstacle as determined by the mobile machine 102. If the obstacle is a predictable moving obstacle 206, the minimum stopping distance of the obstacle may be determined from the data provided by the fleet manager 202 in the some manner that the mobile machine 102 would determine the minimum stopping distance of the mobile machine 102. If the obstacle is a non-predictable moving obstacle 208, the mobile machine can determine the minimum stopping distance of the obstacle as a function of other parameters, such as the velocity of the obstacle and parameters that are determined as a function of the work site 204.

[0035] Parameters that are determined as a function of the work site 204 may include characteristics of the work site 204 that can affect the minimum stopping distance of the mobile machine 102. Examples of such parameters are the condition of the surface of the path 104, e.g., amount of moisture on the path 104, type of material (dirt, sand, rock, etc.), and the like. In addition, the slope of the grade of the path 104 may be a parameter. For example, the mobile machine 102 may stop in a shorter distance going up a hill than going down a hill.

[0036] Parameters that are determined as a function of the work site 204 may also include characteristics of the work site 204 that can affect the maximum distance that an obstacle detection system can scan. For example, dust, fog, and night operations may affect the range that an obstacle detection system can function in.

[0037] The examples of parameters discussed above are representative of a sampling of parameters that may be of interest in the preferred embodiment of the present invention. It is emphasized that other parameters may be determined in the present invention, and any combination of parameters may be used.

[0038] In a first decision block 608, a level of predictability of motion of the detected obstacle relative to the motion of the mobile machine 102 is determined. In the preferred embodiment, one of two levels of predictability is chosen. The obstacle is determined to be a predictable moving obstacle 206 or a non-predictable moving obstacle 208.

[0039] The obstacle is determined to be a predictable moving obstacle 206 if the planned heading and velocity of the obstacle is communicated to the mobile machine 102 from either the fleet manager 202 or directly from the obstacle. The movement of the obstacle is predictable if the mobile machine 102 knows the heading of the obstacle, knows the velocity of the obstacle, and knows of any planned changes in either the heading or the velocity of the obstacle.

[0040] The obstacle is determined to be a non-predictable moving obstacle 208 if the planned heading and velocity of the obstacle is not communicated to the mobile machine 102 from either the fleet manager 202 or directly from the obstacle. The movement of the obstacle is non-predictable if the mobile machine 102 knows the heading of the obstacle, knows the velocity of the obstacle, but does not know of any planned changes in either the heading or the velocity of the obstacle.

[0041] With continued reference to FIG. 6, control proceeds to a fourth control block 610 if the motion of the obstacle is determined to be predictable, or to a fifth control block 612 if the motion of the obstacle is determined to be non-predictable. In the fourth and fifth control blocks 610,612, the range of each zone 306,308,310 is defined. Preferably, if the motion of the obstacle is non-predictable, the range of each zone 306,308,310 is larger than the ranges for a predictable moving obstacle 206. The larger ranges allow for longer response times by the mobile machine 102 due to the non-predictable heading and velocity of the obstacle. The range of each zone 306,308,310 is also varied as a function of the determined parameters to allow for variations in obstacle sensing range and stopping distance by the mobile machine 102.

[0042] In the preferred embodiment, three zones are used. The first zone 306 from the mobile machine 102 to the first distance from the mobile machine 102 is known as an alarm zone 306. The second zone 308 from the first distance to a second distance from the mobile machine 102 is known as an alert zone 308. The third zone 310 from the second distance to a third distance from the mobile machine 102 is known as a caution zone 310. Detection of a moving obstacle in any of the three zones 306,308,310 causes a unique responsive action by the mobile machine 102, as is discussed below.

[0043] If the moving obstacle is determined to be in the caution zone 310 in a second decision block 614, control proceeds to a sixth control block 616. In the sixth control block 616, the mobile machine 102 maintains the velocity that the mobile machine 102 previously had. However, the mobile machine 102 monitors the moving obstacle in preparation for the moving obstacle entering one of the other two zones 306,308 from the caution zone 310.

[0044] If the moving obstacle is determined, in the second decision block 614, to not be in the caution zone 310, control proceeds to a third decision block 613. If, in the third decision block 618, the moving obstacle is determined to be in the alert zone 308, control moves to a seventh control block 620, where the mobile machine 102 reduces velocity.

[0045] The desired amount of reduction of velocity of the mobile machine 102 is determined, preferably, by analyzing the heading and velocity of the moving obstacle with respect to the heading and velocity of the mobile machine 102, and reducing the velocity of the mobile machine 102 enough to enable the mobile machine 102 and the moving obstacle to continue moving along their present headings without interfering with the travel paths of each other.

[0046] Alternatively, the present invention may allow the mobile machine 102 to alter its heading to prevent interference with the motion of the moving obstacle. For example, if the moving obstacle is determined to be moving directly toward the mobile machine 102 on the path 104, the mobile machine 102 may slightly and temporarily alter course to allow the moving obstacle and the mobile machine 102 to pass each other.

[0047] If the moving obstacle is determined, in the third decision block 618, to not be in the alert zone 308, control proceeds to a fourth decision block 622. If, in the fourth decision block 622, the moving obstacle is determined to be in the alarm zone 306, control moves to an eighth control block 624, where the mobile machine 102 stops until the moving obstacle is no longer in the alarm zone 306. If the moving obstacle is determined to not be in the alarm zone 306 in the fourth decision block 622, then the moving obstacle is no longer in the field of interest, and control returns to the first control block 602.

[0048] If, in the first decision block 608, it is determined that the moving obstacle is a predictable moving obstacle 206, the mobile machine 102 has knowledge of the planned heading and velocity of the predictable moving obstacle 206. The mobile machine 102 is also informed by either the fleet manager 202 or the predictable moving obstacle 206 if the heading or velocity of the obstacle changes. With this information, the mobile machine 102 is able to predict the movement of the detected obstacle into any one of the three zones 306,308,310. Therefore, the mobile machine 102 can initiate a responsive action corresponding to any of the zones 306,308,310 that the predictable moving obstacle 206 is about to move into. This predictive ability of the mobile machine 102 allows for a more efficient method for responding to the presence of a moving obstacle in the scanned field of interest of the mobile machine 102.

[0049] In an example of an application of the present invention, a fleet of off-road mining trucks travel over roads throughout a mining site, hauling loads of material and performing other tasks. The mining site is typically in a harsh environment and the roads at the mining site are constantly changing due to the changing nature of the mining areas.

[0050] Quite often, conditions arise which introduce obstacles on the mining roads. For example, rocks and boulders may roll or slide down hillsides onto the roads, materials may spill out of the trucks, and trucks may break down and block the roads. In addition, with multiple trucks traveling on the same roads, the trucks frequently become moving obstacles to each other.

[0051] Operators of these trucks constantly monitor the roads for obstacles and respond as needed by either stopping, slowing down, or driving around the obstacle. However, autonomous trucks are being developed to remove human operators from these harsh, fatiguing environments. Consequently, some means is required to monitor the roads for obstacles and respond appropriately in an autonomous manner. The preferred embodiment of the present invention allows for an autonomous fleet of mining trucks to monitor for moving obstacles by employing any of a variety of obstacle detection techniques, determine the presence of a moving obstacle, and respond to the presence of the moving obstacle in an appropriate and efficient manner.

[0052] Other aspects, objects, and features of the present invention can be obtained from a study of the drawings, the disclosure, and the appended claims.