AUTOMATED PLANT PROBLEM RESOLUTION

[0001] This application is related to commonly assigned and co-pending U.S. patent application Ser. No. ______ (Attorney Docket No. 18934-US) entitled “Robotic Pesticide Application”; U.S. patent application Ser. No. ______ (Attorney Docket No. 18937-US) entitled “Networked Chemical Dispersion System” all of which are hereby incorporated by reference.

[0002] The present invention relates generally to a horticultural control system and, more particularly, to automated resolution of horticultural problems.

[0003] Horticulture is the industry and science of plant cultivation. Horticulturists work and conduct research in the disciplines of plant propagation and cultivation, crop production, plant breeding and genetic engineering, plant biochemistry, and plant physiology. The work particularly involves fruits, berries, nuts, vegetables, flowers, trees, shrubs, and turf. Horticulturists work to improve crop yield, quality, nutritional value, and resistance to insects, diseases, and environmental stresses.

[0004] One aspect of horticultural management is addressing visual symptoms of a potential plant problem. These symptoms may be recognizable to a horticulturalist or plant expert, but often are not identifiable to the home owner, for example.

[0005] Fields and lawns typically have a single species of plant. Other areas, such as gardens, residential yards, and landscaped areas, may contain multiple plant varieties and species.

[0006] The different illustrative embodiments provide an apparatus for performing horticultural tasks. In an illustrative embodiment, an apparatus is comprised of a number of data storage devices, a diagnostic system, and a processor unit. The number of data storage devices includes a horticultural knowledge base, a logistics database, and a home site database. The processor unit executes the diagnostic system and accesses the horticultural knowledge base, the logistics database, and the home site database on the number of data storage devices to identify a horticultural need for a plurality of plants.

[0007] The different illustrative embodiments further provide a vehicle comprising a machine controller, a steering system, a propulsion system, a braking system, a link for receiving input from a number of sensors, and a diagnostic system. The diagnostic system is configured to identify plant anomalies and generate application plans to address the plant anomalies identified. The machine controller is connected to the diagnostic system. The machine controller uses the diagnostic system to identify a horticultural need for a plurality of plants.

[0008] The different illustrative embodiments further provide a system for managing horticultural needs comprising a resolution manager, a horticultural knowledge base, a logistics database, and a home site database. The resolution manager is configured to receive a number of images and analyze the number of images to identify a number of plant anomalies, a number of diagnoses, and a number of treatment options. The horticultural knowledge base includes information about a number of plants. The logistics database includes information about a number of plant treatments. The home site database includes information about a given area.

[0009] The features, functions, and advantages can be achieved independently in various embodiments of the present invention or may be combined in yet other embodiments in which further details can be seen with reference to the following description and drawings.

[0022] FIG. 1 is a block diagram of a horticultural resolution management system in which an illustrative embodiment may be implemented. Horticultural resolution management system 100 may be implemented in a network of computers in which the illustrative embodiments may be implemented. Horticultural resolution management system 100 contains network 102, which is the medium used to provide communications links between various devices and computers connected together within horticultural resolution management system 100, such as mobile utility vehicle 104 and back office 106. Network 102 may include connections, such as wire, wireless communication links, or fiber optic cables.

[0023] In the depicted example, mobile utility vehicle 104 connects to network 102 in a wireless configuration while back office 106 has a hard connection to network 102. In another illustrative embodiment, both mobile utility vehicle 104 and back office 106 may connect to network 102 in a wireless configuration. Back office 106 may be, for example, personal computers or network computers. In one illustrative example, back office 106 provides data, such as boot files, operating system images, and applications, to mobile utility vehicle 104. Mobile utility vehicle 104 is a client to back office 106 in this example. Horticultural resolution management system 100 may include additional servers, clients, and other devices not shown.

[0024] Horticultural resolution management system 100 may be used to identify, diagnose, and manage treatment for a number of different horticultural problems. As used herein, horticultural problems refers to, for example, without limitation, plant problems, insect problems, environmental problems, and/or any other suitable horticultural problem.

[0025] Horticultural resolution management system 100 includes area 108. Area 108 is any location in which plurality of plants 110 may be located. Area 108 may be, for example, a flowerbed, garden, yard, lawn, landscape, park, agricultural field, athletic field, green, golf course, fairway, rough, orchard, vineyard, or any other area of recreational land planted with grass and/or other plants.

[0026] Plurality of plants 110 includes individual plant 112, individual plant 114, and individual plant 116, in this illustrative example. Individual plant 112, individual plant 114, and individual plant 116 may be homogenous or heterogeneous plant varieties and/or species. In one illustrative embodiment, individual plants 112, 114, and 116 may be located in the same portion of area 108. In another illustrative embodiment, individual plants 112, 114, and 116 may be located in separate portions of area 108. In yet another illustrative embodiment, individual plants 112, 114, and 116 may be grouped together in homogenous groupings, or may be grouped together in heterogeneous groupings. Individual plants 112, 114, and 116 may be grouped together in a dense arrangement, or may be spaced apart in any number of arrangements and distances within area 108.

[0027] Individual plants 112, 114, and 116 are used as an illustrative example of a number of plants that may be present in area 108. Area 108 may contain a number of heterogeneous plants and/or a number of homogeneous plants. As used herein, each plant may refer to one or more plants within a category of plants, and/or one or more plants within a common area of location. For example, in an illustrative embodiment, if area 108 is a golf course, individual plant 112 may represent a number of types of plants and/or vegetation on the areas of the golf course referred to as the green, while individual plant 114 may represent a number of types of plants and/or vegetation on the areas of the golf course referred to as the rough.

[0028] Back office 106 includes diagnostic system 118 and communications unit 120. Diagnostic system 118 uses images of plurality of plants 110 and/or area 108 to identify, diagnose, and generate treatment plans for plant problems. Diagnostic system 118 may receive images using communications unit 120. Communications unit 120, in these examples, provides for communications with other data processing systems or devices, such as mobile utility vehicle 104, for example. Communications unit 120 may provide communications through the use of either or both physical and wireless communications links using network 102.

[0029] Diagnostic system 118 may receive images from mobile utility vehicle 104 and/or camera 122 operated by user 124. Camera 122 may transmit images to back office 106 via a wired or wireless connection using network 102, for example. Diagnostic system 118 uses the images to identify the problem and generate an application plan for treatment. Diagnostic system 118 may send the application plan to mobile utility vehicle 104 for autonomous resolution of the identified plant problem, in one illustrative embodiment. In another illustrative embodiment, diagnostic system 118 may display the treatment plan via a user interface to user 124 for manual resolution.

[0030] In these illustrative examples, the problem identified by diagnostic system 118 may be, without limitation, a plant, a plant anomaly, an invertebrate animal, a vertebrate animal, a fungus, a single celled life form, a virus, an environmental condition around a plant, and/or any other horticultural issue.

[0031] Mobile utility vehicle 104 includes authenticator 126, number of cartridges 128, cartridge receptor 130, applicator 132, and plurality of databases 134. Authenticator 126 may be a software agent configured to authenticate number of cartridges 128 and/or the application plan received from diagnostic system 118. Authenticator 126 may access plurality of databases 134 when authenticating number of cartridges 128 and/or the application plan. Plurality of databases 134 may include a cartridge authentication database, an application plan authentication database, and/or any other suitable database for mobile utility vehicle 104.

[0032] In these examples, a cartridge may refer to a component having a number of resource reservoirs. A resource may be, for example, without limitation, chemicals, water, fertilizer, herbicide, insecticide, fungicide, plant food, nutrients, and/or any other suitable resource for horticultural use. Number of cartridges 128 may contain a number of resources used by applicator 132 of mobile utility vehicle 104 in area 108, for example. In an illustrative example, number of cartridges 128 may be chemical cartridges used for autonomous application of chemicals to plurality of plants 110 by mobile utility vehicle 104. Cartridge receptor 130 is a component that is configured to receive number of cartridges 128, secure number of cartridges 128 to and/or within mobile utility vehicle 104, and provide applicator 132 access to the resources within number of cartridges 128.

[0033] In an illustrative example, mobile utility vehicle 104 may autonomously traverse area 108, capturing images of plurality of plants 110. Mobile utility vehicle 104 may wirelessly transmit the images captured to diagnostic system 118 using network 102, in this example. Diagnostic system 118 uses the images received from mobile utility vehicle 104 to identify and diagnose and plant problem for one or more specific plants, such as individual plant 112, individual plant 114, and individual plant 116. Diagnostic system 118 identifies a number of treatment options and generates an application plan for treatment of the problem identified. Diagnostic system 118 sends the application plan to mobile utility vehicle 104 using network 102. Authenticator 126 receives the application plan from diagnostic system 118 and authenticates the application plan using plurality of databases 134. Mobile utility vehicle 104 may identify required resources associated with the application plan, and determine whether these resources are included within mobile utility vehicle 104, for example.

[0034] In one illustrative example, mobile utility vehicle 104 may determine that additional cartridges are needed in order to execute the application plan. In this example, mobile utility vehicle 104 travels to home location 136 to access number of cartridges 138. Number of cartridges 138 may be stored cartridges accessible to mobile utility vehicle 104, for example. Mobile utility vehicle 104 selects the appropriate number of cartridges 128 for the application plan received using cartridge receptor 130, and authenticator 126 authenticates number of cartridges 128. In these examples, authentication refers to identifying whether the cartridges selected are compatible with the cartridge receptor of a mobile utility vehicle, whether the resources within the cartridges selected are the resources specified in the application plan, and whether the application plan received is from an authorized source.

[0035] The illustration of horticultural resolution management system 100 in FIG. 1 is intended as an example, and not as an architectural limitation to the manner in which the different illustrative embodiments may be implemented. Other components may be used in addition to or in place of the ones illustrated for horticultural resolution management system 100 in other illustrative embodiments. For example, in some illustrative embodiments a set of mobile utility vehicles may be used in addition to mobile utility vehicle 104. In another illustrative example, diagnostic system 118 may be implemented directly within mobile utility vehicle 104.

[0036] In yet another illustrative embodiment, horticultural resolution management system 100 may represent a system for addressing horticultural tasks other than plant problems. A horticultural task may include, without limitation, watering, pruning, cultivating, and winterizing a number of plants. As used herein, a number refers to one or more plants.

[0037] As used herein, vehicle refers to any number of different types of vehicles, including, without limitation, ground vehicles, land vehicles, air vehicles, water vehicles, sub-surface vehicles, and/or any other suitable type of vehicle.

[0038] With reference now to FIG. 2, a block diagram of a data processing system is depicted in accordance with an advantageous embodiment. Data processing system 200 is an example of a data processing system that may be used to implement servers and clients, such as back office 106 and mobile utility vehicle 104 in FIG. 1.

[0039] In this illustrative example, data processing system 200 includes communications fabric 202, which provides communications between processor unit 204, memory 206, persistent storage 208, communications unit 210, input/output (I/O) unit 212, and display 214. Processor unit 204 serves to execute instructions for software that may be loaded into memory 206. Processor unit 204 may be a number of processors, a multi-processor core, or some other type of processor, depending on the particular implementation. A number, as used herein with reference to an item, means one or more items. Further, processor unit 204 may be implemented using a number of heterogeneous processor systems in which a main processor is present with secondary processors on a single chip. As another illustrative example, processor unit 204 may be a symmetric multi-processor system containing multiple processors of the same type.

[0040] Memory 206 and persistent storage 208 are examples of storage devices 216. A storage device is any piece of hardware that is capable of storing information, such as, for example without limitation, data, program code in functional form, and/or other suitable information either on a temporary basis and/or a permanent basis. Memory 206, in these examples, may be, for example, a random access memory or any other suitable volatile or non-volatile storage device. Persistent storage 208 may take various forms depending on the particular implementation. For example, persistent storage 208 may contain one or more components or devices. For example, persistent storage 208 may be a hard drive, a flash memory, a rewritable optical disk, a rewritable magnetic tape, or some combination of the above. The media used by persistent storage 208 also may be removable. For example, a removable hard drive may be used for persistent storage 208.

[0041] Communications unit 210, in these examples, provides for communications with other data processing systems or devices. In these examples, communications unit 210 is a network interface card. Communications unit 210 may provide communications through the use of either or both physical and wireless communications links.

[0042] Input/output unit 212 allows for input and output of data with other devices that may be connected to data processing system 200. For example, input/output unit 212 may provide a connection for user input through a keyboard, a mouse, and/or some other suitable input device. Further, input/output unit 212 may send output to a printer. Display 214 provides a mechanism to display information to a user.

[0043] Instructions for the operating system, applications and/or programs may be located in storage devices 216, which are in communication with processor unit 204 through communications fabric 202. In these illustrative examples the instruction are in a functional form on persistent storage 208. These instructions may be loaded into memory 206 for execution by processor unit 204. The processes of the different embodiments may be performed by processor unit 204 using computer implemented instructions, which may be located in a memory, such as memory 206.

[0044] These instructions are referred to as program code, computer usable program code, or computer readable program code that may be read and executed by a processor in processor unit 204. The program code in the different embodiments may be embodied on different physical or tangible computer readable media, such as memory 206 or persistent storage 208.

[0045] Program code 218 is located in a functional form on computer readable media 220 that is selectively removable and may be loaded onto or transferred to data processing system 200 for execution by processor unit 204. Program code 218 and computer readable media 220 form computer program product 222 in these examples. In one example, computer readable media 220 may be computer readable storage media 224 or computer readable signal media 226. Computer readable storage media 224 may include, for example, an optical or magnetic disk that is inserted or placed into a drive or other device that is part of persistent storage 208 for transfer onto a storage device, such as a hard drive, that is part of persistent storage 208. Computer readable storage media 224 also may take the form of a persistent storage, such as a hard drive, a thumb drive, or a flash memory, that is connected to data processing system 200. In some instances, computer readable storage media 224 may not be removable from data processing system 200. In these illustrative examples, computer readable storage media 224 is a non-transitory computer readable storage medium.

[0046] Alternatively, program code 218 may be transferred to data processing system 200 using computer readable signal media 226. Computer readable signal media 226 may be, for example, a propagated data signal containing program code 218. For example, computer readable signal media 226 may be an electromagnetic signal, an optical signal, and/or any other suitable type of signal. These signals may be transmitted over communications links, such as wireless communications links, optical fiber cable, coaxial cable, a wire, and/or any other suitable type of communications link. In other words, the communications link and/or the connection may be physical or wireless in the illustrative examples.

[0047] In some advantageous embodiments, program code 218 may be downloaded over a network to persistent storage 208 from another device or data processing system through computer readable signal media 226 for use within data processing system 200. For instance, program code stored in a computer readable storage medium in a server data processing system may be downloaded over a network from the server to data processing system 200. The data processing system providing program code 218 may be a server computer, a client computer, or some other device capable of storing and transmitting program code 218.

[0048] The different components illustrated for data processing system 200 are not meant to provide architectural limitations to the manner in which different embodiments may be implemented. The different advantageous embodiments may be implemented in a data processing system including components in addition to or in place of those illustrated for data processing system 200. Other components shown in FIG. 2 can be varied from the illustrative examples shown. The different embodiments may be implemented using any hardware device or system capable of running program code. As one example, the data processing system may include organic components integrated with inorganic components and/or may be comprised entirely of organic components excluding a human being. For example, a storage device may be comprised of an organic semiconductor.

[0049] As another example, a storage device in data processing system 200 is any hardware apparatus that may store data. Memory 206, persistent storage 208, and computer readable media 220 are examples of storage devices in a tangible form.

[0050] In another example, a bus system may be used to implement communications fabric 202 and may be comprised of one or more buses, such as a system bus or an input/output bus. Of course, the bus system may be implemented using any suitable type of architecture that provides for a transfer of data between different components or devices attached to the bus system. Additionally, a communications unit may include one or more devices used to transmit and receive data, such as a modem or a network adapter. Further, a memory may be, for example, memory 206, or a cache such as found in an interface and memory controller hub that may be present in communications fabric 202.

[0051] As used herein, the phrase “at least one of”, when used with a list of items, means that different combinations of one or more of the items may be used and only one of each item in the list may be needed. For example, “at least one of item A, item B, and item C” may include, for example, without limitation, item A or item A and item B. This example also may include item A, item B, and item C or item B and item C.

[0052] As used herein, when a first component is connected to a second component, the first component may be connected to the second component without any additional components. The first component also may be connected to the second component by one or more other components. For example, one electronic device may be connected to another electronic device without any additional electronic devices between the first electronic device and the second electronic device. In some cases, another electronic device may be present between the two electronic devices connected to each other.

[0053] The different advantageous embodiments recognize and take into account that identifying and resolving plant problems is currently a labor intensive task. When a plant anomaly is noticed by a home owner, for example, the visual symptoms are diagnosed by manually browsing books or websites until a good match is found. Alternately, the home owner may take a plant or insect specimen to an expert for identification. The home owner must then also identify possible solutions to the problem, and implement the solutions manually. This implementation may involve contacting a professional lawn or gardening service, making a trip to a retailer for supplies, ordering chemicals, studying chemical application, performing the chemical application, cleaning up after the application, and then storing any unused chemicals. This current approach is time consuming and often results in leftover chemicals being stored and presenting potential safety hazards.

[0054] Thus, the illustrative embodiments provide an apparatus for performing horticultural tasks. In an illustrative embodiment, an apparatus is comprised of a number of data storage devices, a diagnostic system, and a processor unit. The number of data storage devices includes a horticultural knowledge base, a logistics database, and a home site database. The processor unit executes the diagnostic system and accesses the horticultural knowledge base, the logistics database, and the home site databse on the number of data storage devices to identify a horticultural need for a plurality of plants.

[0055] The different illustrative embodiments further provide a vehicle comprising a machine controller, a steering system, a propulsion system, a braking system, a link for receiving input from a number of sensors, and a diagnostic system. The diagnostic system is configured to identify plant anomalies and generate application plans to address the plant anomalies identified. The machine controller is connected to the diagnostic system. The machine controller uses the diagnostic system to identify a horticultural need for a plurality of plants.

[0056] The different illustrative embodiments further provide a system for managing horticultural needs comprising a resolution manager, a horticultural knowledge base, a logistics database, and a home site database. The resolution manager is configured to receive a number of images and analyze the number of images to identify a number of plant anomalies, a number of diagnoses, and a number of treatment options. The horticultural knowledge base includes information about a number of plants. The logistics database includes information about a number of plant treatments. The home site database includes information about a given area.

[0057] With reference now to FIG. 3, a block diagram of a mobile utility vehicle is depicted in accordance with an illustrative embodiment. Mobile utility vehicle 300 is an example of one implementation for mobile utility vehicle 104 in FIG. 1.

[0058] As illustrated, mobile utility vehicle 300 includes machine controller 302, propulsion system 304, steering system 306, braking system 308, sensor system 310, communications unit 312, resource application system 314, cartridge receptor 316, and data storage device 318.

[0059] Machine controller 302 includes diagnostic system 320, download module 322, authenticator 324, and control software 326. Machine controller 302 may be, for example, a data processing system, such as data processing system 200 in FIG. 2, or some other device that may execute processes to control movement of mobile utility vehicle 300. Machine controller 302 may be, for example, a computer, an application integrated specific circuit, and/or some other suitable device. Different types of devices and systems may be used to provide redundancy and fault tolerance. Machine controller 302 may be connected to the different components and systems of mobile utility vehicle 300, such as propulsion system 304, steering system 306, braking system 308, sensor system 310, communications unit 312, resource application system 314, cartridge receptor 316, and data storage device 318. As used herein, “connected to” refers to the machine controller being in communication with the different components and systems of mobile utility vehicle 300 in a manner such that information can be exchanged between machine controller 302 and the different components and systems of mobile utility vehicle 300. In an illustrative example, information may be anything that can be sent between the components and systems of mobile utility vehicle 300 to operate mobile utility vehicle 300. Examples of information include, but are not limited to, data, commands, programs, and/or any other suitable information.

[0060] Diagnostic system 320 is an illustrative example of one implementation of diagnostic system 118 in FIG. 1. In this illustrative example, diagnostic system 320 is implemented on mobile utility vehicle 300 as a component of machine controller 302. Diagnostic system 320 identifies, diagnoses, and generates treatment plans for plant problems.

[0061] Diagnostic system 320 includes resolution manager 328, horticultural knowledge base 330, and user interface 332. Resolution manager 328 may include software for generating application plan 334. Application plan 334 may be used by machine controller 302 to generate plans for execution of horticultural tasks, such as applying chemicals to treat a plant problem, for example.

[0062] Machine controller 302 may execute processes using control software 326 to control propulsion system 304, steering system 306, and braking system 308 to control movement of mobile utility vehicle 300. Machine controller 302 may also use control software 326 to coordinate the movements of each mobile utility vehicle receiving commands from machine controller 302. Machine controller 302 may execute processes using control software 326 to control resource application system 314 and sensor system 310. Machine controller 302 may execute processes using horticultural knowledge base 330 to control tasks being performed by mobile utility vehicle 300, such as resource application by resource application system 314 and/or image capturing by sensor system 310 using number of cameras 336, for example.

[0063] Machine controller 302 may send various commands to these components to operate the mobile utility vehicle in different modes of operation. These commands may take various forms depending on the implementation. For example, the commands may be analog electrical signals in which a voltage and/or current change is used to control these systems. In other implementations, the commands may take the form of data sent to the systems to initiate the desired actions. Machine controller 302 may be a single processing unit, two processing units, or distributed across a number of processing units. As used herein, a number refers to one or more processing units.

[0064] Download module 322 provides for updates of horticultural knowledge base 330 through a control system or remote location, such as back office 106 in FIG. 1. Download module 322 may also provide mobile utility vehicle 300 access to application plans, and other information located at a remote location, such as back office 106 in FIG. 1.

[0065] Horticultural knowledge base 330 contains information about the operating environment, such as, for example, a fixed map showing the landscape, structures, tree locations, flowerbed locations, individual plant locations, and other static object locations. Horticultural knowledge base 330 may also contain information, such as, without limitation, plant species and varieties located in the operating environment, information about the water needs, growth stages, and life cycles of the plant species and varieties located in the operating environment, current weather for the operating environment, weather history for the operating environment, specific environmental features of the operating environment that affect mobile utility vehicle 300, and/or any other suitable information for management and execution of horticultural tasks. The information in horticultural knowledge base 330 may be used to perform classification, identify anomalies, diagnose problems, and plan actions for horticultural tasks. Horticultural knowledge base 330 may be located entirely in mobile utility vehicle 300 or parts or all of horticultural knowledge base 330 may be located in a remote location, such as back office 106 in FIG. 1, which is accessed by mobile utility vehicle 300.

[0066] User interface 332 may be, in one illustrative embodiment, presented on a display monitor mounted on a side of mobile utility vehicle 300 and viewable by an operator. User interface 332 may display sensor data from the environment surrounding mobile utility vehicle 300, as well as messages, alerts, and queries for the operator. In other illustrative embodiments, user interface 332 may be presented on a remote display held by an operator or located in a remote location, such as back office 106 in FIG. 1.

[0067] In these examples, propulsion system 304 may propel or move mobile utility vehicle 300 in response to commands from machine controller 302. Propulsion system 304 may maintain or increase the speed at which a mobile utility vehicle moves in response to instructions received from machine controller 302. Propulsion system 304 may be an electrically controlled propulsion system. Propulsion system 304 may be, for example, an internal combustion engine, an internal combustion engine/electric hybrid system, an electric engine, or some other suitable propulsion system.

[0068] Steering system 306 may control the direction or steering of mobile utility vehicle 300 in response to commands received from machine controller 302. Steering system 306 may be, for example, an electrically controlled hydraulic steering system, an electrically driven rack and pinion steering system, an Ackerman steering system, a skid-steer steering system, a differential steering system, or some other suitable steering system.

[0069] Braking system 308 may slow down and/or stop mobile utility vehicle 300 in response to commands from machine controller 302. Braking system 308 may be an electrically controlled braking system. This braking system may be, for example, a hydraulic braking system, a friction braking system, or some other suitable braking system that may be electrically controlled.

[0070] Resource application system 314 is an example of one type of system that may be located on mobile utility vehicle 300 for executing a horticultural task, such as applying chemicals to treat an identified plant problem. Resource application system 314 also enables mobile utility vehicle 300 to apply a resource, such as a chemical, to a plurality of individual plants, such as individual plants 112, 114, and 116 in FIG. 1. Resource application system 314 includes applicator 338. Applicator 338 may be any type of component or device configured to apply a resource to a surface. Applicator 338 may include, for example, without limitation, a hose, nozzle, pump, sprayer, tubing, wiper, cloth, roller, laser, electromagnetic wave generator, light emitter, mister, fogger, duster, atomizer, gas stream, mechanical finger, and/or any other suitable applicator. Applicator 338 may include number of valves 340 for starting and stopping the flow of a resource.

[0071] Cartridge receptor 316 is an illustrative example of a type of resource storage system used by mobile utility vehicle 300. Cartridge receptor 316 is configured to receive and secure number of cartridges 342. Number of cartridges 342 is an illustrative example of one implementation of number of cartridges 128 in FIG. 1. Number of cartridges 342 includes number of resource reservoirs 344 and number of resources 346. Each cartridge may include one or more partitioned resource reservoirs containing one or more resources. The resources within the one or more resource reservoirs of a cartridge may be homogenous and/or heterogeneous.

[0072] Number of cartridges 342 may also include number of flow/level meters 348. Number of flow/level meters 348 monitors the amount of a resource in number of resource reservoirs 344 and the amount of a resource applied at a particular location.

[0073] In an illustrative embodiment, number of flow/level meters 348 may be, for example, a float in number of resource reservoirs 344. The vertical position of the float may be representative of the amount of resource in number of resource reservoirs 344. In an illustrative embodiment, the float may be a sensor that tracks the change of resource levels over time, and transmits the sensor data to a processing system, such as machine controller 302. In another illustrative embodiment, number of flow/level meters 348 may be a device for measuring the flow rate of a resource as the resource passes from number of resource reservoirs 344 through resource application system 314.

[0074] The amount of a resource to be applied, such as a chemical, is specified by an application plan. The actual resource applied may be estimated from resource application system 314 activity or measured using a fluid flow sensor, such as number of flow/level meters 348 in number of cartridges 342.

[0075] Sensor system 310 is a high integrity perception system and may be a set of sensors used to collect information about the environment around a mobile utility vehicle. In these examples, the information is sent to machine controller 302 to provide data in identifying how mobile utility vehicle 300 should manage resource application for horticultural problem resolution, specifically providing data about the plurality of plants and current conditions in the operating environment. In these examples, “a set” refers to one or more items. A set of sensors is one or more sensors in these examples.

[0076] Communications unit 312 is a high integrity communications system and may provide multiple redundant communications links and channels to machine controller 302 to receive information. The communication links and channels may be heterogeneous and/or homogeneous redundant components that provide fail-safe communication. This information includes, for example, data, commands, and/or instructions.

[0077] Communications unit 312 may take various forms. For example, communications unit 312 may include a wireless communications system, such as a cellular phone system, a Wi-Fi wireless system, a Bluetooth wireless system, and/or some other suitable wireless communications system. Further, communications unit 312 also may include a communications port, such as, for example, a universal serial bus port, a serial interface, a parallel port interface, a network interface, and/or some other suitable port to provide a physical communications link. Communications unit 312 may be used to communicate with a remote location, such as back office 106 in FIG. 1, or an operator.

[0078] Data storage device 318 is one example of persistent storage 208 in FIG. 2. Data storage device 318 may include application plan 350. Application plan 350 may be generated by diagnostic system 320 and stored in data storage device 318, or may be received from a remote location via download module 322.

[0079] The illustration of mobile utility vehicle 300 in FIG. 3 is not meant to imply physical or architectural limitations on the manner in which different advantageous embodiments may be implemented. Other components in addition or in place of the ones illustrated may be used. Some components may be unnecessary in some advantageous embodiments. Also, the blocks are presented to illustrate some functional components and combined and/or divided into different blocks when implemented in hardware and/or software.

[0080] For example, in some illustrative embodiment, mobile utility vehicle 300 may contain additional systems in place of or in addition to the systems depicted. For example, other systems may include, without limitation, pruning systems, cultivation systems, planting systems, and/or any other suitable system for executing horticultural tasks. Mobile utility vehicle 300 may be a general purpose mobile utility vehicle or a dedicated mobile utility vehicle. A general purpose mobile utility vehicle may have one or more interchangeable systems. A dedicated mobile utility vehicle may have one or more fixed systems.

[0081] With reference now to FIG. 4, a block diagram of a diagnostic system is depicted in accordance with an illustrative embodiment. Diagnostic system 400 is an example of one implementation of diagnostic system 118 FIG. 1 and/or diagnostic system 320 in FIG. 3.

[0082] Diagnostic system 400 includes resolution manager 402, horticultural knowledge base 404, logistics database 406, home site database 408, authorizing agent 410, communications unit 412, and user interface 414. Resolution manager 402 is an illustrative example of one implementation of data processing system 200 in FIG. 2. Resolution manager 402 identifies horticultural problems using images of plants and/or plant areas, identifies a number of diagnoses and treatment options for the problem using a number of databases, and generates a preferred set of treatment implementation options to authorizing agent 410 using the number of databases.

[0083] Resolution manager 402 includes image analyzer 416. Image analyzer 416 processes number of images 418 against horticultural knowledge base 404 to identify plant anomalies 420. Number of images 418 may be received from a camera operated by a user, such as camera 122 in FIG. 1, and/or a sensor system of a mobile utility vehicle, such as sensor system 310 of mobile utility vehicle 300 in FIG. 3.

[0084] Resolution manager 402 uses plant anomalies 420 and horticultural knowledge base 404 to identify number of diagnoses 422 and number of treatment options 424. Horticultural knowledge base 404 contains information about a number of different species and varieties of plants, plant anomalies, visible symptoms, and treatment options for plant problems. Number of diagnoses 422 is one or more diagnostic identifications of a plant problem. Number of treatment options 424 is one or more treatment options associated with the number of plant problems identified.

[0085] Resolution manager 402 processes number of diagnoses 422 and number of treatment options 424 against logistics database 406 to generate number of implementation options 426. Logistics database 406 contains information on the types of resources, resource applications, and associated monetary costs required for treatment of plant problems. Number of implementation options 426 is one or more options of how a plant problem can be treated, such as with what chemicals, by whom, and when, for example.

[0086] Resolution manager 402 processes number of implementation options 426 against home site database 408 to generate subset of implementation options 428. Home site database 408 contains information specific to a location or area, such as a yard, garden, lawn, and the like. This information may be defined by an owner of the location or area, for example. Subset of implementation options 428 are possible treatment options that fit within pre-defined guidelines or parameters of the particular area to be treated. For example, the particular area may include pet inhabitants that would limit the types of possible chemical applications for that area. In another illustrative example, the particular area may include budgetary constraints that would limit the treatment options to comply with budgetary constraints.

[0087] Resolution manager 402 sends subset of implementation options 428 to authorizing agent 410. In one illustrative example, authorizing agent 410 is a software agent authorized to make decisions on behalf of an owner, such as a home owner or area manager, for example. In another illustrative example, authorizing agent 410 is the owner. Authorizing agent 410 uses subset of implementation options 428 to generate application plan 430. Application plan 430 is a treatment plan selected for execution. Application plan 430 may include number of tasks 432. Number of tasks 432 may include, for example, without limitation, ordering a required resource, associating the required resource with a mobile utility vehicle, applying the required resource, storing remaining resource, disposing of remaining resource, and/or any other suitable task. Application plan 430 may also include at least one of an amount of resource to be applied, a number of plants on which to apply the resource, and the location of the number of plants.

[0088] Communications unit 412 is an illustrative example of one implementation of communications unit 210 in FIG. 2. In an illustrative example, where diagnostic system 400 is implemented at a location remote from a mobile utility vehicle, authorizing agent 410 may use communications unit 412 to transmit application plan 430 to a mobile utility vehicle.

[0089] User interface 414 may include a display device, such as display 214 in FIG. 2, to display application plan 430 to a user, such as user 124 in FIG. 1, for example. In another illustrative example, user interface 414 may include a number of peripheral devices, such as a keyboard and mouse, to allow a user to interact with resolution manager 402.

[0090] The illustration of diagnostic system 400 in FIG. 4 is not meant to imply physical or architectural limitations on the manner in which different advantageous embodiments may be implemented. Other components in addition or in place of the ones illustrated may be used. Some components may be unnecessary in some advantageous embodiments. Also, the blocks are presented to illustrate some functional components and combined and/or divided into different blocks when implemented in hardware and/or software.

[0091] For example, in some advantageous embodiments, one or more of horticultural knowledge base 404, logistics database 406, and home site database 408 may be located in whole or in part at a location remote from diagnostic system 400 and accessible to resolution manager 402 using communications unit 412.

[0092] With reference now to FIG. 5, a block diagram of a plurality of databases is depicted in accordance with an illustrative embodiment. Plurality of databases 500 may be located in a mobile utility vehicle, such as mobile utility vehicle 104 in FIG. 1 and mobile utility vehicle 300 in FIG. 3, or distributed across both a remote location and a mobile utility vehicle.

[0093] Plurality of databases 500 includes cartridge authentication database 502, application plan authentication database 504, and other databases 506. Cartridge authentication database 502 contains information about the type of cartridge receptor associated with a particular mobile utility vehicle and the corresponding cartridges that are compatible with each type of cartridge receptor. Application plan authentication database 504 contains information about the authoritative sources authorized to generate application plans for a particular mobile utility vehicle and/or a specific location or area.

[0094] An authenticator of a mobile utility vehicle, such as authenticator 324 in FIG. 3, may access cartridge authentication database 502 and application plan authentication database 504 to authenticate number of cartridges 342 and/or application plan 350 in FIG. 3, for example.

[0095] With reference now to FIG. 6, a block diagram of a horticultural knowledge base is depicted in accordance with an illustrative embodiment. Horticultural knowledge base 600 is an example of a knowledge base component of a diagnostic system, such as horticultural knowledge base 330 of mobile utility vehicle 300 in FIG. 3. For example, horticultural knowledge base 600 may be, without limitation, a component of a navigation system, an autonomous machine controller, a semi-autonomous machine controller, or may be used to make horticultural management decisions regarding operating environment activities and coordination activities.

[0096] Horticultural knowledge base 600 includes fixed knowledge base 602, online knowledge based 604, and learned knowledge base 606.

[0097] Fixed knowledge base 602 contains static information about the operating environment of a mobile utility vehicle. Fixed knowledge base 602 includes work area maps 608, plant species 610, plant varieties 612, water needs 614, growth stages 616, life cycles 618, object database 620, pruning patterns 622, cultivation methods 624, and winterization methods 626. Work area maps 608 contains information about the operating environment of a mobile utility vehicle such as, without limitation, a fixed map showing the landscape, structures, tree locations, flowerbed locations, individual plant locations, and other static object locations.

[0098] Plant species 610 contains information about the characteristics of various plant species. For example, characteristics of various plant species may be, without limitation, trunk, bark, branching system, stem size, leaf pattern, budding, non-budding, color, growth pattern, preferred sunlight, preferred soil moisture, preferred soil pH, and the like. Plant varieties 612 contain information about the characteristics of the different plant varieties or cultivars of the various plant species found in plant species 610. For example, characteristics of different plant varieties or cultivars of the various plant species may be, without limitation, color, size, growth pattern, budding pattern, preferred sunlight, preferred soil moisture, preferred soil pH, and the like. A cultivar is a cultivated plant that has been selected and given a unique name because of its decorative or useful characteristics. A cultivar is usually distinct from similar plants and when propagated it retains those characteristics.

[0099] In an illustrative embodiment, some examples of various characteristics of preferred soil moisture may be, without limitation, more water than average rainfall for the year, more water during growth stage, no water during dormancy period, well-drained soil, and the like. In another illustrative embodiment, some examples of various characteristics of color and size may be, without limitation, green leaves with white margins, green leaves with irregular wide light yellow margins, chartreuse to gold leaves with dark green margins, dark blue leaves with yellow shades, large leaves chartreuse to gold, green leaves with wide gold centers and white streaks between, and the like.

[0100] Water needs 614 contains information about the typical water needs associated with each plant species and plant variety or cultivar found in plant species 610 and plant varieties 612, according to the growth stage and life cycle of the plant. Growth stages 616 contains information about the typical growth stages, or expected growth stages, associated with each plant species and plant variety found in plant species 610 and plant varieties 612. Expected growth stages may be, for example, the growth height, bloom, flowering, and/or any other suitable growth stage indicator used for determining the developmental stage of a particular plant. Life cycles 618 contains information about the typical life cycles associated with each plant species and plant variety found in plant species 610 and plant varieties 612. For example, life cycles 618 may indicate whether a particular plant species or variety is an annual or a perennial. Perennials, especially small flowering plants, grow and bloom over the spring and summer die back every autumn and winter, then return in the spring from their root-stock. Annuals will typically germinate, flower, and die within one year, unless they are prevented from setting seed. Some seedless plants can also be considered annuals even though they do not flower. The life cycle of an individual plant varies and depends upon the point in the growing season as well as the type of plant species and variety.

[0101] Object database 620 contains fixed information about objects that may be identified in an operating environment, which may be used to classify identified objects in the environment. This fixed information may include attributes of classified objects, for example, an identified object with attributes of tall, narrow, vertical, and cylindrical, may be associated with the classification of “tree trunk.” Fixed knowledge base 602 may contain further fixed operating environment information. Fixed knowledge base 602 may be updated based on information from learned knowledge base 606.

[0102] Pruning patterns 622 contains information about how to prune a particular plant variety and/or species. Pruning patterns 622 may include a heading back cut, a thinning out cut, a topping off cut, deadheading, and/or any other suitable pruning method. A heading back cut is a pruning pattern that cuts back to an intermediate point of growth. A thinning out cut is a pruning pattern that cuts back to some point of origin, such as removal of an entire shoot, limb, or branch at its point of origin on the plant. A topping off cut is a pruning pattern that involves removing all branches and growths down to a few large branches or to the trunk of the tree. Deadheading is a pruning pattern that removes spent flowers or flower heads for aesthetics, to prolong bloom for up to several weeks or promote re-bloom, or to prevent seeding.

[0103] Cultivation methods 624 contains information about how to cultivate a particular plant variety and/or species. Cultivation methods 624 may include information on how to perform certain tasks, such as, without limitation tilling or working the soil, removing weeds, harvesting plants, and/or any other suitable cultivation task. Different methods for tilling or working the soil may include, without limitation, turning the soil, aerating the soil, and/or any other suitable method of working the soil. For example, working the soil may be necessary when the soil becomes hardened, such as when soil receives moisture and then dries rapidly forming a hardened crust which prevents further moisture from penetrating the soil to reach the plant roots. Cultivation methods 624 may also take into account the root depth of a particular plant when providing appropriate methods for a particular plant variety or species. For example, a plant with shallow roots may require a passive tool for working the soil, such as a hoe, while a plant with a deep root system may allow for the use of an active tool for working the soil, such as a rotor till.

[0104] Different methods for removing weeds may include, without limitation, physical methods, chemical methods, and/or any other suitable method for removing weeds. For example, physical methods may include ploughing to cut the roots of the weeds or pulling the weeds up from the soil. Chemical methods may include distributing herbicides across the area in which weeds are growing. Different methods for harvesting may include, without limitation, reaping, picking, cutting, or otherwise removing mature crops, fruit, vegetables, flowers, and/or any other plant yield.

[0105] Winterization methods 626 contains information about how to winterize a particular plant variety and/or species. Winterization methods 626 may include methods such as, without limitation, pruning old growth, adding organic matter, blanketing dormant plants for insulation, and/or any other suitable winterization method. For example, blanketing dormant plants may include using shredded leaves, straw, or other suitable organic material to cover the plant to a certain depth, such as insulating a plant with two feet of shredded leaves.

[0106] Online knowledge base 604 may be accessed with a communications unit, such as communications unit 312 in FIG. 3, to wirelessly access the Internet. Online knowledge base 604 dynamically provides information to a machine control process which enables adjustment to sensor data processing, site-specific sensor accuracy calculations, and/or exclusion of sensor information. For example, online knowledge base 604 may include current weather conditions of the operating environment from an online source. In some examples, online knowledge base 604 may be a remotely accessed knowledge base. This weather information may be used by control software 326 in machine controller 302 in FIG. 3 to determine which sensors to activate in order to acquire accurate environmental data for the operating environment. Weather, such as rain, snow, fog, and frost may limit the range of certain sensors, and require an adjustment in attributes of other sensors in order to acquire accurate environmental data from the operating environment. Other types of information that may be obtained include, without limitation, vegetation information, such as foliage deployment, leaf drop status, and lawn moisture stress.

[0107] Learned knowledge base 606 may be a separate component of horticultural knowledge base 600, or alternatively may be integrated with fixed knowledge base 602 in an illustrative embodiment. Learned knowledge base 606 contains knowledge learned as the mobile utility vehicle spends more time in a specific work area, and may change temporarily or long-term depending upon interactions with online knowledge base 604 and user input. Learned knowledge base includes observed plant growth stage 628, visual plant stress data 630, observed actual resource use 632, and application plan 634. Observed plant growth stage 628 contains information collected by a sensor system, such as sensor system 310 in FIG. 3, detecting the actual plant growth stage of an individual plant, such as individual plants 112, 114, and 116 in FIG. 1. The information in observed plant growth stage 628 may be compared to the typical plant growth stage information located in growth stages 616, and used to adjust the treatment and water application to an individual plant. Visual plant stress data 630 contains information collected by a sensor system about an individual plant that is in distress, shows visual signs of stress, or has visual anomalies. The information in visual plant stress data 630 can be used to adjust the treatment and resource application of the individual plant in order to address the plant stress observed.

[0108] Observed actual resource use 632 contains information collected by a sensor system about soil moisture, water retention, and actual amount of resource applied. Observed actual resource use 632 is learned information about the actual resource applied to an individual plant that can be used by a processing system, such as diagnostic system 320 in machine controller 302 in FIG. 3, to adjust or maintain the amount of resource applied in future treatment applications.

[0109] Application plan 634 contains information about the amount of resources that should be applied to each individual plant, such as individual plants 112, 114, and 116 in FIG. 1. Resources may be, for example, without limitation, water, chemicals, fertilizer, herbicide, plant food, pesticide, and the like. In one illustrative embodiment, application plan 634 is transmitted to a mobile utility vehicle, such as mobile utility vehicle 300 in FIG. 3, either through download module 322 or communications unit 312 in FIG. 3.

[0110] In another illustrative embodiment, application plan 634 is calculated by a processing system, such as diagnostic system 320 in FIG. 3, using the learned data from observed plant growth stage 628, visual plant stress data 630, and observed actual resource use 632, as well as the fixed data from fixed knowledge base 602. A mobile utility vehicle, such as mobile utility vehicle 300 in FIG. 3, fulfills application plan 634 by moving within the operating environment to collect resources from a resource source, such as home location 136 in FIG. 1, and apply the resource to the plurality of plants, such as plurality of plants 110 in FIG. 1. Application plan 634 may be instructions for applying a specific amount of a resource or resources to a plurality of plants. In these examples, application plan 634 may be directed to an individual plant, such as individual plant 112 in FIG. 1, or may be directed to a plurality of plants, such as plurality of plants 110 in FIG. 1.

[0111] In another illustrative example, learned knowledge base 606 may detect the absence of a tree that was present the last time it received environmental data from the work area. Learned knowledge base 606 may temporarily change the environmental data associated with the work area to reflect the new absence of a tree, which may later be permanently changed upon user input confirming the tree was in fact cut down. Learned knowledge base 606 may learn through supervised or unsupervised learning.

[0112] The information in horticultural knowledge base 600 may be used to identify plant anomalies and plan actions for treatment of plant problems. Horticultural knowledge base 600 may be located entirely in a mobile utility vehicle, such as mobile utility vehicle 300 in FIG. 3, or parts or all of horticultural knowledge base 600 may be located in a remote location, such as back office 106 in FIG. 1, which is accessed by a mobile utility vehicle.

[0113] With reference now to FIG. 7, a block diagram of a logistics database is depicted in accordance with an illustrative embodiment. Logistics database 700 is an illustrative example of one implementation of logistics database 406 in FIG. 4.

[0114] Logistics database 700 includes information about the resources, resource application, and cost of addressing different plant problems. Logistics database 700 may include, for example, without limitation, number of plant problems 702, number of resources 704, number of resource application types 706, number of resource application amounts 708, and number of associated monetary costs 710.

[0115] Number of plant problems 702 contains information about a number of different problems associated with plants. For example, number of plant problems 702 may include plant health issues, animal issues, fungi issues, bacterial issues, environmental issues, and/or any other issue affecting a plant. Number of resources 704 contains information on a number of different resources associated with treatment of number of plant problems 702. Number of resources 704 may include identification of number of chemicals 712 and number of natural resources 714, for example. Each resource in number of resources 704 may be associated with one or more plant problems in number of plant problems 702.

[0116] Number of resource application types 706 contains information about types of applications available for given resources. Each application type in number of resource application types 706 may be associated with one or more resources from number of resources 704. Number of resource application amounts 708 contains information about the amount of a given resource associated with treatment of a given plant problem. Number of associated monetary costs 710 contains information about the monetary costs associated with each of number of resources 704, number of resource application types 706, and number of resource application amounts 708.

[0117] With reference now to FIG. 8, a block diagram of a home site database is depicted in accordance with an illustrative embodiment. Home site database 800 is an example of one implementation of home site database 408 in FIG. 4.

[0118] Home site database 800 contains information specific to a given area or location. The information in home site database 800 may be defined by an owner of the given area or location, for example, such as a home owner or property manager.

[0119] Home site database 800 is associated with area 802 in this illustrative example. Home site database 800 includes area weather 804, area schedule 806, area inhabitants 808, environmental impacts 810, area budget 812, area brands 814, and available applicators 816. Area weather 804 may include information about the current weather for area 802 and/or weather forecasts for area 802. Area weather 804 may be downloaded to home site database 800 using a processing system, such as diagnostic system 400 in FIG. 4, in one illustrative embodiment. In another illustrative embodiment, area weather 804 may be obtained with online access to the Internet using a communications unit, such as communications unit 412 in FIG. 4.

[0120] Area schedule 806 contains information about scheduled events and/or use of area 802. In an illustrative example, area schedule 806 may include, without limitation, dates and times when the area is occupied, dates and times when the area is unoccupied, dates and times when the area is occupied by humans, dates and times when the area is occupied by pets, dates and times when the area is occupied by children, dates and times when resource application is prohibited, dates and times when resource application is preferred, and the like.

[0121] Area inhabitants 808 contain information about the anticipated or expected human and/or animal inhabitants of area 802. For example, area inhabitants 808 may contain information about the type of pets who frequent area 808, such as cats or dogs. Environmental impacts 810 contains information about the environmental impact to area 802 associated with a given resource application.

[0122] Area budget 812 contains information about the pre-defined monetary expenditure constraints placed on resource application to area 802. For example, area budget 812 may include a monthly budgetary allotment that a treatment plan must fall within to be acceptable for application to area 802. Area brands 814 contains information about pre-defined product brands, preferred applicators, chemical handling guidelines, and other parameters defined by an owner for treatment plans to area 802.

[0123] Available applicators 816 contain information about the application means available to area 802. Available applicators 816 may include, for example, without limitation, a mobile utility vehicle, special manual equipment, a preferred service, and/or any other suitable applicator.

[0124] With reference now to FIG. 9, a block diagram of an application plan is depicted in accordance with an illustrative embodiment. Application plan 900 is an example of one implementation of application plan 350 in FIG. 3.

[0125] Application plan 900 contains information about the amount of a resource or resources that should be applied to a given plant, such as individual plants 112, 114, and 116 in FIG. 1. Application plan 900 may be instructions for applying a specific amount of a resource or resources to a plurality of plants. In these examples, application plan 900 may be directed to an individual plant, such as individual plant 112 in FIG. 1, or may be directed to a plurality of plants, such as plurality of plants 110 in FIG. 1.

[0126] As illustrated, application plan 900 includes, for example, plant identification 902, plant location 904, resource type 906, amount of resource 908, application type 910, and application time 912. These different components of application plan 900 are used to identify the plant to be treated as well as the amount of resource to be applied to that plant, the type of application for the resource, and when the resource is to be applied.

[0127] Plant identification 902 includes information identifying the species and variety of an individual plant or group of plants. The information in plant identification 902 is obtained using components of a fixed knowledge base, such as plant species 610 and plant varieties 612 of fixed knowledge base 602 in FIG. 6, as well as a sensor system, such as sensor system 310 in FIG. 3.

[0128] Plant location 904 includes information about the location of a plant or group of plants. For example, plant location 904 may contain information about the location of an individual plant, such as individual plant 112 in FIG. 1, information about the location of a group of plants, such as plurality of plants 110 in FIG. 1, and/or information about the location of an area with a plurality of plants, such as area 108 in FIG. 1.

[0129] Resource type 906 identifies the resource or resources to be applied to the plant identified. Amount of resource 908 is the amount of resource required for application to a plant or group of plants after a diagnostic system has determined application plan 900. Application type 910 includes information about the type of application and/or applicator to be used to apply the resource to the plant identified in application plan 900. Application time 912 contains information about the time required for application and/or the frequency of application for the resource identified.

[0130] In one illustrative embodiment, application plan 900 is transmitted to a mobile utility vehicle, such as mobile utility vehicle 300 in FIG. 3, either through download module 322 or communications unit 312 in FIG. 3. In another illustrative embodiment, application plan 900 is calculated by a processing system, such as diagnostic system 320 in machine controller 302 in FIG. 3.

[0131] With reference now to FIG. 10, a block diagram of a sensor system is depicted in accordance with an illustrative embodiment. Sensor system 1000 is an example of one implementation of sensor system 310 in FIG. 3.

[0132] As illustrated, sensor system 1000 includes, for example, near-infrared camera 1002, visible light camera 1004, soil moisture sensor 1006, rain sensor 1008, temperature gauge 1010, wind sensor 1012, ambient light sensor 1014, global positioning system 1016, and structured light sensor 1018. These different sensors may be used to identify the operating environment around a mobile utility vehicle and to identify plant anomalies in a number of plants. The sensors in sensor system 1000 may be selected such that one of the sensors is always capable of sensing information needed to operate the mobile utility vehicle in different operating environments.

[0133] Near-infrared camera 1002 may form an image using infrared radiation. Visible light camera 1004 may be a standard still-image camera, which may be used alone for color information or with a second camera to generate stereoscopic, or three-dimensional, images. When visible light camera 1004 is used along with a second camera to generate stereoscopic images, the two or more cameras may be set with different exposure settings to provide improved performance over a range of lighting conditions. Visible light camera 1004 may also be a video camera that captures and records moving images.

[0134] The near-infrared images from near-infrared camera 1002 and visible light camera 1004 may be processed using means known in the art to identify plant species and assess plant health.

[0135] Soil moisture sensor 1006 detects the current in situ soil moisture information from specific portions of the operating environment.

[0136] Rain sensor 1008 detects precipitation on an exterior surface of the mobile utility vehicle. In one embodiment, rain sensor 1008 includes an infrared beam and an infrared sensor. In this illustrative example, rain sensor 1008 operates by beaming an infrared light at a 45-degree angle into a windshield of the mobile utility vehicle from the inside of the mobile utility vehicle. If the windshield is wet, less light makes it back to the sensor, indicating the presence of moisture on the windshield and the likelihood of rain. The illustrative embodiment is not meant to limit the architecture of rain sensor 1008. Other rain detection technologies may be used without departing from the spirit and scope of the invention.

[0137] Temperature gauge 1010 detects the ambient temperature of the operating environment. Wind sensor 1012 detects the wind speed in an operating environment. In an illustrative embodiment, temperature gauge 1010 and wind sensor 1012 are optional features of sensor system 1000. The information detected by temperature gauge 1010 and wind sensor 1012 may alternatively be received from an online knowledge base, such as online knowledge base 604 in FIG. 6. Ambient light sensor 1014 measures the amount of ambient light in the operating environment.

[0138] Global positioning system 1016 may identify the location of the mobile utility vehicle with respect to other objects in the environment. Global positioning system 1016 may be any type of radio frequency triangulation scheme based on signal strength and/or time of flight. Examples include, without limitation, the Global Positioning System, Glonass, Galileo, and cell phone tower relative signal strength. Position is typically reported as latitude and longitude with an error that depends on factors, such as ionospheric conditions, satellite constellation, and signal attenuation from vegetation.

[0139] Structured light sensor 1018 emits light in a pattern, such as one or more lines, reads back the reflections of light through a camera, and interprets the reflections to detect and measure objects in the environment.

[0140] In an illustrative embodiment, sensor system 1000 receives data from soil moisture sensor 1006 identifying the soil moisture of specific portions of the operating environment. The information about the soil moisture is processed by a processor, such as diagnostic system 320 in machine controller 302 in FIG. 3, and optionally displayed to an operator through user interface 414 in FIG. 4. In one illustrative example, user input may be received to adjust an application plan for the individual plant or plants in the specific portion of the operating environment. The user input is then used by a control system, such as control software 326 in machine controller 302 in FIG. 3, to determine which commands to send to the mobile utility vehicle's resource application system.

[0141] In another illustrative embodiment, machine controller 302 in FIG. 3 receives the soil moisture data from sensor system 1000, and interacts with horticultural knowledge base 330 in FIG. 3 in order to determine which commands to send to the mobile utility vehicle's resource application system.

[0142] With reference now to FIG. 11, a flowchart illustrating a process for managing a plant problem is depicted in accordance with an illustrative embodiment. The process in FIG. 11 may be implemented by diagnostic system 320 and control software 326 in machine controller 302 in FIG. 3.

[0143] The process begins by identifying a number of plant anomalies (step 1102). The number of plant anomalies may be, for example, a number of visible anomalies detected for plurality of plants 110 in FIG. 1. The number of plant anomalies may be detected using a number of images captured by a camera, such as number of cameras 336 of sensor system 310 in FIG. 3, for example. The plurality of plants and the number of anomalies detected may be identified using a number of databases, such as horticultural knowledge base 600 in FIG. 6 and/or logistics database 700 in FIG. 7. In an illustrative example, plant identification may be accomplished using a horticultural knowledge base, while the number of anomalies are identified using a logistics database.

[0144] Next, the process determines a number of diagnoses and a number of treatment options for the number of plant anomalies (step 1104). The diagnoses and treatment options may be determined using a knowledge base, such as horticultural knowledge base 600 in FIG. 6. The process then generates a number of implementation options (step 1106). The implementation options may be generated using a logistics database that contains corresponding plant problems and resources used to treat the plant problems, as well as the resource amounts, application types, and associated costs for the treatment options considered.

[0145] The process identifies a subset of implementation options (step 1108) for the number of plant anomalies identified. The subset of implementation options is a portion of the number of implementation options that is identified as applicable to a given area and/or location using a home site database. The home site database contains information on site-specific parameters used to filter the number of implementation options to result in the subset of implementation options.

[0146] Next, the process generates an application plan (step 1110), such as application plan 350 in FIG. 3. The application plan may be instructions for applying a specific amount of a resource or resources to a plurality of plants at a given time and location.

[0147] The process then executes the application plan in an area using a mobile utility vehicle (step 1112), with the process terminating thereafter.

[0148] The flowcharts and block diagrams in the different depicted embodiments illustrate the architecture, functionality, and operation of some possible implementations of apparatus, methods and computer program products. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of computer usable or readable program code, which comprises one or more executable instructions for implementing the specified function or functions. In some alternative implementations, the function or functions noted in the block may occur out of the order noted in the figures. For example, in some cases, two blocks shown in succession may be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

[0149] The illustrative embodiments recognize a need for an automated means of dealing with plant problems, which reduces the human labor required to address the problems and reduces chemical handling and storage.

[0150] The illustrative embodiments recognize that current methods for identifying and resolving plant problems are a labor intensive task. When a plant anomaly is noticed by a home owner, for example, the visual symptoms are diagnosed by manually browsing books or websites until a good match is found. Alternately, the home owner may take a plant or insect specimen to an expert for identification. The home owner must then also identify possible solutions to the problem, and implement the solutions manually. This implementation may involve contacting a professional lawn or gardening service, making a trip to a retailer for supplies, ordering chemicals, studying chemical application, performing the chemical application, cleaning up after the application, and then storing any unused chemicals. This current approach is time consuming and often results in leftover chemicals being stored and presenting potential safety hazards.

[0151] Therefore, the illustrative embodiments provide an autonomous horticultural resolution system that identifies plant anomalies, determines treatment plans, and applies the treatment to the plants in order to resolve the issue detected.

[0152] The description of the different advantageous embodiments has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. Further, different embodiments may provide different advantages as compared to other embodiments. The embodiment or embodiments selected are chosen and described in order to best explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.