Method and system for context-based automated product identification and verification

[0001] 1. Technical Field

[0002] Exemplary embodiments disclosed herein relate to identifying objects and more particularly to methods and systems for providing automated verification and status identification (context) of objects using data about the objects captured via computer-enabled sensing elements.

[0003] 2. Description of the Related Art

[0004] The introduction of tagging technologies for automated product identification, e.g., bar codes and more recently radio frequency identification (RFID), revolutionizes the supply chain management process. In an ever increasing rate, these technologies permit the integration of the information technology (IT) support infrastructure in an enterprise for tracing the location of products between manufacturing plants, distribution centers, storage facilities, retail outlets, etc. The integration of the IT support infrastructure enables the automation of a supply chain, better tracking of shipments, reduction of human errors in record keeping, on-demand access to shipment status, and so on.

[0005] However, tagging techniques are only used in identifying the object/product to which the tag has been attached. Tagging techniques cannot identify the status of an object, potential mismatches, etc. For example, it would be beneficial not only to be told that a shipped object is a washing machine, but be able to verify without human intervention that this is indeed the case, or make a statement of the condition of the shipment (e.g., box is damaged), and initiate appropriate actions if something out of the ordinary has been detected.

[0006] Prior art has focused on identification of objects alone (e.g., via the use of bar codes), and identification and verification of objects involving human presence. Bellis, Jr. et al. in U.S. Patent Application no. US 2003/0018897 A1 describe a system and a method for verifying the identity of a customer at a shelf-checkout system. The method comprises capturing an image of a customer's identification at the self-checkout system and displaying the customer's identification at a location remote from the self-checkout system to verify the identity of the customer. Maloney et al. in U.S. Pat. No. 6,119,932 describe an identification verification apparatus and method that is being used to identify individuals and verify that they are eligible to take certain actions, for example, buy tobacco products from a vending machine. Both methods require individuals to supply an identification form, e.g., an ID card, to the system, which can then retrieve information from the ID card that can be used to verify the individuals.

[0007] Taylor et al. in PCT Application WO 01/35326 A1 propose a method for identification or verification of an object class using a model based upon appearance parameters that are derived by comparing images of objects of different classes.

[0008] The main focus of the prior art has been that of the identification of a random object that “spontaneously” appears at a location to execute some function. This situation is best exemplified by humans appearing at a waiting line, e.g., a check-out line, or a line to a vending machine, to complete a transaction, e.g., buying merchandise.

[0009] Due to privacy concerns, automatic identification of humans via electronic surveillance and identification means remains a debatable issue. Supply chains are not faced with such concerns and more and more shipped goods are equipped with RFIDs. This permits the goods to be identified without the need for intervention by a human inspector. However, as mentioned, the mere identification of goods is not sufficient to guarantee that a shipment is in order.

[0010] It would be advantageous to have an improved method and system that will automatically verify that a (shipped) item is indeed what its identification says it is, evaluate the condition of the item, and decide whether it appears, or not appears, at the right place and at the right time.

[0011] The present embodiments provide a method and a system for automated verification and status identification (context) of objects using data about the objects captured via computer-enabled sensing elements. The objects may include goods tagged with electronic identifiers. The objects are shipped from one location to another and identified via their electronic identifiers. Moreover, the objects are scanned at the various locations by a number of sensing devices. The outcome of sensing is then compared with stored information describing the object and pointed at by their electronic identifier. The comparison is used to automatically verify that the scanned object is as identified and to evaluate its condition.

[0012] These and other objects, features and advantages will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.

[0017] Exemplary embodiments disclosed herein aim at addressing the automated verification of objects using context information related to the object. An object as applied herein is a general term that includes anything that needs to be identified and verified, e.g., consumer goods, inventory, or other tangible things that have an identity, physical condition and/or status are also included. The present embodiments take advantage of tagging technologies that identify an object. The identification context information related to the object (e.g., dimensions, weight, color, shape, predefined responses to testing stimuli, shipment logs—to see whether the items were expected in the first place, etc.) is retrieved.

[0018] The context information retrieved for an object is subsequently correlated to how the object looks and/or behaves. Based on this, the object can be verified and, if necessary, corrective actions can be initiated. Furthermore, embodiments disclosed can adjust to new products on-the-fly, in that the system does not have to reset every time a new type of product needs to be identified and verified (e.g., after finishing with the washing machines, the dryers can be immediately handled).

[0019] It should be understood that the elements shown in the FIGS. may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software used in conjunction with one or more appropriately programmed general-purpose digital computers having a processor and memory and input/output interfaces. System and methods in accordance with this disclosure assists in the identification and verification of shipped goods in a supply chain as these goods are passing via inspection centers at various stops of the supply chain, e.g., a distribution center, a warehouse, a port, etc. It should be understood though that the embodiments described herein are not restricted only to supply chains. By way of example only, exemplary embodiments of the present invention may be applicable not only to a particular product, but also shipping containers, assembly lines, and so on.

[0020] Referring now to the drawings in which like numerals represent the same or similar elements and initially to FIG. 1, an exemplary implementation 10 includes an item 100 ready to be shipped from one location to another. Item 100 may include a boxed product, e.g., a washing machine, an unboxed item, e.g., an automobile, a container of products or other objects. The concepts described herein are equally applicable to any of these alternatives and may be applied recursively at various levels, e.g., first at the level of a container shipped as a single unit by a shipping company, or the individual items inside the container prior to or after they have been removed from the container.

[0021] Item 100 is shown to be tagged with a radio frequency identification (RFID) tag or bar code tag 101. The RFID tag includes information 102 that can be used to retrieve information regarding the item 100. According to one embodiment, the information on the RFID tag 101 may include a protocol version (prtvr) identifier 121 describing the format of the information used by this RFID tag 101; a manufacturer (mnfctr) identifier 122 used to identify the manufacturer of the tagged item 100; a product classification (prctClass) identifier 123 used to identify the type of the tagged item 100, e.g., a washing machine; and a serial number (serialNo) identifier 124 used to identify the specific item 100.

[0022] The product classification identifier 123 and serial number identifier 124 may serve as pointers to product and specific item description databases 103 and 105, respectively. The product description database 103 includes information records 104 that describe the general characteristics of the item 100. According to one embodiment, information records 104 include information like an item description (prdDescr) 125; an image of the item (image) 126; the physical dimensions of the item (dims) 127; the weight of the item (weight) 128; and a pointer to design and manufacturing data (D&Mp) 129. The data 129 may provide information about the designer of the item, when it was originally designed, the locations it is being manufactured, etc. The various elements of a record 104 may point to additional records providing more detailed information. For example, the dimensions 127 and weight 128 elements may point to a data structure that includes the dimensions and weight of the item before and after it is being packaged in a carton box.

[0023] The item description database 105 includes information records 106 relevant to the specific item instance. According to one embodiment, the information records 106 may include color of the item (color) 130; the date that item 100 was manufactured (dateMan) 131; the data that the item was shipped (dateSh) 132; the item's current location (curLoc) 133; the item's next location (nxtLoc) 134, and so on.

[0024] As before, the various elements of a record 106 may point to additional records providing more detailed information. For example, the ship date and current location elements may point to data structures that provide information regarding all the inspection stations that the item has already gone through and the dates and times that they were inspected.

[0025] The information records in databases 103 and 105 identify the characteristics of the tagged item(s) 100. The information stored in the databases 103 and 105 will be used during the verification of the item.

[0026] Referring to FIG. 2, a particularly useful exemplary embodiment is shown for an identification and verification (IDV) station 200. Station 200 is employed to identify an item passing through station 200 and collect additional information to assist in the verification of the item.

[0027] In FIG. 2, items (e.g., 205 and 206) are placed on a conveyor belt 204 whose path passes through the IDV station 200. The IDV station 200 comprises an RFID reader 201 for reading RFID tags 101 attached onto the item 205, 206; a collection of object scanners 202, like a video camera, a laser scanner, etc.; and weighing scale 203, which can also be thought as a type of scanner.

[0028] The RFID reader 201 is used to read the information stored in the RFID tags 101 attached on the item 205, 206. This information is used for the identification of the item 205. The object scanners 202 and the weighting scale 203 are used to take snapshots of the physical characteristics of the product. Particularly, the video camera and the digital camera can be used to identify the color of the item as well as its relative size, compared with other known items in the picture, for example the item may be photographed as it passes in front of a measuring ruler, or other measurements or comparisons may also be made. The laser scanner can be used to obtain the 3D dimensions of the item. The cameras and the laser scanner can also assist in identifying deformities on item. X-rays or other irradiation techniques may incorporated into scanner 202 to retain a record of the internal contents and ensure no tampering has occurred especially in transit. The weighting scale is used of course to measure the weigh of the item. The measurements obtained from the RFID reader 201, the object scanners 202 and the weighting scale 203 feed a module 207, e.g., an identification and verification module described below.

[0029] Referring to FIG. 3, a process to assist the identification and verification of the items that have passed through the IDV station 200 in FIG. 2 is illustratively shown. In the embodiment of FIG. 3, the object identification and verification module 300 uses the information read from the RFID tag 101 on the item 205 (FIG. 2) to retrieve information about this item from a shipment database 301. The shipment database 301 includes information about the items expected to be received or are maintained at a given location where the identification and verification operation occurs. According to one embodiment, shipment information is sent along the path of the shipping route to support the proper tracking of a shipped item. The shipment database 301 may include information records 302 describing the physical characteristics of the object (e.g., size, color, weight).

[0030] In one embodiment, the aforementioned information may reside on and be retrieved from a database (not shown) separate from the shipment database. Next, the item snapshot information derived when the item passed through the IDV station is matched in block 303 against any pertinent information record(s) in the shipment database 301. If a match exists, an event is logged in block 304 and an entry is made in a “supply chain” database 305. The supply chain database 305 maintains information records 306 pertinent to the shipping status of an item, e.g., the location and time the item was last scanned, whether it was an item expected at this location (match: “yes|“no”), etc.

[0031] If a match is not found, a type of mismatch is identified in block 307, for example, item not expected, mismatch in color, mismatch in shape, item deformed, contents added, contents removed, etc. Following the mismatch identification, a corrective action is taken in block 308. This may include disposing of an item, marking the item for further inspection, etc. The event is logged in block 304 and stored in the supply chain database 305, or in a separate database (not shown).

[0032] There are a number of corrective actions that can be taken in block 308. The embodiment in FIG. 3 shows a few possible ones in block 309 that may include sending a notification to anyone with the need to know of this mismatch event; the removal of the item from its current supply chain; light a warning light or sound an alarm at an inspection or monitoring station; feed information to an analysis module that calculates, for example, the percentage of mismatching, labeling the package, destroying the item, etc.

[0033] The embodiments shown and described herein are applicable to supply chain products in undocking stations at storage facilities. However, those skilled in the art could apply the core features of the present invention in other areas where automatic identification and verification is beneficial (e.g., to reduce the possibility that, for example, a visible defective part is automatically picked-up for assembly in an assembly line) without departing from the spirit of this invention.

[0034] Variations described for the present invention can be realized in any combination desirable for each particular application. Thus, particular limitations and/or embodiment enhancements described herein, which may have particular advantages to the particular application, need not be used for all applications. Also, it is to be understood that not all limitations need be implemented in methods, systems and/or apparatus including one or more concepts of the present disclosure.

[0035] The present illustrative embodiments can be realized in hardware, software, or a combination of hardware and software. Any kind of computer system—or other apparatus adapted for carrying out the methods and/or functions described herein—is suitable. A possible combination of hardware and software may include a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. The present system may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which—when loaded in a computer system—is able to carry out these methods.

[0036] “Computer program means” or “computer program” in the present context includes any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after conversion to another language, code or notation, and/or reproduction in a different material form.

[0037] Thus, the present embodiments include an article of manufacture, which comprises a computer usable medium having computer readable program code means embodied therein for causing a function described above. The computer readable program code means in the article of manufacture comprises computer readable program code means for causing a computer to affect the steps of a method in accordance with this disclosure. Similarly, the present embodiments may be implemented as a computer program product comprising a computer usable medium having computer readable program code means embodied therein for causing a function described above.

[0038] The computer readable program code means in the computer program product comprises computer readable program code means for causing a computer to effect one or more functions of this invention. Furthermore, the present embodiments may be implemented as a program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for causing one or more functions described herein.

[0039] It is to be understood that such individual components/methodologies may be implemented on one such computer system, or on more than one such computer system. In the case of an implementation in a distributed computing system, the individual computer systems and/or devices may be connected via a suitable network, e.g., the Internet or World Wide Web. However, the system may be realized via private or local networks. The embodiments are not limited to any particular network. For example, the implementation shown in FIG. 3 may convey information to multiple locations using secured or unsecured network communication to convey information over distance.

[0040] It is noted that the foregoing has outlined some of the more pertinent objects and embodiments. The concepts herein described may be used for many applications. Thus, although the description is made for particular arrangements and methods, the intent and concept of the invention is suitable and applicable to other arrangements and applications.

[0041] Having described preferred embodiments of a method and system for context-based automated product identification and verification (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments disclosed which are within the scope and spirit of the invention as outlined by the appended claims. Having thus described aspects of the invention, with the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.