Method and apparatus for protecting the legitimacy of an article

[0002] The present invention relates to systems for protecting the legitimacy of an article and in particular to systems for verifying the authenticity of an electronic document or article against forgery.

[0003] Verifying the authenticity of a document or article is a well-known problem that is made increasingly more difficult with the widespread use of sophisticated reproduction technologies. This is particularly the case in relation to digital media. Sophisticated reproduction systems are readily available. Even home computer systems are capable of performing reproduction functions that until not very long ago were only capable of being performed by large institutions, such as government agencies and large corporations, due to the resources that were required. Thus, technology capable of facilitating the counterfeiting or misuse of documents is widespread. Consequently, attempts have been made to provide methods and systems for verifying the authenticity of documents and articles such as identification cards against forgery or fraud.

[0004] U.S. Pat. No. 5,719,939 describes a system and method for verifying the legitimacy of a product against forgery. A pattern of overlying individual fibres is embedded in a transparent base material, so that the fibres form differing geometrical configurations. The fibres are capable of being optically scanned through a surface of the transparent base material. Subsequently, an inspector may scan the product and compare the obtained data with the stored data in an attempt to verify the authenticity of the product.

[0005] However, the security of the method disclosed in U.S. Pat. No. 5,719,939 is heavily dependent on the different geometrical configurations of the particular fibres. If the configurations are too simple, security cannot be guaranteed. On the other hand, if the configurations are too complex, the costs of the system increase significantly.

[0006] U.S. Pat. No. 5,742,685 discloses a method for verifying an identification card and recording a verification of the same. An image of a person whom the identification card is to identify is scanned to produce a digital signal associated with a text message. They are compressed, encrypted, and then coded as a two-dimensional barcode. The barcode is then printed on the back of the identification card. To verify the validity of the card, the barcode is scanned, decoded, decrypted, expanded and displayed. To perform verification, the resulting displayed image and text are compared with the corresponding information printed on the card.

[0007] While the method of U.S. Pat. No. 5,742,685 utilises a cryptographic connection between the printed image and the text on the one hand and the printed barcode on the other, there are several disadvantages of this method, relating to the practicability and complexity of the method. One such difficulty is how to compress an entire image to a size that satisfies the requirements of encryption and barcode encoding, while maintaining image quality. Significant compression can cause a significant degradation in the capacity to the recovered image with the original image. A further disadvantage is that a separate encryption/decryption key is required

[0008] There is therefore a need for an improved technique of verifying the authenticity of an article, especially an electronic document.

[0009] In accordance with a first aspect of the invention, a method of embedding linked watermarks in an article requiring protection against forgery is disclosed. The method includes the steps of: extracting information from a first portion of the article; encrypting the extracted information from the first portion; generating a watermark using the encrypted information; rendering the watermark to a second portion of the article; and repeating the extracting, encrypting, generating and rendering steps with another portion of the article until all relevant information of the article has been processed and a cryptographic link is formed thereby.

[0010] Preferably, the watermark is generated based on a selected watermark generating mechanism dependent upon the encrypted information. Further, each of the watermarks can be generated based on different watermark generation mechanism. Still more preferably, seeds for generating a watermark can be obtained from only one portion of the article or several selected portions of the article.

[0011] Preferably, the information is extracted directly from text and/or from one or more invariant features of an image. The image can depict biometric data of a person associated with the article.

[0012] Preferably, the article is an electronic document. It can also be a printed document.

[0013] In accordance with a second aspect of the invention, there is disclosed an apparatus for embedding linked watermarks in an article requiring protection against forgery. The apparatus includes: a device for extracting information from a first portion of the article; a device for encrypting the extracted information from the first portion; a device for generating a watermark using the encrypted information; a device for rendering the watermark to a second portion of the article; and a device for controlling repeated operation of the extracting, encrypting, generating and rendering devices with another portion of the article until all relevant information of the article has been processed and a cryptographic link is formed thereby.

[0014] In accordance with a third aspect of the invention, there is disclosed a computer program product having a computer readable medium having a computer program recorded therein for embedding linked watermarks in an article requiring protection against forgery, the computer program product including: a module for extracting information from a first portion of the article; a module for encrypting the extracted information from the first portion; a module for generating a watermark using the encrypted information; a module for rendering the watermark to a second portion of the article; and a module for controlling repeated operation of the extracting, encrypting, generating and rendering modules with another portion of the article until all relevant information of the article has been processed and a cryptographic link is formed thereby.

[0015] In accordance with a fourth aspect of the invention, there is disclosed an article requiring protection against forgery or fraud. The article includes: two or more portions for containing information, the information including text, biometric data, or both; two or more watermarks, each watermark printed in a respective one of the portions and being dependent upon information in a different portion, whereby a cryptographic link is formed between the two or more portions.

[0016] Preferably, the article is an electronic document. It can also be a printed document.

[0017] In accordance with a fifth aspect of the invention, there is disclosed an article requiring protection against forgery or fraud. The article is formed by the steps of: extracting information from a first portion of the article, the article having two or more portions for containing information, the information including text, biometric data, or both; encrypting the extracted information from the first portion; generating a watermark using the encrypted information; rendering the watermark to a second portion of the article; and repeating the extracting, encrypting, generating and rendering steps with another portion of the article until all relevant information of the article has been processed so that two or more watermarks are formed, each watermark being rendered in a respective one of the portions and being dependent upon information extracted from a different portion, whereby a cryptographic link is formed between the two or more portions.

[0018] In accordance with a sixth aspect of the invention, there is disclosed a method of forming an article requiring protection against forgery. The method includes the steps of: generating an invisible watermark dependent upon information contained in the article; and rendering the watermark within an official seal placed on the article, the official seal being a securely controlled item of an authority.

[0019] Preferably, the article is an electronic document. It can also be a printed document.

[0020] Preferably, the method includes the steps of: extracting information from a portion of the article; and encrypting the extracted information. The information can be extracted directly from text, or from one or more invariant features of an image. The image can depict biometric data of a person associated with the article.

[0021] In accordance with a seventh aspect of the invention, there is disclosed an apparatus for forming an article requiring protection against forgery. The apparatus includes: a device for generating an invisible watermark dependent upon information contained in the article; and a device for rendering the watermark within an official seal placed on the article, the official seal being a securely controlled item of an authority.

[0022] In accordance with an eighth aspect of the invention, there is disclosed a computer program product having a computer readable medium having a computer program recorded therein for forming an article requiring protection against forgery. The computer program product includes: a module for generating an invisible watermark dependent upon information contained in the article; and a module for rendering the watermark within an official seal placed on the article, the official seal being a securely controlled item of an authority.

[0023] In accordance with a ninth aspect of the invention, there is disclosed an article requiring protection against forgery or fraud. The article includes: a portion containing information, the information including text, biometric data, or both; an official seal placed on the article, the official seal being a securely controlled item of an authority; and an invisible watermark dependent upon the information and being rendered within the official seal.

[0024] Preferably, the article is an electronic document. It can also be a printed document.

[0025] In accordance with a tenth aspect of the invention, there is disclosed an article requiring protection against forgery or fraud. The article is formed by the steps of: generating an invisible watermark dependent upon information contained in the article, the information including text, biometric data, or both; and rendering the watermark within an official seal placed on the article, the official seal being a securely controlled item of an authority.

[0026] In accordance with an eleventh aspect of the invention, there is disclosed a method of verifying the legitimacy of an article against forgery. The method includes the steps of: inputting the article as two or more portions; extracting at least one watermark from each portion; determining a watermark from information in each portion; comparing the extracted watermark from one portion with the determined watermark from a different portion to determine if a corresponding cryptographic link is found; and repeating the comparing step until all portions of the article have been processed, the article being verified as a legitimate article if all cryptographic links are found between the two or more portions.

[0027] Preferably, the method includes the steps of: scanning the product; and dividing the scanned product into two or more portions. It can also include the step of scanning information from a portion of the product to reconstruct a seed to a generated watermark using a cryptographic technique carried out in a process of embedding a watermark in the portion. More preferably, the method includes the step of: extracting an invariant feature from the scanned information to reconstruct the seed. The extracted, invariant feature can include biometric data.

[0028] Preferably, the method also includes the step of decrypting the scanned information to reconstruct the seed. Optionally, a cryptographic link can be a self-circle, that is referring back to itself.

[0029] In accordance with a twelfth aspect of the invention, there is disclosed an apparatus for verifying the legitimacy of an article against forgery. The apparatus includes: a device for inputting the article as two or more portions; a device for extracting at least one watermark from each portion; a device for determining a watermark from information in each portion; a device for comparing the extracted watermark from one portion with the determined watermark from a different portion to determine if a corresponding cryptographic link is found; and a device for repeating the comparing step until all portions of the article have been processed, the article being verified as a legitimate article if all cryptographic links are found between the two or more portions.

[0030] In accordance with a thirteenth aspect of the invention, there is disclosed a computer program product having a computer readable medium having a computer program recorded therein for verifying the legitimacy of an article against forgery. The computer program product includes: a module for inputting the article as two or more portions; a module for extracting at least one watermark from each portion; a module for determining a watermark from information in each portion; a module for comparing the extracted watermark from one portion with the determined watermark from a different portion to determine if a corresponding cryptographic link is found; and a module for repeating the comparing step until all portions of the article have been processed, the article being verified as a legitimate article if all cryptographic links are found between the two or more portions.

[0031] In accordance with a fourteenth aspect of the invention, there is disclosed a method of verifying the legitimacy of an article against forgery. The method includes the steps of: extracting at least one invisible watermark from an official seal, the official seal being a securely controlled item of an authority; and comparing the extracted watermark with verification information to determined if the extracted watermark matches the verification information indicating that the article is legitimate.

[0032] Preferably, the verification information is information identifying the authority.

[0033] Preferably, the method includes the step of generating a watermark dependent upon information forming part of the article to provide the verification information. The information forming part of the article can be biometrics data.

[0034] Preferably, the method includes the step of decrypting the watermark.

[0035] In accordance with a fifteenth aspect of the invention, there is disclosed an apparatus for verifying the legitimacy of an article against forgery. The apparatus includes: a device for extracting at least one invisible watermark from an official seal, the official seal being a securely controlled item of an authority; and a device for comparing the extracted watermark with verification information to determined if the extracted watermark matches the verification information indicating that the article is legitimate.

[0036] In accordance with a sixteenth aspect of the invention, there is disclosed a computer program product having a computer readable medium having a computer program recorded therein for verifying the legitimacy of an article against forgery. The computer program product includes: a module for extracting at least one invisible watermark from an official seal, the official seal being a securely controlled item of an authority; and a module for comparing the extracted watermark with verification information to determined if the extracted watermark matches the verification information indicating that the article is legitimate.

[0037] Embodiments of the invention are described hereinafter with reference to the drawings, in which:

[0038] FIG. 1 is a block diagram illustrating an article according to the first embodiment of the invention;

[0039] FIG. 2 is a symbolic diagram depicting the formation of a cryptographic watermark link in accordance with the first embodiment;

[0040] FIG. 3 is a flow diagram illustrating a method of forming and embedding watermarks in accordance with the first embodiment;

[0041] FIG. 4 is a flow diagram illustrating a method of authentication in accordance with the first embodiment;

[0042] FIG. 5 is a flow diagram illustrating a typical method of extracting invariant biometric features, which may be practised in the methods of FIGS. 3 and 4;

[0043] FIG. 6 is a flow diagram illustrating a typical method of generating a watermark, which may be practised in the methods of FIGS. 3 and 4; and

[0044] FIG. 7 is a block diagram illustrating an article according to the second embodiment of the embodiment.

[0045] A method, apparatus, and computer program product for verifying the authenticity of an electronic document or article are disclosed. Further, an improved electronic document is disclosed. In the following description of several embodiments, numerous specific details such as particular watermarking techniques are described in order to provide a more thorough description of those embodiments. It will be apparent, however, to one skilled in the art that the present invention may be practised without those specific details. In other instances, well-known features such as particular biometrics data, for example, have not been described in detail so as not to obscure the invention.

[0046] In broad terms, the embodiments of the invention provide a system for verifying the legitimacy of an electronic product against forgery or fraud. The embodiments of the invention can be used to verify the authenticity of articles formed from electronic data, including identification cards and other security related items. Other types of products that can be protected include passports, credit cards, personal identification cards, banknotes, checks or negotiable instruments, certificates, security forms, lottery tickets, and the like. Generally, the embodiments of the invention can be used in any electronic or physical documents relating to security.

[0047] In one embodiment, a watermark dependent upon the source electronic product is embedded in an electronic seal or stamp, which is incorporated in or embedded on the electronic product. This electronic “seal” or “stamp” is a controlled marking establishing the authority of the person verifying the electronic product's authenticity. For example, a notary public could embed their official electronic seal on an electronic document. The official seal is itself preferably visible. To ensure that tampering of the electronic document can be detected after the document is certified or endorsed with the stamp, an invisible watermark containing information about the authority. Alternatively, the invisible watermark can be dependent upon a portion of, portions of, or the entire document is embedded in the stamp. Thus, the authenticity of the document can be verified. In the latter case, subsequent changes to the document can be detected since the watermark in the seal will not match a watermark that is generated dependent upon the modified data.

[0048] In another embodiment, relevant information in portions of an electronic product are linked to other respective portions of the document in a cryptographic way based on invisible or visible watermarks. That is, information in a first portion of an electronic document, for example, is embedded as an invisible watermark in a second portion of the document. Information in the second portion is embedded as a watermark in a third portion. Likewise, information in the third portion can be embedded as a watermark in the first portion. Numerous other combinations and arrangements are possible.

[0049] Preferably, the product has a unique feature representation of a biometric characteristic of its owner (e.g. a facial image) printed on a first portion of the product. Using a facial recognition method, invariant features can be extracted from the first representation to form the second representation of biometric characteristics of the owner. The second representation is coded and encrypted as input for the first watermark generator. The first watermark generated (the third representation of a biometric characteristic of the owner) is printed onto a second portion of the product.

[0050] The second portion of the product may have also a first unique feature representation of another biometric characteristic of the owner, such as a picture of the person's fingerprint printed on the second portion. Using a fingerprint recognition method, invariant features can be extracted from-the above first representation (i.e. fingerprint picture) to form the second representation of the biometric characteristic of the owner. The second representation is then coded and encrypted as input of a second watermark generator. The second watermark generated (the third representation of a biometric characteristic of the owner) is printed onto a third portion of the product. This process can be repeated any number of times in a similar fashion for other portions of the product. This process continues until a coded and encrypted representation from the last portion is printed on the first portion of the product.

[0051] A cryptographic link is thereby formed. The security of the product's authentication is increased not only by verifying it through traditional authentication means, but also by verifying the correctness of the formed cryptographic link. Preferably, the cryptographic link can be implemented in a self-circle way. That is, unique information is extracted from a portion, and a corresponding watermark is formed and embedded into the same portion to protect the portion from alteration.

[0052] Again, the first representation of biometric characteristic can be an image of the persons face or fingerprint. The second representation can be invariant extracted features of the first representation. The third representation is a watermark generated from the second representation.

[0053] Optionally, other information related to the product owner's identity, including the person's ID number, birth date, birthplace, and the like, is appended to the source of the representation at a different representation level. Still further information can be used related to whole operation, such as the embedding time and the embedding place, can be appended to the source of the representation in different portions of the product. Optionally, the verification can be done at different levels based on different requirements of particular applications.

[0054] FIG. 1 is a block diagram depicting an article 100 containing security information in accordance with a first embodiment of the invention. The depicted exemplary article 100 is a passport. However, the article can be any of numerous products requiring protection against forgery, including a credit card, a bank note, a lottery ticket, a legal document, a driver's license, a birth certificate, etc. Forming linked cryptographic watermarks in several portions of the article increases the verifiable authenticity of the article 100 requiring protection against forgery or any other unauthorised modification.

[0055] The depicted passport 100 of FIG. 1 includes three regions, areas or portions 102, 120 and 140. For example, the portion 102 of the passport 100 is the cover of a passport, which normally is a separate sheet. The other portions 120 and 140 of the article or product 100 can be separate or overlapping parts of the same sheet, which is different from that of portion 102. Numerous other possibilities can be envisaged and will be readily apparent to those skilled in the art in view of the disclosure provided herein. In FIG. 1, the portions 120 and 140 do not overlap.

[0056] The first portion 102 of the passport 100 is marked with information 104 that can be used to watermark one or more other portions 120 and 140 of the article 100. The information 104 includes a first identification portion 106 and the name of the country or state 108 for which the passport is issued.

[0057] The second portion 120 of the passport 100 contains a person's photographor other depiction of their likeness 122, various pieces of data 124 about the passport and the person, and another identification portion 126. The various pieces of data 124 are typically associated with the person and include in this example the passport number, the name of the person, and both the place and date of issue of the passport.

[0058] The third portion of the passport 100 contains biometric data 142 such as the person's fingerprint, personal particulars 144 and a third identification portion 146. The personal particulars in this example include the person's age, blood group, and height.

[0059] In the article 100, one or more messages or pieces of information that are likely to be included in the article 100 (e.g. the passport) can be utilised to generate the linked watermarks or cryptographic link. Watermarking links formed in this manner significantly increase the security of the article or product 100 against undetected forgery. At the same time, the conventional means employed in the article 100 against forgery can be retained.

[0060] In the first portion 102 of the passport 100, the message to be extracted can be the “Name of Country” 108. The extracted message is encrypted. The encrypted message is then used to generate a first watermark based on the first selected watermark generating mechanism. In turn, the first watermark is printed or otherwise reproduced in at least the second portion 120. An arrow 160 extending from the first portion 102 to the second portions 120 of the passport 100 generally depicts this method in accordance with the first embodiment.

[0061] In the second portion 120 of the passport 100, the photograph or depiction 122 of the person can be used as information to generate a watermark for the third or first portions 140, 102. For example, a biometrics recognition engine can be used with the person's face contained in the image 122 to extract one or more invariant features of the person. One of the invariant features alone, or several invariant features combined, can be encrypted (for example, by hashing). The encrypted message is used to generate the second watermark based on a second selected watermark generating mechanism. The second generated watermark is rendered or printed onto the third portion 140 of the passport 100, where the person's fingerprint picture and associated messages are located. Another arrow 162 extending from the second portion 120 to the third portion 140 of the passport 100 generally depicts this process.

[0062] In turn, yet another biometric recognition engine can be used with the fingerprint 142 to extract its invariant features. Again, one of these invariant features alone or several invariant features combined can be encrypted (for example, by hashing) with the above messages. The encrypted message is used to generate a third watermark based on the third selected watermark generating mechanism. The third generated watermark is printed onto the first portion 102 of the article 100. In this manner, a cryptographic watermarking link is formed between the various portions 102, 120, 140 of the passport 100.

[0063] FIG. 2 provides a symbolic depiction of the method in accordance with the first embodiment. Various portions of an article requiring protection against forgery or unauthorised modification are depicted by dashed-line ovals 200, 220, 240 and 260, each of which is labelled area 1, area 2, area 3, . . . , area n. The number n may be dependent on the particular application of the method and can be selected by the user. Each area 200, 220, 240 is depicted containing a circle 202, 222, 242 representing extraction of a feature for the area and encryption of the extracted feature. The area 200, 220, 240 also contains another circle 204, 224, 244 depicting printing or rendering of a watermark from another area. The area 260 is meant to be a general depiction of another area and therefore its details are not shown. The dashed arrows extending between the areas 200, 220, 240, 260 indicate the relationship between features extracted and encrypted 202, 222, 242 from one area being used to print or render a watermark 204, 224, 244 of at least one other different area 200, 220, 240, 260.

[0064] With reference to the specific example of FIG. 1 and the more abstract depiction of FIG. 2, a process of authenticating an article embedded with linked watermarks according the first embodiment is explained. During the authentication process, portions of the article 100, for example, are scanned and digitised. Firstly, each portion 102, 120, 140 is checked to detect whether or not an embedded watermark is located in the relevant portion. If an embedded watermark is not detected in one or more of the portions 102, 120, 140, this result indicates that the article is a forgery. Furthermore, an extracted copy of the watermark detected in a portion under scrutiny is checked against a corresponding watermark, which is derived on the fly using a combined and encrypted message obtained from another relevant portion of the article. If the watermark rendered in the portion does not match the on-the-fly watermark, this indicates that the article is also a forgery. The foregoing authentication or verification process is carried out until all portions of the article 100 are checked. This method of verifying the legitimacy of an article against forgery or fraud does not affect any conventional or existing security features or means used in the article to protect against forgery.

[0065] FIG. 3 is a flow diagram illustrating the method of forming and embedding linked watermarks in an article in accordance with the first embodiment of the invention. Processing commences in step 300. In step 302, a “working area” or portion of the article is selected for processing. For example, the first portion 102 of the passport 100 in FIG. 1 can be selected. In step 304, an encrypted message extracted from the portion is generated. In particular, sub-step 304A extracts a feature from the portion. Preferably, this involves extracting a biometrics feature. In sub-step 304B, one ore more extracted features are selected for encryption and encrypted. One skilled in the art will appreciate that the sub-steps 304A and 304B can be implemented as separate steps. In step 306, a watermark is formed or generated using the encrypted message. While step 306 as depicted in FIG. 3 only indicates that a watermark is formed, it will be appreciated from the disclosure herein that one or more watermark generation techniques can be employed. Preferably, different watermark generation techniques are utilised to generate each watermark in different “working areas”. One method of forming a watermark is to produce a noise-like random pattern using the extracted message and combine the original content and the generated pattern under the condition that no change in the original document can be readily perceived by the HVS. An example of such a technique is disclosed by Cox, I J, Killan, J, Leighton, T and Shamoon, T, Secure Spread Spectrum Watermarking for Multimedia, Tech. Rep. 95-10, NEC Research Institute.

[0066] In step 308, the generated watermark is rendered or embedded into at least one other “working area”. For example, the watermark derived from the portion 102 can be rendered or embedded in the second portion 120 of the article 100. In decision block 310, a check is made to determine if all portions of the article have been processed (i.e. is processing complete?). If decision block 310, returns false (NO), processing continues at step 302 and another portion of the article is selected as the “working area” for processing. Otherwise, if decision block 310 returns true (YES), processing terminates in step 312. Thus, the embedding method of the first embodiment is carried out until all working areas have been processed. The method produces a more secure article that can be better protected against undetected forgery or other unauthorised modification.

[0067] FIG. 4 is a flow diagram of authenticating or verifying an article embedded with linked watermarks according the first embodiment. Processing commences in step 400. In step 402, a “working area” or portion of the article is selected for processing. Preferably, steps 404 and 406 on the one hand and steps 410 and 412 on the other are performed substantially in parallel as indicated graphically in FIG. 4 where the two groups of steps form parallel branches of operations following step 402. However, one skilled in the art will appreciate that this need not be the case, and the groups of steps can be carried out sequentially instead.

[0068] In step 410, a watermark is extracted from the “working area” selected in step 402. In decision block 412, a check is made to verify the watermark obtained in step 410. If decision block 412 returns false (NO), processing preferably continues at step 420, in which a warning message is issued, before processing terminates in step 424. Step 420 is indicated with dashed lines to show that the step is optional and different processing may be implemented or omitted altogether without departing from the scope and spirit of the invention. Otherwise, if decision block 412 returns true (YES), processing continues at step 414.

[0069] In step 404, one or more features are extracted from another working area, different from the one selected in step 402. The working area for step 404 is the portion of the article from which the watermark extracted from the selected working area in step 410 is derived. Preferably, a biometric feature(s) is extracted. In step 406, one extracted feature or a combination of features extracted from the working area of step 404 are selected and encrypted. Processing then continues at step 414.

[0070] In step 414, a correlation is carried out between the verified watermark extracted from the selected working area and the output of step 406. In decision block 416, a check is made to determine whether or not the correlation result exceeds a predefined threshold. If decision block 416 returns false (NO), this indicates that the article is a forgery. Processing then preferably continues at step 420, and a warning message is given before processing terminates in step 424. Otherwise, if decision block 416 returns true (YES), processing continues at decision block 418. In decision block 418, a check is made to determine if all working areas of the article 100 have been processed. If decision block 418 returns false (NO), processing continues at step 402 and another remaining working area is selected for processing. Otherwise, if the decision block 418 returns true (YES), processing preferably continues at optional step 422. In this manner, the authentication process is carried out until a selected working area fails or all working areas are processed. In step 422, a message that the article is authenticated or has “passed” is output. Step 422 is also indicated with dashed lines to show that the step is optional, and different processing may be implemented or omitted altogether without departing from the scope and spirit of the invention. Processing then terminates in step 424.

[0071] FIG. 5 is a flow diagram illustrating an exemplary process of extracting invariant biometrics feature, which can be practised with the embodiments of the invention. Processing commences with the input of biometrics data, such as a person's facial image 500 or fingerprint, for example. Other types of biometrics data may be practised with the embodiments of the invention without departing from the scope and spirit of the invention. In step 504, the biometrics data (e.g. facial image 500 or fingerprint 502) is electronically scanned and digitised. Optionally, step 506 may be carried out if necessary to pre-process the digital data. This can involve filtering, or enhancing the data content, for example. Other conventional techniques of processing digital data can be practised without departing from the scope and spirit of the invention.

[0072] In step 508, the digital data (i.e. image) is normalised in both space and intensity based on predefined rules and landmarks. In step 510, one or more features are extracted from the normalised data. In step 512, recognition processing of the extracted features is carried out to identify invariant features. Any of a number of recognition methods can be practised. For some recognition methods, the recognition base 514 may be required as input to the recognition engine in step 512. For example, in a facial recognition system, an eigenface technique can be practised. The eigenfaces (recognition base) are previously produced by training facial samples. The invariant features can be determined by computing a projection of an input facial image onto the eigenfaces. As this is optional dependent upon the recognition method used, it is depicted using dashed lines. Finally, in step 512, the invariant biometrics features 516 are obtained using the recognition engine. The invariant features 516 can be output to the watermark generator. Normally, these features 516 have a size of a few hundred bytes.

[0073] FIG. 6 is a flow diagram illustrating a method of generating a watermark, which can be practised with the embodiments of the invention. Biometrics data or information 600 and other appending information 602 alone or together can be provided as input to the procedure. Such information is derived from a portion or working area of an article 100. In step 604, after the invariant biometric information and/or other appending information are obtained, the information is encrypted. Any of a number of encryption techniques can be practised without departing from the scope and spirit of the invention. The particular encryption technique is represented as the algorithm selection 606 that is provided as input to step 604. The encryption technique may be fixed or selected on the fly dependent on the data to be encrypted. Exemplary encryption techniques include secret mapping, hashing, and cryptographic methods such as those disclosed by Schneier, Bruce, Applied Crotography: Protocols, Algorithms, and Source Code in C, John Wiley & Sons, Inc., 1996. The selection of different algorithms can be controlled dependent upon particular applications and security requirement to increase overall security.

[0074] In step 608, a random pattern is generated based on a selected watermark generating mechanism 610. The selection can be done so that the random pattern is controlled or dependent upon the extracted message. Different random number generators can be chosen to increase overall security.

[0075] In step 612, a final watermark is formed dependent upon perceptual analysis 614 on the area to be embedded based on the Human Vision System (HVS). The strength of the watermark is also controlled by the requirements of the particular application or system requirements 616. Thus, step 612 adjusts the watermark generated in step 608 dependent upon the area embedded analysis 614 and system requirements 616. For example, by checking Discrete-Cosine Transform (DCT) or Fast Fourier Transform (FFT) components within a preselected block size, the content of the affected area can be roughly classified. A stronger or more noticeable watermark can be embedded in an area of high texture, and a weaker or less noticeable watermark can be embedded in a low texture or perhaps blank area.

[0076] In step 618, the adjusted watermark is printed, output or otherwise embedded in the assigned portion or working area. In this connection, FIGS. 1 and 2 illustrate the relationships between the generation of watermarks using data from one area and the embedding of the watermark in another area. The encryption used in the first embodiment is used not only for the purpose of concealment but also for the purpose of verification of the article or product 100. As biometric features and recognition/extraction techniques are known, those skilled in the art will appreciate that the selection and encryption of the extracted biometrics information 600 and other appended messages 602 are helpful to guarantee the security of watermark generators and the whole system. Meanwhile, the authentication is carried out using the encrypted selected message and extracted watermark. This is like verifying a digital signature.

[0077] The watermarking process and the corresponding watermark extraction process according to the first embodiment of the invention can be implemented in hardware or software form. The functionality of the processes can be implemented as electronic or software modules, the latter capable of being carried out using a computer. For example, the embodiment can be implemented as a computer program product. A computer program for protecting the legitimacy of an article can be stored on a computer readable medium. Likewise, the computer program can be one for verifying the legitimacy of an article. In each case, the computer program can be read from the medium by a computer, which in turn carries out the operations of the computer program. In yet another embodiment, the method depicted in FIG. 3 can be implemented as-an Application Specific Integrated Circuit (ASIC), for example. The methods are capable of being implemented in a number of other ways, which will be apparent to those skilled in the art in view of this disclosure, without departing from the scope and spirit of the invention.

[0078] Also, commercial printers and scanners can be used to practice the embodiments of the invention and satisfy the requirements of the system. For example, an HP Laser Jet 5 Printer offers true 600-dpi printing with resolution enhancement technology (RET), MicroFine toner, and 120 levels of grey of the smooth. A report on image quality tests of Primascan 5100 Greyscale Scanner, for example, points out that this scanner can achieve a greyscale range about 200 levels and a resolution about 500 dpi. Equipment of this type is readily available to the public. The foregoing is merely exemplary of the range-of products that can be used to practice the embodiments of the invention.

[0079] FIG. 7 is a block diagram depicting an article 700 containing security information according to the second embodiment. The depicted exemplary article 700 is a passport. However, the article can be any of numerous products requiring protection against forgery, including a credit card, a bank note, a lottery ticket, a legal document, a driver's license, a birth certificate, etc. Embedding an invisible watermark in an official seal increases the verifiable authenticity of the article 700 requiring protection against forgery or any other unauthorised modification.

[0080] The passport 700 is depicted as a single sheet, or portion, 702. It includes an identification portion 704 and the name of country 708 in a first area 704 indicated by a dashed line. It also contains a facial image 710 of the passport holder. The “Name of Country” 708 can be extracted to form a watermark. Likewise, this can be done using the identification portion alone or with the name of the country. Also, the person's picture 710 can be used to form a watermark alone or with the other information. If the facial image 710 is used, invariant features of the facial image 710 are extracted using any of a number of techniques well known to those skilled in the art. The resulting extracted message (i.e., the name of the country 708, identification portion 706 and/or invariant extracted features of image 710) is encrypted. That is a digested or encrypted message is formed. This can be done using a hash function or other cryptographic technique. The encrypted message is then used to generate an invisible watermark.

[0081] To verify the passport as being properly issued, an official seal 712 is placed on the passport sheet 702. The exemplary seal 712 includes a marking indicating its official nature, the date it is embossed or embedded on the sheet, and the signature of the signing authorised person. Numerous other possibilities for seals exist, including those of a notary public, justice of the peace, a tax official, and the like. Preferably, the seal is an electronic one. A dashed-line portion 714 indicates that the watermark formed from the extracted message is embedded in the seal and is invisible. By embedding a watermark 714 within an official seal 712, it can be ensured that the document has been properly averred to or authorised and that its contents have not been changed and only contain the information that the authorising authority considered. In this manner, a certifiable official seal is provided.

[0082] Alternatively, a watermark can be embedded in the seal containing information about the authority alone or in combination with information described above. The invisible watermark authenticates and protects the owner of the seal that is applied. Only the authority has access to an unwatermarked copy of the seal. All other copies of the seal available to the public are embedded with an invisible watermark.

[0083] As described hereinbefore with reference to the first embodiment, the watermarking process and the corresponding watermark extraction process according to the second embodiment of the invention can be implemented in hardware or software form.

[0084] The foregoing embodiments of the invention provide an electronic seal of sorts, by which an electronic or printed document can be certified as authentic. In particular, articles providing protection against fraud forgery, and a method, an apparatus and a computer program product for protecting the legitimacy of an article have been described. A corresponding method, apparatus and computer program product have also been disclosed for verifying the legitimacy of an article. While only several embodiments have been set forth, it shall be apparent to those skilled in the art, in view of the disclosure herein, that numerous changes and/or modifications can be made without departing from the scope and spirit of the invention.