Printing media and methods employing digital watermarking

[0001] The present application is a continuation-in-part of each of the following applications:

• • [0002] Ser. No. 09/127,502, filed Jul. 31, 1998 (now U.S. Pat. No. 6,345,104), which is a continuation-in-part of Ser. No. 08/967,693, filed Nov. 12, 1997 (now U.S. Pat. No. 6,122,392), which is a continuation of Ser. No. 08/614,521, filed Mar. 15, 1996 (now U.S. Pat. No. 5,745,604), which is a continuation of Ser. No. 08/215,289, filed Mar. 17, 1994, now abandoned;
  • [0003] Ser. No. 09/498,223, filed Feb. 3, 2000 (now U.S. Pat. No. 6,574,350), which is a continuation in part of Ser. No. 09/287,940, filed Apr. 7, 1999 (now U.S. Pat. No. 6,580,819), which claims priority to Ser. No. 60/082,228, filed Apr. 16, 1998; the 09/498,223 application is also a continuation Ser. No. 09/433,104, filed Nov. 3, 1999 (now U.S. Pat. No. 6,636,615), which is a continuation in part of Ser. No. 09/234,780, filed Jan. 20, 1999 (abandoned), which claims priority to application Ser. No. 60/071,983 filed Jan. 20, 1998;
  • [0004] Ser. No. 09/553,112, filed Apr. 20, 2000 (attached as Appendix D, now abandoned), which claims priority from application Ser. No. 60/131,005, filed Apr. 22, 1999;
  • [0005] Ser. No. 09/562,516, filed May 1, 2000 (attached as Appendix E)
  • [0006] Ser. No. 09/562,524, filed May 1, 2000 (now U.S. Pat. No. 6,724,912);
  • [0007] Ser. No. 09/571,422, filed May 15, 2000 (international counterpart published as WO00/70585);
  • [0008] Ser. No. 09/619,264, filed Jul. 19, 2000 (attached as Appendix H);
  • [0009] Ser. No. 09/629,401, filed Aug. 1, 2000 (now U.S. Pat. No. 6,522,770);
  • [0010] Ser. No. 09/631,409, filed Aug. 3, 2000 (attached as Appendix J);
  • [0011] Ser. No. 09/633,587, filed Aug. 7, 2000, which is a continuation-in-part of Ser. No. 09/343,104, filed Jun. 29, 1999 (abandoned), which is a continuation-in-part of Ser. No. 09/314,648, filed May 19, 1999 (now U.S. Pat. No. 6,681,028).
  • [0012] Ser. No. 09/640,806, filed Aug. 17, 2000 (now U.S. Pat. No. 6,438,231);
  • [0013] Ser. No. 09/689,289, filed Oct. 11, 2000 (attached as Appendix K), which is a continuation-in-part of Ser. No. 09/567,405, filed May 8, 2000;
  • [0014] Ser. No. 09/803,167, filed Mar. 9, 2001 (now published as US 20020126871).

[0015] Claims directed to blank paper media have earlier issued to the present assignee in U.S. Pat. Nos. 5,850,481, 5,822,436, and 6,111,954, and have been indicated as allowable (subject to Terminal Disclaimer) in application Ser. No. 09/640,806 (now U.S. Pat. No. 6,438,231).

[0016] The present invention relates to steganographic encoding of substrates—such as blank paper, wherein the encoding is not apparent or conspicuous to human observers, yet is detectable by visible light scanning of the media.

[0017] In a great variety of applications, it is desirable for documents and other substrates to convey digital information.

[0018] Printed bar codes are one way of encoding digital data on documents, but bar codes are unsuited for many applications due to aesthetics etc. Magnetic stripes can be used in some circumstances, but again the stripe is conspicuous, and reading the stripe requires a reader device that is not generally available. Radio frequency ID (RFID) is another technology that is sometimes used, but the cost is prohibitive for most applications, and specialized readers are again required.

[0019] For those situations in which the marking needs to be both inconspicuous and low cost, digital waternarking offers a promising alternative. Digital watermarking involves making subtle changes to a substrate's appearance (e.g., by ink speckling, texturing, background printing, or other techniques detailed in the literature)—changes that generally pass unnoticed by human viewers but that can be sensed by optical techniques (e.g., webcams, scanners, digital cameras) and decoded by computer processing of the resulting image data to extract the encoded information application Ser. No. 09/503,881 (now U.S. Pat. No. 6,614,914) details illustrative watermark encoding/decoding technology. A great number of other techniques are known to artisans in the field, and can be alternatively used. (The following specification commonly uses the term “watermarking” as shorthand for “digital watermarking.” This steganographic form of digital data encoding is different than the paper watermarks that have, for centuries, been used in certain documents.)

[0020] The present assignee has filed many patent applications that have dealt with digital watermarking of paper and other substrates. The present application serves to compile these various works into a consolidated filing.

[0021] Application Ser. No. 09/640,806 (now U.S. Pat. No. 6,438,231), with priority back to application Ser. No. 08/215,289, filed Mar. 17, 1994 (through intervening U.S. Pat. Nos. 5,822,436 and 6,111,954) teaches that blank photographic paper and photographic film can be pre-processed—before exposure—to encode digital watermark information. When the paper/film is thereafter developed, the encoded information permeates the exposed image. That application also discusses substrate texturing as a way of effecting digital watermarking.

[0022] Application Ser. No. 09/127,502 (now U.S. Pat. No. 6,345,104) teaches how a watermark pattern can be formed in the background of a printed document, such as by speckling small droplets of ink, or printing a mesh or weave of very thin lines. Ink-jet, intaglio, offset litho, letterpress, xerography, and other printing processes can be used. Such printing can be used to impart a tint to paper while simultaneously encoding auxiliary data (the watermark payload). Watermark encoding by texturing, such as by use of embossing pressure rollers or intaglio plates, is also discussed. Such processes can be performed by the end-user of the paper, or earlier, e.g., by a paper manufacturer. Moreover, they can be applied to the base substrate, or to a laminate layer (which may be clear) that is applied to the base substrate. The background patterning can encode both the auxiliary data payload, and calibration/orientation information that helps the decoder determine (and compensate for) rotation or scaling of the scan data prior to decoding. The encoding can extend across the entire document/substrate, or can be restricted to certain areas.

[0023] Application Ser. No. 09/562,524 (now U.S. Pat. No. 6,724,912) particularly considers watermarking of laminate layers and synthetic substrates by techniques including opacification, laser ablation and cutting, and gravure printing. This application also considers how a single sheet of blank media can be encoded to convey different watermarks in different regions.

[0024] Application Ser. No. 09/562,516 details a variety of techniques for digitally encoding blank media, including printing watermark patterns with inks whose spectral response extends into UV or IR, and printing with combinations of inks. This application also recognizes that the selection of inks can be tailored to the spectra of expected illumination sources.

[0025] Application Ser. No. 09/553,112 details how particular line patterns can be designed to encode desired digital watermark information on documents and substrates. According to one method, a watermark tile is first defined—specifying luminance values in different regions. Lines are then formed between different areas in accordance with the values in the watermark tile.

[0026] Application Ser. Nos. 09/571,422 and 09/633,587 detail how a printed document, such as a business card, greeting card, product packaging, postal mail, catalog, magazine, credit card, office document, driver's license, book jacket, event ticket, etc., can be encoded with a digital watermark that corresponds to an electronic address. When presented to an imaging system, such as a webcam-equipped computer or other device, the resulting image data is processed to decode the watermark. The device then establishes a link to the electronic address in order to provide the user with additional information or content related to the original document, or to trigger an associated action. (The electronic address can be literally encoded in the watermark. More commonly, however, the watermark encodes an identifier. After detection, the decoding device uses this identifier to access a data structure, such as a remote database, to obtain a corresponding address.) These applications also contemplate that the encoding can be applied to blank media, such as blank magazine paper stock, and blank Post-It brand adhesive note pages. After end use by a consumer, the encoding persists, permitting linking or other watermark-based functionality.

[0027] Application Ser. No. 09/631,409 expands on the foregoing—particularly considering systems that link from invoices, bank statements and checks, and other account paperwork to associated on-line resources. By such arrangements, consumers can review billing history, make electronic payments, correspond with the banking or commercial institution, print completed checks, etc.

[0028] Applications Ser. No. 09/498,223 (now U.S. Pat. No. 6,574,350) and Ser. No. 09/433,104 (now U.S. Pat. No. 6,636,615) detail “fragile” digital watermarks, i.e., watermarks that are designed to be lost, or to degrade in a predictable manner, when subject to certain forms of processing (e.g., scanning and printing, or photocopying). A watermark may be made fragile in numerous ways. One form of fragility relies on low watermark amplitude. That is, the strength of the watermark is only marginally above the minimum needed for detection. If any significant fraction of the signal is lost, as typically occurs in photocopying operations, the watermark becomes unreadable. Another form of fragility relies on the watermark's frequency spectrum. High frequencies are typically attenuated in the various sampling operations associated with digital scanning and printing. Even a high amplitude watermark signal can be significantly impaired, and rendered unreadable, by such photocopying operations. Fragile watermarks can be combined with more traditional, “robust” watermarks within a single document. The former serves to authenticate the document as an original. The latter serves to tag the document with a persistent set of auxiliary data (which can be used for any of the purposes for which watermarks are used).

[0029] Application Ser. No. 09/689,289 details particular applications of document watermarking in fields relating to stationary, postal mail and postage. Exemplary applications include document serialization, authentication, copy-control, envelope franking, internet linking, encoding of delivery address information, etc. Again, watermarking of blank printing stock is contemplated. Large lots of documents can be watermarked with the same data payload, or each sheet can convey a unique watermark payload. Corporate stationary can be marked with a fragile watermark to permit a genuine document to be distinguished from a photocopy or other reproduction.

[0030] Application Ser. No. 09/619,264 details that printers (including fax machines, photocopiers, etc.) can include optical sensors and decode watermark information from blank paper stock. This watermark can signal to the printer the particular type of paper about to be printed (e.g., glossy photo stock, corporate letterhead, etc.). The printer can then tailor its printing attributes in accordance with the particular paper being printed. The substrate watermark can be implemented using a variety of techniques, including clear inking.

[0031] Application Ser. No. 09/629,401 (now U.S. Pat. No. 6,522,770) details how office documents, such as printed spreadsheets, can include a background (or other) watermark pattern. When presented to a webcam, or other such device, an associated computer can decode the watermark and, from this information, identify where the document is stored. The document can then be loaded from such storage, and a corresponding program launched to permit on-screen review or editing. Meta-data associated with the document can also be recalled by reference to the watermark. The encoding of the watermark in the printed output can be effected transparently to the user, such as by the application program (Excel), by printer driver software, or by the printer itself.

[0032] Application Ser. No. 09/803,167, filed Mar. 9, 2001 (now published as US 20020126871) details how a substrate can be treated so that, when printed with unwatermarked text or imagery, the resulting document will be watermarked. This can be done, e.g., by locally tailoring the ink absorption attributes of different regions on the page, such as by a finely patterned waxy coating.

[0041] In accordance with one aspect, an embodiment of the invention is a substrate to which final user printing can later be applied to yield a final printed object. The substrate is characterized by having been processed prior to final user printing to yield a steganographic digital watermark pattern thereon. This pattern does not impair subsequent use of the substrate, yet conveys plural bits of digital information. The presence of such information is not apparent to a human observer of the substrate, but can be detected by visible-light scanning of the substrate to yield data from which the plural bit information can be recovered.

[0042] The steganographic digital watermark pattern can be formed by ink, which may be, e.g., speckled across at least part of the substrate. Or the ink can form a mesh of thin lines. (For example, the mesh can comprise a single pattern that is tiled across the substrate, with the pattern being arranged so that lines located at adjoining tile edges meet without discontinuity.) Such inking can serve to impart a colored tint to the substrate, and may be applied by known ink-jet printing processes.

[0043] The watermark pattern may also be defined by generating a tile specifying one of N luminance values for each of plural different areas, consolidating the N values down to M (where M<N), and then forming lines between such areas in response to the consolidated luminance values. The user may specify line criteria to be used, including whether the lines are straight or curved, and if curved parameters therefor.

[0044] The ink used in forming the watermark pattern can be of known types, including clear. The ink may be chosen to optimize watermark detection in the presence of expected illumination spectra, e.g., the illumination cast by a computer monitor.

[0045] In other embodiments the steganographic digital watermark pattern can be formed by texturing the substrate (e.g., by force of pressure, by embossing, by an intaglio plate, etc.).

[0046] In still other embodiments, the substrate can be processed to locally change its ink absorption ability.

[0047] In yet other embodiments, the substrate can include a photographic emulsion, and the watermark pattern can be formed by exposing the emulsion with a pattern (e.g., a noise-like pattern) and thereafter developing the emulsion to make the pattern detectable.

[0048] The pattern can be formed on the substrate prior to delivery of the substrate to an end user, e.g., by a producer or supplier of the substrate. Alternatively, the pattern can be formed on the substrate after such delivery.

[0049] In some embodiments, the digital watermark pattern may degrade when photocopied, so that the printed object can be distinguished from a photocopy. Such embodiments may also include a second digital watermark pattern—one that is robust against photocopying.

[0050] Depending on application, the digital watermark pattern may extend across an entire face of the substrate, or be restricted to certain areas. Likewise, only one side of the substrate—or both—can include watermark patterns. In substrates with laminate construction, the digital watermark pattern may be manifested in a laminate layer. In some embodiments, different regions of the substrate can convey different watermark payloads.

[0051] The plural bits of digital information represented by the watermark pattern can comprise an identifier that serves to convey information indicative of an electronic address. More particularly, the identifier can comprise a pointer into a remote data structure, with the remote data structure storing an electronic address corresponding to the substrate.

[0052] In some embodiments, the watermark pattern on the substrate may also convey a steganographic orientation signal.

[0053] To permit a document printed on such a substrate to be uniquely identified from other—seemingly identical—printed documents, the plural bits of digital information represented by the watermark can comprise serialization information. Alternatively, the digital information can serve to identify the type of substrate to a printer, so that the printer can tailor print parameters accordingly.

[0054] The watermark pattern may be formed on a side of the substrate opposite that to which final end-user printing is later applied.

[0055] Secret knowledge may be required to decode the plural bits of digital information from the substrate. Thus, a first end user cannot decode information encoded on a substrate of a second end user, and vice versa.

[0056] The substrate can take different forms, including an envelope, stationery, etc. The substrate can also comprise printing stock, such as for a security document (e.g., a banknote) or for newspapers and magazines. Or the substrate can comprise a printed check.

[0057] The summaries of the priority applications noted earlier are necessarily abbreviated and incomplete; the reader is referred to the cited applications for their full disclosures. Moreover, the disclosures discussed in connection with one application or technology may have antecedents in earlier applications. Again, the reader is referred to the cited applications.

[0058] Certain of the cited applications note that document identification technologies other than digital watermarking (e.g., bar codes, RFIDs, etc.) can be used in certain circumstances.

[0059] The above-referenced patents and patent applications are incorporated herein as if set forth in their entireties.

[0060] In view of the wide variety of embodiments to which the principles and features discussed above can be applied, it should be apparent that the detailed embodiments are illustrative only and should not be taken as limiting the scope of the invention. Rather, we claim as our invention all such modifications as may come within the scope and spirit of the following claims and equivalents thereof. (Claims follow appendices.)