US 9,716,807 B2Grant
Methods for estimating watermark signal strength, an embedding process using the same, and related arrangements
Issue Date:2017-07-25
•33 Claims
•3 Drawing Sheets
Abstract
The present disclosure relates to advanced signal processing including digital watermarking and steganography. One method includes: obtaining image data representing imagery in a first color mode; steganographically embedding a watermark signal into the image data, thereby generating watermarked image data; obtaining reader data representing an input color mode of a reader configured to detect or decode the watermarked image data, wherein the input color mode is different from the first color mode; transforming the watermarked image data from the first color mode to the input color mode; estimating a signal strength of the watermark signal within the transformed watermark image data; and visually displaying the estimated signal strength. The estimated signal strength can be visually displayed as a multi-color heat map. Of course, other combinations are described as well.
Metadata
Assignee
- Digimarc Corporation
Inventors
- Vojtech Holub
- Tomas Filler
Application Information
Application Number:US 14/881,448
Filing Date:2015-10-13
Priority Date:2014-10-13
Art Unit:2673
Classifications
IPC:
H04N1/40H04L9/32H04N1/32G06T1/00
Patent Drawings (3 sheets)
Description
Related Application Data
[0001] This application claims benefit of U.S. Provisional Application No. 62/063,248, filed Oct. 13, 2014, which is hereby incorporated herein by reference in its entirety.
Technical Field
[0002] The disclosure relates generally to product packaging, image capture, signal processing, steganographic data hiding and digital watermarking.
Background and Summary
[0003] The term “steganography” generally means data hiding. One form of data hiding is digital watermarking. Digital watermarking is a process for modifying media content to embed a machine-readable (or machine-detectable) signal or code into the media content. For the purposes of this application, the data may be modified such that the embedded code or signal is imperceptible or nearly imperceptible to a human, yet may be detected through an automated, machine-based detection process. Most commonly, digital watermarking is applied to media content such as images, audio signals, and video signals. Digital watermarks can be incorporated into images or graphics that are then printed, e.g., on product packaging.
[0004] Digital watermarking systems may include two primary components: an embedding component that embeds a watermark in media content, and a reading component that detects and reads an embedded watermark (referred to as a “watermark reader,” or “watermark decoder,” or simply as a “reader” or “decoder”). The embedding component (or “embedder” or “encoder”) may embed a watermark by altering data samples representing the media content in the spatial, temporal or some other domain (e.g., Fourier, Discrete Cosine or Wavelet transform domains). The reading component (or “reader” or “decoder”) may analyze target content to detect whether a watermark is present. In applications where the watermark encodes information (e.g., a message or auxiliary information), the reader may extract this information from a detected watermark.
[0005] A watermark embedding process may convert a message, signal, etc., into a payload conveyed by a watermark signal. The embedding process may then combine the watermark signal with media content and possibly other signals (e.g., a transform domain-based orientation pattern or synchronization signal) to create watermarked media content. The process of combining the watermark signal with the media content may be a linear or non-linear function. The watermark signal may be applied by modulating or altering signal samples in a spatial, temporal or transform domain.
[0006] A watermark encoder may analyze and selectively adjust media content to give it attributes that correspond to the desired message symbol or symbols to be encoded. There are many signal attributes that may encode a message symbol, such as a positive or negative polarity of signal samples or a set of samples, a given parity (odd or even), a given difference value or polarity of the difference between signal samples (e.g., a difference between selected spatial intensity values or transform coefficients), a given distance value between watermarks, a given phase or phase offset between different watermark components, a modulation of the phase of a host signal associated with the media content, a modulation of frequency coefficients of the host signal, a given frequency pattern, a given quantizer (e.g., in Quantization Index Modulation) etc.
[0007] The present assignee's work in steganography, data hiding and digital watermarking is reflected, e.g., in U.S. Pat. Nos. 7,013,021, 6,993,154, 6,947,571, 6,912,295, 6,891,959, 6,763,123, 6,718,046, 6,614,914, 6,590,996, 6,449,377, 6,408,082, 6,345,104, 6,122,403 and 5,862,260. Some 3rd-party work is reflected in, e.g., U.S. Pat. Nos. 7,130,442; 6,208,735; 6,175,627; 5,949,885; 5,859,920. Each of the patent documents identified in this paragraph is hereby incorporated by reference herein in its entirety. Of course, a great many other approaches are familiar to those skilled in the art, e.g., Avcibas, et al., “Steganalysis of Watermarking Techniques Using Images Quality Metrics”, Proceedings of SPIE, January 2001, vol. 4314, pp. 523-531; Dautzenberg, “Watermarking Images,” Department of Microelectronics and Electrical Engineering, Trinity College Dublin, 47 pages, October 1994; Hernandez et al., “Statistical Analysis of Watermarking Schemes for Copyright Protection of Images,” Proceedings of the IEEE, vol. 87, No. 7, July 1999; J. Fridrich and J. Kodovský. Rich models for steganalysis of digital images, IEEE Transactions on Information Forensics and Security, 7(3):868-882, June 2011; J. Kodovský, J. Fridrich, and V. Holub. Ensemble classifiers for steganalysis of digital media, IEEE Transactions on Information Forensics and Security, 7(2):432-444, 2012; and T. Pevný, P. Bas, and J. Fridrich. Steganalysis by subtractive pixel adjacency matrix, IEEE Transactions on Information Forensics and Security, 5(2):215-224, June 2010; I. J. Cox, M. L. Miller, J. A. Bloom, J. Fridrich, and T. Kalker. Digital Watermarking and Steganography, Morgan Kaufman Publishers Inc., San Francisco, Calif., 2007; R. O. Duda, P. E. Hart, and D. H. Stork. Pattern Classification. Wiley Interscience, New York, 2nd edition, 2000; each of which is hereby incorporated herein by reference in its entirety. The artisan is presumed to be familiar with a full range of literature concerning steganography, data hiding and digital watermarking.
[0008] Digital watermarking may be used to embed auxiliary information into cover media (e.g., images, packaging, graphics, etc.) such that changes to the cover media to convey the digital watermarking remain invisible to humans but allows machines to reliably extract the auxiliary information even after common signal-processing operations (e.g., noise, filtering, blurring, optical capture). This allows machines to uniquely identify objects depicted in captured imagery. Digital watermarking has been used for applications including media content protection, track and trace, etc.
Brief Description of the Drawings
[0009] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
[0010] FIG. 1 is a flow chart illustrating various embodiments of a watermark embedding process.
[0011] FIG. 2A illustrates an example of imagery (i.e., a front image of a box of oatmeal) conveying multiple instances of a watermark signal and represented by image data that has been transformed as discussed with respect to FIG. 1 . In FIG. 2A , illustrated textual elements (e.g., “Heart Healthy,” “May reduce the risk of heart disease,” “Concordia Superstores,” “Apple Cinnamon Oatmeal,” etc.) and certain graphical elements (e.g., the red heart, the green and white logo above “Concordia”) are vector images, whereas the remainder of the elements (e.g., the apples, the bowl of oatmeal, the syrup, cinnamon sticks, the oats in the background, etc.) are raster images.
[0012] FIG. 2B illustrates a representation (e.g., rainbow-colored a “heat map”) of estimated watermark signal strength at different areas of the imagery illustrated in FIG. 2A . In FIG. 2B , the heat map is overlaid by outlines of some of the aforementioned graphical elements discussed above with respect to FIG. 2A .
Detailed Description
[0013] Embodiments of the present invention relate to estimating the signal strength of a watermark signal embedded within media content. In these embodiment, the signal strength represents a measure indicating how easy or difficult a watermark signal, embedded within media content, can be detected or decoded by a reader. Generally, the techniques disclosed herein are applicable to watermark signals embedded within media content such as consumer packaging (e.g., beverages, food, toiletries, cosmetics, small appliances, etc.), documents, labels, tags, stickers, books, posters, etc., as well as to embedded watermark signals that are visually conveyed by electronic displays, or are otherwise embedded or present within surface textures of physical objects, or the like or any combination thereof.
[0014] When included in consumer packaging, auxiliary information conveyed by a watermark signal can include information such as a universal product code (UPC) number, a global trade item number (GTIN), application identifier (AI) number (e.g., as used within UCC/EAN-128 Symbols), an electronic product code (EPC), a globally unique identifier (GUID), recycling information, product information, distribution information, retail channel information, labelling information, an index to such information, or the like or any combination thereof. Assignee's U.S. patent application Ser. No. 14/611,515, filed Feb. 2, 2015, (published as U.S. Ser. No. 2015/0302543 A1), which is hereby incorporated herein by reference in its entirety, describes additional examples of auxiliary information that may be conveyed by a digital watermark. Because a large surface area of a package can be watermarked, consumers, retail check-out personnel, etc., do not need to search for barcode at checkout, thus leading to overall speedup of the checkout process. U.S. Patent App. Pub. Nos. 2013/0223673 and 2014/0112524, each of which is hereby incorporated herein by reference in its entirety, discusses related use scenarios. Such retail checkout scenarios are improved when digital watermarking can be located and decoded in a timely manner as watermarked packaging is swiped or moved in front of an optical scanner (or camera).
[0015] Once embedded into cover media, the signal strength of the embedded watermark signal may vary depending upon factors such as the presence, type, color, etc., of any pattern, texture or gradient depicted by the cover media where the watermark was embedded, or in the vicinity thereof. Further, watermark signals are typically embedded into imagery by changing data representing pixel values of images (e.g., raster images). In practice, however, it is common to stack a vector image over a raster image (e.g., by assigning vector and raster image to different layers supported by digital image editing software such as ADOBE PHOTOSHOP, PHOTO-PAINT, PAINT SHOP PRO, GIMP, PAINT.NET, STYLEPIX, etc.). Stacking a vector image over a watermarked raster image can degrade the signal strength of the embedded watermark signal. To address these and other problems, numerous embodiments for estimating the signal strength of a watermark signal embedded within media content are discussed in greater detail below. To provide a comprehensive disclosure without unduly lengthening the specification, applicant hereby incorporates by reference certain referenced patent documents, each in their entirety. These documents also disclose other technologies and teachings that can be incorporated into the arrangements detailed herein, and into which the technologies and teachings detailed herein can be incorporated.
[0016] The methods, processes, components, apparatus and systems described herein may be implemented in hardware, software or a combination of hardware and software. For example, the watermark encoding processes and embedders may be implemented in software, firmware, hardware, combinations of software, firmware and hardware, a programmable computer, electronic processing circuitry, processors, parallel processors, or by executing software or instructions with processor(s) or circuitry. Example software includes, e.g., C, C++, Visual Basic, Java, Python, Tcl, Perl, Scheme, Ruby, executable binary files, etc. Similarly, watermark data decoding or decoders may be implemented in software, firmware, hardware, combinations of software, firmware and hardware, a programmable computer, electronic processing circuitry, or by executing software or instructions with a multi-purpose electronic processor, parallel processors or multi-core processors, or other multi-processor configurations.
[0017] Applicant's work also includes taking the scientific principles and natural laws on which the present technology rests, and tying them down in particularly defined implementations. One such implementation uses the hardware/software apparatus mentioned above. Another such implementation is electronic circuitry that has been custom-designed and manufactured to perform some or all of the component acts, as an application specific integrated circuit (ASIC).
[0018] To realize such an ASIC implementation, some or all of the technology is first implemented using a general purpose computer, using software such as MatLab (from Mathworks, Inc.). A tool such as HDLCoder (also available from Math Works) is next employed to convert the MatLab model to VHDL (an IEEE standard, and doubtless the most common hardware design language). The VHDL output is then applied to a hardware synthesis program, such as Design Compiler by Synopsis, HDL Designer by Mentor Graphics, or Encounter RTL Compiler by Cadence Design Systems. The hardware synthesis program provides output data specifying a particular array of electronic logic gates that will realize the technology in hardware form, as a special-purpose machine dedicated to such purpose. This output data is then provided to a semiconductor fabrication contractor, which uses it to produce the customized silicon part. (Suitable contractors include TSMC, Global Foundries, and ON Semiconductors.) Several detailed embodiments are now described.
A. Embodiment 1
[0019] At 102, image data is obtained. Generally, the image data is obtained in one or more raster file formats (e.g., TIFF, PSD, EPS, JPG, PNG, BMP, etc.), one or more vector file formats (e.g., EMF, EPS, PDF, PS, etc.), or the like or any combination thereof. The image data represents imagery as a raster image, a vector image or any combination thereof (e.g., represented by one or more different “layers” of imagery, as is understood in the field of digital image editing).
[0020] Generally, the image data represents imagery in a color mode selected from the group including, e.g., grayscale, indexed, bitmap, RGB, CMYK, Lab, HSB, HSL, duotone, multichannel, PMS, or the like or any combination thereof. In one embodiment, the image data may be accompanied by color mode data describing the color mode with which the imagery is represented. In another embodiment, the obtained image data may be processed according to any known technique to derive the color mode data.
[0021] At 104, the image data is processed to embed one or more watermark signals (e.g., each conveying an orientation or synchronization pattern, auxiliary information, or the like or any combination thereof) therein. Exemplary techniques that may be used for embedding a watermark signal are described in aforementioned U.S. Pat. Nos. 7,130,442, 7,013,021, 6,993,154, 6,947,571, 6,912,295, 6,891,959, 6,763,123, 6,718,046, 6,614,914, 6,590,996, 6,449,377, 6,408,082, 6,345,104, 6,208,735, 6,175,627, 6,122,403, 5,949,885, 5,862,260 and 5,859,920, or the like or any combination thereof. Additional techniques are disclosed in US Published Patent Appln. No. 2015-0156369, and U.S. patent application Ser. No. 14/725,399, filed May 29, 2015, (published as U.S. Ser. No. 2016/0275639 A1) and Ser. No. 14/842,575, filed Sep. 1, 2015, (published as U.S. Ser. No. 2017-0004597 A1),which are hereby incorporated herein by reference in their entirety.
[0022] In one embodiment, the image data represents imagery as a raster image and a vector image, and one or more blocks or patches of the raster image is watermarked at a location that is overlapped by the vector image. In another embodiment, the image data simply represents imagery as a one or more raster images, and does not represent a vector image.
[0023] At 106, reader data is obtained. In one embodiment, the reader data may include the reader color profile data describing an input color profile (e.g., in an ICC color profile format) of one or more readers configured to detect or decode one or more watermark signals embedded within the image data. In other embodiments, reader data may include reader identifier data (e.g., specifically identifying one or more readers configured to detect or decode the embedded watermark signal(s)), reader type data (e.g., identifying one or more types of readers configured to detect or decode the embedded watermark signal(s)), reader manufacturer data (e.g., identifying one or more manufacturers of readers configured to detect or decode the embedded watermark signal(s)), or the like or any combination thereof. In such other embodiments, the reader identifier data, reader type data, reader manufacturer data, etc., may be used as an index in a database to look up associated reader color profile data representing the input color profile of the reader. Reader type data can identify types of readers as hand-held readers (e.g., a specially-designed reader such as the JOYA or the POWERSCAN series, both offered by DATALOGIC, or a reader implemented as software—such as DIGIMARC DISCOVER, offered by DIGIMARC—operating on a smartphone—such as an IPHONE, offered by APPLE, etc.), fixed-position readers (e.g., so-called “in-counter scanners”), a laser scanners, CCD readers, camera-based readers, video camera readers, or the like or any combination thereof.
[0024] At 108, upon obtaining the color mode data and the reader color profile data, the watermarked image data is processed to transform the imagery having the embedded watermark signal(s) from an initial color mode (e.g., the color mode with which the imagery was initially represented by the image data obtained at 102) to a transformed color mode (e.g., a color mode that corresponds to or is otherwise compatible with the input color profile of the reader) according to one or more known techniques. The transformed image data thus represents the imagery in a color space for which the reader is designed.
[0025] At 110, the transformed image data is analyzed to estimate the signal strength of the embedded watermark signal. Examples of techniques for estimating the signal strength of the embedded watermark signal in the transformed image data are described in U.S. Pat. Nos. 8,051,295, 7,796,826, 7,607,016, 7,602,977, 7,352,878, 7,263,203, 7,085,396, 7,058,200, 7,006,662, 6,993,154 and 6,738,495, each of which is incorporated herein by reference in its entirety. Generally, the analysis is performed on individual blocks or patches of the transformed image data which may overlap one another, adjoin (i.e., so as to not overlap) one another, be adjacent to (i.e., so as to not adjoin) one another, or the like or any combination thereof.
[0026] At 112, results of the estimated signal strength may be rendered (e.g., via a display such as a computer monitor communicatively coupled to a computer that performed an act at 104, 106, 108, or the like or any combination thereof) so that a user can identify areas in imagery represented by the transformed image data (e.g., the imagery illustrated in FIG. 2A ) where the watermark signal strength is unacceptably low (e.g., in the vicinity of the depicted green and white logo above “Concordia,” in the vicinity of the oatmeal depicted in the bowl, etc., as illustrated by the heat map shown in FIG. 2B ).
[0027] Upon viewing the rendering of the estimated signal strength, the user may, at 114, provide one or more commands, instructions, or other input (e.g., by interacting with some user interface, keyboard, mouse, touch-screen, stylus, or the like or any combination thereof) to identify one or more blocks or patches of the transformed image data where the watermark signal strength is to be adjusted (e.g., increased). Optionally, the user input indicates an amount or percentage by which the user desires the watermark signal strength be increased. In one embodiment, the user input may also allow the user to decrease watermark signal strength in one or more blocks or patches of the transformed image data (e.g., in cases where the user determines that the watermark signal is undesirably visible).
[0028] Upon receiving the user input, the signal strength of the identified blocks/patches can be adjusted (e.g., as described in any of aforementioned U.S. Pat. No. 8,051,295, 7,796,826, 7,607,016, 7,602,977, 7,352,878, 7,263,203, 7,085,396, 7,058,200, 7,006,662, 6,993,154 or 6,738,495, or any combination thereof) and, in one embodiment, one or more of the watermark signals can be re-embedded (e.g., at 104) according to the adjusted signal strength. The above described acts (e.g., 108, 110, 112 and 114) may thereafter performed again, as desired until the watermark signal strength is acceptably strong. In another embodiment, however, the user input received at 114 can indicate that the watermarked signal strength is acceptably high, and the watermarked image data obtained as a result of performing (or re-performing) the watermark embedding at 104 is rendered at 116. As used herein, watermarked image data is rendered by generating one or computer-readable files (e.g., each having a raster file format, a vector file format, or the like or any combination thereof) representing the watermarked image data, storing the computer-readable file (e.g., in a computer-readable memory such as Flash memory, hard drive, magnetic tape, optical disk, or the like or any combination thereof), transmitting the computer-readable file (e.g., via FTP, Ethernet, WiFi, or the like or any combination thereof), printing the imagery represented by the watermarked image data, or the like or any combination thereof.
[0029] Notwithstanding the foregoing, it will be appreciated that identification of one or more blocks or patches or adjustment of the watermark signal strength can be performed automatically (e.g., without receiving user input) or semi-automatically (e.g., upon receipt of user input identifying one or more blocks or patches of the transformed image data where the watermark signal strength is to be adjusted).
B. Embodiment 2
[0030] In this embodiment, the embedding workflow may be performed as described above with respect to “Embodiment 1,” but may be performed by reference to the color gamut of the printer(s) that will be used to print imagery represented by the watermarked image data. In this Embodiment 2, therefore, printer data is obtained at 118, which includes the printer color profile data describing an output color profile (e.g., in an ICC color profile format) of one or more printers configured to print the watermarked image data. In other embodiments, printer data may include printer identifier data (e.g., specifically identifying one or more printers configured to print the watermarked image data, printer type data (e.g., identifying one or more types of printers configured to print the watermarked image data), printer manufacturer data (e.g., identifying one or more manufacturers of printers configured to print the watermarked image data), or the like or any combination thereof. In such other embodiments, the printer identifier data, printer type data, printer manufacturer data, etc., may be used as an index in a database to look up associated printer color profile data representing the output color profile of the printer. Printer type data can identify types of printers according to the printing processes they are designed to carry out, such as offset lithography, flexography, digital printing (e.g., inkjet, xerography, etc.), gravure, screen printing, or the like or any combination thereof.
[0031] At 108, upon obtaining the color mode data and the printer color profile data, the watermarked image data is processed to transform the imagery having the embedded watermark signal(s) from an initial color mode (e.g., the color mode with which the imagery was initially represented by the image data obtained at 102) to a transformed color mode (i.e., a color mode that corresponds to or is otherwise compatible with the output color profile of the printer) according to one or more known techniques. The transformed image data thus represents the imagery in a color space in which the printer will print imagery (e.g., at 116).
[0032] In one embodiment, the watermarked image data is not transformed according to the reader color profile data (and, thus, act 106 can be omitted). In another embodiment, however, the transformation at 108 can be based upon the reader color profile data (and, thus, act 106 may be performed). For example, after initially transforming the watermarked image data by reference to the printer color profile data, the initially-transformed watermarked image data can be subsequently transformed by reference to the reader color profile data (e.g., as discussed above with respect to Embodiment 1).
C. Embodiment 3
[0033] In this embodiment, the embedding workflow may be performed as described above with respect to “Embodiment 1” or “Embodiment 2,” but may be performed by reference to the substrate onto which imagery represented by the watermarked image data will be printed. In this Embodiment 3, therefore, substrate data is obtained at 120, which includes information describing the type of substrate (e.g., paper, cardboard, metal, plastic, foil, etc.) on which the watermarked image data will be printed, the surface finish of the substrate (e.g., matte, glossy, etc.), or the like or any combination thereof.
[0034] At 108, upon obtaining the color mode data and the substrate data, the watermarked image data is processed to estimate or otherwise emulate the appearance of the watermarked imagery when rendered on a substrate associated with the substrate data. In one embodiment, the watermarked image data is not transformed according to the reader color profile data or the printer color profile data (and, thus, acts 106 and 118 can be omitted). In another embodiment, however, the transformation at 108 can be based upon the printer color profile data (and, thus, act 118 may be performed, and the watermarked image data may be transformed by reference to the printer color profile data before transforming the watermarked image data by reference to the substrate data). In another embodiment, the transformation at 108 can be further based upon the reader color profile data (and, thus, act 106 may be performed, so that the watermarked image data is transformed by reference to the reader color profile data after being transformed by reference to the substrate data).
D. Embodiment 4
[0035] In this embodiment, the embedding workflow may be performed as described above with respect to “Embodiment 1,” but may be performed by reference to the color gamut of the electronic display(s) that will be used to visually convey imagery represented by the watermarked image data. In this Embodiment 4, therefore, display data is obtained at 122, which includes the display color profile data describing an output color profile (e.g., in an ICC color profile format) of one or more displays configured to display the watermarked image data (e.g., at 116). In other embodiments, display data may include display identifier data (e.g., specifically identifying one or more displays configured to display the watermarked image data, display type data (e.g., identifying one or more types of displays configured to display the watermarked image data), display manufacturer data (e.g., identifying one or more manufacturers of printers configured to display the watermarked image data), or the like or any combination thereof. In such other embodiments, the display identifier data, display type data, display manufacturer data, etc., may be used as an index in a database to look up associated display color profile data representing the output color profile of the display.
[0036] At 108, upon obtaining the color mode data and the display color profile data, the watermarked image data is processed to transform the imagery having the embedded watermark signal(s) from an initial color mode (e.g., the color mode with which the imagery was initially represented by the image data obtained at 102) to a transformed color mode (e.g., a color mode that corresponds to or is otherwise compatible with the output color profile of the display) according to one or more known techniques. The transformed image data thus represents the imagery in a color space in which the display will present imagery.
Possible Combinations:
[0037] A few combinations of features include the following. Of course, this is not an exhaustive list since many other combinations are evident from the above detailed description.
A. A method comprising:
[0038] obtaining image data representing imagery in a first color mode;
[0039] steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
[0040] obtaining reader data representing an input color mode of a reader configured to detect or decode the watermarked image data, wherein the input color mode is different from the first color mode;
[0041] transforming the watermarked image data from the first color mode to the input color mode;
[0042] estimating a signal strength of the watermark signal within the transformed watermark image data; and
[0043] re-embedding the watermark signal in the image data based upon the estimated signal strength within the transformed image data.
B. A method comprising:
[0044] obtaining image data representing imagery;
[0045] steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
[0046] obtaining printer data representing an output color mode of a printer configured to print the watermarked image data;
[0047] transforming the watermarked image data to the output color mode;
[0048] obtaining reader data representing an input color mode of a reader configured to detect or decode printed watermarked image data, wherein the input color mode is different from the output color mode;
[0049] transforming the watermarked image data from the output color mode to the input color mode;
[0050] estimating a signal strength of the watermark signal within the transformed watermark image data; and
[0051] re-embedding the watermark signal in the image data based upon the estimated signal strength within the transformed image data.
C. A system comprising:
[0052] a processor;
[0053] at least one non-transitory, computer-readable medium communicatively coupled to the processor,
[0054] wherein at least one non-transitory, computer-readable medium stores image data, reader data and, optionally, printer data, and
[0055] wherein at least one non-transitory, computer-readable medium stores instructions to cause the processor to perform the method of any of combination A or B; and
[0056] optionally, a display communicatively coupled to the processor.
D. A non-transitory, computer-readable medium comprising instructions to cause a computer processor to perform the method of any one of combination A or B.
E. An apparatus comprising:
[0057] means for obtaining image data representing imagery in a first color mode;
[0058] steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
[0059] means for obtaining reader data representing an input color mode of a reader configured to detect or decode the watermarked image data, wherein the input color mode is different from the first color mode;
[0060] means for transforming the watermarked image data from the first color mode to the input color mode;
[0061] means for estimating a signal strength of the watermark signal within the transformed watermark image data; and
[0062] means for re-embedding the watermark signal in the image data based upon the estimated signal strength within the transformed image data.
F. An apparatus comprising:
[0063] means for obtaining image data representing imagery;
[0064] means for steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
[0065] means for obtaining printer data representing an output color mode of a printer configured to print the watermarked image data;
[0066] means for transforming the watermarked image data to the output color mode; means for obtaining reader data representing an input color mode of a reader configured to detect or decode printed watermarked image data, wherein the input color mode is different from the output color mode;
[0067] means for transforming the watermarked image data from the output color mode to the input color mode;
[0068] means for estimating a signal strength of the watermark signal within the transformed watermark image data; and
[0069] means for re-embedding the watermark signal in the image data based upon the estimated signal strength within the transformed image data.
Conclusion
[0070] For the avoidance of doubt we expressly contemplate the combination of subject matter under any above embodiment with the subject matter from the other such detailed embodiments.
[0071] Having described and illustrated the principles of the technology with reference to specific embodiments, it will be recognized that the technology can be implemented in many other, different, forms. To provide a comprehensive disclosure without unduly lengthening the specification, applicant hereby incorporates by reference each of the above referenced patent documents in its entirety. Such documents are incorporated in their entireties, even if cited above in connection with specific of their teachings. These documents disclose technologies and teachings that can be incorporated into the arrangements detailed herein, and into which the technologies and teachings detailed herein can be incorporated.
[0072] The particular combinations of elements and features in the above-detailed embodiments are exemplary only; the interchanging and substitution of these teachings with other teachings in this and the incorporated-by-reference patents are also contemplated.
Claims
Certificate of Correction present
The claims shown below may not include correction changes. Use the corrected PDF for authoritative text.
What is claimed is:
1. A method comprising:
obtaining image data representing imagery in a first color mode;
steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
obtaining reader data representing an input color mode of a reader configured to detect or decode the watermarked image data, wherein the input color mode is different from the first color mode;
transforming the watermarked image data from the first color mode to the input color mode, in which the input color mode corresponds to or is compatible with a color space associated with the reader;
estimating a signal strength of the watermark signal within the transformed watermark image data; and
visually displaying the estimated signal strength spatially relative to the image data, with a first color representing first signal strength and a second color representing second signal strength, in which the second signal strength comprises a higher signal strength relative to the first signal strength, and with a third color representing a third signal strength comprising a signal strength between the first signal strength and the second signal strength.
2. The method of claim 1 in which the estimated signal strength is visually displayed as a multi-color heat map spatially relative to the image data.
3. A non-transitory, computer-readable medium comprising instructions to cause a computer processor to perform the method of claim 1.
4. A method comprising:
obtaining image data representing imagery;
steganographically embedding a watermark signal into the image data, thereby generating watermarked image data;
obtaining printer data representing an output color mode of a printer configured to print the watermarked image data;
transforming the watermarked image data to the output color mode;
obtaining reader data representing an input color mode of a reader configured to detect or decode printed watermarked image data, wherein the input color mode is different from the output color mode;
transforming the watermarked image data from the output color mode to the input color mode, in which the input color mode corresponds to or is compatible with a color space associated with the reader;
estimating a signal strength of the watermark signal within the transformed watermark image data; and
visually displaying the estimated signal strength spatially relative to the image data.
5. The method of claim 4 in which the estimated signal strength is visually displayed as a multi-color heat map spatially relative to the image data.
6. A non-transitory, computer-readable medium comprising instructions to cause a computer processor to perform the method of claim 4.
7. A method comprising:
obtaining image data representing imagery;
encoding data representing picture portions of the image data with a plural-bit signal, thereby generating encoded image data;
obtaining substrate data associated with a type of or surface finish of a substrate upon which the encoded image data will be printed during printing, the printing to yield printed encoded image data;
obtaining reader data associated with a reader configured to detect or decode the plural-bit signal from the printed encoded image data;
adapting the encoded image data according to the substrate data and the reader data, said adapting yielding adapted encoded image data;
estimating a signal strength of the plural-bit signal encoded within the adapted encoded image data; and
visually displaying the estimated signal strength spatially relative to the image data.
8. The method of claim 7 in which the estimated signal strength is visually displayed as a multi-color heat map spatially relative to the image data.
9. The method of claim 8 in which the estimated signal strength is visually displayed spatially relative to the image data with a first color representing first signal strength and a second color representing second signal strength, in which the second signal strength comprises a signal strength that is relative higher than the first signal strength.
10. The method of claim 9, further comprising visually displaying the estimated signal strength spatially relative to the image data, with a third color representing a third signal strength comprising a signal strength between the first signal strength and the second signal strength.
11. The method of claim 7 in which said adapting adapts the encoded image data according to the substrate data, the reader data and color profile information of a printer that will print the printed encoded image data.
12. The method of claim 7 in which the substrate data associated with a substrate upon which the encoded image data will be printed comprises data associated with surface finish.
13. The method of claim 7 in which the substrate data associated with a substrate upon which the encoded image data will be printed comprises data associated with a plastic or metal substrate.
14. The method of claim 7 in which the reader data associated with the reader comprises a color profile associated with the reader.
15. The method of claim 14 in which the color profile comprises an ICC color profile format.
16. The method of claim 7 in which the reader data associated with the reader comprises reader type information.
17. The method of claim 7 in which said encoding data representing picture portions of the image data with a plural-bit signal comprises digital watermarking.
18. The method of claim 7 in which said encoding data representing picture portions of the image data with a plural-bit signal comprises steganographic encoding.
19. The method of claim 7 in which the substrate data comprises data associated with a type of substrate, the type of substrate comprising paper, cardboard, metal, plastic or foil.
20. The method of claim 7 in which the substrate data comprises data associated with a surface finish of the substrate, the surface finish comprising matte or glossy.
21. A method comprising:
obtaining image data representing imagery;
embedding data representing picture portions of the image data with a plural-bit signal, thereby generating embedded image data;
obtaining printer data associated with a printer that is expected to print the embedded image data, in which the printer yields printed embedded image data;
obtaining reader data associated with a reader configured lo detect or decode the plural-bit signal from the printed embedded image data;
processing the embedded image data according lo the printer data and the reader data, said processing yielding processed embedded image data;
estimating a signal strength of the plural-bit signal embedded within the processed embedded image data; and
visually displaying the estimated signal strength spatially relative to the image data.
22. The method of claim 21 in which the estimated signal strength is visually displayed as a multi-color heat map spatially relative to the image data.
23. The method of claim 21 further comprising re-embedding the data representing picture portions of the image data with a plural-bit signal based on an analysis of the estimated signal strength, the re-embedding limited to a subset of image patches that comprises less image patches relative to the image data, thereby generating re-embedded image data.
24. The method of claim 21 in which the printer data comprises printer color profile data describing an output color profile of the printer.
25. The method of claim 24 in which the output color profile comprises an ICC color profile.
26. The method of claim 21 in which the printer data comprises printer type data.
27. The method of claim 26 in which the printer type data comprises data identifying a printing process comprising offset, flexography, or digital printing.
28. The method of claim 21 in which said embedding data representing picture portions of the image data with a plural-bit signal comprises digital watermarking.
29. The method of claim 21 in which said embedding data representing picture portions of the image data with a plural-bit signal comprises steganographic embedding.
30. The method of claim 21 in which the estimated signal strength is visually displayed spatially relative to the image data with a first color representing first signal strength and a second color representing second signal strength, in which the second signal strength comprises a signal strength that is relative higher than the first signal strength.
31. The method of claim 30, further comprising visually displaying the estimated signal strength spatially relative to the image data with a third color representing a third signal strength comprising a signal strength between the first signal strength and the second signal strength.
32. The method of claim 21 in which the printer data comprises printer identifier data or printer manufacturer data.
33. The method of claim 21 in which the primer data comprising data associated with the printer's color gamut.
Patent Citations (107)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US5365048(A) | 1994-11-01 | Komiya et al. | Applicant |
| US5745604(A) | 1998-04-01 | Rhoads | Examiner |
| US5832119(A) | 1998-11-01 | Rhoads | Examiner |
| US5859920(A) | 1999-01-01 | Daly et al. | Applicant |
| US5862260(A) | 1999-01-01 | Rhoads | Applicant |
| US5949885(A) | 1999-09-01 | Leighton | Applicant |
| US5974150(A) | 1999-10-01 | Kaish | Examiner |
| US6122403(A) | 2000-09-01 | Rhoads | Applicant |
| US6175627(B1) | 2001-01-01 | Petrovic et al. | Applicant |
| US6208735(B1) | 2001-03-01 | Cox et al. | Applicant |
| US6246775(B1) | 2001-06-01 | Nakamura et al. | Applicant |
| US6345104(B1) | 2002-02-01 | Rhoads | Applicant |
| US6408082(B1) | 2002-06-01 | Rhoads et al. | Applicant |
| US6449377(B1) | 2002-09-01 | Rhoads | Applicant |
| US6516079(B1) | 2003-02-01 | Rhoads | Examiner |
| US6535618(B1) | 2003-03-01 | Rhoads | Examiner |
| US6590996(B1) | 2003-07-01 | Reed | Examiner |
| US6614914(B1) | 2003-09-01 | Rhoads et al. | Applicant |
| US6625297(B1) | 2003-09-01 | Bradley | Applicant |
| US6683966(B1) | 2004-01-01 | Tian | Examiner |
| US6698658(B2) | 2004-03-01 | McQueen | Applicant |
| US6704869(B2) | 2004-03-01 | Rhoads et al. | Applicant |
| US6718046(B2) | 2004-04-01 | Reed et al. | Applicant |
| US6738495(B2) | 2004-05-01 | Rhoads et al. | Applicant |
| US6757406(B2) | 2004-06-01 | Rhoads | Examiner |
| US6763123(B2) | 2004-07-01 | Reed et al. | Applicant |
| US6771797(B2) | 2004-08-01 | Ahmed | Examiner |
| US6891959(B2) | 2005-05-01 | Reed et al. | Applicant |
| US6912295(B2) | 2005-06-01 | Reed | Examiner |
| US6947571(B1) | 2005-09-01 | Rhoads et al. | Applicant |
| US6988202(B1) | 2006-01-01 | Rhoads | Examiner |
| US6993154(B2) | 2006-01-01 | Brunk | Applicant |
| US7006662(B2) | 2006-02-01 | Alattar et al. | Applicant |
| US7013021(B2) | 2006-03-01 | Gustafson | Applicant |
| US7046819(B2) | 2006-05-01 | Stach | Applicant |
| US7054461(B2) | 2006-05-01 | Zeller et al. | Applicant |
| US7058200(B2) | 2006-06-01 | Donescu et al. | Applicant |
| US7085396(B2) | 2006-08-01 | Pelly et al. | Applicant |
| US7116781(B2) | 2006-10-01 | Rhoads | Examiner |
| US7130442(B2) | 2006-10-01 | Braudaway et al. | Applicant |
| US7197164(B2) | 2007-03-01 | Levy | Examiner |
| US7231061(B2) | 2007-06-01 | Bradley | Examiner |
| US7263203(B2) | 2007-08-01 | Rhoads et al. | Applicant |
| US7277468(B2) | 2007-10-01 | Tian | Examiner |
| US7286685(B2) | 2007-10-01 | Brunk et al. | Applicant |
| US7319775(B2) | 2008-01-01 | Sharma | Examiner |
| US7352878(B2) | 2008-04-01 | Reed et al. | Applicant |
| US7502759(B2) | 2009-03-01 | Hannigan | Examiner |
| US7607016(B2) | 2009-10-01 | Brunk et al. | Applicant |
| US7656930(B2) | 2010-02-01 | Tian | Examiner |
| US7657058(B2) | 2010-02-01 | Sharma | Applicant |
| US7738673(B2) | 2010-06-01 | Reed | Examiner |
| US7796826(B2) | 2010-09-01 | Rhoads et al. | Applicant |
| US7916354(B2) | 2011-03-01 | Rhoads | Examiner |
| US7986807(B2) | 2011-07-01 | Stach et al. | Applicant |
| US8005254(B2) | 2011-08-01 | Rhoads | Examiner |
| US8051295(B2) | 2011-11-01 | Brunk et al. | Applicant |
| US8127137(B2) | 2012-02-01 | Levy | Examiner |
| US8243980(B2) | 2012-08-01 | Rhoads et al. | Applicant |
| US8245926(B2) | 2012-08-01 | Guess et al. | Applicant |
| US8301893(B2) | 2012-10-01 | Brundage | Examiner |
| US8321350(B2) | 2012-11-01 | Durst, Jr. | Examiner |
| US8339668(B2) | 2012-12-01 | Kato | Examiner |
| US8488837(B2) | 2013-07-01 | Bae | Examiner |
| US8610958(B2) | 2013-12-01 | Rossier | Examiner |
| US8923546(B2) | 2014-12-01 | Reed | Examiner |
| US9224184(B2) | 2015-12-01 | Bai | Applicant |
| US2001/0019618(A1) | 2001-09-01 | Rhoads | Examiner |
| US2002/0003903(A1) | 2002-01-01 | Engeldrum | Examiner |
| US2002/0009208(A1) | 2002-01-01 | Alattar | Examiner |
| US2002/0054355(A1) | 2002-05-01 | Brunk | Examiner |
| US2002/0157005(A1) | 2002-10-01 | Brunk | Examiner |
| US2002/0191812(A1) | 2002-12-01 | Kim | Examiner |
| US2003/0002710(A1) | 2003-01-01 | Rhoads | Applicant |
| US2003/0009670(A1) | 2003-01-01 | Rhoads | Examiner |
| US2003/0025423(A1) | 2003-02-01 | Miller et al. | Applicant |
| US2003/0053653(A1) | 2003-03-01 | Rhoads | Examiner |
| US2003/0156733(A1) | 2003-08-01 | Zeller | Examiner |
| US2004/0190751(A1) | 2004-09-01 | Rhoads | Examiner |
| US2004/0263911(A1) | 2004-12-01 | Rodriguez | Examiner |
| US2006/0171559(A1) | 2006-08-01 | Rhoads | Examiner |
| US2006/0230273(A1) | 2006-10-01 | Crichton | Examiner |
| US2007/0091376(A1) | 2007-04-01 | Calhoon | Examiner |
| US2008/0025554(A1) | 2008-01-01 | Landwehr | Examiner |
| US2008/0137749(A1) | 2008-06-01 | Tian | Examiner |
| US2008/0192275(A1) | 2008-08-01 | Reed | Examiner |
| US2008/0309612(A1) | 2008-12-01 | Gormish | Examiner |
| US2009/0046931(A1) | 2009-02-01 | Xiao | Examiner |
| US2009/0060331(A1) | 2009-03-01 | Liu | Examiner |
| US2009/0067671(A1) | 2009-03-01 | Alattar | Examiner |
| US2010/0008534(A1) | 2010-01-01 | Rhoads | Examiner |
| US2010/0027851(A1) | 2010-02-01 | Walther | Examiner |
| US2010/0142003(A1) | 2010-06-01 | Braun | Examiner |
| US2012/0133993(A1) | 2012-05-01 | Ohira | Examiner |
| US2012/0277893(A1) | 2012-11-01 | Davis | Examiner |
| US2013/0223673(A1) | 2013-08-01 | Davis et al. | Applicant |
| US2013/0336525(A1) | 2013-12-01 | Kurtz | Examiner |
| US2014/0027516(A1) | 2014-01-01 | Fushiki | Applicant |
| US2014/0112524(A1) | 2014-04-01 | Bai et al. | Applicant |
| US2015/0030201(A1) | 2015-01-01 | Holub et al. | Applicant |
| US2015/0146262(A1) | 2015-05-01 | Fan | Examiner |
| US2015/0156369(A1) | 2015-06-01 | Reed | Examiner |
| US2015/0187039(A1) | 2015-07-01 | Reed et al. | Applicant |
| US2016/0034231(A1) | 2016-02-01 | Miyake | Examiner |
| US2016/0105585(A1) | 2016-04-01 | Holub et al. | Applicant |
| US2016/0198064(A1) | 2016-07-01 | Bai | Examiner |
| WO/2013/033442 | 2013-03-01 | Applicant |
Non-Patent Literature (29)
- Jan. 12, 2017 non-final Office Action, and Jan. 13, 2017 Amendment, both from assignee's U.S. Appl. No. 15/154,572.Applicant
- U.S. Appl. No. 15/154,529, filed May 13, 2016.Applicant
- U.S. Appl. No. 15/154,572, filed May 13, 2016.Applicant
- U.S. Appl. No. 62/322,193, filed Apr. 13, 2016.Applicant
- U.S. Appl. No. 61/856,476, filed Jul. 19, 2013.Applicant
- U.S. Appl. No. 61/918,214, filed Dec. 19, 2013.Applicant
- Avcibas, et al., “Steganalysis of Watermarking Techniques Using Images Quality Metrics”, Proceedings of SPIE, Jan. 2001, vol. 4314, pp. 523-531.Applicant
- Dautzenberg, “Watermarking Images,” Department of Microelectronics and Electrical Engineering, Trinity College Dublin, 47 pages, Oct. 1994.Applicant
- Hernandez et al., “Statistical Analysis of Watermarking Schemes for Copyright Protection of Images,” Proceedings of the IEEE, vol. 87, No. 7, Jul. 1999.Applicant
- Holub & Fridrich, “Digital image steganography using universal distortion,” IH&MMSec '13 Proceedings of the first ACM workshop on Information hiding and multimedia security, pp. 59-68 (2013).Applicant
- Kodovský, Fridrich & Holub, “On dangers of overtraining steganography to incomplete cover model,” MM&Sec '11 Proceedings of the thirteenth ACM multimedia workshop on Multimedia and security, pp. 69-76 (2011).Applicant
- Fridrich, Kodovský & Holub, “Steganalysis of Content-Adaptive Steganography in Spatial Domain,” Information Hiding, vol. 6958 of the series Lecture Notes in Computer Science pp. 102-117, 2011.Applicant
- J. Fridrich and J. Kodovský, “Rich models for steganalysis of digital images,” IEEE Trans. on Information Forensics and Security, 7(3):868-882, Jun. 2012.Applicant
- J. Kodovský, J. Fridrich, and V. Holub, “Ensemble classifiers for steganalysis of digital media,” IEEE Trans. on Inform. Forensics and Security, 7(2):432-444, Apr. 2012.Applicant
- Pevný, P. Bas, and J. Fridrich, “Steganalysis by subtractive pixel adjacency matrix,” IEEE Transactions on Information Forensics and Security, 5(2):215-224, Jun. 2010.Applicant
- O'Ruanaidh, “Rotation, Scale and Translation Invariant Digital Image Watermarking,” Signal Processing, pp. 2-15, May 1, 1998.Applicant
- S. Pereira, J. J. K. Oruanaidh, F. Deguillaume, G. Csurka and T. Pun, Template Based Recovery of Fourier-Based Watermarks Using Log-polar and Log-log Maps, in Int. Conference on Multimedia Computing and Systems Jun. 1999.Applicant
- R. O. Duda, P. E. Hart, and D. G. Stork, “Pattern Classification.” Wiley Interscience, 2nd edition, 2000.Applicant
- Chih-Chung Chang and Chih-Jen Lin,, “LIBSVM: A Library for Support Vector Machines,” ACM Transactions on Intelligent Systems and Technology, vol. 2, No. 3, Article 27, Publication date: Apr. 2011.Applicant
- Kutter, “Watermarking Resisting to Translation, Rotation and Scaling,” Proc. of SPIE: Multimedia Systems and Applications, vol. 3528, pp. 423-431, Boston, Nov. 1998.Applicant
- O'Ruanaidh et al., “Rotation, Scale and Translation Invariant Spread Spectrum Digital Image Watermarking,” Signal Processing 66, May 1, 1998, pp. 303-317.Applicant
- O'Ruanaidh et al., “Rotation, Scale and translation Invariant Digital Image Watermarking,” Int. Conf. on Image Proc., Oct. 1997, IEEE, pp. 536-539.Applicant
- Sheng et al., “Experiments on Pattern Recognition Using Invariant Fourier-Mellin Descriptors,” Journal of Optical Society of America, vol. 3. No. 6, Jun. 1986, pp. 771-776.Applicant
- Su et al., “An Image Watermark Scheme to Resist Generalized Geometrical Transformations,” Proc. of SPIE: Multimedia Systems and Applications III, vol. VV08, Boston, USA, Nov. 2000.Applicant
- Lin et al., “Rotation, Scale, and Translation Resilient Watermarking for Images,” IEEE Transactions on Image Processing, vol. 10, No. 5, May 2001, pp. 767-782.Applicant
- Nikolaidis et al., “Region-Based Image Watermarking,” IEEE Transactions on Image Processing, vol. 10, No. 11, Nov. 2001, pp. 1726-1740.Applicant
- Su et al., “Synchronized Detection of the Block-based Watermark with Invisible Grid Embedding,” Proc. SPIE vol. 4314: Security and Watermarking of Multimedia Contents III, Jan. 2001, pp. 406-417.Applicant
- Pitas et al., “Region-based Image Watermarking,” IEEE Transactions on Image Processing, vol. 10, No. 5, May 2001, pp. 1726-1740.Applicant
- Fan, et al., “LIBLINEAR: A Library for Large Linear Classification,” Journal of Machine Learning Research 9 (2008) 1871-1874.Applicant