US 7,127,744 B2Grant
Method and apparatus to protect media existing in an insecure format
Issue Date:2006-10-24
•31 Claims
•2 Drawing Sheets
Abstract
The present invention provides methods, systems and apparatus to manage processing of video content. In one implementation, a method of managing processing of video content is provided. The video content includes picture data representing picture elements to be rendered for display to a user. The embedded data is conveyed along with the video content. The method includes: (a) examining the embedded data for rights data, wherein the rights data is carried by a header; (b) only if the rights data is missing, examining the embedding data for protect data that is contained within the picture data; and (c) if the rights data is missing and the protect data is present, then limiting processing of the video content. Other implementations are provided as well.
Metadata
Assignee
- Digimarc Corporation
Inventor
- Kenneth L Levy
Application Information
Application Number:US 09/801,515
Filing Date:2001-03-07
Priority Date:2000-03-10
Art Unit:2135
Classifications
IPC:
H04L9/00
Patent Drawings (2 sheets)
Description
[0001] This application claims the benefit of Provisional Patent Applications Ser. No. 60/188,462 filed Mar. 10, 2000, incorporated herein by reference.
Technical Field
[0002] This invention relates to the field of embedded data, known as watermarks, and copy control for media.
Background of the Invention
[0003] Digital content, including audio, video, images, multimedia, etc., is easy to copy and expensive to create. Thus, it is a great target for illegal distribution, defined as piracy. Currently, this piracy is occurring with audio, using MPEG-1 Layer 3 (MP3) bit-rate compression format and the Internet. The MP3 format is used by new artist who want their music freely distributed, as well as by people transforming CD audio into MP3 and possibly illegally distributing it on the Internet. Professional artists and record labels want to stop the second action while allowing the first, and even distribute new content in MP3.
[0004] The problem with robust embedded data based methods of protecting content in this insecure format is that they are computationally intense. The prior-art describes numerous examples of such methods using embedded data (a.k.a. watermarks or steganography) that require frequency transformations. Assuming a different watermark is required for each user, player, storage unit and/or content, distributors will need expensive equipment to protect the data and users will require expensive devices to render the content.
[0005] The problem with efficient embedded data methods used to protect the content in this insecure format is that they are easy to remove, even though they can be made robust to duplication, such as utility patent application Ser. No. 09/404,291 entitled “Method and apparatus for robust embedded data” submitted on Sep. 23, 1999 by Levy, included herein by reference. Removal of embedded data is not a problem if you require the content to contain the embedded data in order to be rendered, but this concept only works in a secure format. In other words, in an insecure format, if the embedded data that informs the rendering device that the content can or cannot be played is removed, the content can always be played. However, with a secure format, removal of the embedded data that informs the rendering device that the content can or cannot be played leaves the content useless since the device cannot render, such as decrypt, the content without this embedded authorization. For example, in MP3, an insecure format where there is a desire to freely distribute content without protection, the removal of the watermark creates useful pirated content.
[0006] Cryptology can also be used to secure the content. However, not only is this technique computationally intense since it requires many operations using a large number of bits, but also one can argue that the format has been changed since existing players cannot play the protected content.
Summary of the Invention
[0007] This object of this novel process is to efficiently protect content in an insecure format using two different layers of embedding data (referred to as watermarks for ease of understanding).
[0008] One watermark is robust and declares that the content is protected. This watermark is embedded when the content is created in the desired format, such as MP3, CD or DVD. This means that the computational intensity of adding the watermark is not an issue because the watermark is only added to the audio once, and copied with the audio by the distributor. This watermark is labeled the Protect watermark.
[0009] The other watermark gives the content its rights, i.e. declares that it is okay to play or record the content. It is efficient, and does not need to be difficult to removal, since removing it produces no advantageous results. The efficiency of this watermark is desirable since it must be embedded each time the audio reproduced, such as downloaded on the Internet, possibly to link the content to the user, player, recorder and/or storage device. Thus, it greatly reduces the cost of copy management for the distributor. In addition, it lowers the cost of the portable players, since they only have to find this efficient watermark. This watermark is labeled the Rights Watermark.
[0010] To this end, it is desirable to use different types of watermark for each layer and not two different layers of one watermarking technique. For example, it is not desirable to use one watermarking technique where one layer is embedded at a low-level, thus being fragile, and another layer is embedded at a higher-level, thus being robust.
[0011] Importantly, non-protected content may contain neither watermark and can be rendered by any device from any storage. Thus, the rendering devices can be both forward and backwards compatible.
[0012] The invented apparatus, which implements the described process, includes an analog or digital logic processor and a storage unit, such a random access memory.
Brief Description of the Drawings
[0013] FIG. 1 is an overview of the process of using two watermarks to protect content in an insecure format with minimal increase in computational complexity, and thus cost.
[0014] FIG. 2 displays the pseudocode for the embedding process.
[0015] FIG. 3 displays the pseudocode for the retrieving process.
[0016] FIG. 4 displays the apparatus.
Detailed Description
[0017] This invention begins by explaining the terminology. Content refers to the data, including but not limited to audio, video, images and smells. Storage refers to device that stores the data. The term watermark refers to any system of embedding data that is minimally perceived when the content is played, and is also known as steganography. Data embedded in the header, and not hidden within the content is still considered a watermark. Robust methods are difficult to bypass. A pirate is an individual who attempts to illegally copy or distribute the content.
[0018] FIG. 1 displays an overview of the invented process. Content 100 exists in an insecure format, which means that non-compliant devices, i.e. devices ignoring copy protection rules, can render the content even if the content declares itself as non-renderable. An intrinsic benefit of an insecure format is that legacy devices, i.e. device created before the copy protection system was defined, can render the protected content. In other words, the system is backwards and forwards compatible. An example of an insecure format is MP3. Some artists wish to freely distribute their content in this format. However, there are other interested parties who want to distribute their content in the same format without allowing it to be freely copied and redistributed.
[0019] The protect watermark 110 declares that the content is protected. The protect watermark 110 must be extremely difficult to remove, and, accordingly, may be computationally intense. Many existing watermark methods meet this description, and future ones will certainly be designed. The rights watermark 120 gives the user rights to render the content. This watermark may link the content to the user, player, recorder and/or storage device. This link would determine if the user may copy and/or play the content. The rights watermark 120 must be a computationally efficient method that is hard to duplicate. Currently, Levy's application, as referenced above, describes how to design embedded data that is hard to duplicate, i.e. transfer between content to give rights to content that should not include these rights. However, it is expected that more duplication resistant watermarks will be produced in the future.
[0020] Both watermarks are embedded and retrieved at different times in the reproduction process, as shown in FIGS. 1 , 2 and 3. The protect watermark 110 is embedded when the audio is created, and copied with the audio when distributed. In addition, the protect watermark 110 is only retrieved when the rights watermark 120 does not exist in the content. Thus, the computational intensity of adding the watermark is not that important.
[0021] The rights watermark 120 is embedded when the content is reproduced, such as being distributed, placed on permanent storage, or encoded to an alternative form by a personal encoding device. The term reproduced refers to the legal transformation or distribution of the content, whereas copying refers to an individual producing an exact bit-for-bit replication of the content for legal or illegal utilization. Since rights watermark 120 is embedded every time the content is reproduced, its efficiency creates a useful reduction in cost for the supporting hardware. Since the rights watermark 120 is embedded after watermark 110 it must be okay to layer the watermarks, as known to be possible with existing technology.
[0022] Optimally, the watermarks are search and retrieved in a specific order, as shown in FIGS. 1 and 3 . First, the content is searched for rights watermark 120 (box 300). If rights watermark 120 is retrieved (box 310) the embedded information is evaluated (box 320). If the embedded information is correct, the desired action is enabled (box 330). Alternatively, if the embedded information is not correct, the desired action is disabled (box 340). Only if rights watermark 120 is not found does the content need to be searched for the computationally intense protect watermark 110 (box 350). If protect watermark 110 declares the content protected, then the desired action is disabled (box 340), otherwise the desire action is allowed (box 330).
[0023] When using a rendering device, such as a MP3 player, which has a portable section, the watermark processing tasks can be split between the loader, potentially a PC program, and the portable section. The split can be designed such that the portable section never needs to retrieve the protect watermark, thus reducing the price of the consumer electronics portable player by reducing required processing power in this portable section. For example, when loading the content to the portable section, the loader can check for the rights watermark and the protect watermark, if necessary. If the desired action for the content is not allowed, the content is not loaded. If the desired action is allowed, the content is loaded to the portable device.
[0024] Then, the portable device may only required to process the rights watermark, which is efficient to retrieve and embed, for future actions. The portable section would check for the rights watermark 120 if the rights watermark 120 contained information the portable device is required to understand, such that the portable device can intelligently (i.e. based upon an rules engine) decide how to act upon the content. For example, utility patent application Ser. No. 09/522,312 entitled “Method and apparatus for automatic ID management” submitted on Mar. 9, 2000 by Levy (included herein by reference), requires that the portable section (i.e. portable player) requires the user ID contained in the rights watermark such that the portable section can track usage and intelligently limit it to a specified number of users, while allowing all content to be previewed.
[0025] Finally, this invented process can be used to restrict copying and/or playing of the content. Since this content is easily created by individuals and desired to exist on storage in general purpose computers, it is preferred to use the invention to restrict playing.
[0026] FIG. 4 shows the hardware apparatus required to implement the invented processes, such as embedding and detecting the protect watermark 110 and rights watermark 120. The hardware includes a logic processor 400 and a storage unit 410. The logic processor 400 may be defined as the equivalent of a digital signal processor (DSP), general-purpose central processing unit (CPU), or a specialized CPU, including media processors. A likely DSP chip is one of the Texas Instruments TMS320 product line. A CPU could include one of Intel's Pentium line or Motorola/IBM's PowerPC product line. The design is simple for someone familiar with the state of the art given the above pseudocode and description. The storage unit 410 includes RAM when using a digital processor.
[0027] In addition, a person familiar with the state of the art could implement the process with analog and digital circuitry, either separate or in an application specific integrated circuit (ASIC). The analog and digital circuitry could include any combination of the following devices: a digital-to-analog converter (D/A), comparators, sample-and-hold circuits, delay elements, analog-to-digital converter (A/D), and programmable logic controllers (PLC).
[0028] The foregoing descriptions of the preferred embodiments of the invention have been presented to teach those skilled in the art how to best utilize the invention. Many modifications and variations are possible in light of the above teaching. For example, even though this invention discusses audio and the Internet, it is extendable to other types of content and distribution. To this end, the following claims define the scope and spirit of the invention.
Claims
Certificate of Correction present
The claims shown below may not include correction changes. Use the corrected PDF for authoritative text.
I claim:
1. A method of managing processing of video content, the video content including picture data representing picture elements to be rendered for display to a user, and including data conveyed along with the picture data but not representing picture elements to be rendered for display to a user, the method including:
(a) examining the data for copy control data, wherein the data comprises a header;
(b) only if the copy control data is missing, examining the picture data for a steganographic signal; and
(c) if the copy control data is missing, and the steganographic signal is present, then limiting processing of the video content.
2. The method of claim 1 wherein the copy control data represents one of a plurality of states, the states comprising at least: i) copy once; ii) copy freely; iii) copy no more; and iv) copy never.
3. A method of managing processing of video content, the video content including picture data representing picture elements to be rendered for display to a user, and including a first watermark and a second watermark, the method including:
(a) examining the video content for the first watermark to obtain copy control data, wherein the first watermark comprises a header;
(b) examining the picture data for a second watermark, wherein the picture data is examined for the second watermark only when the copy control data is missing; and
(c) if the copy control data is missing, and the second watermark is present, then limiting processing of the video content.
4. The method of claim 3 wherein the copy control data represents one of a plurality of states, the states comprising al least: i) copy once; ii) copy freely; iii) copy no more; and iv) copy never.
5. A method of managing processing of video content, the video content including picture data representing picture elements to be rendered for display to a user, where embedded data is conveyed along with the video content, the method including:
(a) examining the embedded data for rights data, wherein the rights data is carried by a header;
(b) only if the rights data is missing, examining the embedded data for protect data that is contained within the picture data; and
(c) if the rights data is missing and the protect data is present, then limiting processing of the video content.
6. The method of claim 5 wherein relative to detection of the protect data, the rights data is more efficient to detect.
7. The method of claim 5 wherein the rights data can be separated from the video content during video processing.
8. The method of claim 5 wherein the protect data is visible when the picture elements are rendered for the user.
9. The method of claim 5 wherein the protect data is generally imperceptible when the picture elements are rendered for the user.
10. The method of claim 9 wherein relative to the rights data, the protect data is more robust to removal with video processing.
11. The method of claim 10 wherein relative to the rights data, the protect data is more complex to detect.
12. The method of claim 5 wherein the protect data is either present or absent.
13. The method of claim 12 wherein the protect data is robust to removal with video processing, and the rights data is efficient to detect relative to the protect data.
14. The method of claim 13 wherein the rights data includes copy control states, and the copy control states represent one of a plurality of states, the states comprising at least: i) copy once; ii) copy no more; and iii) copy never.
15. The method of claim 14 wherein the copy control states further represent: iv) copy freely.
16. The method of claim 14 wherein the video content comprises a viewable, non-encrypted format.
17. The method of claim 14 wherein the method is performed during a process of loading the video content to a remote location.
18. The method of claim 17 wherein the remote location comprises portable media, and the limiting processing of the video content comprises blocking loading of the video content to the portable media.
19. The method of claim 12 wherein the rights data includes copy control states, and the copy control states represent one of a plurality of states, the states comprising at least: i) copy once; ii) copy no more; and iii) copy never.
20. The method of claim 19 wherein the video content comprises a viewable, non-scrambled format.
21. The method of claim 19 wherein the method is performed during a process of loading the video content to a remote location.
22. The method of claim 21 wherein the remote location comprises portable media, and the limiting processing of the video content comprises blocking loading of the video content to the portable media.
23. The method of claim 12 wherein the rights data comprises multi-bits and carries different information than the protect data.
24. The method of claim 5 wherein the rights data includes copy control states, and the copy control states represent one of a plurality of states, the states comprising at least: i) copy once; ii) copy no more; and iii) copy never.
25. The method of claim 24 wherein the copy control states further represent: iv) copy freely.
26. The method of claim 24 wherein the copy control states further represent: iv) copy freely.
27. The method of claim 5 wherein the video content comprises a viewable, non-scrambled format.
28. The method of claim 5 wherein the method is performed during a process of loading the video content to a remote location.
29. The method of claim 28 wherein the remote location comprises portable media, and the limiting processing of the video content comprises blocking loading of the video content to the portable media.
30. The method of claim 5 wherein the rights data and protect data carry different information.
31. The method of claim 5 wherein the protect data is contained within the picture data through steganographic embedding.
Patent Citations (58)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4807031(A) | 1989-02-01 | Broughton | Applicant |
| US5459583(A) | 1995-10-01 | Nakata | Applicant |
| US5579124(A) | 1996-11-01 | Aijala et al. | Applicant |
| US5721788(A) | 1998-02-01 | Powell et al. | Applicant |
| US5748763(A) | 1998-05-01 | Rhoads | Applicant |
| US5765152(A) | 1998-06-01 | Erickson | Applicant |
| US5841978(A) | 1998-11-01 | Rhoads | Applicant |
| US5845281(A) | 1998-12-01 | Benson et al. | Applicant |
| US5862260(A) | 1999-01-01 | Rhoads | Applicant |
| US5875249(A) | 1999-02-01 | Mintzer et al. | Applicant |
| US5910987(A) | 1999-06-01 | Ginter et al. | Applicant |
| US5912972(A) | 1999-06-01 | Barton | Applicant |
| US5930369(A) | 1999-07-01 | Cox et al. | Applicant |
| US5940134(A) | 1999-08-01 | Wirtz | Applicant |
| US5943422(A) | 1999-08-01 | Van Wie et al. | Applicant |
| US5991500(A) | 1999-11-01 | Kanota et al. | Applicant |
| US6021196(A) | 2000-02-01 | Sandford et al. | Applicant |
| US6031815(A) | 2000-02-01 | Heemskerk | Applicant |
| US6044182(A) | 2000-03-01 | Daly et al. | Applicant |
| US6049627(A) | 2000-04-01 | Becker et al. | Applicant |
| US6061793(A) | 2000-05-01 | Tewfik et al. | Applicant |
| US6112008(A) | 2000-08-01 | Sugita et al. | Applicant |
| US6131161(A) | 2000-10-01 | Linnartz | Applicant |
| US6209092(B1) | 2001-03-01 | Linnartz | Applicant |
| US6230268(B1) | 2001-05-01 | Miwa et al. | Applicant |
| US6246775(B1) | 2001-06-01 | Nakamura et al. | Examiner |
| US6282654(B1) | 2001-08-01 | Ikeda et al. | Applicant |
| US6311214(B1) | 2001-10-01 | Rhoads | Applicant |
| US6314518(B1) | 2001-11-01 | Linnartz | Applicant |
| US6342924(B1) | 2002-01-01 | Ikeda et al. | Applicant |
| US6370319(B1) | 2002-04-01 | Matsumoto et al. | Examiner |
| US6374036(B1) | 2002-04-01 | Ryan et al. | Applicant |
| US6421450(B1) | 2002-07-01 | Nakano | Applicant |
| US6433946(B1) | 2002-08-01 | Ogino | Applicant |
| US6434322(B1) | 2002-08-01 | Kimura et al. | Applicant |
| US6437933(B1) | 2002-08-01 | Kanagawa et al. | Applicant |
| US6449425(B1) | 2002-09-01 | Ogino | Applicant |
| US6473560(B1) | 2002-10-01 | Linnartz et al. | Applicant |
| US6526510(B1) | 2003-02-01 | Kori et al. | Applicant |
| US6530021(B1) | 2003-03-01 | Epstein et al. | Applicant |
| US6535614(B1) | 2003-03-01 | Kimura et al. | Applicant |
| US6571220(B1) | 2003-05-01 | Ogino et al. | Applicant |
| US6590997(B1) | 2003-07-01 | Rhoads | Applicant |
| US6591365(B1) | 2003-07-01 | Cookson | Applicant |
| US6601046(B1) | 2003-07-01 | Epstein | Applicant |
| US6633723(B1) | 2003-10-01 | Kuroda et al. | Applicant |
| US6636551(B1) | 2003-10-01 | Ikeda et al. | Applicant |
| US6674858(B1) | 2004-01-01 | Kimura et al. | Applicant |
| US6687802(B1) | 2004-02-01 | Kori et al. | Applicant |
| US6707774(B1) | 2004-03-01 | Kuroda et al. | Applicant |
| US6721437(B1) | 2004-04-01 | Ezaki et al. | Applicant |
| US6882728(B1) | 2005-04-01 | Takahashi et al. | Examiner |
| US6987862(B1) | 2006-01-01 | Rhoads | Applicant |
| US2001/0021144(A1) | 2001-09-01 | Oshima et al. | Applicant |
| US2002/0090114(A1) | 2002-07-01 | Rhoads | Applicant |
| US2002/0156742(A1) | 2002-10-01 | Ogino et al. | Applicant |
| US2004/0059581(A1) | 2004-03-01 | Kirovski et al. | Applicant |
| US2004/0240846(A1) | 2004-12-01 | Cookson et al. | Applicant |
Non-Patent Literature (17)
- U.S. Appl. No. 09/404,291, filed Sep. 23, 1999, Levy.Applicant
- U.S. Appl. No. 60/116,641, filed Jan. 21, 1999, Cookson.Applicant
- Subset of allowed claims and Sep. 7, 2005, Notice of Allowance and Issue Fee Due, each from Assignee's U.S. Appl. No. 10/017,678.Applicant
- Response to CfP for Technology Solutions to Screen Digital Audio Content for LCM Acceptance, NTT Waveless Radio Consotium, May 23, 1999, 9 pages.Applicant
- Microsoft Response to CfP for Technology Solutions to Screen Digital Audio Content for LCM Acceptance, SDMI, PDWG Tokyo, May 23, 1999, 9 pages.Applicant
- Audio Watermarking Architectures for Secure Digital Music Distribution, A Proposal to the SDMI Portable Devices Working Group by ARIS Technologies, Inc, Mar. 26, 1999, pp. 1-9.Applicant
- Audio Watermarking Architectures for Persistent Protection, Presentation to SDMI PDWG, Mar. 29, 1999, pp. 1-16.Applicant
- Audio Watermarking System to Screen Digital Audio Content for LCM Acceptance, A Proposal Submitted in Response to PDWG99050504-Transition CfP by ARIS Technologies, Inc., May 23, 1999, Document Version 1.0, 15 pages.Applicant
- Thomas, Keith, Screening Technology for Content from Compact Discs, May 24, 1999, 11 pages.Applicant
- Cookson, Chris, General Principles of Music Uses on Portable Devices, presented to SDMI, Mar. 5, 1999, pp. 1-4.Applicant
- NEC Data Hiding Proposal, Response to Call for Proposal Issued by the Data Hiding SubGroup, Copy Protection Technical Working Group, Oct. 1997.Applicant
- Philips Electronics, Response to Call for Proposals Issued by the Data Hiding SubGroup, Copy Protection Technical Working Group, 1997.Applicant
- Digital Audio Screening Technology for Phased Rollout, Version 1.00, Philips Research, Liquid Audio, Fraunhofer Institute, May 1999.Applicant
- Pierce et al, “Interim Report, Results of Phases I and II, Issued by the Data Hiding Subgroup, Copy Protection Technical Working Group,” May 1998.Applicant
- “AIPL Greyhound Overview,” Hand-out distributed at meeting of Secure Digital Music Initiative, Mar. 29, 1999, 1 page.Applicant
- “AIPL's Copy Management System,” distributed on or after Oct. 1999, 5 pages.Applicant
- AIPL, “Our Proposal for SDMI's Short-Term Objective,” privately distributed, Mar. 11, 1999, 9 pages.Applicant