Scrambled packet stream processing

[0001] This application claims the benefit of the filing date of U.S. Provisional Patent Application Ser. No. 60/360,635, filed Mar. 1, 2002, and titled “Processing of Scrambled Streams,” and U.K. Patent Application No. 0204190.3, filed Feb. 22, 2002, and titled “Processing of Scrambled Streams,” both of which are incorporated herein by reference in their entirety.

[0002] The present invention relates to packet-based communications systems in general, and more particularly to processing scrambled packet streams.

[0003] Systems for receiving digital television signals are well known. In one common end-user configuration, such as may be seen in FIG. 1, a home video server 100 employs a tuner 102 to receive a digital television broadcast signal via a satellite receiver 104. The signal data, such as a scrambled MPEG-2 packet stream, may be stored on a storage medium 110, descrambled and decoded by an MPEG decoder 106 for viewing on a television 108, and transmitted in scrambled form via a transmitter 112 to a client 114. Client 114 may similarly descramble and decode the scrambled packet stream at an MPEG decoder 116 for viewing on a television 118.

[0004] When transmitting to client 114, it is advantageous to transmit the MPEG-2 packet stream in scrambled form in support of anti-piracy measures. However, current solutions for providing trick mode support to clients, such as fast-forward viewing, require a) changing the transmission rate, or b) descrambling the packet stream at the video server, modifying the video content to support the trick mode, and either b1) transmitting the descrambled and modified video to the client, or b2) rescrambling and transmitting the modified video to the client. Unfortunately, the existing bandwidth between the server and the client is often insufficient to support an accelerated transmission rate, transmitting descrambled video to the client defeats anti-piracy measures, and existing home video servers are generally incapable of scrambling, and the cost and complexity of adding scrambling functionality to existing hardware, or replacing existing hardware with hardware having scrambling capability, may be prohibitive.

[0005] Trick mode support for scrambled packet streams that takes advantage of existing bandwidth, that provides for transmission of scrambled packet streams to clients, and that does not require rescrambling at the end-user video server would therefore be advantageous.

[0006] The present invention, in preferred embodiments thereof, provides for scrambled packet stream processing in which portions of a scrambled packet stream are removed or descrambled and altered, such as in support of digital video trick modes, while preserving a valid video stream that includes scrambled portions that have not been altered.

[0007] In one aspect of a preferred embodiment of the present invention a method is provided for processing a packet-based scrambled stream, the method including receiving a plurality of scrambled packets in a packet stream, descrambling any of the scrambled packets, and transmitting a modified packet stream including at least one of the descrambled packets and at least one of the scrambled packets.

[0008] In another aspect of a preferred embodiment of the present invention the method further includes moving a data segment within a payload of any of the packets from a first location within the payload to a second location within the payload.

[0009] In another aspect of a preferred embodiment of the present invention the method further includes overwriting at least a portion of the first location.

[0010] In another aspect of a preferred embodiment of the present invention the overwriting step includes overwriting with any of zeroes, stuffing bytes, and padding bytes.

[0011] In another aspect of a preferred embodiment of the present invention the method further includes overwriting data designated as undesirable within a payload of any of the packets.

[0012] In another aspect of a preferred embodiment of the present invention any of the overwriting steps includes overwriting with any of zeroes, stuffing bytes, and padding bytes.

[0013] In another aspect of a preferred embodiment of the present invention the method further includes changing the value of at least one byte of any of the packets in accordance with a predefined processing decision.

[0014] In another aspect of a preferred embodiment of the present invention the changing step includes changing the byte in any of the descrambled packets.

[0015] In another aspect of a preferred embodiment of the present invention the method further includes changing the value of at least one bit of any of the packets in accordance with a predefined processing decision.

[0016] In another aspect of a preferred embodiment of the present invention the changing step includes changing the bit in any of the descrambled packets.

[0017] In another aspect of a preferred embodiment of the present invention the method further includes dropping any of the packets from the received packet stream in accordance with a predefined processing decision.

[0018] In another aspect of a preferred embodiment of the present invention the receiving step includes receiving a video stream including a plurality of independent video elements and at least one video element that is dependent on any of the independent video elements, and the method further includes removing any of the dependent video elements from the video stream, thereby resulting in the modified packet stream.

[0019] In another aspect of a preferred embodiment of the present invention the method further includes modifying any of the video elements to maintain the validity of the processed video stream with respect to a protocol.

[0020] In another aspect of a preferred embodiment of the present invention the method further includes holding any of the packets until the packets collectively comprise a predefined processing unit, and the transmitting step includes transmitting the held packets including the processing unit.

[0021] In another aspect of a preferred embodiment of the present invention the method further includes holding any of the packets until the packets collectively comprise the data of at least one picture, and the transmitting step includes transmitting the held packets including the data of the picture.

[0022] In another aspect of a preferred embodiment of the present invention the method further includes retransmitting the held packets at least one additional time.

[0023] In another aspect of a preferred embodiment of the present invention the retransmitting step includes retransmitting a sufficient number of times in order to effect a predetermined slow-down factor of a display of the picture.

[0024] In another aspect of a preferred embodiment of the present invention the retransmitting step includes retransmitting where the picture is an MPEG-protocol B-picture.

[0025] In another aspect of a preferred embodiment of the present invention the method further includes transmitting a sufficient number of null pictures in order to effect a predetermined slow-down factor of a display of the picture.

[0026] In another aspect of a preferred embodiment of the present invention the transmitting null pictures step includes transmitting where the picture is either of an MPEG-protocol P-picture and an MPEG-protocol I-picture.

[0027] In another aspect of a preferred embodiment of the present invention the method further includes converting any of the packets including data from multiple pictures into a plurality of individual packets, each including data from only one of the multiple pictures.

[0028] In another aspect of a preferred embodiment of the present invention the method further includes modifying any of the packets to maintain the slow-down factor.

[0029] In another aspect of a preferred embodiment of the present invention the method further includes modifying any of the packets to maintain the validity of the packet stream with respect to an MPEG protocol.

[0030] In another aspect of a preferred embodiment of the present invention a method is provided for providing a processed MPEG video stream, the method including receiving an MPEG video stream as a plurality of scrambled packets including data that are designated as desirable data and data that are designated as undesirable data, descrambling any of the scrambled packets, and transmitting a processed MPEG video stream including at least one of the descrambled packets and at least one of the scrambled packets.

[0031] In another aspect of a preferred embodiment of the present invention the method further includes removing any of the undesirable data from any of the descrambled packets, thereby resulting in a modified descrambled packet, and where the transmitting step includes transmitting the modified descrambled packet.

[0032] In another aspect of a preferred embodiment of the present invention the method further includes designating as desirable data any of I-picture data and header data that is necessary to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0033] In another aspect of a preferred embodiment of the present invention the method further includes designating as undesirable data any of P-picture data, B-picture data, and header data that not is necessary to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0034] In another aspect of a preferred embodiment of the present invention the method further includes modifying any header information in the processed MPEG video stream to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0035] In another aspect of a preferred embodiment of the present invention the removing step includes dropping any of the packets having only the undesirable data.

[0036] In another aspect of a preferred embodiment of the present invention the removing step includes overwriting at least a portion of the undesirable data with any of zeroes, stuffing bytes, and padding bytes.

[0037] In another aspect of a preferred embodiment of the present invention the removing step includes padding an adaptation field within any of the packets having the undesirable data with a sufficient number of bytes to overwrite at least a portion of the undesirable data.

[0038] In another aspect of a preferred embodiment of the present invention the removing step includes moving the desirable data within a payload of any of the packets from a first location within the payload to a second location within the payload.

[0039] In another aspect of a preferred embodiment of the present invention the removing step includes overwriting at least a portion of the first location.

[0040] In another aspect of a preferred embodiment of the present invention the removing step includes overwriting at least a portion of the first location with any of zeroes, stuffing bytes, and padding bytes.

[0041] In another aspect of a preferred embodiment of the present invention the removing step includes padding an adaptation field within the packet with a sufficient number of bytes to overwrite at least a portion of the first location.

[0042] In another aspect of a preferred embodiment of the present invention the removing step includes overwriting a PES header in any of the packets with PES header stuffing bytes, where the PES header is followed by the desirable data, and setting a flags byte of the PES header to indicate that no PES header options are present.

[0043] In another aspect of a preferred embodiment of the present invention the method further includes generating and inserting into the processed MPEG video stream a TS packet including a generated PES header where the PES header is required to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0044] In another aspect of a preferred embodiment of the present invention the method further includes generating and inserting into the processed MPEG video stream a TS packet including a generated PCR where the PCR is required to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0045] In another aspect of a preferred embodiment of the present invention the method further includes generating and inserting a sufficient number of null pictures into the processed MPEG video stream to achieve a predefined playback speed.

[0046] In another aspect of a preferred embodiment of the present invention the removing step includes, where any of the packets includes an ES sequence header, setting a bit_rate_value of the ES sequence header to a peak bit rate at which the processed MPEG video stream will be transmitted, and setting a vbv_buffer_size_value of the ES sequence header equal to that which is indicated for a Main Profile at Main Level.

[0047] In another aspect of a preferred embodiment of the present invention the removing step includes, where any of the packets includes a picture header of an I-picture, setting a temporal_reference value in the packet to zero setting a vbv_delay in the packet to indicate that no value is specified.

[0048] In another aspect of a preferred embodiment of the present invention the removing step includes, where any of the packets includes an adaptation field that may be removed without compromising the validity of the processed MPEG video stream, replacing a flags byte of the adaptation field with zeros, and replacing all remaining bytes of the adaptation field with stuffing bytes.

[0049] In another aspect of a preferred embodiment of the present invention a scrambled packet stream processor is provided including a descrambler operative to descramble any packet in a scrambled packet stream, a packet processor operative to perform at least one packet processing decision upon any of the packets resulting in any of generating a packet, deciding to drop any of the packets, altering any of the packets, and deciding to forward any of the packets from the stream, and a packet selector responsive to the decision and operative to perform any of inserting the generated packet into the stream, dropping any of the packets, and forwarding any of the packets, where the packet selector forwards at least one of the scrambled packets and at least one descrambled packet.

[0050] In another aspect of a preferred embodiment of the present invention a packet stream processing architecture is provided including a first packet buffer into which a first TS packet from a packet stream may be placed, a second packet buffer into which a second TS packet that follows the first TS packet in the packet stream may be placed, a first data pointer operative to indicate the location of the packet payload of the first packet, a second data pointer operative to indicate the location of the packet payload of the second packet, a first flag operative to indicate if the first packet should be transmitted in scrambled or descrambled form, and a second flag operative to indicate if the second packet should be transmitted in scrambled or descrambled form.

[0051] In another aspect of a preferred embodiment of the present invention the architecture further includes a PID filter operative to selectively place any of the packets into any of the buffers in accordance with predefined selection criteria.

[0052] In another aspect of a preferred embodiment of the present invention apparatus for processing a packet-based scrambled stream is provided including a descrambler operative to receive a plurality of scrambled packets in a packet stream and descramble any of the scrambled packets, and a packet selector operative to transmit a modified packet stream including at least one of the descrambled packets and at least one of the scrambled packets.

[0053] In another aspect of a preferred embodiment of the present invention the apparatus further includes a packet processor operative to modify any of the packets.

[0054] In another aspect of a preferred embodiment of the present invention the packet processor is operative to move a data segment within a payload of any of the packets from a first location within the payload to a second location within the payload.

[0055] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite at least a portion of the first location.

[0056] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite with any of zeroes, stuffing bytes, and padding bytes.

[0057] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite data designated as undesirable within a payload of any of the packets.

[0058] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite with any of zeroes, stuffing bytes, and padding bytes.

[0059] In another aspect of a preferred embodiment of the present invention the packet processor is operative to change the value of at least one byte of any of the packets in accordance with a predefined processing decision.

[0060] In another aspect of a preferred embodiment of the present invention the packet processor is operative to change the byte in any of the descrambled packets.

[0061] In another aspect of a preferred embodiment of the present invention the packet processor is operative to change the value of at least one bit of any of the packets in accordance with a predefined processing decision.

[0062] In another aspect of a preferred embodiment of the present invention the packet processor is operative to change the bit in any of the descrambled packets.

[0063] In another aspect of a preferred embodiment of the present invention the packet processor is operative to drop any of the packets from the received packet stream in accordance with a predefined processing decision.

[0064] In another aspect of a preferred embodiment of the present invention the stream includes a plurality of independent video elements and at least one video element that is dependent on any of the independent video elements, and the packet processor is operative to remove any of the dependent video elements from the video stream, thereby resulting in the modified packet stream.

[0065] In another aspect of a preferred embodiment of the present invention the packet processor is operative to modify any of the video elements to maintain the validity of the processed video stream with respect to a protocol.

[0066] In another aspect of a preferred embodiment of the present invention the packet processor is operative to hold any of the packets until the packets collectively comprise a predefined processing unit, and where the packet selector is operative to transmit the held packets including the processing unit.

[0067] In another aspect of a preferred embodiment of the present invention the packet processor is operative to hold any of the packets until the packets collectively comprise the data of at least one picture, and where the packet selector is operative to transmit the held packets including the data of the picture.

[0068] In another aspect of a preferred embodiment of the present invention the packet selector is operative to retransmit the held packets at least one additional time.

[0069] In another aspect of a preferred embodiment of the present invention the packet selector is operative to retransmit the held packets a sufficient number of times in order to effect a predetermined slow-down factor of a display of the picture.

[0070] In another aspect of a preferred embodiment of the present invention the packet selector is operative to retransmit where the picture is an MPEG-protocol B-picture.

[0071] In another aspect of a preferred embodiment of the present invention the packet selector is operative to transmit a sufficient number of null pictures in order to effect a predetermined slowdown factor of a display of the picture.

[0072] In another aspect of a preferred embodiment of the present invention the packet selector is operative to transmit where the picture is either of an MPEG-protocol P-picture and an MPEG-protocol I-picture.

[0073] In another aspect of a preferred embodiment of the present invention the packet processor is operative to convert any of the packets including data from multiple pictures into a plurality of individual packets, each including data from only one of the multiple pictures.

[0074] In another aspect of a preferred embodiment of the present invention the packet processor is operative to modify any of the packets to maintain the slowdown factor.

[0075] In another aspect of a preferred embodiment of the present invention the apparatus further includes modifying any of the packets to maintain the validity of the packet stream with respect to an MPEG protocol.

[0076] In another aspect of a preferred embodiment of the present invention apparatus is provided for providing a processed MPEG video stream including a descrambler operative to receive an MPEG video stream as a plurality of scrambled packets including data that are designated as desirable data and data that are designated as undesirable data and descramble any of the scrambled packets, and a packet selector operative to transmit a processed MPEG video stream including at least one of the descrambled packets and at least one of the scrambled packets.

[0077] In another aspect of a preferred embodiment of the present invention the apparatus further includes a packet processor operative to remove any of the undesirable data from any of the descrambled packets, thereby resulting in a modified descrambled packet, and where the packet selector is operative to transmit the modified descrambled packet.

[0078] In another aspect of a preferred embodiment of the present invention the desirable data includes any of I-picture data and header data that is necessary to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0079] In another aspect of a preferred embodiment of the present invention the undesirable data includes any of P-picture data, B-picture data, and header data that not is necessary to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0080] In another aspect of a preferred embodiment of the present invention the packet processor is operative to modify any header information in the processed MPEG video stream to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0081] In another aspect of a preferred embodiment of the present invention the packet processor is operative to drop any of the packets having only the undesirable data.

[0082] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite at least a portion of the undesirable data with any of zeroes, stuffing bytes, and padding bytes.

[0083] In another aspect of a preferred embodiment of the present invention the packet processor is operative to pad an adaptation field within any of the packets having the undesirable data with a sufficient number of bytes to overwrite at least a portion of the undesirable data.

[0084] In another aspect of a preferred embodiment of the present invention the packet processor is operative to move the desirable data within a payload of any of the packets from a first location within the payload to a second location within the payload.

[0085] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite at least a portion of the first location.

[0086] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite at least a portion of the first location with any of zeroes, stuffing bytes, and padding bytes.

[0087] In another aspect of a preferred embodiment of the present invention the packet processor is operative to pad an adaptation field within the packet with a sufficient number of bytes to overwrite at least a portion of the first location.

[0088] In another aspect of a preferred embodiment of the present invention the packet processor is operative to overwrite a PES header in any of the packets with PES header stuffing bytes, where the PES header is followed by the desirable data, and set a flags byte of the PES header to indicate that no PES header options are present.

[0089] In another aspect of a preferred embodiment of the present invention the packet processor is operative to generate and insert into processed MPEG video stream a TS packet including a generated PES header where the PES header is required to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0090] In another aspect of a preferred embodiment of the present invention the packet processor is operative to generate and insert into the processed MPEG video stream a TS packet including a generated PCR where the PCR is required to maintain the validity of the processed MPEG video stream with respect to an MPEG protocol.

[0091] In another aspect of a preferred embodiment of the present invention the packet processor is operative to generate and insert a sufficient number of null pictures into the processed MPEG video stream to achieve a predefined playback speed.

[0092] In another aspect of a preferred embodiment of the present invention the packet processor is operative to, where any of the packets includes an ES sequence header, set a bit_rate_value of the ES sequence header to a peak bit rate at which the processed MPEG video stream will be transmitted, and set a vbv_buffer_size_value of the ES sequence header equal to that which is indicated for a Main Profile at Main Level.

[0093] In another aspect of a preferred embodiment of the present invention the packet processor is operative to, where any of the packets includes a picture header of an I-picture, set a temporal_reference value in the packet to zero set a vbv_delay in the packet to indicate that no value is specified.

[0094] In another aspect of a preferred embodiment of the present invention the packet processor is operative to, where any of the packets includes an adaptation field that may be removed without compromising the validity of the processed MPEG video stream, replace a flags byte of the adaptation field with zeros, and replace all remaining bytes of the adaptation field with stuffing bytes.

[0095] It is appreciated throughout the specification and claims that references to modifying data may be understood as referring to data modification at the bit or byte level.

[0096] The disclosures of all patents, patent applications, and other publications mentioned in this specification and of the patents, patent applications, and other publications cited therein are hereby incorporated by reference in their entirety.

[0097] The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the appended drawings in which:

[0098] FIG. 1 is a simplified block diagram of a home video server architecture, useful in understanding the present invention;

[0099] FIG. 2 is a simplified conceptual illustration of aspects of MPEG-2 streams and packets, useful in understanding the present invention;

[0100] FIG. 3 is a simplified block diagram of a scrambled packet stream processor, constructed and operative in accordance with a preferred embodiment of the present invention;

[0101] FIGS. 4A-4J are simplified flowchart illustrations of packet processing decisions, operative in accordance with a preferred embodiment of the present invention;

[0102] FIG. 5 is a simplified block diagram of a packet stream processing architecture, constructed and operative in accordance with a preferred embodiment of the present invention; and

[0103] FIG. 6 is a simplified flowchart illustration of an alternate method of scrambled packet processing, operative in accordance with a preferred embodiment of the present invention.

[0104] Preferred embodiments of the present invention are now described with respect to MPEG-2 Elementary Streams and their transmission via MPEG-2 Transport Stream packets. It is noted, however, that the present invention is not limited to use with MPEG-2 streams and packets, and may be utilized in other packet-based communications systems.

[0105] Reference is now made to FIG. 2, which is a simplified conceptual illustration of aspects of MPEG-2 streams and packets, useful in understanding the present invention. In FIG. 2 an MPEG-2 Elementary Stream (ES) 200 is shown comprising an alternating stream of header portions 202 and video portions 204. ES 200 may be segmented, with each ES segment packetized into one or more Packetized Elementary Stream (PES) packets 206. Each PES packet 206 includes a PES header 208 followed by a PES payload 210, where each PES payload 210 stores a portion of an ES segment. Likewise, each PES packet 206 may be packetized into one or more Transport Stream (TS) packets 212. Each TS packet 212 includes a TS header 214, optionally followed by an adaptation field 216, and followed by a TS payload 218, where each TS packet 212 stores a portion of a PES packet 206.

[0106] Video portions 204 of ES 200 typically include groups of pictures (GOP), where each picture is encoded as one of three picture types: an Intra picture, or I-picture, where all the data for the picture are held within the picture itself; a Predicted picture, or P-picture, where some of the image data are predicted from the previous I or P picture; and a Bi-directionally Predicted picture, or B-picture, where some of the image data are predicted from the next I- or P-picture and some from the previous I- or P-picture. The structure of a GOP typically starts with an I-picture followed by a combination of P- and B-pictures, such as in the sequence IBBPBBPBBPBB, although for coding efficiency the order of the pictures within the GOP is typically different than presentation order of the pictures. Each coded picture is preceded by a start code, typically a bit string of 32 or more bits which starts byte-aligned with the 24-bit value 0x000001 and which may be preceded by any number of zero bytes. The start code provides information about the ES data that follow the start code. Individual pictures may vary in size, and are typically large enough to fill many TS packets. The start and end of a picture is not necessarily aligned with the start and end of a TS or PES packet.

[0107] PES header 208 may include timestamps which indicate when to decode or display pictures stored in PES payload 210. PES header 208 must start at the beginning of a TS packet, and may be followed by any part of the ES, including any part (i.e., beginning, middle, or end) of header portion 202 or video portion 204.

[0108] Reference is now made to FIG. 3, which is a simplified block diagram of a scrambled packet stream processor, constructed and operative in accordance with a preferred embodiment of the present invention. In FIG. 3, a scrambled packet stream, such as an MPEG-2 TS packet stream, is descrambled by a descrambler 300 in accordance with conventional techniques. Each packet is then processed by a packet processor 302 where the decision is made to drop the packet, forward the packet as-is in scrambled or descrambled form, alter and forward the scrambled or descrambled packet, or insert generated packets into the scrambled packet stream. A preferred method of operation of packet processor 302 is described in greater detail hereinbelow with reference to FIGS. 4A-4J. The decision is then forwarded to a packet selector 304. Packets that have been altered, that are to be forwarded as-is in scrambled or descrambled form, or that have been generated are forwarded by packet processor 302 to packet selector 304 as well. For each scrambled packet in the scrambled packet stream, packet selector 304 generates a processed packet stream by carrying out the decision made by packet processor 302 and either drops the packet, forwards the scrambled packet as is, replaces the packet with its altered version or as-is descrambled version, and/or inserts a generated packet into the scrambled packet stream.

[0109] Reference is now made to FIGS. 4A-4J, which are simplified flowchart illustrations of packet processing decisions, such as may be carried out by packet processor 302 (FIG. 3), operative in accordance with a preferred embodiment of the present invention. The packet processing decisions shown in FIGS. 4A-4J are typically carried out in support of fast-forward viewing of MPEG-2 streams, in which a TS packet stream is purged of packets that do not include data that are designated as desirable, such as I-picture data (including I-picture header information) or other critical header data. TS packets that include desirable data are either forwarded unmodified and in scrambled form, or are modified, such as by purging data that are designated as undesirable, such as B- and P-picture data, or by changing header field values, and forwarded in descrambled form.

[0110] In FIG. 4A, a descrambled TS packet is received. If the TS packet payload contains only data that are designated as undesirable, such as P-picture or B-picture data, PES header information, ES header data that are not required to maintain the validity of the MPEG stream, or any combination thereof, the entire packet is dropped (i.e., removed) from the stream.

[0111] In FIG. 4B, a descrambled TS packet is received in which the TS packet payload starts with data that are designated as undesirable, such as P- or B-picture data, and that is followed by data that are designated as desirable, such as I-picture data. The P- or B-picture data may be removed by overwriting them at the bit or byte level with zeroes which represent ES stuffing bytes (i.e., 0x00) which are ignored by the MPEG decoder. Alternatively, if the TS packet includes an adaptation field, the adaptation field may be expanded by padding it with a sufficient number of stuffing bytes to overwrite the P- or B-picture data bytes until the I-picture boundary is reached. A flags byte is then added if one does not exist, and the adaptation_field_length is then changed to reflect the increased size of the adaptation field. If no adaptation field is present, one may be created by setting the relevant TS packet header flag, including a length byte set to the size of the adaptation field, and, as needed, a flags byte set to 0x00followed by a sufficient number of adaptation field stuffing bytes (0xFF) until the I-picture startcode is reached.

[0112] In FIG. 4C, a descrambled TS packet is received in which the TS packet payload starts with data that are designated as desirable, such as I-picture data, followed only by data that are designated as undesirable, such as P-picture and/or B-picture data and/or ES header data that are not required to maintain the validity of the MPEG stream. The I-picture data is preferably moved to the end of the payload. The data at the start of the payload that is not desired may then be eliminated by overwriting them with ES stuffing bytes (i.e., 0x00) until the I-picture boundary is reached. Alternatively, the data that are not desired may be overwritten by expanding or inserting an adaptation field and padding it with stuffing bytes (i.e., 0xFF) as described above (FIG. 4B) until the I-picture boundary is reached.

[0113] In FIG. 4D, a descrambled TS packet is received in which the TS packet payload contains only PES header information followed by data that are designated as desirable, such as I-picture data and/or ES header data that are required to maintain the validity of the MPEG stream. The PES header may be eliminated by overwriting it with an allowable number (i.e., 32 bytes in the MPEG standard) of PES header stuffing bytes (i.e., 0xFF), and by setting the flags byte of the PES header to 0x00(i.e., setting the flags to indicate that no PES header options are present). Alternatively, the PES header may be eliminated by moving the I-picture data and/or ES header data to the end of the packet payload if the data are not already located at the end of the packet payload, by expanding or inserting an adaptation field and padding it with adaptation layer stuffing bytes (i.e., 0xFF) as described above (FIG. 4B), and by clearing the payload_unit_start_indicator in the TS header to indicate that there is no PES header present.

[0114] In FIG. 4E, if a PES header is required to maintain the validity of the MPEG stream, a TS packet may be generated including a generated PES header, and preferably no other payload data, and inserted into the TS packet stream. Preferably, the frame_rate_code most recently encountered in the sequence header portion of the ES header data is read. The frame_rate_code indicates the frame rate of the encoded video and is used to determine the correct display and/or decode timestamps for the generated PES header in accordance with conventional techniques. The TS packet payload may be reduced to the size required for the PES header through the use of a padded adaptation field, if required.

[0115] In FIG. 4F, if a Program Clock Reference (PCR) is required to maintain the validity of the MPEG stream, a TS packet may be generated including a generated PCR inserted into the TS packet stream. In order to generate a valid buffer model and to control the transmission of additional data, an accurate PCR correctly linked to the PES timestamps must be maintained. The last transmitted PCR, the number of packets sent since the last PCR was sent (and hence the number of bits sent), and the output bit rate are preferably maintained. If a constant bit-rate is in use, when a PCR value is required a “soft PCR” can be calculated by adding to the last transmitted PCR the time taken to send the number of packets transmitted at the bit-rate specified. When a PCR is transmitted, the soft PCR value is used, and the remembered PCR value is updated. Since PCRs must be transmitted frequently, a target time for the transmission of the next PCR is preferably maintained and compared with the end time of the current packet. If the current packet will finish being transmitted after the target time, then the PCR must be transmitted first. Once the correct time is identified, the PCR is transmitted.

[0116] In FIG. 4G, it may be necessary to display a given I-picture more than once to achieve a given playback speed. Thus, if the repetition of an I-picture is required to achieve a desired speed, one or more null pictures may be generated in accordance with conventional techniques and inserted into the TS packet stream. Typically, a null picture repeats the presentation of the most recently encountered reference picture, which is either an I- or P-picture, and is coded as a P-picture. Preferably, the horizontal_size_value and vertical_size_value most recently encountered in the sequence header portion of the ES header data are read. When generating null pictures these values are used to ensure that the generated frames are the same size as other frames in the stream. The temporal_reference value in the null picture header is preferably incremented relative to the previously encountered temporal_reference value.

[0117] In FIG. 41, a descrambled TS packet is received in which ES sequence header information is stored. In order to maintain the validity of the MPEG stream, the bit_rate_value and vbv_buffer_size_value of the ES sequence header are preferably changed. The bit_rate_value specifies the maximum bit rate at which the MPEG decoder buffer may operate, which, in practice, defines the peak bit-rate of the stream. This value is preferably set to the peak bit rate at which the stream will be transmitted and which may be set in accordance with conventional techniques. The vbv_buffer_size_value defines the size of the decoder buffer that is required to decode the stream. This value is preferably set equal to that which is indicated for the Main Profile at Main Level (MP@ML) in accordance with conventional techniques.

[0118] In FIG. 4I, a descrambled TS packet is received in which the picture header of an I-picture is stored. In order to maintain the validity of the MPEG stream, the temporal_reference and vbv_delay of the picture header are preferably changed. The temporal_reference defines when, in display order, the I-picture is to be displayed. The temporal_reference value in the current TS packet is preferably set to zero. The vbv_delay typically defines the length of time that the data for the current picture will remain in the decoder buffer. The value in the current TS packet is preferably set to all ones to indicate that no value is specified.

[0119] In FIG. 4J, a descrambled TS packet is received including an adaptation field. If the decision is made to retain the TS packet, and the adaptation field may be removed without compromising the validity of the MPEG stream, the flags byte (i.e., the second byte of the adaptation field) may be replaced with zeros, and all the remaining adaptation bytes may be replaced with stuffing bytes (0xff). Since adaptation fields are not scrambled, these changes may be alternatively made to the corresponding scrambled packet. If no other changes are made to the packet, the modified scrambled packet may be transmitted. Otherwise, the modified descrambled packet is transmitted.

[0120] In FIG. 4K, after the packet processing decisions of FIGS. 4A-4J have been made, if the TS packet is to be dropped, packet selector 304 is so notified. If the TS packet is to be forwarded, and no changes were made to the TS packet, packet selector 304 is notified to forward the scrambled version of the packet in the MPEG stream as is. If any changes where made to the descrambled packet payload, including reducing its size, packet selector 304 is notified to replace the scrambled version of the packet in the MPEG stream with the modified descrambled version. If no changes were made to the descrambled packet payload, but changes were made to the packet header, such as to the adaptation field, packet selector 304 is notified to forward the modified scrambled packet. Otherwise, packet selector 304 is notified to forward the modified descrambled packet.

[0121] Reference is now made to FIG. 5, which is a simplified block diagram of a packet stream processing architecture, constructed and operative in accordance with a preferred embodiment of the present invention. The architecture of FIG. 5 may be employed to carry out the packet processing decisions of FIGS. 4A-4J. In the architecture of FIG. 5, two packet buffers 500 and 502 are respectively used to read in a current TS packet and the packet following the current packet. Since picture start codes may straddle packets, it may be necessary to look into the next packet to identify a start code that begins in the current packet or to identify whether the start code that begins in the current packet is for an I-, P-, or B-picture.

[0122] When a packet is placed into a packet buffer, a data pointer 504, 506 is preferably set to indicate where the packet payload is to be found. If the packet has no payload (e.g., it is a PCR-only packet), then the packet may be dropped and another packet may be loaded. Likewise, a flag 508, 510 may be initialized that will be used to indicate if the packet should be transmitted in scrambled or descrambled form.

[0123] To calculate the payload start, any adaptation field bytes must be skipped, which may later be removed as described hereinabove. The length of the adaptation field is specified by the first byte of the adaptation field. Next, any PES header bytes, whose presence is indicated by the payload_unit_start_indicator flag in the TS header, should be skipped. The PES header bytes may also be removed by replacing them with adaptation field stuffing as described hereinabove. A PES header will start after any adaptation data, and its length is indicated in the ninth byte of the PES header of an audio or video stream. The remaining data in the packet represents the payload.

[0124] A PID filter 512 may be used to ensure that only TS packets with desired PIDs are processed by the stream processor. For example, where a fast-forward trick mode video stream is desired without audio, PID filter 512 may be used to filter out any TS packets with only audio data.

[0125] Reference is now made to FIG. 6, which is a simplified flowchart illustration of an alternate method of scrambled packet processing, operative in accordance with a preferred embodiment of the present invention. The method of FIG. 6 is typically carried out in support of slow-motion viewing of MPEG-2 streams, in which previously transmitted pictures are caused to be displayed multiple times in accordance with a slow-down factor.

[0126] In the method of FIG. 6, a scrambled TS packet is received and descrambled, such as at descrambler 300 (FIG. 3). The descrambled packet is then examined, such as at packet processor 302, to determine whether or not the packet contains data from an I-, P-, or B-picture. If so, the packet is held, such as in a buffer, together with other packets of the same picture type until a predefined processing unit, such as an entire I-, P-, or B-picture, is formed. If a packet is received that contains data from multiple pictures, typically being the end of one picture and the beginning of another, the packet is converted into multiple packets using conventional techniques or other techniques described hereinabove, where each packet contains data from only one of the pictures. The packet that contains data belonging to the currently held picture thus completes the data for the picture.

[0127] Once packets for an entire picture are held, slow-motion may be achieved as follows. If the picture is an I- or P-picture, the packets may be transmitted once, such as at packet selector 304, followed by one or more null pictures instructing the receiver to display the picture one or more additional times in accordance with a predetermined slow-down factor. If the picture is a B-picture, all the packets for the B-picture are transmitted once, and then are retransmitted one or more times in accordance with the slow-down factor. The packets of the currently held picture may be discarded once they are no longer required for transmission.

[0128] Any of the received packets may be modified to maintain the slow-down factor maintain and/or the validity of the MPEG stream using conventional techniques or other techniques described hereinabove. For example, the temporal_value is preferably replaced with a multiple of the original temporal_value which represents the slow-down factor, and the vbv_delay of all the headers is preferably replaced with ones as described hereinabove. Packets that have been modified are preferably transmitted in descrambled form, while packets that have not been modified may be transmitted in either scrambled or descrambled form.

[0129] It is appreciated that one or more of the steps of any of the methods described herein may be omitted or carried out in a different order than that shown, without departing from the true spirit and scope of the invention.

[0130] While the methods and apparatus disclosed herein may or may not have been described with reference to specific hardware or software, it is appreciated that the methods and apparatus described herein may be readily implemented in hardware or software using conventional techniques.

[0131] While the present invention has been described with reference to one or more specific embodiments, the description is intended to be illustrative of the invention as a whole and is not to be construed as limiting the invention to the embodiments shown and described herein. It is appreciated that the true spirit and scope of the present invention includes both combinations and subcombinations of the various features described herein, as well as variations and modifications thereof which would occur to persons skilled in the art. For example, the modified packet stream of the present invention may be scrambled and/or encrypted using conventional techniques prior to transmission.