Transient datastream-processing buffer memory organization with software management adapted for multilevel housekeeping

[0002] The invention relates to a datastream-processing buffer memory organization, U.S. Pat. Nos. 4,314,361, 4,236,225, and 4,222,102 respectively describe FIFO(first in first out) organizations with fixed input and variable output, with variable input and fixed output, and with both variable input and variable output. For effecting such elementary FIFO functionality the references use exclusively hardware-based housekeeping.

[0003] The present inventor has experienced a need for an enhanced and more flexible functionality, in particular to allow more complicated processing modes. Moreover, moving of information from one physical location to another should be kept as restricted as possible, in view of limited transfer capability viz à viz ever larger datastream volumes, so that no undue delays will be incurred. This applies even more when the same data items are used several times for respective functions. A final argument against physical movements is that power consumption for physical data transport should be kept low.

[0004] In consequence, amongst other things, it is an object of the present invention to allow the mapping of various logical buffers on shared physical memory space, whilst dimishing physical data transfer to an extremely low amount.

[0005] Advantageously, the memory management is arranged for multilevel housekeeping. The definition of the data format often has specified various successive levels. Through assigning the housekeeping with respect to a particular format level to an associated housekeeping level, flexibility is attained in an easy manner. Further advantageous aspects of the invention will be disclosed or become obvious to those skilled in the art by studying the detailed description below with reference to the following drawings which illustrate the elements of the appended claims of the inventions.

[0006] These and further aspects and advantages of the invention will be discussed more in detail hereinafter with reference to the disclosure of preferred embodiments, and in particular with reference to the appended Figures that show:

[0007] FIG. 1, exemplary hardware for thereon mapping the organization;

[0008] FIG. 2, an example of a data flow organization;

[0009] FIG. 3, an exemplary sector header format;

[0010] FIG. 4, an exemplary user data format of an audio sector.

[0011] FIG. 1 shows an exemplary hardware embodiment for thereon mapping the organization of the invention. The processor is centred around bus facility 80 that has sufficient capacity for the application and has an appropriate width for transferring data, addresses, and control signals between the various subsystems connected thereto. I/O(input and/or output) subsystem 88 interfaces to the external world through interconnection 90. Processing facility 82 executes necessary processing operations. RAM(random access memory) memory 92 stores the data proper according to an organization that will be disclosed more in detail with reference to FIG. 2 hereinafter. Memory Management Unit 84 executes various housekeeping tasks with respect to memory 92. ROM memory 86 may allow storage of the appropriate software, inasfar as this is not stored in processing facility 82.

[0012] FIG. 2 shows an example of a data flow organization. Herein, serial data are received on datastream input 20 from an appropriate source, such as an optical high volume disc or a remote broadcast or line source. Multiple sources may be connectable in parallel or in alternation. The width of the data stream may be defined in appropriate manner. In the embodiment hereinafter, the data source is a DVD (digital video disk) or VCD disc that stores digital video complete with associated digital audio and also various extra data to enable further functionalities to the system and to the user.

[0013] Module 22 reads the data and stores it in buffer 24. In particular, this module has a DMA feature. Here, the storage is physical, inasmuch as the data is received from the external world, such as on connection 90 in FIG. 1. Subsequent writing of the data to other buffers is generally executed through logical assigning of the data as will be discussed hereinafter. If applicable, read-modify-write memory cycles can be executed, in which case there is physical data transport between processing facility and memory. Furthermore, module 22 may perform error checking on the data, and if necessary and feasible, error correction. Upon finding or reaching an appropriate level of correctness, user data are presented to decryption control module 51. These user data exclude sector headers and error checking information ECC.

[0014] Next to decryption control module 51, the corrected data are assigned to buffer 30, that is used for a pre-navigation feature. This allows a user to navigate through the data in a fast manner, such as fast forward or fast reverse, through using non-encrypted data, and without necessitating any further operations on the data. In decryption control module 51, the data are decrypted if necessary, through an appropriate decryption key. Next, the decrypted data are assigned to buffer 26. This buffer receives data at a uniform high rate, and outputs data at a variable rate, in accordance with various source compactions that may be present. Module 28 accesses the data in buffer 26, and dispatches the readout data to further buffers 34, 38, 42, 48, 49, the first three of which interface to modules 36, 40, 44, respectively.

[0015] In the embodiment, module 40 is an MPEG video decoder that requires a packetized elementary stream PES as input. Further, module 36 is an MPEG audio decoder that requires an elementary stream as input. Module 44 is a subpicture decoder. Buffer 48 allows similar user navigation as buffer 30, but in a more precise manner such as through so-called seamless jumping, whilst also taking into account various presentation control modes, such as information that has been copy-protected. Buffer 49 allows storage of subcode items that can be used for various overlaying functionality types, such a timecode display and further user navigation.

[0016] The housekeeping with respect to buffers 34, 38, is such that only the necessary parts of the information are read by modules 36, 40, 44. A final buffer 46 is fed by video decoder 40, for buffering user data such as closed-caption information. The various buffer sizes will be specified hereinafter. These sizes are based on the organization of the related packetizing of the datastream. For example, the amount of video information is relatively large with respect to the amount of audio information, whereas the amount of subcode information is still much less.

[0017] Various one of the modules shown, not necessary exclusively on the rightmost or lowest level, access the stored data for outputting the result to a user or user device, which has been shown by respective arrows. Such device may be a television monitor for video, an audio presentation device for audio, and similarly for still further streams of user information data. Another example would be a further control device not shown such as one that may serve for effecting further types of user navigation.

[0018] FIG. 3 shows an exemplary sector format; this pertains to the format as relevant on interface 20. As shown, a sector contains a sector header, that delimits the sector, indicates a time value, an identifier, and possibly other parameters that may be used for subsequently organizing the storage proper. Part 54 contains error protection code, such as the redundancy symbols of a Reed-Solomon code that can be used for correcting a percentage of the symbols that have been received in an incorrect manner. After executing the correction, part 54 generally is of no use for further processing. Generally, the header and ECC information are sequestered and not used in subsequent accessing.

[0019] FIG. 4 shows an exemplary user data format of an audio sector. Here, the sector contains two packets of audio data, that each comprise a relevant packet header information, and two parts of the relevant audio data. The number of audio parts may be different, and their sizes may be non-uniform. The function of the headers on this level may be variable. Sometimes, the header information is sequestered and not used in subsequent accessing. Other decoder types may use the header for easier delimitation of the information.

[0020] Further legends of FIG. 2 are as follows:

[0021] SBM: Stream Buffer Manager

[0022] SP: Sector Processor

[0023] DCRYP: DeCRYPtion Control

[0024] DMX: DeMultipleXer

[0025] AUD: AUDio decoder

[0026] VID: VIDeo decoder

[0027] SUBP: SUBPicture decoder

[0028] Capacity of a DVD disc: 14 GByte

[0029] Input data rate: 11 Mbit/sec

[0030] Buffer size indications:

[0031] SBM_ERRCHECK 10 KByte

[0032] SBM_VBR 500 KByte

[0033] SBM_PRENAV 20 KByte

[0034] SBM_AUDIO 20 KByte

[0035] SBM_VIDEO 250 KByte

[0036] SBM_SUBPIC 64 KByte

[0037] SBM_POSTNAV 20 KByte

[0038] SBM_SUBCODE 1 KByte

[0039] SBM_VID_USER_DATA 5 KByte

[0040] The SBM controls all buffer accesses in a manner that is invisible for producer as well as for consumer processes, and in particular controls:

[0041] a pool of buffer units

[0042] for each unit an administration of the number of references to it from any buffer

[0043] a linked list indicating the free buffer units

[0044] for each buffer a linked list of buffer units plus additional administration for the applicable range(s) inside a buffer unit.

[0045] All buffers are assumed to be FIFO's, with an additional non-destructive ‘peek’ facility; in other applications, a different organization such as random access may apply. In particular, the scenario is given as follows in the form of a list, as an alternative of a standard flow-chart:

[0046] data comes in on the left-hand side of the pictures in chunks of N bytes (sector size);

[0047] the size of the units is also N bytes

[0048] SP requests SBM to write N bytes to SBM_ERRCHECK

[0049] SBM takes the first unit from the free list and sets up DMA to copy the data in

[0050] SBM sets the number of references to the unit to “1”

[0051] SBM adds the unit to the list of buffer SBM ERRCHECK with range indication [0,N); generally, the lower buffer boundary is included, the upper one is not

[0052] if after M new sectors no error has been indicated by the hardware, SP assumes the sector to be correct

[0053] SP reads X bytes (sector header size) from SBM_ERRCHECK

[0054] SBM updates the range indication to [X,N)

[0055] via a ‘peek’ read, SBM determines if it is a NAV pack

[0056] SP requests SBM to copy N−X−Y bytes from SBM_ERRCHEGK to SBM_VBR (Y equals the ECC size)

[0057] if it is a NAV pack, SP also requests SBM to copy the (N−X−Y) bytes to SBM_PRENAV

[0058] SBM adds the unit to the list of SBM_VBR with range indication [X, N−Y) and increments the number of references to the unit

[0059] if it is a NAV pack, SBM also adds the unit to the list of SBM_PRENAV with range indication [X,N−Y) and increments the number of references to the unit again

[0060] SBM updates the range indication in SBM_ERRCHECK to [N−Y,N)

[0061] SP requests SBM to read Y bytes from SBM_ERRCHECK

[0062] SBM updates the range indication in SBM_ERRCHECK to [N,N)

[0063] this means that there is no data in the unit for this buffer, so SBM removes the unit from the list of SBM_ERRCHECK and decrements the number of references to the unit

[0064] DMX determines the packet type and size S by ‘peeking’ SBM_VBR

[0065] in case of a NAV pack, DMX requests SBM to copy S bytes from SBM_VBR to SBM_POSTNAV

[0066] SBM adds the unit to the list of SBM_POSTNAV with range indication [X,X+S) and increases the number of references to the unit

[0067] SBM updates the range indication of the unit in SBM_VBR to [X+S,N−Y)

[0068] the application wants to read B bytes from SBM_POSTNAV

[0069] SBM updates the range indication of the unit in SBM_POSTNAV to [X+B,X+S).

[0070] Suppose an audio decoder requires a PES stream:

[0071] when DMX discovers audio packets in SBM_VBR, it can request SBM to copy them completely to SBM_AUDIO

[0072] consequently, SBM will add the corresponding unit to the list of SBM_AUDIO and set the range indication to [X,N−Y), where X and Y correspond to the sector header and ECC sizes as indicated in FIG. 3

[0073] note that the unit is also removed from the list of SBM_VBR.

[0074] Suppose an audio decoder requires an elementary stream:

[0075] suppose that the contents of the first unit in the list of SBM_VBR are as presented in FIG. 4

[0076] the range indication of this unit is [X,N−Y)

[0077] by ‘peeking’, DMX discovers an audio packet in SBM_VBR and determines packet header size Q1 and packet size S1

[0078] DMX requests SBM to read Q1 bytes from SBM_VBR

[0079] SBM updates the range indication of the unit in SBM_VBR to [X+Q1,N−Y)

[0080] DMX requests SBM to copy S1−Q1 bytes to SBM_AUDIO

[0081] SBM adds the unit to the list of SBM_AUDIO and increments the number of references to the unit

[0082] SBM sets the range indication in the SBM_AUDIO buffer to [X+Q1,X+S1)

[0083] SBMi sets the range indication in the SBM_VBR buffer to [X+S1,N−Y)

[0084] by ‘peeking’, DMX discovers an audio packet in SBM_VBR and determines packet header size Q2 and packet size S2

[0085] DMX requests SBM to read Q2 bytes from SBM_VBR

[0086] SBM updates the range indication of the unit in SBM_VBR to [X+S1+Q2,N−Y)

[0087] DMX requests SBM to copy S2−Q2 bytes to SBM_AUDIO

[0088] SBM adds the unit to this list of SBM_AUDIO and increments the number of references to the unit (this means that the same unit is referenced multiple times from the same buffer; also see note below)

[0089] SBM sets the range indication in the SBM_AUDIO buffer to [X+S1+Q2,X+S1+S2)

[0090] note that in this example, X+S1+S2 equals N−Y

[0091] SBM sets the range indication in SBM_VBR to [N−Y,N−Y)

[0092] this means that the unit can be removed from SBM_VBR and the number of references to the unit can be decremented

[0093] In the above, an optimization may be to indicate multiple ranges. In the case of an audio decoder requiring an elementary stream, this could apply to the situation that the range indication of an element in the list of SBM_AUDIO would have a range indication {[X+Q1,X+S1),[X+S1+Q2,N−Y)}, meaning that a single unit would point at two respective ranges.