Smart profiles for capturing and publishing audio and video streams

[0001] The present invention relates to the field of capturing and publishing audio and video streams. Specifically, the present invention pertains to the automatic selection of appropriate audio and video profiles for use during capture and publication of audio and video streams.

[0002] An increasing number of people own and use camcorders to make videos that capture their experiences and document their lives. Multimedia editing applications (MEA) allow users to bring new life to such videos via their personal computer by bringing professional video and audio editing to personal computers. However, MEAs are not always user friendly and users who are less experienced with such applications may be overwhelmed.

[0003] The first step in editing video and audio material with an MEA is importing a video and/or an audio stream from a source to a computer storing the MEA. This process of importing video and/or audio streams to the computer is also known as capturing. The next step is converting the video and audio data contained in the respective stream into the appropriate format (i.e., digital) for storage on the computer as individual files or clips. Traditional MEAs include a library or a bin in which the user can assemble and organize clips stored on disk, view the name and a thumbnail of each clip, and preview their contents. Each clip can then be edited, and dragged to a timeline or storyboard to assemble a production.

[0004] The centerpiece of any video editing tool is the storyboard or the timeline in which the user arranges the video or audio production. This allows the user to organize the video and audio clips, insert transitions between them, and apply special effects, and add titles and background audio. The consolidated video or audio production can then be saved or “published” to the hard drive of the computer or to an external storage medium such as a DVD or CD. In addition, the consolidated video or audio production can be played on a monitor or speakers, respectively, linked with the computer.

[0005] Traditional MEAs have emphasized ease of use by constraining the user interface, simplifying the layout process, restricting the number of parallel tracks, and providing a step-by-step process for adding effects. However, a number of design choices are made prior to capturing video and audio material and prior to publishing the consolidated video and audio material (i.e., production). These choices include resolution, frame rate, and bit rate. These parameters can determine the amount of disk space used, image quality and playback rate.

[0006] In fact, in order to use the MEA effectively, MEAs often require the user to define profiles specifying parameters for capturing video and audio material, and for publishing the consolidated video and audio material. However, defining a profile for capturing and for publishing can be a daunting task for novice users, especially if the user does not know or understand the meaning of resolution, frame rate, bit rate, etc.

[0007] For these reasons, there is a need for an MEA that allows the user to easily capture and publish their video and audio material at the appropriate quality and/or size for what they are trying to achieve. Moreover, the capturing and publishing process should be accomplished without requiring the user to have knowledge of bit rates, resolution, frame rates, compression formats, etc.

[0008] The invention provides an MEA for capturing and publishing video and/or audio streams. In particular, the invention automatically suggesting parameters settings to use for capturing and/or publishing video or audio streams.

[0009] In accordance with one aspect of the invention, a computer readable medium includes executable instructions for capturing a video stream. The executable instructions include format instructions for determining a format of the video stream. The executable instructions also include property instructions for determining a property of the of the video stream. The executable instructions also include selecting instructions for selecting a profile that corresponds to the determined format and the determined property of the video stream. The executable instructions further include capturing instructions for capturing the video stream according to the selected profile.

[0010] In accordance with another aspect of the invention, a method is provided for capturing a video stream according to one of a list of profiles, each profile specifying a plurality of parameters for capturing a stream of video. The method includes determining a format of the video stream. The method also includes determining a property of the video stream. The method also includes selecting one of the profiles from the list of profiles that corresponds to the determined format and the determined property of the video stream. The method further includes capturing the video stream according to the selected profile.

[0011] In accordance with another aspect of the invention, a method is provided for publishing a video stream according to one of a list of profiles, each profile specifying a plurality of parameters for publishing a stream of video. The method includes determining a format of the video stream. The method also includes determining a property of the video stream. The method also includes selecting one of the profiles of list of profiles that correspond to the determined format and the determined property of the video stream. The method further includes publishing the video stream according to the selected profile.

[0012] In accordance with another aspect of the invention, a computer readable medium includes a capture routine for executing capturing instructions for capturing a video stream according to a capture profile selected from a list of profiles. The capture profile defines a video format and a video property of the video stream. The computer readable medium also includes a publishing routine for publishing a consolidated video stream according to a publish profile selected from the list of profiles. The publish profile defines a video format and a video property of the consolidated video stream.

[0013] In accordance with another aspect of the invention, a computer readable medium includes a capture routine for executing capturing instructions for capturing an audio stream according to a capture profile. The capture profile defines an audio property of the audio stream. The computer readable also includes a publishing routine for publishing a consolidated audio stream according to a publish profile. The publish profile defines an audio property of the consolidated audio stream.

[0014] In accordance with yet another aspect of the invention, a computer readable medium includes executable instructions for publishing a consolidated video stream from a timeline including a plurality of individual video streams. Format instructions determine a format of the consolidated video stream. Property instructions determine a property of the consolidated video stream. Identifying instructions identify a list of profiles that correspond to the determined format and the determined property of the consolidated video stream. Selecting instructions select one of the identified list of profiles that correspond to the determined format and the determined property of the consolidated video stream. Publishing instructions publish the consolidated video stream according to the selected profile.

[0015] In accordance with another aspect of the invention, a computer readable medium includes executable instructions for publishing a consolidated video stream from a timeline including a plurality of individual video streams that have a total length of time. Format instructions determine a format of the consolidated video stream. Property instructions determine a property of the consolidated video stream. Determining instructions determine a target file size of the consolidated video stream to be published. Calculating instructions calculate a total target bit rate based on the determined target file size and the total length of time of the consolidated video stream. Identifying instructions identify a list of profiles that correspond to the calculated target bit rate. Selecting instructions select one of the profiles of the identified list of profiles that correspond to the calculated target bit rate. Publishing instructions publish the consolidated video stream according to the selected profile.

[0016] In accordance with another aspect of the invention, a computer readable medium includes executable instructions for capturing an audio stream. The computer readable medium also includes a list of profiles, each specifying a plurality of parameters for capturing a stream of audio. Property instructions determine a property of the audio stream. Selecting instructions selecting one of the profiles from the list of profiles that corresponds to the determined property of the audio stream. Capturing instructions capture the audio stream according to the selected profile.

[0017] In accordance with yet another aspect of the invention, a computer readable medium includes executable instructions for publishing a consolidated audio stream from a timeline including a plurality of individual audio streams. The computer readable medium includes a list of profiles, each specifying a plurality of parameters for publishing a stream of audio. Property instructions determine a property of the consolidated audio stream. Identifying instructions identify profiles from the list of profiles that correspond to the determined bit rate of the consolidated audio stream. Selecting instructions select one of the profiles from the identified list of profiles that correspond to the determined bit rate of the consolidated audio stream. Publishing instructions publish the consolidated audio stream according to the selected profile.

[0018] In accordance with another aspect of the invention, a computer readable medium includes executable instructions for publishing a consolidated audio stream from a timeline that includes a plurality of individual audio streams having a total length of time. The computer readable medium also includes a list of profiles, each specifying a plurality of parameters for publishing a stream of audio. Determining instructions determine a target file size of the consolidated audio stream to be published. Calculating instructions calculate a target bit rate based on the determined target file size and the total length of time of the consolidated audio stream. Identifying instructions identify profiles from the list of profiles that correspond to the calculated target bit rate. Selecting instructions select one of the profiles from the list of profiles that correspond to the calculated target bit rate. Publishing instructions publish the consolidated audio stream according to the selected profile.

[0019] In accordance with another aspect of the invention, a computer-readable medium stores a data structure. A first data field includes data representing a predefined list of profiles, and each profile specifies parameters for capturing a data stream. A second data field contains data representative of the data stream. A third functioning field retrieves one of the predefined list of profiles as a function the data representative of the data stream. Parameters specified in the retrieved profile are used for capturing the data stream.

[0020] In accordance with another aspect of the invention, a computer-readable medium stores a data structure. A first data field includes data representing a predefined list of profiles, and each profile specifies parameters for publishing the consolidated data stream. A second data field contains data representative of the consolidated data stream. A third functioning field retrieves one of the predefined list of profiles as a function the data representative of the consolidated data stream. Parameters specified in the retrieved profile are used for publishing the consolidated data stream.

[0021] Alternatively, the invention may comprise various other methods and apparatuses. Other features will be in part apparent and in part pointed out hereinafter.

[0038] Corresponding reference characters indicate corresponding parts throughout the drawings.

[0039] Referring first to FIG. 1, an exemplary block diagram illustrates a computer comprising an MEA 101 for capturing a video stream 102 or audio stream 104 and for publishing a consolidated video stream 106 or audio stream 108 to be captured from a video/audio source (V/A source) 110 linked to the computer 112.

[0040] The video stream 102 includes video data representative of a visual image or a series of visual images. The audio stream 104 includes audio data representative of one or more sounds, which may or may not correspond to the visual image or series of visual images. The V/A source 110 can be any device used to record a visual image or a series of visual images and/or sound data. The V/A source 110 may generate the video stream 102 or audio stream 104 as an analog signal or a digital signal. For example, the V/A source 110 can be an analog camcorder that generates the video stream 102 and audio stream 104 as analog signals. Alternatively, the V/A source 110 can be a web camera or DV camcorder that generates the video stream 102 as a digital signal. Whether analog or digital, the video stream 102 includes video format data. The video format data indicates a frame rate, a resolution, an aspect ratio, and a frame display mode of the individual video images or “frames” included in the video stream 102.

[0041] A capture tool 114 is linked to the computer 112 and the V/A source 110 for capturing the video format data, the video property data and/or the audio property data. As described above, video and audio streams 102, 104 can be generated in analog format or digital format. In the case of an analog format, the capture tool 114 digitizes the video stream or audio stream before transferring the format data to the computer 112 for storage. In other words, data contained in the analog video stream 102 and/or analog audio stream 104 is converted into binary format (i.e., digital format) for storage as a video file 116 or audio file 118, respectively. In this case, the video file 116 or audio file 118 is stored on a CRM 120 associated with the computer 112. For example, the CRM 120 may be the random access memory (RAM) of the computer 112 or the hard drive of the computer 112. In contrast, a digital stream is already in digital format and the capture tool 114 transfers the digital data directly to the CRM 120 of the computer for storage as a video file 116 or audio file 118. After the video file stored is stored on the hard drive in digital form (e.g. as a .avi, .wmv) it also contains video property data. The video property data indicates a total bit rate and a resolution of the individual video frames included in the video stream 102. After the audio file stored is stored on the hard drive in digital form (e.g. as .wma) it also contains audio property data. The audio property data indicates a bit rate, a sample frequency, and an output mode of the audio signal included in the audio stream 104.

[0042] In one embodiment, the capture tool 114 is a capture card that is connected to the computer 112 via an ISA slot or PCI slot. The capture card includes an input port that can be linked with an output port of the V/A source 110 via a cable such as S-video cable, or coaxial cable. Thereafter, video data or audio data can be transferred from V/A source 110 to the computer 112. For example, the video stream 102 can be captured from a VCR by connecting a cable to the video-output port on the back of the VCR and connecting the other end of the cable to the video-in of the video capture card. In an alternative embodiment, the capture tool 114 is a direct connection such as an Institute of Electrical and Electronic Engineers (IEEE) 1394 interface. Typically, the IEEE 1394 interface connection is used for capturing digital video. For example, the IEEE 1394 interface can be connected to an IEEE1394 connection port on a digital camcorder and connected to an IEEE1394 connection port on the computer 112 to facilitate transfer the digital signal generated by digital camcorder to the computer 112 for storage.

[0043] Video capture and storage often involves large amounts of data. For instance, to display a single 320×200 frame (64000 pixels) on a computer monitor may require approximately 128 KB of RAM per frame (assuming each pixel requires approximately 2 bytes; 16 bit display). In order to capture ten (10) complete frames per second, more than 1.28 MB per second (i.e., bit rate) will have to be channeled into system RAM of the computer 112. As a result, the available RAM can be used up in a few seconds. However, because of the repetitive nature of the data contained in the video file 116 or audio file 118, compression schemes can be used to eliminate redundant information before it is channeled into the system RAM. Consequently, the actual data stored in the system RAM can be much less than it would be otherwise. After the video or audio files are compressed they can be decompressed for playback. The method of compression and decompression is often referred to as a CODEC. One of the drawbacks in reducing the size of the video or audio file is that there is some loss in video or audio quality. CODECs often require users to define parameters that will be used during the compression and decompression process. The parameters typically include bit rate, frame rate, and resolution. The selection of these parameters can significantly influence the video or audio quality. CODEC functions can be implemented in hardware as a digital signal processor, or in software as a driver.

[0044] A MEA 101 such as Windows® Movie Maker offered by Microsoft, Inc. allows a user to create a consolidated video stream 106 and/or consolidated audio stream 108. The consolidated video stream 106 is representative of a user designed sequence of video frames or images that combine to form a motion video image on a television screen or computer system monitor. The consolidated audio stream 108 is representative of a user designed sequence of audio files, which may or may not correspond to the user designed sequence of video frames, that combine to produce sounds via speakers. In one embodiment, the MEA 101 provides a User-Interface 122 for stepping the user through the process of arranging video files, or video clips, into a desired sequence along a timeline. (See FIG. 1A). The MEA 101 creates a consolidated video stream 106 corresponding to the video clips along the timeline, and/or creates a consolidated audio stream 108 corresponding to the audio clips along the time line. The MEA 101 of the invention further allows the user to indicate a publication target for publishing the consolidated video stream 106 and/or consolidated audio stream 108. In this case, publications refers to saving or transferring the consolidated video stream 106 and/or consolidated audio stream 108 to a particular publication target as a consolidated video file 124 and/or consolidated audio file 126, respectively. For example, consolidated video files or consolidated audio files can be stored on the CRM 120 of the computer 112, or on a destination CRM 128 such as a DVD data disk or hard drive of a remote computer. As another example, the consolidated video stream 106 can be published to the destination CRM 128 via e-mail. By indicating a publication target (e.g., e-mail, CD), the user also determines whether video or audio profiles are selected to achieve the best quality or selected to achieve a best fit to size. (See FIG. 1B).

[0045] Although the invention is described below in terms of consolidated video and consolidated audio streams as defined along a timeline, it is contemplated that the invention can be used for publishing consolidated streams with an MEA 100 that utilizes a storyboard or any other method for constructing consolidated streams.

[0046] Existing MEAs require the user to select a video profile when capturing the video stream 102 or publishing the consolidated video stream, and select an audio profile when capturing the audio stream 104 or publishing the consolidated audio stream. As used herein, the profile refers to a set of parameters that correspond to a desired format and/or property of the particular stream 102, 104 to be captured, or to a desired format and/or property of the particular consolidated stream 106, 108 to be published. Although format data and property data can often be detected from the V/A source 110 during the capture process, there are instances where the format and/or property data cannot be detected. Moreover, there are instances where the user may prefer not to use the detected format and property due to quality issues or limited storage space. Thus, profile selection allows the user more control over the final output file. Unfortunately, selecting a profile can be a daunting task for users, especially if the user is unfamiliar with resolution, frame rate, bit rate, etc. The MEA 101 according to the invention allows the user to control the capture of video and audio streams 102, 104 by automatically suggesting parameters settings for capture of the video or audio stream 102, 104. Moreover, the MEA 101 according to the invention allows the user control the publication of consolidated video and audio streams 106, 108 by automatically suggesting parameter settings for publication of the consolidated video and audio stream 106,108.

[0047] Referring now to FIG. 2, an exemplary block diagram illustrates basic components of an MEA 200 for implementing the invention. In this example, the basic components of an MEA 200 include a profile database 202, a capturing routine 204, a best-quality publishing routine 206, and a best-fit publishing routine 208.

[0048] The profile database 202 stores a list of profiles. Each profile specifies parameters for capturing video or audio streams or for publishing consolidated video or consolidated audio streams. In this case, each parameter specifies a desired format value (e.g., frame rate, resolution) and/or a desired property value (e.g., bit rate) to use for capturing video or audio streams, or to use for publishing consolidated video or consolidated audio streams. The capturing routine 204 includes a set of computer executable instruction for capturing the video stream or audio stream according to parameters specified in one of the list of profiles. The best-quality publishing routine 206 includes a set of computer executable instruction for publishing the consolidated video stream and/or consolidated audio stream according to parameters specified in one of the list of profiles that will produce the best quality video during playback. The best-fit publishing routine 208 includes a set of computer executable instructions for publishing a consolidated video and/or consolidated audio stream according to parameters specified in one of the list of profiles and a maximum file size defined by the user.

[0049] Referring next to FIG. 3, an exemplary block diagram illustrates the contents of a video profile database 302 storing data relating to parameters settings for use during the capture of a video stream and/or for use during the publication of the consolidated video stream. Each profile in the video profile database 302 has a resolution field 304, a total bit rate field 306, a frame rate field 308, and an audio profile field 310. (See appendix, Table 1).

[0050] The resolution field 304 contains resolution data. The resolution data includes capture and storage information regarding image quality. More specifically, resolution data includes information regarding the amount of information contained in each frame (i.e., image) of the video stream. Resolution is expressed as the number of horizontal pixels times the number of vertical pixels (e.g., 640×480 or 720×480). A higher resolution yields a higher quality image.

[0051] The total bit rate field 306 contains total bit rate data. Bit rate indicates the speed at which digital information (binary data) is transferred to the RAM of the computer, and is generally measured in multiple bits per second (e.g., kilobits or thousands of bits per second, Kbps). The total bit rate data includes information regarding the speed at which digital video and audio information corresponding to a particular video stream is transferred to RAM.

[0052] The frame rate field 308 contains frame rate data. The frame rate data includes information regarding the number of frames to display per second in a motion video.

[0053] The audio profile field 310 contains audio profile data. The audio profile data includes information regarding a corresponding audio profile to use with each video profile.

[0054] In one embodiment, the video profile database 302 includes other fields 312 containing data such as buffer window data, smoothness data, or decoding complexity data. Buffer window data includes information regarding how much content can be buffered. For example, if you have a stream with a bit rate of 32 Kbps and a buffer window of 3 seconds, the buffer is sized to hold 3 seconds of 32 Kbps content, or 12,000 bytes (32000 bits per second×3 seconds/8 bits per byte). Smoothness data includes information regarding the smoothness of the motion video during playback. Decoding complexity data includes information regarding error control techniques used to control errors that occur during the transmission and storage of digital data. Such fields are less important for implementing the invention, but can be used for the publication of the consolidated video.

[0055] Referring next to FIG. 3A, an exemplary block diagram illustrates the contents of an audio profile database 320 storing data relating to parameters settings for use during the capture of an audio stream or during the publication of the consolidated audio stream. Each profile in the audio profile database 320 has a bit rate field 322, an audio sample rate field 324, and an output field 326. (See appendix, Table 2).

[0056] The bit rate field 322 contains audio bit rate data. The audio bit data includes information regarding the speed at which digital audio information is transferred to the RAM of the computer.

[0057] A sample rate field 324 contains audio sample rate data. The audio sample rate is the frequency at which samples are taken from an analog audio stream during the conversion of the analog signal to a digital format. The higher the sampling rate the more the digitized audio stream matches the original sound during playback. Thus, the audio sample rate data includes information regarding the frequency with which samples are taken from an analog audio stream. For example, common sampling rates like 44.1 KHz indicates that the analog audio signal is sampled 44100 times per second to convert the analog sound (source) into a digital stream.

[0058] The output field contains 326 output data. The output data includes information regarding whether the audio stream is stereo or mono.

[0059] In one embodiment, the audio profile database 320 includes other fields 328 such as a buffer window field, which is less important, but can be used for the publication of the consolidated audio stream.

[0060] Referring next to FIG. 4, an exemplary block diagram illustrates the contents of a video capture routine 402 comprising computer executable instructions for capturing a video stream.

[0061] Video format instructions 404 include determining the format of the video stream being captured. In this embodiment, determining the format includes determining the aspect ratio, the frame rate, the resolution, and/or the frame display mode of the video stream. The frame rate corresponds to the frame per second (fps) rate at which the individual series of video frames will be displayed during playback on a viewing device (not shown) such as a television or computer monitor. Generally, the geographic region in which the video stream is targeted for playback determines the frame rate of the video stream. For example, a video stream targeted for playback in Europe will generally have a frame rate of approximately 25 fps, which corresponds to an Phase Alternating Line (PAL) format. In contrast, a video stream targeted for playback in North America will generally have a frame rate of approximately 30 fps, which corresponds to an National Television Systems Committee (NTSC) format. PAL and NTSC are commonly referred to as TV standards.

[0062] The aspect ratio indicates the width to height proportion of a video frame. For example, traditional television sets have a 4:3 aspect ratio and video frames displayed on traditional television appear almost square in appearance. In contrast, widescreen television sets have a 16:9 aspect ratio, and video frames displayed on widescreen television sets appear more rectangular. As described above, the resolution indicates a quality of the image and is typically expressed horizontal pixels times vertical pixels. The frame display mode indicates whether the video frame is interlaced or progressive scan. For example, when a television set displays its analog video signal, it displays the odd lines (the odd field) first and then the even lines (the even field). The “odd field” and the “even field” together form a frame. For NTSC, approximately sixty of these fields are displayed every second. This is called “interlaced video.” However, digital video displays use progressive scan to update the screen. With this method, the screen is not separated into fields. Rather, each line is displayed in sequence, from top to bottom. The entire frame is displayed 30 times every second. This is also called “non-interlaced video.”

[0063] In another embodiment, the video format instructions 404 include automatically detecting the format of the captured video stream by analyzing encoded data included the video stream as received from the video source. For example, it is possible to detect from a digital camcorder driver in most cases whether the camcorder is NTSC or PAL (i.e., the frame rate). Because there may be cases where the camcorder returns both NTSC and PAL or the value returned is incorrect, the video format instructions 404 may include assigning a default format for the video stream. That is, in the event the format of the video stream cannot be determined the video format instructions 404 designate the format. For example, if the TV standard (i.e., PAL or NTSC) of the video stream cannot be determined, the video format instructions 404 assign a default TV standard. In one such embodiment, the video includes retrieving the region setting (i.e., country) from an operating system such as Windows XP®. The video further include retrieving from a table (not shown) that lists TV standards by country, the TV standard that corresponds to the country retrieved from the region setting of the operating system. In another embodiment, during the capture of the video stream the format of the video stream is determined on a frame-by-frame basis. That is, no conversion between formats takes place even if formats of the frames included in the video stream are mixed. For example, during capture of a video stream including 16:9 and 4:3 frames, frames that have an aspect ratio of 16:9 will be determined to have an aspect ratio of 16:9 and frames that have an aspect ratio of 4:3 will be determined to have an aspect ration of 4:3.

[0064] In another embodiment, the user designates a default setting using a Tools/Options menu of the MEA. Thereafter, the video format instructions 404 designate the format of the captured video stream to correspond to the default setting designated in the Tools/Options menu. For example, the MEA may designate 4:3 as the default for the aspect ratio and designate interlaced as the default for the frame display mode within Tools/Options menu. (See FIG. 4B).

[0065] Video property instructions 406 include determining one or more properties of the video stream being captured. In this case, determining one or more properties includes determining the total bit rate of the video stream. In one embodiment, properties of the video stream being captured are determined from encoded data included in the video stream. For example, the bit rate can be determined from data encoded into the video stream by the video source (e.g., digital camera driver) or the capture tool 114 (i.e., capture card). Video property instructions 406 further include determining one or more properties of the audio stream being captured. In this case, determining one or more properties includes determining the bit rate of the audio stream. In one embodiment, properties of the video stream being captured are determined from encoded data included in the video stream. For example, the resolution and bit rate can be determined from resolution data encoded into the video stream by the video source (e.g., digital camera driver) or the capture tool 114 (i.e., capture card).

[0066] Video profile instructions 408 include selecting one of a list of video profiles such as described above in reference to FIG. 3. The purpose of using profiles is to capture the video stream at a resolution and frame rate that is not higher than the video source, while at the same time capturing as much information as possible (i.e., not throwing away resolution). In one embodiment, the profile selection is dependent on the determined format. For example, if the format of a digital video stream is determined to be NTSC, a profile specifying a resolution of 720×480 and a frame rate of 30 fps may be selected. Alternatively, if the format of a digital video stream is determined to be PAL, a profile specifying a resolution of 720×576 and 25 fps may be selected. In another embodiment, the profile selection is dependent on the determined video source. For example, if the video source is a web camera a profile specifying the determined resolution and the determined frame may be selected.

[0067] Video capturing instructions 410 include capturing the video stream according to the selected profile. In this case, capturing refers to the process of storing video data and audio data on the computer in accordance with parameters specified in the selected video profile. In one embodiment, video and sound data contained in the video stream are synchronized together, and then stored on the hard drive in a standard file format such as Windows Media™ Video (.WMV).

[0068] Referring now to FIG. 4A, an exemplary block diagram illustrates the contents of audio capture routine 420 comprising computer executable instructions for capturing an audio stream.

[0069] Audio property instructions 422 include determining one or more properties of the particular audio stream being captured. In this case, determining one or more properties includes determining the bit rate of the audio stream. In one embodiment, properties of the audio stream being captured are determined from encoded data included in the audio stream. For example, the bit rate and output mode (i.e., stereo or mono) can be determined from resolution data or other metadata encoded into the audio stream by the audio source.

[0070] Audio profile instructions 424 include selecting one of a list of profiles such as described above in reference to FIG. 3A. In one embodiment, the audio profile selection is dependent on the audio source. For example, if the audio stream is generated by a digital camcorder an audio profile specifying the sample rate used by the digital camcorder is selected. In another embodiment, the audio profile instructions 424 include designating a audio profile. For example, if the audio source is a microphone an audio profile specifying a sample rate of 44.1 khz and a stereo output mode may be selected.

[0071] Audio capturing instructions 426 include capturing the audio stream according to the selected profile. In this case, audio capturing refers to the process of storing audio data on the computer in accordance with parameters specified in the selected audio profile. In one embodiment, sound data contained in the audio stream is stored on the hard drive in a standard file format such Windows Media™ Audio (WMA).

[0072] After the video stream or audio stream has been captured, the MEA can be used to publish a consolidated video stream or consolidated audio stream.

[0073] Referring now to FIG. 5, an exemplary block diagram illustrates the contents of a video best quality publishing routine 502 comprising computer executable instructions for publishing a consolidated video stream that provides the best quality video during playback.

[0074] Video best-quality format instructions 504 include determining the format of the consolidated video stream to be published. In this case, determining the format includes determining the aspect ratio, the frame rate, resolution and/or the frame display mode of the consolidated video stream. In one embodiment, the format of the consolidated video stream is the same as the format of the one or more captured video frames from which the video stream is defined. If the video frames that define the consolidated video have different formats, video best-quality format instructions 504 may include assigning a default format to consolidated video such as described above in reference to FIG. 4. In one embodiment, the resolution of the consolidated video stream is determined from a maximum resolution of one or more video clips that define the consolidated video stream. In other words, each video clip along the timeline is examined to determine its resolution. Thereafter, the maximum resolution can be determined by comparing the resolution of each frame in the clip to determine maximum and minimum values. One method of comparing resolutions involves calculating the number of pixels in each frame. This achieved by multiplying the width by the height. For example, a frame with a 420×420 resolution has a total of 176,400 pixels, and a frame with a 480×360 resolution has a total of 172,360 pixels. Therefore, the resolution of the 420×420 frame is greater than the 480×360 frame. In the event the format of the video stream cannot be determined from examining the timeline, the video best-quality format instructions 504 can designate the format. For example, if the resolution and bit rate of the video content cannot be determined, the video best-quality property instructions 506 may designate the resolution as 320×240.

[0075] In another embodiment, the user designates a default setting using a Tools/Options menu of the multimedia editing application. Thereafter, the video best-quality format instructions 504 designate the format of the consolidated video stream to correspond to the default setting as designated in the Tools/Options menu. In one such embodiment, the aspect ratio (e.g., 4:3 or 16:9) and the frame display mode (i.e., interlaced or progressive) is determined solely from Tools/Options settings as designated by the user or as designated as a default within the MEA. For example, the MEA may designate 4:3 as the default for the aspect ratio and designate interlaced as the default for the frame display mode within Tools/Options menu. As another example, if the frame display mode (i.e., TV standard) is determined to be in an NTSC format the resolution is designated as 720×480. Alternatively, if the frame display mode is determined to be in a PAL format the resolution is designated as 720×576.

[0076] Video best-quality property instructions 506 include determining one or more properties of the consolidated video stream to be published. In this instance, determining one or more properties includes determining the bit rate of the consolidated video stream. In one embodiment, the bit rate of the consolidated video stream is determined from a maximum bit rate of one or more video clips that define the consolidated video stream, respectively. In other words, each video clip along the timeline is examined to determine its resolution and bit rate. Thereafter, the maximum bit rate can be determined by comparing bit rate of each frame in the clip to determine maximum and minimum values. In an alternative embodiment, the video best-quality property instructions 506 include assigning a default property for the consolidated video stream. That is, in the event the property of the video stream cannot be determined from examining the timeline, the video best-quality property instructions 506 designate the property. For example, if the bit rate of the video content cannot be determined, the video best-quality property instructions 506 may designate the bit rate as 304 Kbps.

[0077] Video best-quality identifying instructions 508 include identifying a set of video profiles that corresponds to the determined format and the determined property of the consolidated video stream. In this case, the set of video profiles is identified from a list of video profiles such as stored in the profile database described above in reference to FIG. 3. As described above, the profile database includes resolution data. The set of video profiles may include two or more of the list of video profiles each specifying the timeline resolution. Alternatively, the set of profiles may include a first list of profiles and a second list of profiles. The first list of profiles includes the list of profiles specifying the same first resolution, wherein the specified first resolution is greater than or equal to timeline resolution. The second list of profiles includes the list of profiles each specifying the same second resolution, wherein the specified second resolution less than or equal to the timeline resolution. In other words, the timeline resolution falls between the first resolution specified in the first list of profiles and the second resolution specified in second list of profiles. The video best-quality identifying instructions 508 further include identifying a first profile and a second profile from the identified set of video profiles. The first profile specifies a bit rate less than the determined bit rate of the consolidated video stream. The second profile specifies a bit rate greater than the determined resolution of the consolidated video stream. (See appendix, Example 1).

[0078] Video best-quality selection instructions 510 include selecting one of the lists of profiles as a function of the difference between the identified first list of profiles and the identified second list of profiles. In one embodiment, the video best-quality selection instructions 510 include selecting one of the identified lists of profiles as function of the difference between the first resolution specified in the first list of profiles and the second resolution specified in the second list of profiles. For example, video best-quality selection instructions 510 may include the following instructions:

• • [0079] If T_R<=L_R+0.1*(H_R−L_R), select list of profiles with the lower resolution,
  • [0080] If T_R>L_R+0.1*(H_R−L_R), select list of profiles with the higher resolution,
  • [0081] If T_R is lower than the lowest resolution in the profile database, select video profile with the lowest resolution in the database, or
  • [0082] If T_R is higher than the highest resolution in the database, select video profile with the highest resolution in the profile database;
    where T_R is the maximum resolution determined from the timeline, L_R is the second resolution specified by the second list of profiles, and H_R is the first resolution specified by the first list of profiles. Notably, all other resolutions in the profile database are either less than or equal to L_R or greater than or equal to H_R. The video best-quality selection instructions 510 further include selecting one of the video profiles as function of the difference between the identified first profile and the identified second profile. In another embodiment, the video best-quality selection instructions 510 include selecting one of the video profiles as function of the difference between the bit rate specified in the first profile and the bit rate specified in the second profile. For example, video best-quality selection instructions 510 may include the following instructions:
  • [0083] If T_BR<=L_BR+0.1*(H_BR−L_BR), select video profile with the lower bit rate,
  • [0084] If T_BR>L_BR+0.1*(H_BR−L_BR), select video profile with the higher bit rate,
  • [0085] If T_BR is lower than the lowest bit rate in the list of profiles, select video profile with the lowest bit rate in the list of profiles, or
  • [0086] If T_BR is higher than the highest bit rate in the list of profiles, select video profile with the highest bit rate in the list of profiles;
    where T_BR is the maximum bit rate determined from the timeline, L_BR is the bite rate specified by the second profile, and H_BR is the bite rate specified by the first profile. Notably, all other bit rates in the profile database are either less than or equal to L_BR or greater than or equal to H_BR. In the case where the set of profiles includes at least two of the list of video profiles each specifying the same resolution as the determined resolution for the consolidated video stream, the first profile specifying a bit rate closest to the determined bit rate is selected. (See appendix, Example 1)

[0087] Video best-quality publishing instructions 512 include publishing the consolidated video stream according to the selected profile. In this embodiment, video best-quality publish instructions 512 includes local publishing and remote publishing. Local publishing includes the process of saving and/or copying the consolidated video stream to the hard drive of the computer that stores the MEA used to create the consolidated video stream. In this case, remote publishing includes the process of saving and/or copying the consolidated video stream to an external CRM where storage space (i.e., file size) is not an issue. In one embodiment, the user indicates a publication target prior to the execution of the selection instructions. (See FIG. 1B). By indicating a publication target (e.g., e-mail, CD), the user determines whether video profiles are selected to achieve the best-quality or selected to achieve a best fit to size.

[0088] Referring now to FIG. 5A, an exemplary block diagram illustrates the contents of an audio best-quality publishing routine 520 comprising computer executable instructions for publishing a consolidated audio stream that provides the best-quality audio during playback.

[0089] Audio best-quality property instructions 522 include determining one or more properties of the consolidated audio stream to be published. In this instance, determining one or more properties includes determining the bit rate of the consolidated audio stream. In one embodiment, the bit rate of the consolidated audio stream is determined from a maximum resolution and a maximum bit rate of one or more audio clips that define the consolidated audio stream. In other words, each audio clip along the timeline is examined to determine its bit rate. Thereafter, the maximum bit rate can be determined by comparing the bit rate of each clip to determine maximum and minimum values. In an alternative embodiment the audio best-quality property instructions 522 include assigning a default property for the consolidated audio stream. That is, in the event the property of the audio stream cannot be determined the audio best-quality property instructions 522 designate the property.

[0090] Audio best-quality identifying instructions 524 include identifying a set of audio profiles that correspond to the determined property of the consolidated audio stream. In this case, the set of audio profiles is identified from a list of audio profiles such as stored in the audio profile database described above in reference to FIG. 3A. As described above, the audio profile database includes bit rate data. In one embodiment, the set of profiles includes a first profile and a second profile from the identified set of audio profiles. The first profile specifies a bit rate less than the determined bit rate of the consolidated audio stream. The second profile specifies a bit rate greater than the determined bit rate of the consolidated audio stream. (See appendix, Example 2).

[0091] Audio best-quality selection instructions 526 include selecting one of the audio profiles as function of the difference between the identified first profile and the identified second profile. In one embodiment, audio best-quality selecting instructions 526 include selecting one of the audio profiles as function of the difference between the bit rate specified in the first profile and the bit rate specified in the second profile. For example, audio best-quality selection instructions 526 may include the following instructions:

• • [0092] If T_BR<=L_BR+0.1*(H_BR−L_BR), select audio profile with the lower bit rate,
  • [0093] If T_BR>L_BR+0.1*(H_BR−L_BR), select audio profile with the higher bit rate,
  • [0094] If T_BR is lower than the lowest bit rate in the profile database, select audio profile with lowest bit rate in the profile database, or
  • [0095] If T_BR is higher than the highest bit rate in the profile database, select audio profile with highest bit rate in the profile database;
    where T_BR is the maximum bit rate determined from the timeline, L_BR is the bite rate specified by the second profile, and H_BR is the bite rate specified by the first profile. (See appendix, Example 2). Notably, all other bit rates in the audio profile database are either less than or equal to L_BR or greater than or equal to H_BR.

[0096] Audio best-quality publishing instructions 528 include publishing the consolidated audio stream according to the selected profile. In this embodiment, audio best-quality publish instructions include local publishing and remote publishing. Local publishing includes the process of saving and/or copying the consolidated audio stream to the hard drive of the computer that stores the MEA used to create the consolidated audio stream. In this case, remote quality publishing includes the process of saving and/or copying the consolidated audio stream to an external CRM where storage space (i.e., file size) is not an issue. In one embodiment, the user indicates a publication target prior to the execution of the selection instructions. By indicating a publication target (e.g., e-mail, CD), the user determines whether audio profiles are selected to achieve the best-quality or selected to achieve a best fit to size.

[0097] Referring now to FIG. 6, an exemplary block diagram illustrates the contents of a video best fit publishing routine 602 comprising computer executable instructions for publishing a consolidated video stream that will best fit a designated file size.

[0098] Video best-fit format instructions 604 include instructions such as described above in reference to video best-quality format instructions 504. Video best-fit property instructions 606 include instructions such as described above in reference to video best-quality property instructions 506.

[0099] Video calculating instructions 608 include calculating a target bit rate for the consolidated video stream. In one embodiment, the target bit rate is determined as a function of a target file size and a total length of time required for playback of the consolidated video stream. For example, the target bit rate can be determined from the following equation:
TT_BR=F_S/L_CV;  (1)
where TT_BR is the total target bit rate, F_S is file size in bits, and L_CV is the length of the consolidated video stream in seconds. (See appendix, Example 3). The video calculating instructions 608 further include retrieving a target file size and determining the length of time that corresponds to the consolidated video stream. The target file size can be defined by the user via the MEA or set to a default target file size by the MEA. In one embodiment, the MEA provides an user interface that allows the user to enter a desired file size and/or allows the user to select a publication target such as a CD or e-mail. (See FIG. 5B) In the latter, the MEA can automatically designate the target file size based on the remaining disk space available on the publication target. For example, if the publication target is a CD the MEA reads the CD to determine the amount of free space on the CD and designates the target file size to equal the free space. In one embodiment, the MEA subtracts some amount (e.g., 50 MB) from the determined free space for finalizing the disc, closing the session, etc. Alternatively, if the publication target is e-mail, the MEA may designate the file size to conform to limits as determined by the e-mail provider (e.g., 1 MB to 10 MB). Alternatively, if the publication target is e-mail and the user does not designate a file size, the MEA may assign a default file size (e.g., 1 MB). The length of time that corresponds to the consolidated video stream can be determined by summing the playback time of the individual video clips along the time line.

[0100] Video best-fit identifying instructions 610 include identifying a set of video profiles corresponding to the determined format and the target bit rate of the consolidated video stream. The video best-fit identifying instructions 610 further include identifying the set of video profiles from a list of video profiles such as stored in the profile database described above in reference to FIG. 3. As described above, the video profile database includes bit rate data. The set of profiles may include at least two the list of video profiles each specifying a bit rate equal to the target bit rate. Alternatively, the set of profiles may include a first list of profiles and a second list of profiles. The first list of profiles includes the list of profiles specifying the same first bit rate, wherein the specified first bit rate is greater than or equal to the target bit rate. The second list of profiles includes the list of profiles each specifying the same second bit rate, wherein the specified second bit rate is less than or equal to the target bit rate. In other words, the target bit rate falls between the first bit rate specified in the first list of profiles and the second bit rate specified in second list of profiles.

[0101] Video best-fit selection instructions 612 include selecting one of the list of video profiles as a function of the difference between the identified first list of profiles and the identified second list of profiles. In this embodiment, the video best-fit selection instructions 612 include selecting one of the identified list of profiles as function of the difference between the first bit rate specified in the first list of profiles and the second bit rate specified in the second list of profiles. For example, the video best-fit selection instructions 612 may include the following instructions:

• • [0102] If TT_BR<=L_BR+0.1*(H_BR−L_BR), select list of video profiles with the lower bit rate,
  • [0103] If TT_BR>L_BR+0.1*(H_BR−L_BR), select list of video profiles with the higher bit rate,
  • [0104] If TT_BR is lower than the lowest bit rate in the profile database, select video profile with the lowest bit rate in the video profile database, or
  • [0105] If TT_BR is higher than the highest bit rate in the profile database, select video profile with the highest bit rate in the profile database;
    where TT_BR is the calculated total target bit rate, L_BR is the second bite rate specified by the second list of profiles, and H_BR is the first bite rate specified by the first list of profiles. (See appendix, Example 3). Notably, all other bit rates in the audio profile database are either less than or equal to L_BR or greater than or equal to H_BR. The video best-fit selection instructions 612 further include selecting one of the video profiles as a function of the difference between the identified first profile and the identified second profile. In one embodiment, the video best-fit selection instructions 612 include selecting one of the profiles as function of the difference between the resolution specified in the first profile and the resolution specified in the second profile. For example, video best-fit selection instructions 612 may include the following:
  • [0106] If T_R<=L_R+0.1*(H_R−L_R), select video profile with the lower resolution,
  • [0107] If T_R>L_R+0.1*(H_R−L_R), select video profile with the higher resolution,
  • [0108] If T_R is lower than the lowest resolution in the list of video profiles, select the video profile with lowest resolution, or
  • [0109] If T_R is higher than the highest resolution in the list of video profiles, select the profile with the highest resolution;
    where T_R is the maximum resolution determined from the timeline, L_R is the resolution specified by the second profile, and H_R is the resolution specified by the first profile. Notably, all other resolutions in the profile database are either less than or equal to L_R or greater than or equal to H_R. In the case where the set of profiles includes at least two of the list of video profiles each specifying the same bit rate as the target bit rate for the consolidated video stream, the profile specifying a resolution closest to the determined resolution is selected. (See appendix, Example 3).

[0110] Video best-fit publishing instructions 614 include publishing the consolidated video stream according to the profile selected by the selection instructions 612. In this embodiment, video best-fit publish instructions 614 include remotely publishing the consolidated video stream or publishing the consolidated video stream according to a user defined file size. In this instance, remote publishing refers to the process of saving, copying and/or transferring the consolidated video stream to external CRM such as a CD, DVD data disk or remote computer (via e-mail) where file size is an issue.

[0111] In one embodiment, the video best fit publishing routine 602 executes the video best quality routine 502 to compare the target bit rate of the video profile for best-fit (i.e., TT_BR) to the determined bit rate of the video profile for best quality (i.e., T_BR). For example, if TT_BR is greater than T_BR, as determined from the video best quality routine 502, then the profile with bit rate equal to T_BR is selected since this is the maximum quality. In other words, it is a waste of disk space to publish the consolidated video stream using a bit rate that provides a quality higher than the maximum quality of the content on the timeline.

[0112] Referring now to FIG. 6A, an exemplary block diagram illustrates the contents of an audio best fit publishing routine 620 comprising computer executable instructions for publishing a consolidated audio stream that will best fit a designated file size.

[0113] Audio calculating instructions 622 include calculating a target bit rate for the consolidated audio stream. In one embodiment, the target bit rate is determined as a function of a target file size and a total length of time required for playback of the consolidated audio stream. For example, the target bit rate can be determined from the following equation:
TT_BR=F_S/L_CA;  (2)
where TT_BR is the total target bit rate, F_S is file size in bits, and L_CA is the length of the consolidated audio stream in seconds. (See appendix, Example 4). The audio calculating instructions 622 further include retrieving a target file size and determining the length of time that corresponds to the consolidated audio stream. The target file size can be defined by the user via the MEA or set to default by the MEA. In one embodiment, the MEA provides a user interface that allows the user to enter a desired file size and/or allows the user to select a publication target such as a CD or e-mail. (See FIG. 1B). In the latter case, the MEA can automatically designate the target file size based on the publication target. For example, if the publication target is a blank CD the MEA may designate the file size as 650 MB (i.e., 700 MB−50 MB). Alternatively, if the publication target is e-mail, the MEA may designate a default file size as 1 MB. The length of time that corresponds to the consolidated audio stream can be determined by summing the playback time of the individual audio clips along the time line. (See appendix, Example 4).

[0114] Audio best-fit identifying instructions 624 include identifying a set of audio profiles corresponding to the target bit rate of the consolidated audio stream. The audio best-fit identifying instructions 624 further include identifying the set of audio profiles from a list of audio profiles such as stored in the audio profile database described above in reference to FIG. 3A. As described above, the audio profile database includes bit rate data. In one embodiment, the set of profiles includes a first profile and a second profile from the identified set of audio profiles. The first profile specifies a bit rate less than the calculated bit rate of the consolidated audio stream. The second profile specifies a bit rate greater than the calculated bit rate of the consolidated audio stream.

[0115] Audio best-fit selection instructions 626 include selecting one of the lists of profiles as a function of the difference between the identified first profile and the identified second profile. In this embodiment, the audio best-fit selection instructions 626 include selecting one of the identified profiles as function of the difference between the bit rate specified in the first profile and the bit rate specified in the second profile. For example, the audio best-fit selection instructions 626 may include the following instructions:

• • [0116] If TT_BR<=L_BR+0.1*(H_BR−L_BR), select audio profile with the lower bit rate,
  • [0117] If TT_BR>L_BR+0.1*(H_BR−L_BR), select audio profile with the higher bit rate,
  • [0118] If TT_BR is lower than the lowest bit rate in the database, select audio profile with the lowest bit rate in the profile database, or
  • [0119] If TT_BR is higher than the highest bit rate in the database, select the audio profile with the highest bit rate in the profile database;
    where TT_BR is the calculated total target bit rate, L_BR is the bite rate specified by the second profile, and H_BR is the bite rate specified by the first profile. (See appendix, Example 4). Notably, all other bit rates in the audio profile database are either less than or equal to L_BR or greater than or equal to H_BR.

[0120] Audio best-fit publishing instructions 628 include publishing the consolidated video stream according to the selected profile, and are similar to the video best-quality publishing instructions discussed above in reference to FIG. 5A.

[0121] Referring next to FIG. 7, an exemplary flow chart illustrates the publication of the consolidated video stream as described in reference to FIG. 5. The frames along the timeline that define the consolidated video are analyzed to determine a format to be used (i.e., NTSC, PAL, 4:3, 16:9) at 702. At 704 the user indicates whether a maximum file size is desired (e.g., e-mail, or save to CD). If a maximum file size is desired, the best-fit publication routine is executed (BFPR)(see FIG. 8). If a maximum file size is not desired, the best quality publication routine (BQPR) is executed at 705. At 706 the frames along the timeline that define the consolidated video are analyzed to determine the maximum bit rate, T_BR, and maximum resolution, T_R. At 707, a first list of profiles specifying a first resolution, R1, and a second list of profiles specifying a second resolution, R2, are identified such that T_R is between R1 and R2, where R2 is less than T_R. The BQPR determines whether T_R is less than or equal to R2 plus a resolution error margin (i.e., 0.1*(R1−R2)) at 708. If T_R is less than or equal to R2 plus the resolution error margin, then the BQPR selects the list of profiles specifying R2 at 710. If T_R is greater than R2 plus the resolution error margin, then the BQPR selects the list of profiles specifying R1 at 712. At 713, a first profile specifying a first bit rate, BR1, and a second profile specifying a second bit rate, BR2, are identified from the selected list of profiles such that T_BR is between BR1 and BR2, where BR2 is less than T_BR. The BQPR determines whether T_BR is less than or equal to BR2 plus a bit rate error margin (i.e., 0.1*(BR1−BR2)) at 714. If T_BR is less than or equal to BR2 plus the bit rate error margin, then the BQPR selects the profile specifying BR2 at 716. If T_BR is greater than BR2 plus the bit rate error margin, then the BQPR selects the profile specifying BR1 at 718. At 720, the bit rate specified in the profile selected at 716 or 718 is adjusted to specify the maximum bit rate T_BR. The resolution specified in the profile selected at 716 or 718 and the adjusted bit rate specified at 720 is suggested to the user for publishing the consolidated video stream at 722.

[0122] Referring next to FIG. 8, an exemplary flow chart illustrates of the publication of the consolidated video stream as described in reference to FIG. 6. If a maximum file size is desired, the BFPR is executed at 802. The frames along the timeline that define the consolidated video are analyzed to determine the maximum resolution, T_R, and the time, t, associated with the playback of the consolidated video stream at 804. At 806, the total target bit rate, TT_BR, is calculated based on a designated file size and the determined time, t. At 807, a first list of profiles specifying a first bit rate, BR1, and a second list of profiles specifying a second bit rate, BR2, are identified such that TT_BR is between BR1 and BR2, where R2 is less than TT_BR. The BFPR determines whether TT_BR is less than or equal to BR2 plus a bit rate error margin (i.e., 0.1*(BR1−BR2)) at 808. If TT_BR is less than or equal to BR2 plus the bit rate error margin, then the BFPR selects the list of profiles specifying BR2 at 810. If TT_BR is greater than BR2 plus the bit rate error margin, then BFPR selects the list of profiles specifying BR1 at 812. At 813, a first profile specifying a first resolution, R1, and a second profile specifying a second resolution, R2, are identified from the selected list of profiles such that T_R is between R1 and R2, where R2 is less than T_R. The BFPR determines whether T_R is less than or equal to R2 plus a resolution error margin (i.e., 0.1*(R1−R2)) at 814. If T_R is less than or equal to R2 plus the resolution error margin, then the BFPR selects the profile specifying R2 at 816. If T_R is greater than R2 plus the bit rate error margin, then the BFPR selects the profile specifying R1 at 818. At 820, the bit rate specified in the profile selected at 816 or 818 is adjusted to specify the maximum bit rate TT_BR for best fit. The BQPR (see FIG. 7) is executed to determine the maximum bit rate that provides the best quality (i.e., T_BR) at 822. The BFPR determines whether the bit rate that corresponds to the best fit to file size profile TT_BR is greater than the bit rate that corresponds to the best quality profile T_BR at 824. If TT_BR is greater than T_BR, the profile selected at 816 or 818 with a bit rate of T_BR is suggested to the user for publishing the consolidated video stream at 826. If TT_BR is less than or equal to T_BR, the profile selected at 816 or 818 with a bit rate of TT_BR is suggested to the user for publishing the consolidated video stream at 828.

[0123] FIG. 9 shows one example of a general purpose computing device in the form of a computer 130. In one embodiment of the invention, a computer such as the computer 130 is suitable for use in the other figures illustrated and described herein. Computer 130 has one or more processors or processing units 132 and a system memory 134. In the illustrated embodiment, a system bus 136 couples various system components including the system memory 134 to the processors 132. The bus 136 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.

[0124] The computer 130 typically has at least some form of computer-readable media. Computer-readable media, which include both volatile and nonvolatile media, removable and non-removable media, may be any available medium that can be accessed by computer 130. By way of example and not limitation, computer-readable media comprise computer storage media and communication media. Computer storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can accessed by computer 130. Communication media typically embody computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and include any information delivery media. Those skilled in the art are familiar with the modulated data signal, which has one or more of its characteristics set or changed in such a manner as to encode information in the signal. Wired media, such as a wired network or direct-wired connection, and wireless media, such as acoustic, RF, infrared, and other wireless media, are examples of communication media. Combinations of the any of the above are also included within the scope of computer-readable media.

[0125] The system memory 134 includes computer storage media in the form of removable and/or non-removable, volatile and/or nonvolatile memory. In the illustrated embodiment, system memory 134 includes read only memory (ROM) 138 and random access memory (RAM) 140. A basic input/output system 142 (BIOS), containing the basic routines that help to transfer information between elements within computer 130, such as during start-up, is typically stored in ROM 138. RAM 140 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 132. By way of example, and not limitation, FIG. 9 illustrates operating system 144, application programs 146, other program modules 148, and program data 150.

[0126] The computer 130 may also include other removable/non-removable, volatile/nonvolatile computer storage media. For example, FIG. 9 illustrates a hard disk drive 154 that reads from or writes to non-removable, nonvolatile magnetic media. FIG. 9 also shows a magnetic disk drive 156 that reads from or writes to a removable, nonvolatile magnetic disk 158, and an optical disk drive 160 that reads from or writes to a removable, nonvolatile optical disk 162 such as a CD-ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 144, and magnetic disk drive 156 and optical disk drive 160 are typically connected to the system bus 136 by a non-volatile memory interface, such as interface 166.

[0127] The drives or other mass storage devices and their associated computer storage media discussed above and illustrated in FIG. 9, provide storage of computer-readable instructions, data structures, program modules and other data for the computer 130. In FIG. 9, for example, hard disk drive 154 is illustrated as storing operating system 170, application programs 172, other program modules 174, and program data 176. Note that these components can either be the same as or different from operating system 144, application programs 146, other program modules 148, and program data 150. Operating system 170, application programs 172, other program modules 174, and program data 176 are given different numbers here to illustrate that, at a minimum, they are different copies.

[0128] A user may enter commands and information into computer 130 through input devices or user interface selection devices such as a keyboard 180 and a pointing device 182 (e.g., a mouse, trackball, pen, or touch pad). Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are connected to processing unit 132 through a user input interface 184 that is coupled to system bus 136, but may be connected by other interface and bus structures, such as a parallel port, game port, or a Universal Serial Bus (USB). A monitor 188 or other type of display device is also connected to system bus 136 via an interface, such as a video interface 190. In addition to the monitor 188, computers often include other peripheral output devices (not shown) such as a printer and speakers, which may be connected through an output peripheral interface (not shown).

[0129] The computer 130 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 194. The remote computer 194 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to computer 130. The logical connections depicted in FIG. 9 include a local area network (LAN) 196 and a wide area network (WAN) 198, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and global computer networks (e.g., the Internet).

[0130] When used in a local area networking environment, computer 130 is connected to the LAN 196 through a network interface or adapter 186. When used in a wide area networking environment, computer 130 typically includes a modem 178 or other means for establishing communications over the WAN 198, such as the Internet. The modem 178, which may be internal or external, is connected to system bus 136 via the user input interface 194, or other appropriate mechanism. In a networked environment, program modules depicted relative to computer 130, or portions thereof, may be stored in a remote memory storage device (not shown). By way of example, and not limitation, FIG. 9 illustrates remote application programs 192 as residing on the memory device. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

[0131] Generally, the data processors of computer 130 are programmed by means of instructions stored at different times in the various computer-readable storage media of the computer. Programs and operating systems are typically distributed, for example, on floppy disks or CD-ROMs. From there, they are installed or loaded into the secondary memory of a computer. At execution, they are loaded at least partially into the computer's primary electronic memory. The invention described herein includes these and other various types of computer-readable storage media when such media contain instructions or programs for implementing the steps described below in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.

[0132] For purposes of illustration, programs and other executable program components, such as the operating system, are illustrated herein as discrete blocks. It is recognized, however, that such programs and components reside at various times in different storage components of the computer, and are executed by the data processor(s) of the computer.

[0133] Although described in connection with an exemplary computing system environment, including computer 130, the invention is operational with numerous other general purpose or special purpose computing system environments or configurations. The computing system environment is not intended to suggest any limitation as to the scope of use or functionality of the invention. Moreover, the computing system environment should not be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.

[0134] The invention may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

[0135] When introducing elements of the present invention or the embodiment(s) thereof, the articles “a,” “an,” “the,” and “said” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements.

[0136] In view of the above, it will be seen that the several objects of the invention are achieved and other advantageous results attained.

[0137] As various changes could be made in the above constructions and methods [without departing from the scope of the invention, it is intended that all matter contained in the above description and shown in the accompanying drawings shall be interpreted as illustrative and not in a limiting sense.

[0138]

TABLE 1
Example Video Profiles
	Total target	Resolution in 4:3	Resolution in 16:9		Audio
Name	bit rate	mode	mode	Frame Rate	Profile
DV-AVI	DV-AVI	720 × 480 or	720 × 480 or 720 × 576	59.940058 . . .
	(25 Mbps)	720 × 576 (Interlaced	(Interlaced or	fields per second
		or Progressive))	Progressive)	or 50 fields per
				second
All profiles below here are progressive. The “High Quality” Profiles change depending on the
NTSC/PAL setting in Tools|Options, the rest are unfiltered.
High Quality for	2.5	Mbps	720 × 480 or	720 × 480 or 720 × 576	30 fps or 25 fps	1
Local Playback (2.5 Mbps			720 × 576 if PAL in	if PAL in	if PAL in
			Tools|Options	Tools|Options	Tools|Options
High Quality for	1.5	Mbps	720 × 480 or	720 × 480 or	30 fps or	2
Local Playback (1.5 Mbps)			720 × 576 if PAL in	720 × 576 if PAL in	25 fps if PAL in
			Tools|Options	Tools|Options	Tools|Options
High Quality for	1	Mbps	720 × 480 or	720 × 480	30 fps	3
Local Playback (1 Mbps)			720 × 576 if PAL in	720 × 576 if PAL in	25 fps if PAL in
			Tools|Options	Tools|Options	Tools|Options
Video for Broadband	768	Kbps	640 × 480	852 × 480	30 fps	4
(768 Kbps)
Video for Broadband	512	Kbps	480 × 360	640 × 360	30 fps	5
(512 Kbps)
Video for Broadband	304	Kbps	320 × 240	428 × 240	30 fps	6
Video for Broadband	128	Kbps	320 × 240	428 × 240	15 fps	7
(128 Kbps)
Video for ISDN	48	Kbps	160 × 120	212 × 120	15 fps	8
Video for dial-up	33.6	Kbps	160 × 120	212 × 120	10 fps	8
connection
Video for Pocket PC	225	Kbps	208 × 160	208 × 116	20 fps	Based
(225 Kbps)						on
						system
						profiles
Video for Pocket PC	150	Kbps	208 × 160	208 × 116	8 fps	Based
(150 Kbps)						on
						system
						profiles
Full Screen video for	225	Kbps	320 × 240	320 × 180	15 fps	Based
Pocket PC (225 Kbps)						on
						system
						profiles

[0139]

TABLE 2
Example Audio Profiles
			Audio
Profile		Audio	sample
Number	Name	bit rate	rate	Output
1	High Quality Audio	160 Kbps	44.1 kHz	Stereo
	(160 Kbps)
2	High Quality Audio	128 Kbps	44.1 kHz	Stereo
	(128 Kbps)
3	High Quality Audio	96 Kbps	44.1 kHz	Stereo
	(96 Kbps)
4	CD Quality Audio (64 Kbps)	64 Kbps	44.1 kHz	Stereo
5	Near-CD Quality	48 Kbps	44.1 kHz	Stereo
	Audio (48 Kbps)
6	FM Quality Audio (32 Kbps)	32 Kbps	32 kHz	Stereo
7	AM Quality Audio (16 Kbps)	16 Kbps	16 kHz	Mono
8	Narration quality audio	8 Kbps	8 kHz	Mono
	(8 Kbps)

After examining the frames on the timeline it is determined that the maximum resolution is 720×480, and the maximum bit rate is 1.04 Mbps (T_BR). (Note: Default Aspect ratio 4:3, and assume TV standard NTSC in Tool/Options).

• [0140] 1. Starting with resolution, identify the set of video profiles with the resolution closest to 720×480. In this case several of the profiles listed in Table 1 specify the same resolution as the determined maximum resolution T_R.

[0141]

List of Profiles
High Quality for Local	2.5 Mbps	720 × 480 or	720 × 480 or	30 fps or 25 fps	1
Playback (2.5 Mbps		720 × 576 if PAL	720 × 576 if PAL in	if PAL in
		in Tools|Options	Tools|Options	Tools|Options
High Quality for Local	1.5 Mbps	720 × 480 or	720 × 480 or	30 fps or	2
Playback (1.5 Mbps)		720 × 576 if PAL	720 × 576 if PAL in	25 fps if PAL in
		in Tools|Options	Tools|Options	Tools|Options
High Quality for Local	1 Mbps	720 × 480 or	720 × 480	30 fps	3
Playback (1 Mbps)		720 × 576 if PAL	720 × 576 if PAL in	25 fps if PAL in
		in Tools|Options	Tools|Options	Tools|Options

• [0142] 2. Next identify a first profile specifying a first bit rate, H_BR, and a second profile specifying a second bit rate, L_BR, such that H_BR>T_BR>L_BR. From the list of profiles it is determined that the bit rate 1.04 Mbps is between 1 and 1.5 Mbps.
• [0143] 3. Use video best-quality selection instructions select one of the list of profiles:

[0144] If Tbr<=Lbr+0.1*(Hbr−Lbr) select video profile with the lower bit rate or

[0145] If Tbr>Lbr+0.1*(Hbr−Lbr) select video profile with the higher bit rate;

[0146] 1.04 Mbps<0.1 Mbps+0.1(1.5 Mbps−1.04 Mbps)

[0147] 1.04 Mbps<1.046 Mbps, so select the 1 Mbps, 720×480, 30 fps profile.

• [0148] 4. The video bit rate is either increased or decreased to match timeline bit rate. The bit rate shall not be increased above the absolute maximum video bit rate or decreased below the absolute minimum video bit rate, regardless of the content on the timeline. In this case, the profile of 1 Mbps, 720×480, 30 fps has its bit rate increased to 1.04 Mbps.

[0149]

High	1 Mbps	720 × 480 or	720 × 480	30 fps	3
Quality		720 × 576	720 × 576	25 fps
for Local		if PAL in	if PAL in	if PAL in
Playback		Tools|	Tools|Options	Tools|Options
(1 Mbps)		Options

• [0150] 5. From Table 1 the corresponding audio profile is audio profile 3:

[0151]

3	High Quality Audio	96 Kbps	44.1 kHz	Stereo
	(96 Kbps)

• [0152] 1. After examining the timeline the maximum bit rate (T_BR) is determined to be 110 Kbps.
• [0153] 2. Next identify a first profile specifying a first bit rate, H_BR, and a second profile specifying a second bit rate, L_BR, such that H_BR>T_BR>L_BR. From the list of audio profiles in Table 2, it is determined that the bit rate 110 Kbps is between 128 Kbps and 1.5 Kbps
  Thus, profiles 2 and 3 are identified.

[0154]

List of Profiles
2	High Quality Audio	128 Kbps	44.1 kHz	Stereo
	(128 Kbps)
3	High Quality Audio	96 Kbps	44.1 kHz	Stereo
	(96 Kbps)
TBR = 110 Kbps, Lbr = 96 Kbps, and Hbr = 128 Kbps

• [0155] 3. Use audio best-quality selection instructions to select on of the identified list of profiles:

[0156] If Tbr<=Lbr+0.1*(Hbr−Lbr) select audio profile with the lower bit rate or

[0157] If Tbr>Lbr+0.1*(Hbr−Lbr) select audio profile with the higher bit rate;

[0158] 110>96 Kbs+1*(128 Kbps−96 Kbps)=99.2 Kbps

[0159] 110 Kbs>99.2 Kbps, so the audio profile with the higher bit rate is selected (i.e., profile 2).

[0160]

2	High Quality Audio	128 Kbps	44.1 kHz	Stereo
	(128 Kbps)

After examining the timeline we find that the maximum resolution is 720×480, and the timeline length is 500 seconds. (Note: Default Aspect ratio 4:3, and assume TV standard NTSC in Tool/Options).

• [0161] 1. The user chose file size=20 MB (Note: MB=1024 KB.
• [0162] 2. Calculate Total Target bit rate=(20*8)/500=0.32 Mbps, or 320 Kbps.
• [0163] 3. Starting with the Total Target bit rate, TT_BR, identify a first list of profiles specifying the same first bit rate, H_BR and a second list of profiles specifying the same second bit rate, L_BR such that H_BR>TT_BR>L_BR. In this case, there is one profile in the list of first profiles and one profile in the list of second profiles because the no other profiles have the same bit rates.
  From Table 1 the following profiles are identified.

[0164]

List of Profiles
Video for Broadband	512 Kbps	480 × 360	640 × 360	30 fps	5
(512 Kbps)
Video for Broadband	304 Kbps	320 × 240	428 × 240	30 fps	6
TTBR = 320 Kbps,
LBR = 304 Kbps, and
HBR = 512 Kbps.

• [0165] 3. Use video best-fit selection instructions select one of the lists of profiles:

[0166] If TT_BR<=L_BR+0.1*(H_BR−L_BR) select video profile with the lower bit rate or

[0167] If TT_BR>L_BR+0.1*(H_BR−L_BR) select video profile with the higher bit rate;

320 Kbps+0.1*(512 Kbps−304 Kbps)=340.8 Kbps

320 Kbps<340 Kbps so the video profile with the lower bit rate is selected (i.e., video profile specifying 304 Kbps is selected).

[0168]

Video for Broadband	304 Kbps	320 × 240	428 × 240	30 fps	6

From Table 1 the corresponding audio profile is profile 6.

[0169]

6	FM Quality Audio (32 Kbps)	32 Kbps	32 kHz	Stereo

After examining the timeline the timeline length is determined to be 120 seconds.

• [0170] 1. The user chooses file size=2 MB (e.g., e-mail).
• [0171] 2. Calculate Total Target bit rate=(2*8)/120=0.133 Mbps, or 133 Kbps.
• [0172] 3. Next identify a first profile specifying a first bit rate, H_BR, and a second profile specifying a second bit rate, L_BR, such that H_BR>TT_BR>L_BR. From the list of audio profiles in Table 2, it is determined that the bit rate 133 Kbps is between 128 Kbps and 160 Kbps.

[0173]

1	High Quality Audio	160 Kbps	44.1 kHz	Stereo
	(160 Kbps)
2	High Quality Audio	128 Kbps	44.1 kHz	Stereo
	(128 Kbps)
TTBR = 133 Kbps, LBR = 128 Kbps, and HBR = 160 Kbps.

Use audio best-fit selection instructions select one of the lists of profiles:

[0174] If TT_BR<=L_BR+0.1*(H_BR−L_BR) select audio profile with the lower bit rate or

[0175] If TT_BR>L_BR+0.1*(H_BR−L_BR) select audio profile with the higher bit rate;

133 Kbps>128 Kbps+0.1*(160 Kbps-128 Kbps) or

133 Kbps>131.2 Kbps, so the audio profile with the higher bit rate is selected (i.e., audio profile 1).

[0176]

1	High Quality Audio	160 Kbps	44.1 kHz	Stereo
	(160 Kbps)