Video editing GUI with layer view

[0001] This invention relates to video editing software, and more particularly to the graphical user interface for video editing software.

[0002] The digital video editing process starts when a user imports media (e.g., videos, still-images, and audios) to a computer. The user can import media from many sources, including a camcorder and the Internet. Next, the user edits the video by trimming video clips to appropriate lengths, inserting transitions between, and adding special effects such as titles, logo overlays, and background audio tracks.

[0003] Most video editing programs assemble clips in a storyboard that looks like a picture book, with the clips in sequence. Many programs also include a timeline, which is a linear representation of the clips that simplifies production-wide effects like audio tracks and logo overlays.

[0004] In the final stage, the video is converted to the appropriate format (e.g., rendered), whether for streaming over the Internet, burning onto CD-R or DVD-R, or transferring back to a camera. Most editing programs manage the transfer of video back to a camera, and many also provide CD-R or DVD-R authoring tools.

[0005] Video editors can control a DV camera or deck so a user does not have to stop and start a camera by hand, and several programs also let a user capture multiple files at once (called batch capture). Since DV cameras stamp date and time information into the file, most video editors can identify the time code breaks that indicate scene changes and separate these into discrete scenes.

[0006] Like many creativity applications, video editing software is available in two classes: professional products and consumer products. Both classes provide a similar set of capturing, editing, and rendering features. However, professional programs seek to facilitate creative freedom while consumer programs stress operational simplicity. Most consumer programs favor highly structured interfaces with a limited number of audio and video tracks. For example, Pinnacle Studio Version 7's fixed interface offers two video and three audio tracks, with tabs that guide users through the process. By contrast, Adobe Premiere offers up to 99 audio and video tracks with multiple windows that can be positioned and resized at will.

[0007] As more and more consumers rush to create their own videos, what is needed is an interface for video editing software that is intuitive and easy to use for the consumers.

[0008] In one embodiment of the invention, a graphical user interface for editing a video story includes a storyboard pane, a timeline pane, and a layer pane. The storyboard pane displays video clips of the video story and transitions between the video clips. The timeline pane displays a number of tracks of the video story. The tracks include a video track for displaying the video clips, a video overlay track for displaying video overlay clips, a text track for displaying text clips, an effect track for displaying effects, and at least one audio track for displaying audio clips. The layer pane displays a number of layers of a selected video clip from the video track. Each layer displays one layer clip. The layer clip can be a video layer clip, a text layer clip, or an audio layer clip. The layers in the layer pane show how the layer clips overlay each other (or not) in time to compose the selected video clip. In one embodiment, a user uses the storyboard pane and the timeline pane to layout the video story, and the layer pane to layout the video clips in the video story.

[0021] In one embodiment, a video story (e.g., a movie) is composed of individual tracks, including a video track, a video overlay track, an effect track, a text track, and one or more audio tracks. Each track is composed of “clips”. For example, a video track is composed of video clips and transitions between video clips. In one embodiment, each video clip is composed of individual tracks (hereafter called “layers” to distinguish against the tracks of the video story), including one or more video layers, one or more audio layers, one or more text layers. Unlike a track, each layer is composed of only one clip (hereafter called a “layer clip” to distinguish against the clips of the tracks). For example, each video layer is composed of one video layer clips. A video layer clip can contain a video or a still image.

[0022] FIG. 1 illustrates a main graphical user interface 100 (hereafter “GUI 100”) of a video editing software on a conventional computer. GUI 100 includes a capture button 132, an edit button 134, and a produce button 136 that allow the user to select a phase of video-editing process. By selecting capture button 132, the video editing software enters into a capture mode where interactive windows and panes are displayed for the user to import media into the video editing software. By selecting an edit button 134, the video editing software enters into an edit mode where interactive windows and panes are displayed for the user to layout a video story and its video clips. These windows and panes are described below in detail. By selecting produce button 136, the video editing software enters into a production mode where interactive windows and panes are displayed for the user to render the video story. Once selected, buttons 132, 134, and 136 also indicate the video-editing phase that the user is in.

[0023] In the edit mode, GUI 100 includes a view area 112 with a media tab 114, a theme tab 116, a transition tab 118, an effect tab 120, a text tab 122, and an explorer tab 124. The user uses view area 112 to select the clips that make up the tracks of the video story. Used herein, the term “select” or any form thereof means the act of identifying an element through a mouse, a keyboard, or any other form of input (e.g., single or double-clicking an item using a mouse). GUI 100 further includes a view area 102 with a storyboard tab 104, a timeline tab 106, and a layer tab 108. A user uses view area 102 to arrange the clips to construct the tracks of the video story.

[0024] FIG. 2 illustrates a storyboard pane 200. If the user selects storyboard tab 106, storyboard pane 200 appears in view area 102 (FIG. 1). To add a video clip, the user drags and drops the video clip from a media pane 612 (FIG. 6) into one of frames 202-1 to 202-i (where “i” is a variable). The user accesses media pane 612 in view area 112 (FIG. 1) by selecting media tab 114 (FIG. 1). As discussed above, a video clip may be a video or a still image.

[0025] To add a transition, the user drags and drops the transition from a transition pane 912 (FIG. 9) into one of frames 204-1 to 204-j (where “j” is a variable). The user accesses transition pane 912 in view area 112 by selecting transition tab 118 (FIG. 1). In storyboard pane 200, the video clips and the scene transitions are arranged in the time sequence which they appear. Additional tracks of the video story are not visible in storyboard pane 200.

[0026] FIG. 3 illustrates a timeline pane 300. If the user selects timeline tab 104, timeline pane 300 appears in view area 102 (FIG. 1). Timeline pane 300 displays all the tracks in the video story. Timeline pane 300 includes a video row 302, a video-companion audio row 303, a video overlay row 304, a text row 306, an effect row 308, a first audio row 310, and a second audio row 312. Video row 302 displays the video clips and transitions between the video clips in the video story. Video-companion audio row 303 displays an audio track with audio clips preexisting in the video clips. Video overlay row 304 displays video overlay clips (e.g., a watermark image) superimposed over the video clips. Text row 306 displays the texts in the video clips. Effects row 308 displays the special effects applied to the video clips. Audio rows 310 and 312 display two audio tracks to be played along the video clips but are external to the video clips.

[0027] The user typically drags and drops clips into respective rows in the time sequence which they appear to construct the overall layout of the video story. To add a video clip, the user drags and drops the video clip from media pane 612 (FIG. 6) into video row 302. To add an overlay video clip, the user drags and drops the overlay video clip from media pane 612 into overlay video row 304. To add a transition between video clips, the user drags and drops the transition from transition pane 912 (FIG. 9) into the start or the end of a video clip in video row 302. To add a text clip, the user drags and drops the text clip from text pane 712 (FIG. 7) into text row 306. The user accesses text pane 712 in view area 112 (FIG. 1) by selecting text tab 122 (FIG. 1). To add an effect to be applied to a video clip, the user drags and drops the effect from effect pane 1012 (FIG. 10) into effect row 308. The user accesses effect pane 1012 in view area 112 by selecting effect tab 120 (FIG. 1). To add an audio clip, the user drags and drops the audio clip from media pane 612 into one of audio rows 310 and 312.

[0028] To add a theme to the video story, the user selects a theme from a theme pane. A theme is a template with predetermined transitions, texts, and effects for a video story. The user accesses the theme pane in view area 112 (FIG. 1) by selecting theme tab 116 (FIG. 1). Theme pane is similar to media pane 612 except that themes instead of media are displayed. The user may select a theme while in storyboard pane 200 and timeline pane 300.

[0029] The user selects explorer tab 118 to access an explorer window to manage all the media (video, audio, and still images), transition, text, effect, and theme files. The explorer window is similar to Windows Explorer and allows the user to manipulate (e.g., copying, moving, deleting) files and folders in a tree view.

[0030] FIG. 4 illustrates a layer pane 400. When the user selects a video clip in either storyboard pane 200 (FIG. 2) or timeline pane 300 (FIG. 3), layer tab 108 (FIG. 1) becomes enabled. If the user selects layer tab 108, a layer pane 400 appears in view area 102 (FIG. 1) so the user may edit the selected video clip. Alternatively, the user can double-click a video clip in either storyboard pane 200 or timeline pane 300 to bring up layer pane 400 in view area 102 when the video clip contains multiple layers. When a video clip contains only one layer, double-clicking the video clip will bring up conventional video clip editing pane 1212A (FIG. 12A) in view area 112 instead of layer pane 400 in view area 102. Video clip editing pane 1212A can be expanded to video clip editing pane 1212B (FIG. 12B) by selecting button 1250, and vice versa. In one embodiment, any video clip initially added to storyboard pane 200 or timeline pane 300 contains only one layer, so on that occasion the user has to select layer tab to access layer pane 400. The second time the user double-clicks that video clip, the computer decides whether the video clip contains multiple layers before invoking layer pane 400 or video clip editing pane 1212 in view area 112.

[0031] Layer pane 400 displays all the layers in the selected video clip. As described above, each layer consists of only one layer clip and that layer clip can be a video, text, or audio layer clip. Depending on the number of layer clips that make up the selected video clip, layer pane 400 will displays the corresponding number of layer rows. In one example, layer pane 400 includes a first video row 406, a second video row 412, a first text row 402, a second text row 404, a third text row 408, a fourth text row 414, and an audio row 410. Video rows 406 and 412 display the two video layer clips in the selected video clip. Text rows 402, 404, 408, and 414 display the four text layer clips in the selected video clip. Audio row 410 displays the one audio layer clip in the selected video clip. In other examples, more or less layers may compose the selected video clip.

[0032] To add a video layer clip, the user drags and drops a video clip from media pane 612 (FIG. 6) into layer pane 400 and a video row will be created for that video layer clip. Video layer clips can be moved to different timeslots to create a non-overlapping time sequence of multiple video clips. Video layer clips can also be moved to overlapping timeslots to create an overlapping time sequence of multiple video clips. A combination of overlapping and non-overlapping sequences can be used to modify the selected video clip. To edit a video layer clip, the user selects (e.g., double-click) the video layer clip in video row 402 or 404 and a window 512 (FIG. 5) with a variety of editing tabs appears in view area 112 (FIG. 1). FIG. 5 shows that editing tabs include basic tab 514, color tab 516, effect tab 518, transparency tab 520, and motion tab 522. By selecting one of tabs 514 to 522, a corresponding pane offering a variety of video editing options appear in view area 112. A basic editing pane allows the user to trim a video layer clip, fasten or slow down playback speed, and adjust the volume of the video-companion audio track in one embodiment. A color editing tab allows the user to modify brightness, hue, saturation, and contrast in one embodiment. An effect editing pane allows the user to add video effects to the video layer clip in one embodiment. A transparency editing pane allows the user to edit the visibility of the video layer clip on the screen during playback in one embodiment. A motion editing pane allows the user to move the video layer clip across the screen along a predetermined route in one embodiment.

[0033] To add a text layer clip, the user drags and drops a text clip from text pane 712 (FIG. 7) into layer pane 400 and a text row will be created for that text layer clip. To edit a text layer clip, the user selects (e.g., double-clicks) the text layer clip in text row 406 or 408 and a text editing window 812 (FIG. 8) appears. Window 812 offers a variety of text editing options (e.g., font size, style, orientation). To return to layer pane 400 in GUI 100, the user selects a button 814 (FIG. 8) to accept the editing changes or a button 816 (FIG. 8) to cancel the editing changes.

[0034] To add an audio layer clip, the user drags and drops an audio clip from media pane 612 (FIG. 6) into layer pane 400 and an audio row will be created for that audio layer clip. To edit an audio layer clip, the user selects (e.g., double-clicks) the audio layer clip in audio row 410 or 412 and an audio editing pane 632 (FIG. 6) appears in view area 112. Audio editing pane 632 offers a variety of audio editing options. These editing options include adding audio effects such as fade-in and fade-out, and change the volume.

[0035] To add a layout to the selected video clip, the user selects the layout from a layout pane. Similar to a theme for a video story, a layout is a template with predetermined arrangement of video, audio, and text layer clips. The user accesses the layout pane in view area 112 (FIG. 1) by selecting layout tab 711 (FIG. 7). Layout pane is similar to media pane 612 except that layouts instead of media are displayed.

[0036] FIGS. 11A and 11B illustrates a method 1000 for editing a video story using GUI 100. In action 1002 (FIG. 11A), the computer displays GUI 100. In action 1004, the computer determines from a user input whether to layout the video story with storyboard pane 200 (FIG. 2) or with timeline pane 300 (FIG. 3). As described above, the user can select a storyboard tab 104 or a timeline tab 106 to select the corresponding pane. If the user selects to layout the video story with storyboard pane 200, then action 1004 is followed by action 1006. If the user selects to layout the video story with timeline pane 300, then action 1004 is followed by action 1010.

[0037] In action 1006, the computer displays storyboard pane 200 in view area 102 (FIG. 1). Action 1006 is followed by action 1008. In action 1008, the computer receives a user selection of a video clip or a scene transition. As described above, the user can drag and drop the video clip or transition from media pane 612 (FIG. 6) or transition pane 912 (FIG. 9) in view area 112 (FIG. 1). Action 1008 is followed by action 1014.

[0038] In action 1010, the computer displays timeline pane 300 in view area 102. Action 1010 is followed by action 1012. In action 1012, the computer receives a user selection of a video, an overlay video, a text, an effect, or an audio clip. As described above, the user can drag and drop the clip from media pane 612, text pane 712 (FIG. 7), or effect pane 1012 (FIG. 10). Action 1012 is followed by action 1014.

[0039] In action 1014, the computer determines from a user input whether or not to edit a video clip. If yes, action 1014 is followed by action 1016. If no, action 1014 is followed by action 1018 (FIG. 11B). As described above, the user can select a video clip and then select layer button 108 to edit the video clip. Alternatively the user can double-click the video clip in storyboard pane 200 or timeline pane 300.

[0040] In action 1016, the computer determines if it should display layer pane 400 (FIG. 4). As described above, the computer would display layer pane 400 if the user selects a video clip and then selects layer button 108. The computer would also display layer pane 400 if the user double-clicks a video clip in storyboard pane 200 or timeline pane 300 if the video clip contains more than one layer. If the computer displays layer pane 400, action 1016 is followed by action 1028. The computer would display a video clip editing pane 1212 instead of layer pane 400 if the user double-clicks video clip in storyboard pane 200 or timeline pane 300 if the video clip contains only one layer. If the computer displays video clip editing pane 1212 instead of layer pane 400, action 1016 is followed by action 1018 (FIG. 11B).

[0041] In action 1018, the computer displays video clip editing pane 1212. Action 1018 is followed by action 1020. In action 1020, the computer receives user input on editing the selected video clip. Action 1020 is followed by action 1032.

[0042] In action 1022 (FIG. 11A), the computer displays layer pane 400 (FIG. 4). In action 1024, the computer receives a user selection of a video, a text, or an audio layer clip. As described above, the user can drag and drop the layer clip from media pane 612 and text pane 712. In action 1026, the computer determines from a user input whether or not to edit the layer clip. If yes, action 1026 is followed by action 1028 (FIG. 11B). If no, action 1026 is followed by action 1032 (FIG. 11B). As described above, the user can select a layer clip in layer pane 400 to edit that layer clip.

[0043] In action 1028, the computer displays a corresponding editing window or pane for the selected layer clip. For example, if the user selected a video layer clip, the computer displays video editing window 512. The user could also select a predetermined layout in the layout pane. Action 1028 is followed by action 1030. In action 1030, the computer receives user input on editing the selected layer clip. Action 1030 is followed by action 1032.

[0044] In action 1032, the computer determined if the user has finished the layout of the video story and its video clips. If yes, action 1032 is followed by action 1034 where the video story is ready to be rendered. If no, action 1032 is followed by action 1004 (FIG. 11A) where the user continues to layout and to edit the video story. The user has finished the layout of the video story and its video clips when he or she selected produce button 136 to render the entire story chain.

[0045] Various other adaptations and combinations of features of the embodiments disclosed are within the scope of the invention. Numerous embodiments are encompassed by the following claims.