Method and apparatus for creating multimedia electronic mail messages or greeting cards on an interactive receiver

[0002] A. Field of the Invention

[0003] This invention generally relates to electronic mail systems and, more particularly, to methods and apparatus for creating multimedia electronic mail messages or greeting cards on an interactive receiver.

[0004] B. Description of the Related Art

[0005] The past several years have seen a dramatic shift in methods of communicating information. In the past, the only way of communicating information was via standard mail delivery of handwritten or typed documents. With the advent of the telephone and telegraph, it became possible to convey voice signals and information electrically. Recently, electronic communication has become a rapidly increasing way of conveying information—especially because of widely available access to the Internet. People now exchange electronic mail (“email”) addresses concurrently with telephone numbers, and many major businesses provide access to information and services on the Internet via sites on the World Wide Web.

[0006] Because of the rapid pace of development in this field, however, the evolution has not been completely seamless. Although it is now possible to communicate audio/visual information electronically, it is certainly not easy to do so. Simply to send and receive email, a user initially must purchase a computer system, configure all of its component parts to interoperate, learn the operating system for the computer, contract with an Internet service provider, and learn how to use the application software for email. If a user wants to send audio-visual information such as a picture, video sequence or audio, the user is forced to purchase even more hardware and learn even more software.

[0007] A conventional computer system is shown in FIG. 1. A computer system 100 is used to compose and transmit email, generally by dial-up telephone connection, to an Internet service provider (ISP) 180. ISP 180 contains a mail server 190, which is responsible for receiving email and routing it to the appropriate destination address.

[0008] Computer system 100 consists of a computer 130, to which are attached several accessories. Computer 130 may be any conventional home or business computer such as a personal computer (PC), a Macintosh, a network computer, or a Sun Workstation. The user interface to computer 130 includes a keyboard 140, some type of pointing device such as a mouse 150, and a display screen 120. In addition to a user interface, computer system 100 may also contain an offline storage device 110 for storing messages to be sent and messages that have been received. Typical offline storage devices include a hard disk drive, a floppy disk drive, or a tape unit. A typical computer system I00 also contains a modem 160 which is employed to send or receive messages between computer system 100 and ISP 180.

[0009] To send a email message, a user enters a message into computer 130 via keyboard 140 and/or mouse 150. This email message may or may not then be stored on offline storage device 110. The email message is then transmitted from computer 130 to ISP 180 via modem 160. Upon receiving the message, mail server 190, within ISP 180, forwards the message to the appropriate destination. In this manner, a user of computer system 100 may transmit a email message to any user that is connected to ISP 180, either directly or indirectly via the Internet.

[0010] A user desiring to transmit an email message containing audio-visual information must further employ an audio-video input interface 170. To this interface 170 a user may attach an audio-visual source such as, for example, a video cassette recorder (VCR) or a camcorder. To transmit an audio-visual email message, audio-visual information is transferred from the audio-visual source to computer 130 via interface 170, and converted to an appropriate format such as MPEG. This information may or may not be stored offline on storage device 110. The information is then composed into an email message and is transmitted from computer 130 to ISP 180 via modem 160. Mail server 190 of ISP 180 forwards it to the appropriate destination.

[0011] As the preceding explanation demonstrates, composing and transmitting an email message on a conventional computer system requires numerous hardware components and significant user sophistication. This complexity creates a barrier to entry that prevents many individuals from participating in the information age.

[0012] Recent developments have sought to address the problem noted above. Companies now provide a service that allows an individual to purchase a relatively inexpensive “set-top box,” which is connected to a television receiver to access the Internet. As a result, individuals now have somewhat easier access to the Internet and a simpler way of sending and receiving email.

[0013] A representative example of such a set-top system is shown in FIG. 2, and is commercially available from WebTV. Such a system consists of a set-top box 220 which is connected to a conventional television receiver 200. Also attached to television receiver 200 may be a video signal source 210 such as, for example, a VCR or a camcorder.

[0014] A user of such a system may compose a email message by using remote control 230 in conjunction with set-top box 220. This may be accomplished by using a wireless keyboard (not shown). Alternatively, set-top box 220 may generate a display of the alphabet, which is shown on television receiver 200. By employing remote control 230, the user selects individual letters of the displayed alphabet to compose words, phrases, or sentences. During this composition, the email message being created is stored in a memory of set-top box 220. Once the message has been fully created, it is transmitted from set-top box 220 to a WebTV system 240. This transmission is performed using a conventional modem and dial-up telephone lines. Once the message reaches WebTV system 240, a WebTV mail server 250 forwards the message to the appropriate destination.

[0015] Problems remain, however, despite the availability of such set-top systems. Neither set-top systems nor computer systems contains a robust email management system designed with home users in mind. For example, neither system allows a user to create multimedia email messages or greeting cards.

[0016] There exists, therefore, a need for a versatile but simple form of electronic communication that is readily accessible to the general public. To provide versatility, the system should accommodate text, audio, video, and a robust email system; it should also employ an open architecture so that individuals may use whatever Internet service provider they prefer. To provide simplicity, the system should be integrated, rather than having multiple components that its user needs to purchase separately and then assemble together; it should also employ familiar hardware that requires simple commands.

[0017] The present invention helps to satisfy this need and solve the problem of providing a simple but versatile form of electronic communication. It provides methods and apparatus that allow its users to manipulate, send, and receive audio/visual information easily by using familiar devices such as an interactive receiver and a remote control device. In particular, the present invention is directed to methods and apparatus for creating multimedia electronic mail messages or greeting cards on an interactive receiver.

[0018] Consistent with this invention, a method for creating and editing multimedia greeting cards and multimedia electronic mail simply, using an interactive television receiver comprises the steps of receiving a command from a user selecting a design template from a list, retrieving a file corresponding to the selected template from a memory within the television receiver, displaying an image corresponding to the file on a screen of the television receiver, receiving a command from a user selecting multimedia data from a list, retrieving the multimedia data from a memory within the television receiver, and mapping the multimedia data to the template in response to commands from the user.

[0019] Although this method is described here as one example, one of skill in the art will recognize that there exist other methods and apparatus that are consistent with the claimed invention.

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate the invention and, together with the description, serve to explain the principles of the invention.

[0021] FIG. 1 is a block diagram of a conventional computer system for electronic communication;

[0022] FIG. 2 is a block diagram of a conventional set-top system for electronic communication;

[0023] FIG. 3 is a block diagram of a system, consistent with the claimed invention, for creating multimedia email messages or greeting cards;

[0024] FIG. 4 is a block diagram, consistent with the claimed invention, of an interactive receiver;

[0025] FIG. 5 is a diagram of a remote control device that may be used in conjunction with the claimed invention;

[0026] FIG. 6 is a flow diagram of the steps performed to create a multimedia greeting card or multimedia electronic mail message;

[0027] FIG. 7 is a flow diagrams of the steps performed to morph the multimedia data;

[0028] FIG. 8 is a flow diagram of the steps performed to animate the multimedia data; and

[0029] FIG. 9 is a flow diagram of the steps performed to play back the text of a multimedia greeting card or multimedia electronic mail message via audio; and

[0030] FIG. 10 is a flow diagram of the steps performed to create a slide show of concatenated images.

[0031] Reference will now be made in detail to an implementation of the present invention as illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings and the following description to refer to the same or like parts.

[0032] A. Overview

[0033] Systems consistent with the claimed invention overcome the limitations associated with conventional systems and provide a simple yet versatile way to compose, edit and transmit multimedia greeting cards or multimedia email messages. A user composes a multimedia greeting card or multimedia email message by selecting a design template, which has previously been created and stored on the system. The design template contains one or more slots, into which the user simply drags and drops any desired text, video, or audio data. The user may also edit and add enhancements to the multimedia greeting card or email message. If desired, the user may electronically mail the resulting product to another user.

[0034] As used herein, the term “multimedia data” refers to text, audio, video, or any combination thereof. The term “multimedia item” refers to a multimedia greeting card, a multimedia email message, or a combination thereof.

[0035] B. System Diagrams

[0036] One example of such a system is shown in FIG. 3. This system consists of an interactive receiver 300 and ISP 330, each of which has other components interfaced to it. Interactive receiver 300 may be similar to a conventional television receiver, with additional features as described below. Connected to interactive receiver 300 are an input source 310, a storage 315, a remote control device 320, and an audio microphone 325. Examples of input source 310 include, but are not limited to, a VCR, a digital still camera, or a camcorder. Examples of storage device 315 include, but are not limited to, a hard disk drive, a digital video drive, an analog tape drive, or a random access memory. Examples of remote control device 320 include, but are not limited to, a television remote control device, or a conventional QWERTY keyboard.

[0037] The system also contains a server 340 that is connected to ISP 330. Attached to server 340 is a storage device 350, examples of which include a hard disk, an analog tape drive, or a random access memory. Server 340 is a conventional network mail server computer but contains the software and hardware necessary to manage a system consistent with the claimed invention. This includes, for example, software for the user interface, and temporary or long-term storage for user data.

[0038] The system shown in FIG. 3 provides a simple interface allowing users to manage incoming email messages. Moreover, as the system shown in FIG. 3 also demonstrates, a user of such a system is not limited to a specific ISP, as is the case with conventional systems. Any ISP that chooses to use proprietary server 340 may provide its users with this system's capabilities. This open architecture approach provides significant flexibility to users, who may select any ISP of their liking, so long as that ISP supports this system.

[0039] Although FIG. 3 shows one example of a system that allows users to manage incoming email messages, those of skill in the art will recognize that there exist other systems that are also consistent with the claimed invention. For example, although FIG. 3 shows server 340 and storage device 350 as being separate from ISP 330, any number of these components may be combined.

[0040] FIG. 4 shows a block diagram, consistent with the claimed invention, of the portion of the system with which the administrator and users directly interface, namely, interactive receiver 300. Interactive receiver 300 shown in this diagram contains a multimedia processor 410, examples of which include the Pentium MNX™ processor commercially available from Intel Corporation and the Tri-media™ processor commercially available from Philips Corporation. Processor 410 provides support for audio-visual information, graphic information, a network stack, and a user interface, and is configured to carry out the steps described below in reference to FIGS. 6-10.

[0041] Attached to processor 410 is an analog input 490 and a digital input 440. Input 490 may receive television broadcast information from, for example, a television antenna or a cable television system. Accordingly, input 490 supports standards such as National Television Standards Committee (NTSC). Input 440 may receive information from, for example, digital cable television systems or digital satellite systems. Accordingly, input 440 supports standards such as Quadrature Amplitude Modulation for digital cable and Quadrature Phase Shift Keying for digital satellite systems.

[0042] Also attached to processor 410 is an output interface 430 for sending video data from interactive receiver 300 to, for example, a VCR, a digital video drive, or a video printer. In addition to output interface 430, there is attached to processor 410 a display screen 480 for displaying audio-visual and text information to the user. Examples of display screen 480 include a cathode ray tube, a liquid crystal display, or a plasma display.

[0043] Also attached to processor 410 is a remote input interface 450 for receiving commands, such as infrared or radio frequency signals, from remote control device 320. In addition, an audio input interface 455 is attached to processor 410, which enables the user to add audio to text or graphic images. Interactive receiver 300 also contains an external interface 425 for communicating with external devices such as offline storage device 315. Examples of external interface 425 include, but are not limited to, the Small Computer System Interface (SCSI), IEEE 1394 (“Firewire”), and Electronics Industry Association Recommended Standard 232. A memory device 420 is attached to processor 410 for storing information. Examples of memory device 420 include, but are not limited to, a hard disk, a random access memory, a flash memory, or a floppy disk.

[0044] Also shown in this example is a communication device 460, which represents any device capable of communicating electronic information between multimedia processor 410 and ISP 330. Device 460 may operate over telephone lines using conventional standards such as V.34 or Integrated Services Digital Network (ISDN). Alternatively, device 460 may be a cable modem operating over coaxial cable.

[0045] Although FIG. 4 shows one example of an interactive receiver, those of skill in the art will recognize that there exist other devices that are also consistent with the claimed invention. For example, the components shown in FIG. 4 may be integrated into a digital television receiver cabinet. Alternatively, some of the components may be integrated into a television receiver cabinet while others remain externally attached.

[0046] FIG. 5 shows a diagram of a remote control device that may be used in conjunction with the claimed invention. Remote control device 320 is powered by batteries 510 contained within the device. Remote control device 320 also contains numerous user control keys 520. In addition to providing routine television control, such as changing television channels or volume levels, remote control device 320 also contains keys for displaying a menu, cursor control keys for selecting menu items, and keys for initiating and ending the capture of video data. These are shown in FIG. 5 as: an “Interactive Receiver Menu” key, which is used to display a menu; arrow and “Select” keys for manipulating menu items; an “Image Capture” key for initiating a graphic image capture; a “Video Data Capture” key for initiating a video sequence capture; and a “Stop” key for ending the capture of video data. Remote control device 320 also contains an infrared transmitter 530 for conveying commands from remote control device 320 to interactive receiver 300. The channel of communication between remote control device 320 and interactive receiver 300 is not critical. In addition to infrared signals, one may use any other conventional technique such as RF signals or a physical cable.

[0047] Although FIG. 5 shows one example of a remote control device, those of skill in the art will recognize that there exist other remote control devices that are also consistent with the claimed invention. For example, remote control device 320 could be a conventional QWERTY keyboard.

[0048] A user of a system consistent with the claimed invention purchases an interactive receiver, such as interactive receiver 300. Interactive receiver 300 supports one master account for each home, the master account having multiple user sub-accounts. A user connects interactive receiver 300 to an alternating current power source, and connects modem 460 to a standard telephone line. Upon power-on, the user will be queried by interactive receiver 300 to provide a name and password for an administrator of the account, such as a parent. Once this information is provided, the administrator may configure the system as described below.

[0049] C. Flow Diagrams

[0050] FIG. 6 is a logic flow diagram, consistent with the claimed invention, of the steps performed to create a multimedia item. Interactive receiver 300 receives a command via its remote input 450 to create a multimedia item (step 605). This command may be generated, for example, by using a menu system. The user first presses the “Interactive Receiver Menu” key located on remote control device 320. This causes interactive receiver 300 to display on screen 480 a series of menu choices, one of which is for creating a multimedia item. The user then presses the cursor control keys and the “Select” key on remote control device 320 to select the menu choice for creating a multimedia item.

[0051] In response, interactive receiver 300 displays on display screen 480 a list of available templates for creating the multimedia item (step 610). This list may be stored in memory device 420, on storage device 315, on storage device 350, or any combination thereof. The user next selects one of the available design templates (step 615), using the cursor control keys on remote control device 320. In response to the user's selection, interactive receiver 300 retrieves and displays the selected design template on display screen 480 (step 620). The design template may be retrieved either from memory device 420, storage device 315, storage device 350, or any combination thereof.

[0052] Next, interactive receiver 300 displays a list of available multimedia data on display screen 480 (step 625). The user selects multimedia data, preferably by using the cursor control keys on remote control device 320 (step 630). The user then drags and drops the selected multimedia data onto an open slot on the design template (step 635).

[0053] Interactive receiver 300 then checks to determine whether the user has finished adding multimedia data to the design template and wants to exit (step 640). If the user does not want to exit, the user may add additional multimedia data to the template (step 630). On the other hand, the user may choose to exit; if so, the processor creates an output file by mapping the selected multimedia data onto the appropriate portions of the design template (step 645).

[0054] The process described above allows its user to generate, in a simple manner, a relatively complex multimedia item. The user simply selects multimedia data and drags it onto an open slot on the design template. The processor performs any necessary mapping functions, such as shrinking multimedia data to fit in an available open slot of the design template. By using such a process, therefore, relatively unsophisticated users can generate multimedia items.

[0055] Those skilled in the art will recognize that there exist other processes consistent with the invention. For example, rather than dragging and dropping multimedia data onto slots of a template, a user may simply select multimedia data and a slot onto which that multimedia data is to be mapped.

[0056] FIG. 7 is a logic flow diagram, consistent with the claimed invention, of steps performed to morph a graphic image. Interactive receiver receives a command via remote input 450 to morph a graphic image (step 710). This command may be generated, for example, by using the menu system described above in reference to FIG. 6. In response, interactive receiver 300 displays a list of available graphic images (step 720). Interactive receiver 300 receives a command from the user selecting one of the listed graphic images as the image to be morphed, i.e., the primary image (step 730). Interactive receiver 300 receives another command from the user selecting one of the listed graphic images with which to morph the primary image, i.e., the secondary image (step 740). Interactive receiver 300 then establishes data points on both images and combines the primary image with the secondary image to create a morphed image (step 750).

[0057] FIG. 8 is a logic flow diagram, consistent with the claimed invention, of the steps performed to animate multimedia data Interactive receiver 300 receives a user command through remote input 450 selecting multimedia data that was previously inserted into a slot of the design template (step 810). Presuming that the multimedia item is shown on display screen 480, the user may select this multimedia data by using the cursor control keys in combination with the “Select” key on remote control device 320.

[0058] In response, interactive receiver 300 presents a list of available animation techniques (step 820). This may include, for example, moving the multimedia data across display screen 480, zooming in on the multimedia data, or zooming out from the multimedia data. Interactive receiver 300 then determines the instructions required to animate the selected multimedia data and stores the instructions as part of the multimedia item file (step 830).

[0059] FIG. 9 is a logic flow diagram, consistent with the claimed invention, of the steps performed to play back the text of a multimedia item via audio. The process begins when the user employs remote control device 320 in conjunction with the menu system to record a voice sample. Interactive receiver 300 records samples of the user's voice via audio input interface 455 (step 905). The user may provide the audio samples to audio input interface 455 via audio microphone 325. Interactive receiver 300 converts the audio signals into audio data, by using any conventional standard such as pulse code modulation (PCM) (step 910). Interactive receiver 300 stores the audio data for later use (step 915). This audio data may be stored, for example, in memory 420, on storage device 315, on storage device 360, or any combination thereof.

[0060] At some later time, a user issues a command to convert the text portion of a multimedia item into audio (step 920). This command may be issued by the user composing the multimedia item, before the multimedia item is transmitted to another user. Alternatively, the command may be issued by the recipient of the multimedia item.

[0061] If the command is issued by the user who composes the multimedia item, the conversion of text to audio may be accomplished either at interactive receiver 300, at server 340, or any combination thereof. If the command is issued by the user who is to receive the multimedia item, the conversion is preferably accomplished at server 340. In either case, the conversion of the text to audio is performed based on the previously stored samples of the composing user's voice (step 925). Interactive receiver 300 preferably stores the resulting audio data in the multimedia item file (step 930).

[0062] FIG. 10 is a logic flow diagram, consistent with the claimed invention, of the steps performed to create a slide show of concatenated images. The process begins when interactive receiver 300 receives a command from the user to create a slide show (step 1005). This command may be generated by using remote control device 320 in conjunction with the menu system described above in reference to FIG. 6.

[0063] Interactive receiver 300 then retrieves and displays a design template corresponding to a slide show (step 1010). In particular, the design template may be retrieved from memory 420, storage device 315, storage device 350, or any combination thereof, and is displayed on display screen 480.

[0064] Next, interactive receiver 300 retrieves and displays on display screen 480 a list of available graphic images (step 1015). This list may be retrieved, for example, from memory 420, storage device 315, storage device 350, or any combination thereof Interactive receiver 300 then receives a command from the user through remote input 450, selecting a first image to be added to the slide show (step 1020). The user may select such an image by using the cursor control keys in conjunction with the “Select” key on the remote control device 320. Interactive receiver 300 then adds the selected image to a slide show file (step 1025).

[0065] Next, interactive receiver 300 queries the user as to whether or not the user would like to add more images to the slide show (step 1030). This may be done, for example, by presenting the user with a dialog box, or by displaying an exit button somewhere on display screen 480. If the user selects not to add any more images to the slide show, the process ends. On the other hand, if the user decides to add more images, interactive receiver 300 receives a command from the user through remote input 450 selecting the next image to be added to the slide show (step 1035). This selected image is appended to the slide show file (step 1040), and the process returns to check whether the user wants to add more images (step 1030).

[0066] D. Conclusion

[0067] Methods and apparatus consistent with the invention provide a simple yet versatile way to compose, edit and transmit multimedia greeting cards or multimedia email messages. Methods and apparatus consistent with the present invention may be implemented in software, hardware, or a combination of hardware and software. Software implementations of the invention are preferably embodied in a computer-readable media, such as a magnetic disk, or transferred over computer-readable media, such as the Internet. It will be apparent to those skilled in the art that various modifications and variations can be made in the methods and systems consistent with the present invention without departing from the spirit or scope of the invention.