Video telephony

[0002] Not applicable

[0003] Not applicable

[0004] Not applicable

[0005] 1. Field of the Invention

[0006] The invention is related to the field of video telephony, and in particular, to video communications over a public data network in response to a telephone call placed over a public telephone network.

[0007] 2. Description of the Prior Art

[0008] Video telephony comprises the exchange of both audio and video between a caller and called party. If video telephony were deployed on a large scale, it would dramatically improve user-to-user communications and provide greater efficiency to business entities. For example, large-scale video telephony would significantly reduce business travel expenses. Unfortunately, the mass deployment of video telephony has failed to materialize.

[0009] Various systems have been developed to provide video telephony. For example, computers can be used to place video calls over the Internet. Video telephones can be used to place video calls over video telephone networks. Unfortunately, these video telephony systems are complex to install and operate, and they are often expensive. The cost and complexity has inhibited mass deployment. There is a need for video telephony technology that is easier to install and operate, and that is more inexpensive than current systems.

[0010] The invention helps solve the above problems with video telephony technology that provides for the exchange of both audio and video between a caller and called party. From the user's perspective, this technology can be easy to install and operate. It can also be relatively inexpensive. Advantageously, the video telephony technology could be deployed on a massive scale to improve user-to-user communications and provide greater efficiency to business entities.

[0011] Some examples of the invention include a user system, its method of operation, and software that directs its operation. The user system receives a called telephone number contemporaneously used to establish a telephone call between a caller and a called party over a public telephone network wherein the caller is associated with a caller telephone number and the called party is associated with the called telephone number. The user system generates and transfers a first message indicating the called telephone number to a public data network for delivery to a server system in response to receipt of the called number. The user system receives and processes a second message from the public data network indicating that caller video can be transferred, and in response to the second message, transfers caller video to the public data network for delivery to the called party. The user system may receive and display called party video.

[0012] Some examples of the invention include a user device and its method of operation. The user device monitors a telephone line to detect dual-tone multi-frequency signals indicating a called telephone number contemporaneously being used to establish a telephone call between a caller and a called party over a telephone network. The user device generates and transfers a first message to indicate the called telephone number. The user device monitors the telephone line to detect an on-hook condition. The user device generates and transfers a second message to indicate the on-hook condition. The user device may include telephone jacks for coupling the user device into the telephone line and a port for coupling the user device to a computer connection.

[0013] Some examples of the invention include a server system, its method of operation, and software that directs its operation. A caller is associated with a caller data address and a caller telephone number, and a called party is associated with a called party data address and a called telephone number. The server system receives a first message indicating the called telephone number wherein the called telephone number is contemporaneously used to establish a telephone call between the caller and the called party over a public telephone network. The server system processes the called telephone number from the first message to determine if the called party will receive caller video. If the called party will receive the caller video, the server system transfers a second message for delivery to the called party and a third message for delivery to the caller wherein the second message and the third message indicate that the caller video will be transferred to the called party. The server system may determine if the caller will receive called party video. If the caller will receive the called party video, then the second message and the third message indicate that the called party video will be transferred to the caller.

[0014] In some other examples of the invention, the server system maintains a database of user telephone numbers and associated user data addresses. The server system maintains individual indications if individual ones of the users will receive video. The server system establish video exchanges between callers and called parties over a public data network in response to messages indicating called telephone numbers contemporaneously used to establish telephone calls between the callers and the called parties over a public telephone network.

[0015] The same reference number represents the same element on all drawings.

[0016] FIG. 1 illustrates a video telephony system in an example of the invention.

[0017] FIG. 2 illustrates video system operation in an example of the invention.

[0018] FIG. 3 illustrates a user system in an example of the invention.

[0019] FIG. 4 illustrates user system operation in an example of the invention.

[0020] FIG. 5 illustrates user system operation in an example of the invention.

[0021] FIG. 6 illustrates user system operation in an example of the invention.

[0022] FIG. 7 illustrates a user system in an example of the invention.

[0023] FIG. 8 illustrates a server system in an example of the invention.

[0024] FIG. 9 illustrates server system operation in an example of the invention.

[0025] FIG. 10 illustrates server system operation in an example of the invention.

[0026] FIGS. 1-10 and the following description depict specific examples to teach those skilled in the art how to make and use the best mode of the invention. For the purpose of teaching inventive principles, some conventional aspects have been simplified or omitted. Those skilled in the art will appreciate variations from these examples that fall within the scope of the invention. Those skilled in the art will appreciate that the features described below can be combined in various ways to form multiple variations of the invention. As a result, the invention is not limited to the specific examples described below, but only by the claims and their equivalents.

[0027] Video Telephony System Configuration and Operation—FIGS. 1-2

[0028] FIG. 1 illustrates video telephony system 100 in an example of the invention. Video telephony system 100 comprises user systems 101-104, public data network 110, server system 111, and public telephone network 120. User systems 101-104 communicate with one another and with server system 111 over public data network 110. User systems 101-104 also communicate with one another over public telephone network 120.

[0029] Although various systems could be used within the context of the invention, a few exemplary systems are given for illustrative purposes. Examples of public telephone network 120 include local and long distance telephone companies. Examples of public data network 111 include Internet service providers and the Internet. Server system 111 could be a conventional Internet server configured with software to implement the invention. User systems 101-104 could include a conventional telephone and personal computer in addition to special purpose circuitry and software to implement the invention.

[0030] FIG. 2 illustrates video system 100 operation in an example of the invention. Public data network 110 is not shown for clarity, although it should be appreciated that communications with server system 111 occur over public data network 110. Before a video call, both users systems 101 and 104 transfer log-in messages to server system 111 when they are ready to initiate and/or receive video calls. The log-in messages generally include user names and passwords, user data addresses and telephone numbers, and any video call preferences. Server system 111 checks the passwords against the user names, and if they are valid, associates each related user name/data address/telephone number with an indication that the user is ready to receive and/or initiate video calls. Server system 111 also logs any video call preferences.

[0031] Subsequently, user system 101 transfers a request for a telephone call over public telephone network 120 to user system 104. This telephone call request could be as simple as picking up a telephone and dialing a telephone number. Public telephone network 120 transfers a telephone call request to user system 104—typically by processing the dialed telephone number to a ring a telephone. If user system 104 grants the telephone call request, such as by answering the ringing telephone, a telephone call is established between user systems 101 and 104 over public telephone network 120.

[0032] In response to the telephone call request, user system 101 transfers a video call request to server system 111. The video call request has the called party telephone number, and some caller identification information, such as user name and password, user telephone number and data address, and any other video call parameters. One such parameter is whether the requested video call is bi-directional or unidirectional. Another parameter is the type of video compression and encryption that is used.

[0033] Server system 111 uses the called party telephone number to check if the called party is ready to receive video call requests, and since user system 104 has logged-in, server system 111 transfers a video call request to user system 104. User system 104 may then present the called party with a prompt, such as an instant message or tone, to accept the video call request. If the called party accepts the video call request, user system 104 transfers a video call acceptance to server system 111. The acceptance may also have video call preferences for the called party that server system 111 resolves against the preferences of the caller. Server system 111 transfers video call start messages to user systems 101 and 104 indicating the resolved video call parameters. In response to the video call start messages, user systems 101 and 104 generate and transfer video to server system 111. This transferred video has some indicia indicating the caller and called party, so server system 111 can associate the received video with the video call.

[0034] Server system 111 uses the user system 104 data address to transfer caller video to user system 104. Server system 111 uses the user system 101 data address to transfer called party video to user system 101. Prior to this transfer, server system may interwork the video to provide compatibility at the receiving end. User systems 101 and 104 receive and display the respective video to establish the video call.

[0035] Eventually, User systems 101 and 104 indicate telephone call termination to public telephone network 120—typically by hanging-up their telephones. In response to telephone call termination, user system 101 transfers a telephone call termination message to server system 111. In response, server system 111 transfers a video call termination message to user system 104, and systems 101, 104, and 111 terminate the video call. In some cases, user system 104 may detect telephone call termination and transfer a termination message to server system 111 to eliminate the need for the termination message from server system 111.

[0036] In one variation to the above system, the actual video transfer may be directly between user systems 101 and 104 over public data network 110. The server system 111 would set-up the video call and provide the appropriate data addresses to user systems 101 and 104 for a peer-to-peer video transfer over public data network 110.

[0037] General User System Configuration and Operation—FIGS. 3-6

[0038] FIG. 3 illustrates user system 300 in an example of the invention. User system 300 comprises video system 301, data communication system 302, telephone system 303, and control system 304. Control system 304 comprises telephone interface 305 and data interface 306. Data communication system 302 is coupled to a public data communication network, and telephone interface 305 is coupled to a public telephone network.

[0039] Video system 301 could be any system configured to generate and/or display video. Video system 301 may include a camera for generating video of a caller or called party. Video system 301 may include a television or computer monitor to display video. Telephone system 303 could be any system configured to initiate telephone calls over a public telephone network, and could be integrated into other systems, such as computers, appliances, and televisions. Telephone system 303 could utilize wireless, wire-line, optical, or other communication media. Control system 304 could be any system configured to initiate a video call using systems 301-302 in response to the initiation of a telephone call by telephone 303. Telephone interface 305 is configured to receive a called number from telephone system 303 if the telephone number is contemporaneously used to establish a telephone call over the public telephone network. In response to receiving the called telephone number, data interface 306 is configured to transfer the called telephone number to data communication system 302 for transfer to a server system over the public data network. Data system 302 could be any system configured to transfer the called telephone number to the server system over the public data network and to exchange video between the public data network and video system 301.

[0040] It should be appreciated that systems 301-304 could be integrated together or with other systems. Various combinations of equipment could be used to implement user system 300. Some examples of devices that could incorporate data system 302 include, but are not limited to, a computer, set-top box, telephone, network interface card, digital assistant, information appliance, and stand-alone device. Some examples of devices that could incorporate control system 304 include, but are not limited to, a computer, telephone, modem, network interface card, set-top box, and stand-alone device. In addition, the functionality of data system 302 and control system 304 could be provided by a processing system that retrieves and executes software that is stored on a storage system. The storage system could comprise a disk, tape, integrated circuit, server, or some other memory device.

[0041] FIGS. 4-5 illustrates the operation for user system 300 to initiate video calls in an example of the invention. User system 300 awaits an indication from the caller to begin initiating video calls. This indication could be an input to any of systems 301-304. In response to the indication, data communication system 302 transfers a log-in message over the public data network to the server system. For example, data communication system 302 could be configured to automatically transfer the log-in message upon system start. The log-in message indicates that user system 300 is ready to initiate video calls, and possibly, to also receive video calls. The log-in message may include information such as the user name and password, user data address and telephone number, video call parameters, and other user data or registration information.

[0042] Telephone interface 305 awaits either a telephone call from telephone system 303 to the public telephone network or an indication from the caller to stop initiating video calls. If such a stop indication is received, data interface 302 transfers a log-off message to the server system. For example, data communication system 302 could be configured to automatically transfer the log-off message upon system shut-down. The log-off message indicates that user system 300 is not ready to initiate or receive video calls.

[0043] If telephone system 303 initiates a telephone call, telephone interface 305 obtains the called telephone number, and in response, data interface 306 transfers the called number to data communication system 302. Data communication system 302 transfers a video call request to the server system. The video call request includes the called telephone number and other information, such as the caller user name and password, caller telephone number and data address, and video call parameters. The video call parameters indicate if the requested video call is bi-directional or unidirectional, and the direction if unidirectional—caller to called party or called party to caller. The video call parameters may also indicate requested video quality and security. The information in the video call request is populated by control system 304 and/or data communication system 302.

[0044] Data communication system 302 then awaits a video call start message. If the video call start message is not received, for example if the video call is unavailable or rejected, telephone interface 305 awaits either a telephone call or an indication from the caller to stop initiating video calls. If received (See FIG. 5), the video call start message indicates the actual video call parameters for the video call. If the video call is bi-directional or uni-directional from caller to called party, then video system 301 generates video of the caller that data communication system 302 transfers the caller to the server system. If the video call is bi-directional or uni-directional from called party to caller, then data communication system 302 receives video from the server system that video system 301 displays. Systems 301-302 would typically apply compression, encryption, and other video technologies to the video.

[0045] At this point between the caller and called party, a telephone call exists over the public telephone network and a video call exists over the public data network. If the caller terminates the telephone call, such as by hanging up the telephone, telephone interface 305 determines that the telephone call has been terminated, and as a result, data interface 306 indicates the telephone call termination to data communication system 302. Data communication system 302 then transfers a video call termination message to the server system and video generation, transfer, receipt, and display are terminated by user system 300. The video call is similarly terminated if a video call termination message is received from the server system or if the caller indicates that the video call should be terminated. User system 300 then awaits an additional telephone call or an indication from the caller to stop initiating video call requests.

[0046] FIGS. 5-6 illustrates the operation for user system 300 to receive video calls in an example of the invention. On FIG. 6, user system 300 awaits an indication from the user to begin receiving video call requests. This indication could be an input to any of systems 301-304. In response to the start indication, data communication system 302 transfers a log-in message over the public data network to the server system. For example, data communication system 302 could be configured to automatically transfer the log-in message upon system start. The log-in message indicates that user system 300 is ready to receive video call requests, and may include information such as the user name and password, user data address and telephone number, video call parameters, and other user data or registration information.

[0047] Data interface 302 awaits a video call request from the server system or an indication from the user to stop receiving video call requests. If a stop indication is received, data interface 302 transfers a log-off message to the server system. For example, data communication system 302 could be configured to automatically transfer the log-off message upon system shut-down.

[0048] If data communication system 304 receives a video call request, then the user is notified of the requested video call. The notification could be given from any of systems 301-301 and could include screen displays, tones, or other user signals. Although not shown for clarity, telephone system 303 will receive a contemporaneous telephone call from the public telephone network. The user indicates if the telephone call and/or the video call is accepted. Typically, the telephone call is accepted by operating telephone system 303 to answer the call. The video call may be accepted with an input to one of systems 301-304, such as by pressing a DTMF key, pressing a button, or selecting from a screen display. User system 300 could be configured to automatically accept or reject the video call based on whether the corresponding telephone call is answered.

[0049] If the video call is not accepted, then data communication system 302 transfers a video call rejection to the server system and awaits either a video call request from the server system or an indication from the user to stop receiving video call requests. If the video call is accepted, then data communication system 302 transfers a video call acceptance to the server system. The video call acceptance may indicate accepted video call parameters. Data communication system 302 then awaits a video call start message indicating the actual parameters for the video call. If the video call start message is received, processing proceeds as indicated above for FIG. 5.

[0050] User System Incorporating Conventional Telephone and Computer—FIG. 7

[0051] FIG. 7 illustrates user system 700 in an example of the invention. Advantageously, user system 700 is configured for use with conventional telephones, personal computers, and communication services. Advantageously, this makes video telephony easy for a user to implement by simply adding one small device to conventional devices and services.

[0052] User system 700 includes computer system 701, telephone 703, and interface device 704. Computer system 701 is connected to Internet link 734 that provides Internet service. Telephone 303 is connected to telephone link 731. Telephone link 735 provides telephone service. It should be appreciated that links 734-735 may share the same physical media, especially to egress the user premises.

[0053] Computer system 701 includes user interface 711, communication interface 712, processing system 713, and storage system 714. User interface 711 includes video equipment 718. Storage system 714 stores operating software 716 and video software 717. Interface device 704 includes RJ-11 jacks 721-722, Dual-Tone Multi-Frequency (DTMF) decoder 723, call sensor 724, controller 725, and computer interface 726. RJ-11 jack 721 is coupled to telephone 703 by telephone link 731. RJ-11 jack 722 is coupled to telephone link 735. Computer interface 726 is coupled to communication interface 712 by Universal Serial BUS (USB) 733. Alternatively, USB 733 could be a serial cable. Communication interface 712 is also coupled to Internet link 734. Computer system 701 uses Transaction Control Protocol port 80 or any other port assigned by the user to exchange messages with the server system.

[0054] User interface 711 includes a keyboard and mouse. Video equipment 718 includes a camera and monitor. Communication interface 712 includes a USB or serial port and a Digital Subscriber Line (DSL) modem or some other broadband access system. Processing system 713 includes a computer microprocessor and other circuitry. Storage system 714 includes a hard disk drive and other circuitry. Processing system 713 retrieves and executes operating software 716 and video software 717 from storage system 714. Software 716-717 could comprise an application program, firmware, or some other form of machine-readable processing instructions. Operating software 716 includes an operating system, networking software, and other utilities typically loaded onto a personal computer. When executed by processing system 713, video software 717 directs processing system 713 to operate in accord with the invention.

[0055] Interface device 704 could be a stand-alone enclosure that derives power from the telephone line, battery, AC connection, or another source. RJ-11 jacks 721-722, DTMF decoder 723, call sensor 724, and computer interface 726 could be conventional components. Controller 725 comprises processing circuitry configured to operate in accord with the invention. Interface device 704 can be turned on and off to control video call initiation.

[0056] In operation, operating software 716 directs processing system to retrieve and execute video software 717 in response to computer start-up or user input. Video software 717 directs processing system 713 to operate as follows. Processing system 713 maintains a set of user options that can be viewed and altered through user interface 711. A table of possible options follows.

[0057] Processing system 713 generates and transfers a log-in message through communication interface and over the public data network to the server system. The log-in message include user name and password, user telephone number and data address, and video call parameters.

[0058] Telephone 703 is operated to transfer DTMF digits to the public telephone network. The public telephone network processes the DTMF digits to extend the call to the called party. DTMF decoder 723 monitors the telephone connection between jacks 721-722 to detect and decode any DTMF tones transmitted by telephone 703 to the public telephone network. DTMF decoder 723 indicates the decoded digits to controller 725. Controller 725 forms the called number from the decoded digits and transfers a telephone call initiation message through computer interface 726 and USB connection 733.

[0059] Processing system 713 receives the telephone call initiation message from communication interface 712. Processing system 713 implements the video call initiation options, and if the video call should proceed, processing system 713 generates a video call request including the called telephone number, user name and password, user data address and telephone number, and video call parameters. Processing system 713 transfers the video call request message through communication interface 712 to Internet link 734 for delivery to the server system over the Internet. Processing system 713 then awaits a video call start message from the server system with the parameters for the video call. When the video call start message is received, processing system implements the video call parameters and user options. For a bi-directional video call, processing system 713 directs the exchange of video between video equipment 718 and Internet link 734. Video equipment 718 displays the video.

[0060] Eventually, telephone 703 is placed on-hook. Call sensor 724 monitors the telephone connection between jacks 721-722 to detect the on-hook condition. Typically, call sensor 724 monitors line current to detect off-hook and on-hook conditions. Call sensor 724 indicates the on-hook condition to controller 725. Controller 725 transfers a telephone call termination message through computer interface 726 and USB connection 733.

[0061] Processing system 713 receives the telephone call termination message through communication interface 712. In response, processing system 713 generates and transfers a video call termination message through communication interface 712 to Internet link 734 for delivery to the server system over the Internet. Processing system 713 directs video equipment 718 to stop the generation and display of video.

[0062] It should be appreciated that the user may operate their telephone in the normal manner and corresponding video calls are automatically established over the Internet. The telephone calls provides the audio, and the Internet connection transfers the video. As indicated, options are available to exert various levels of user control over the process.

[0063] To receive a video call, processing system 713 receives a video call request from the server system over Internet link 734 and through communication interface 712. Processing system 713 implements any user options and may notify the user through user interface 711 or video equipment 718. If the video call is accepted, processing system 713 transfers a video call acceptance to the server system through communication interface 712 and over Internet link 734.

[0064] When the video call start message is received, processing system 713 implements the video call parameters and user options. For a bidirectional video call, processing system 713 directs the exchange of video between video equipment 718 and Internet link 734. Video equipment 718 displays the video. Video call termination may proceed as indicated above or a video call termination message may be received from the server system. If a video call termination message is received, then processing system 713 directs video equipment 718 to stop the generation and display of video.

[0065] It should be appreciated that the user may invoke video software 717 to dynamically control video calls. For example, video software 717 may allow the user to terminate video calls in one or both directions during the call. Video software 717 may allow the user to adjust user options during the call. Video software 717 may allow the user to initiate a previously rejected video call during the telephone call.

[0066] Computer system 701, telephone 703, and interface device 704 can be configured to operate together for additional user control. In such a scenario, the user could transfer DTMF digits that are decoded by interface device 704 and transferred to computer system 701 to exert control. For example, incoming video calls could be accepted or rejected by transferring specific DTMF sequences from telephone 703. Video calls could be terminated by the user in a similar fashion.

[0067] Interface device 704 could be further equipped with a tone generator to alert the user to various conditions. For example, interface device 704 could transfer a special tone to telephone link 731 for the user to hear to indicate that a video call is available for the telephone call. The tone could be played in response to a video call request or start message from the server system.

[0068] Server System—FIGS. 8-10

[0069] FIG. 8 illustrates server system 800 in an example of the invention. Server system 800 includes user interface 801, network interface 802, processing system 803, and storage system 804. Storage system 804 stores operating software 806 and video software 807. Network interface 802 is coupled to Internet connection 817. Processing system 803 uses network interface 802 to communicate over the Internet with user systems.

[0070] Processing system 803 retrieves and executes operating software 806 and video software 807 from storage system 804. Software 806-807 could comprise an application program, firmware, or some other form of machine-readable processing instructions. Operating software 806 includes an operating system, networking software, and other utilities typically loaded onto an Internet server. When executed by processing system 803, video software 807 directs processing system 803 to control server system 800 in accord with the invention.

[0071] FIGS. 9-10 illustrate server system 800 operation in an example of the invention. Server system 800 maintains a database of users including user names and passwords, user telephone numbers and data addresses, and possibly user preferences. If server system 800 receives a log-in message, the user password is checked and if it is valid, the user database is modified to indicate that the user is ready to initiate and/or receive video calls. If server system 800 receives a log-off message, then the user password is checked and if it is valid, the user database is modified to indicate that the user is not ready to initiate and/or receive video calls. The user database may also be modified by querying the users and receiving responses indicating user video call specifications.

[0072] If server system 800 receives a video call request, the user database is checked using the called telephone number from the request to determine if the called party is ready to receive video calls. If not, a video call unavailable message is returned to the caller. If so, server system 800 sends a video call request to the called party. If a video call rejection is received from the called party, then server system 800 sends a video call rejection to the caller. If a video call acceptance is received from the called party, server system resolves video call parameters and sends video call start messages to both the caller and called party including the video call parameters. Parameter resolution may entail determining if the caller will receive called party video. If so, this is indicated in the video start messages.

[0073] Server system 800 uses the called party telephone number to retrieve the called party data address. Server system 800 may use the caller telephone number to retrieve the caller data address. If server system 800 receives video from the caller, it addresses the caller video to the called party data address and transfers the caller video for delivery to the called party. If server system 800 receives video from the called party, it addresses the called party video to the caller data address and transfers the called party video for delivery to the caller. In some cases, it may be necessary for processing system 803 to interwork the video so it is compatible with both caller and called party. For example, the caller and called party may use different quality or encryption levels that are interworked by processing system 803.

[0074] If server system 800 receives a video call termination message from one user, it transfers a video call termination message to the other user. Server system 800 then modifies the database to return each user to their pre-call status. Server system also generates billing information for the video call.

[0075] Server system 800 may be configured to download software to the user systems. The software could be the video software used to control the user systems as described above. The software could provide upgrades from older versions. The software could provide video processing, compression, and encryption. The software could provide system diagnostics and trouble-shooting to recommend optimal system software and settings.

[0076] It should be appreciated that the processing and control discussed above could be distributed in various ways between the user system and the server system. For example, the server system could maintain and implement user preferences and provide user prompts.