Exchange of voice and video between two cellular or wireless telephones

[0001] This application identifies the concept of exchanging voice and video between two wireless terminals. It identifies the need for a full duplex transmission path, but does not identify the necessity of a particular transmission path configuration or a particular method of call set up. It does not take into account the rather severe limitations imposed by use of existing wireless voice networks for video transmission and does not offer use of new networking concepts and specifications as defined by recent network design (example IEEE 802.16, 802.20, 802.22).

[0002] This application attempts to define the modifications to a personal digital assistant to render the device capable of functioning as a videophone terminal between PDA's, a PDA and a PC and between a PDA and videophone. The application seems not to define the end to end requirements, but rather defines the means to configure the terminal to allow use as a videophone. In this sense, the application seems to be incomplete.

[0003] This invention defines the means of providing video continuity when the video stream is interrupted momentarily. This means results in retaining a frame when the succeeding frame is delayed by a specified period. The succeeding frame may be discarded and replaced with the next succeeding frame. This method allows repair of momentarily interrupted video flames by carrying the present flame over one or several succeeding frames. The invention thus narrowly defines a certain aspect of videophone service, but does not define the service itself.

[0004] Not Applicable

[0005] Not Applicable

[0006] There are prior patent applications in which the stated objective is the definition of the means of instituting a wireless videophone service. All of these applications take for granted the existence of a suitable transmission path without identifying or defining such a path. The service as defined by these various applications is therefore lacking this essential element. Also lacking is the definition of the specific means of terminal configuration and call set up. These are typically described in vague terms.

[0007] The existing wireless communication networks are used for either cellular voice communication or downloading of broadband data, but not both. Voice and broadband applications are supported over separate networks. As yet there is no unique network which will carry both voice traffic and broadband data simultaneously. The IEEE and other entities are developing specifications for a network which may be dynamically configured to carry content of various bandwidths such as voice or broadband data. Implementation of these specifications will result in construction of a network which will carry both voice and broadband data such as streaming video. The new network specifications specifically allow such an arrangement which will include switched connections to various entities satisfying differing and diverse requirements. The new network will be defined as a fourth generation wireless network (4G) and will carry voice and broadband downloaded and uploaded data.

[0008] For example, the IEEE 802.16 series of specifications defines a broadband network using Orthogonal Frequency Division Multiple Access technology (OFDMA). This new network will be defined as a fourth generation wireless network (4G). Use of this new technology will satisfy requirements for voice, data downloading, data uploading and full duplex data exchange on one network by allowing the subscriber station to initiate configuration of the bandwidth necessary for multiple uses. The originating subscriber station will be able to contend for more bandwidth by employing a CDMA BW request (IEEE 802.16) which will be recognized by the network. The network will then configure the communication channel with the necessary bandwidth and acknowledge that fact to the subscriber station.

[0009] Deployment of the new 4G network will greatly facilitate inauguration of a new service which will allow the subscriber terminal to select the proper bandwidth to satisfy requirements for all wireless services including exchange of video and voice. This specification will deal with the process of defining this new video service based on the new wireless network specifications.

[0010] This specification explains the requirements and method for the exchange of streaming video and voice between two wireless terminals. Since streaming video exchange is not practical using existing 2G and 3G cellular networks because of network congestion problems, 4G network technology must be employed. This technology is in the process of development via open network definition (such as IEEE 802.16). Implementation of this 4G network will supply the means of satisfying the specific desired application of the exchange of voice and video between two wireless terminals. The originating terminal will interact with the 4G network to set bandwidth requirements and also to cause the called terminal to configure itself to video mode automatically. Other applications such as video surveillance may also be implemented over the new network by the same means.

[0030] The present wireless networks are configured for either cellular voice use (2 g and 3G) or for higher speed data including downloads from the Internet, video downloads and music downloads. The three latter are being achieved by use of new broadband wireless networks such as WiMAX (based on IEEE 802.16e), UMTS, EV-DO and WIBRO (in Korea). These networks are designed to facilitate downloading of high speed data to both fixed and mobile users using new broadband interfaces built into wireless terminals. Newer networks such as IEEE 802.16n, 802.20 and 802.22 are still undergoing planning and specification in IEEE working groups. Please note that the voice and broadband data functions presently are carried on separate networks which are configured for voice and text only (2G and 3G) or downloaded broadband data only.

[0031] These new network specifications allow extensions of WI-FI (IEEE 802.11) and inclusion of both long range fixed and mobile wireless communication using new technology to achieve greater bandwidth. An example of this is OFDMA (Orthogonal Frequency Division Multiple Access) technology which will allow dynamic bandwidth allocation so that the network may carry voice, video, Internet download and high speed data. IEEE 802.16 provides the building blocks for creation of a new mobile network which will replace the existing voice and broadband wireless networks with one (4G) network. This new network will fulfill all of the functions of the two existing network types. This new mobile technology will use existing cellular towers to allow a seamless phased cutover to the new network from existing 2G, 3G and broadband networks. The new 4G network will support voice, broadband data and real time streaming video exchange between wireless terminals. Dynamic bandwidth allocation inherent in the new network will allow efficient use of spectrum to support both voice and higher speed data requirements. The deployment of this new network will allow real time full duplex streaming video and voice exchange between wireless terminals. The thrust of this specification is the development of such a service.

[0032] Wireless terminals will be equipped with a digital video camera A microphone and speaker will allow a speaker phone mode to be employed automatically upon exercising of the video option.

[0033] Video will be displayed on a color screen as presently used for interfacing Internet entities from wireless terminals. Each terminal will be equipped with video send and receive capability to exchange both voice and video.

[0034] Selection of the video option on the originating terminal will be table driven. Each user's wireless terminal will contain a list of his contacts who have the video option. All entities in the individual user's video calling group will be displayed on a table. Each video option table entry will be associated with a routing table which contains the selection number of the terminating subscriber, a Class of Service code and an appropriate CDMA BW request code (IEEE 802.16).

[0035] Exercising the table entry and pressing the “call” button will cause the originating subscriber terminal to select the 4G network and send the CDMA BW request code. The CDMA BW request code will signal the network to assign the proper bandwidth. Implementation of network configuration will be acknowledged by the network. The terminal will then send selection and the Class of Service Code. The Class of Service code will cause the network to access an alternate video “caller ID” database in which the originator is identified as a video subscriber for billing purposes. The individual video “caller ID” will contain a terminating class of service code which will be downloaded to the terminating terminal as part of the “caller ID” package after call routing. Receipt of the class of service code by the terminating terminal will cause it to configure itself for video mode. Terminal logic will select a ring tone unique to video service.

[0036] The called party will answer in the usual manner. After call connect, both originator and receiver will be put into video mode and speaker phone mode automatically. Video will be displayed on both forward and backward paths after call connection unless the recipient finds it inconvenient to send video, in which case he may select a voice only keyed option. This will allow the recipient to receive video from the originator. The originator will receive a “canned” video frame which will inform him that the recipient has opted out of the video send mode. The recipient may reenter the video mode via another keyed option. Video will be exchanged using an appropriate compression/decompression algorithm.

[0037] Both participating entities will frame themselves in the video camera field of view and, in turn, speak into the microphone. These actions will cause both the speech and video to be sent to the other entity. Video will be displayed on each terminal screen. Speech will be sent via each terminal speaker. The range and sensitivity of the microphone will allow exchange of speech when the video camera is oriented away from the subscriber.

[0038] Transmission will be in the full-duplex mode to allow video to be observed on both terminals simultaneously. Speech will follow the present cellular or wireless transmission rules. Ending the call will involve clearing via disconnect button on either terminal in the normal manner. Each terminal will be able to operate as a cellular or wireless terminal in all normal modes of operation when not employing the video and voice exchange option. Selection of addresses outside the special table will cause a connection in the normal cellular or wireless mode. The special table may contain entities marked with a different class of service code and CDMA BW request unique to a different type of broadband service. Voice service may be defined by a CDMA BW code as well, but may be selected by either table or selection digits.

[0039] Table generation may be done on separate facilities and down-loaded to individual cellular or wireless terminals or may be done individually on the terminal. The individual routing table will set up the originating terminal parameters to employ differing protocols and compression/decompression algorithms as dictated by the class of service. The terminating terminal will configure itself based on the class of service information set up by the originating terminal routing table and subsequently sent to the terminating terminal in the caller ID package forwarded to the terminating terminal during session set up. The CDMA BW request and class of service code sent by the originating terminal may be configured for various other uses. These may include return of streaming video from other types of terminations such as terminals used for surveillance. In this case, video and sound will be unidirectional from the terminating terminal to the originating terminal and broadband service will exist in the downlink while the uplink will be configured for voice bandwidth. These differing uses may be supported by the same routing table used for video exchange with options linked to the individual table entry.

[0040] Prior to full subscriber migration to the 4G network, the subscriber terminal may be configured to employ the existing 2G or 3G network for voice and text messages. This will require dual frequency subscriber terminals to access 2G, 3G, and 4G networks.

[0041] Terminals may be configured to support the video option on various transmission facilities which may be integrated with the new 4G network. These will include mobile broadband wireless networks, “wireless city” networks (including “Hot spot” interfaces with 802.11) and “wireless city” networks interconnected with other “wireless city” networks by satellite link or fiber optic link. Interconnection of mobile and stationary wireless terminals into one network will allow voice and video communication between both fixed and mobile network entities.