Data and voice transmission within the same mobile phone call

[0001] 1. Field of Invention

[0002] The present invention relates to cellular phones and in particular to the transmission of data and pictures simultaneous to voice.

[0003] 2. Description of Related Art

[0004] With the recent popularity of taking pictures with cellular phones (mobile phones) comes the need to efficiently transmit picture while talking on the cellular phone. Presently Multi-Media Services (MMS) use a General Packet Radio Service (GPRS) to transmit non-voice data. Independent of what mobile phone service is used, the GPRS does not allow the transmission of data simultaneous to voice. When a mobile phone user wants to transfer pictures or other data files while talking to another user, two phone calls are necessary, one for the voice conversation and a second for transmitting data. The second of the two calls will be an additional charge. The two calls are required even if the same GPRS system is used to transmit both voice and the data.

[0005] In U.S. Pat. No. 6,112,084 (Sicher, et al.) a method and system are directed to doing a simultaneous transfer of data and voice during a call between a mobile station having a Digital Simultaneous Voice and Data (DSVD) modem and a radio telecommunications network having a mobile switching center. U.S. Pat. No. 6,185,196 (Mademann) is directed to a method for transmitting data packets in a cellular mobile radio network to provide for voice and data transmission in which one traffic channel (TCH) is reserved for the data. In U.S. Pat. No. 6,532,372 (Hwang) a method and apparatus are directed to providing data communication between an external electronic device such as a personal computer and a communication device such as a mobile phone.

[0006] In FIG. 1A is shown a block diagram of prior art of the communication connection between a first mobile phone 10, or cellular phone, used by talker A and a second mobile phone 20, or cellular phone, used by talker B. A radio signal 11 is transmitted from mobile phone 10 to a receiving antenna tower 12. From there the radio signal 11 is coupled to a Base Station Subsystem (BSS) 13, which contains a Base Transceiver Station (BTS) 30 and a Base Station Controller (BSC) 31, shown in FIG. 1B. The BTS 30 contains a radio transceiver, which communicates by radio signals with a mobile phone 10 and couples the communication with the mobile phone 10 to the Base System Controller (BSC) 31. Multiple BTS transceivers are controlled by the BSC 31, which provide allocation and release of radio channels and the handoff between cells as talker A using the first mobile phone 10 moves between cells.

[0007] Continuing to refer to FIG. 1B, the BSC 13 communicates with a Multimedia Function Service (MFS) 32, which couples packets of digital data to and from a Serving GPRS Support Node (SGSN) 34 that allows digital data to be sent between mobile phones 10 and 20. The BSC 13 also communicates with Transcoder (TC) 33.

[0008] Contained within the TC 33 is a Voice Coder known herein as a vocoder. The vocoder translates the voice signal from the mobile phone 10 and 20 into a time domain 37 signal that can be sent through In Path Equipment (IPE) 14 and the Network 15 coupling the communications between talker B using mobile phone 10 and talker B using mobile phone 20. The vocoder combines packetized groups of speech from the transmitting mobile phone 10 and 20 to be coupled in the time domain 37 through the IPE 14 and the Network 15 to a second vocoder, which then packetizes the speech sent by the transmitting mobile phone into packets that are sent to the receiving mobile phone 10 and 20.

[0009] In FIG. 2A is shown a block diagram of the transmission (TX) function of the Discontinuous Transmission (DTX) function of the prior art for a mobile phone 10 and 20 sending a voice signal from a mobile phone 10 and 20. The circuits that support the DTX are located in the mobile phones 10 and 20 and the vocoder located within the Transcoder (TC) 33. The transmitting TX SCR Handler (Transmission Source Controlled Rate Handler) 40, which includes a Speech Encoder, a Voice Activated Detector (VAD) and a Comfort Noise TX Function, couples information bits (Info Bits) 42 of a 20 ms speech frame and an SP flag 43 to a transmitting TX Radio Subsystem 41. The TX Radio Subsystem 41 includes a Channel Encoding function and an Sp Flag Monitoring function. The SP Flag indicates a speech frame is being transmitted if the flag has a logical “1” value, or a SID (Silence Indicator) frame if the flag value is a logical “0”. The TX SCR Handler 40 and the Radio Subsystem 41 forms a part of the mobile phone 10 and 20, and the BSS 13.

[0010] Continuing to refer to FIG. 2A, in the TX SCR Handler the speech encoder digitally codes the analog voice signal into a digital form to be sent to the receiving mobile phone. The VAD detects when there is voice from the user of the sending mobile phone so that the transmitting voice signal can be captured and communicated to a receiving phone. The comfort noise transmission function provides a signal so that a receiving user knows that mobile phone call is still connected even though there is a pause in conversation. The channel encoding function packetizes the digitized voice and places each voice packet into available communication slots to be sent to the receiving mobile phone 10 and 20.

[0011] The Voice Activity Detector operates continuously and determines whether an input signal from a sending phone contains speech. The VAD controls the overall operation of the transmission of a phone signal indirectly by means of the SP Flag. When speech is detected, the speech encoder output frame is coupled by means of the Info Bits 42 to the TX radio Subsystem 41 and marked with a SP Flag=1. When a particular burst of speech ends, the VAD switches to an inactive speech state. After speech ends and number of consecutive frames (N+1) are transmitted, a new updated SID frame is available for insertion into the transmission of the signal from the sending phone. The first N speech encoder output frames after a speech burst is passed to the TX Radio Subsystem 41 with SP Flag=1, called a “hangover period”. After the “hangover period” at the end of a speech burst, a SID frame is computed and coupled to the TX Radio Subsystem 41. The TX SCR Handler 40 then continues to compute SID frames as long, as the VAD is inactive, that are coupled to the TX Radio Subsystem 41, marked with SP Flag=0 indicating that there is no voice signal from the sending phone.

[0012] In FIG. 2B is shown a block diagram of the receiving transmission function (RX) of the Discontinuous Transmission (DTX) function of the prior art for a mobile phone 10 and 20 receiving a voice signal from a sending mobile phone 10 and 20. This portion of the DTX 50 and 51 forms a part of the mobile phone 10 and 20, and the BSS 13. The RX Access Network 50 for receiving transmission contains a SID frame detection and an error concealment and detection. The RX Handler 51 contains a speech decoder, error concealment and comfort noise generation. The speech decoder translates the digitally transmitted speech into an analog signal to be coupled to the user of the receiving phone, and errors caused by disturbances in the environment that are not recovered are marked and handled separately by the vocoder (voice coder). Information bits (Info Bits) 52, SID 53, BFI (Bad Frame Indication) 54 and TAF (Time Alignment Flag) 55 signals are coupled to the RX SCR Handler (Receiving Transmission Source Controlled Rate Handler) 51 from the RX Access Network 50.

[0013] In the prior art sending a picture by means of the mobile phone system required a separate phone call from a phone call in which there was speech communications between two mobile phones. A method of providing a capability to transmit pictures taken with a cellular phone simultaneous with voice communications to a receiving location without the use of separate cellular phone calls and separate charges is needed in support of the integration of the cellular phone and digital camera functions.

[0014] It is an objective of the present invention to fill unused frames with data to transmit voice and data interleaved during the same cellular phone call.

[0015] It is another objective of the present invention to transmit picture data concurrent with voice during the same cellular phone call.

[0016] It is still another objective of the present invention to use the Discontinuous Transmission (DTX) feature of a mobile phone system and fill unused Silence Indication (SID) frames with picture data taken with the integrated cellular phone and digital camera.

[0017] It is yet another objective of the present invention to transmit data and voice from a cellular phone to a same remote phone location during the same phone call.

[0018] It is still yet another objective of the present invention to interleave picture data and voice data and transmit both during a same phone call.

[0019] It is also still another objective of the present invention to interleave data and voice and transmit both during the same phone call.

[0020] In all modern mobile phones there is a Discontinuous Transmission (DTX). The DTX is used to reduce bandwidth and power consumption of a mobile (cellular) phone while reducing the transfer rate during inactive speech times. The DTX feature is available for voice coders (vocoder) in various forms, including: AMR (adaptive multi-rate), HR (half rate), EFR (enhanced full rate) and FR (full rate). During the inactive speech time only SID (silence indicator) frames are transferred between talker A and talker B. For an AMR vocoder, for example, only each eighth 20 ms frame is used to update background noise attributes. All other frames are not used. The ratio of SID frames to unused frames varies with each vocoder. Filling these unused frames with data allows the transfer of data between talker A and talker B along with voice within the same phone call.

[0021] In a communication between talker A and talker B using a GSM (global system for mobile communications) with an active DTX (discontinuous transmission) feature, talker A and B use approximately fifty percent (50%) or half the communication time. The maximum possible communication rate between the two talkers is 64kbits/second of which approximately half of the bandwidth. or 32kbits/second, are not usually used.

[0022] During half of the time one talker is (80%) active and twenty percent (20%) passive. If it is assumed that non speech data transfers from A to B can take sixty percent (60%) of the overall transmission time, where only fifty percent (50%) of the non-speech time can be effectively used for transferring data due to overhead and SID, then the data rate (DR) for transferring a picture is DR=16 kbits/s×0.6×0.5=4800 bits/s=600 byte/s, where 0.6=0.5 (receiving talker active)+0.2×0.5 (sending talker activity). Thus a data file with a size of 20 kbytes will need approximately 34 seconds transfer time. In order to implement the transfer of data (a picture) along with voice during the same phone call, changes are required to be made to the DTX handling of messages in the Transcoder (TC) located in the Base Station System (BSS). Depending upon the actual phone system that is used, the feature to allow a picture to be transmitted between talkers can be established when the call is initiated or during the call by selecting a key on the sending mobile phone. The system can be structured such that the transmission of a picture is autonomous where the receiving mobile phone does not have any control, or where the receiving mobile phone confirms the reception of the picture and has a possible right of refusal of the transmission of the data. The transcoder (TC) filters the non-voice data (NVD) and forwards the NVD to the Multimedia Service (MFS) or to the Serving General Packet Radio System Support Node (SGSN). The SGSN sends the non-voice data by means of the packet domain to the SGSN of the receiving talker, which transfers the data to the TC of the receiving talker for insertion into the pauses in the downlink voice stream of the receiving talker.

[0023] In a Tandem Free Operation (TFO) only small changes in the TC are required to be able to transfer non-voice data during the time that there is no voice signal. The tandem free operation (TFO) is a solution for eliminating multiple transcoding TC of a call and for improving end-to-end voice quality in mobile-to-mobile phone calls. In a non-TFO connection the TC is required to filter the non-voice data streams and forward the filtered information to the Multimedia Function Service (MFS), or to the Serving GPRS Support Node (SGSN), where GPRS is the general packet support node which transfers packet information between mobile phones. In a non-TFO connection the SGSN sends data by means of a packet domain to the SGSN of the receiving mobile phone, which transfers the data the TC of the receiving mobile phone. The TC inserts the data (picture) into the speech pauses of the downlink voice stream to the receiving mobile phone.

[0024] The DTX (discontinuous transmission) handler of the vocoders (voice coders) is located between the mobile phones and the TC (transcoder) located in the BSS (base station subsystem) depending upon the architecture of the system. Since speech is real time, speech has priority in the system over the transmission of data. The control over when data is transmitted is by the absence of speech at the sending end of the mobile-to-mobile communications. When a talker that has data to send becomes inactive (no speech) a VAD (voice activity detector) changes state from active to inactive, which signals a TX (transmission) information and a SP (speech) flag handler to insert data packets into the quiet transmission time slots while respecting the need for SID frame transmission.

[0025] The vocoders in a GSM (global system for mobile communications) are based on frames of PCM (pulse coded modulation) lasting for 20 ms where there is “160” samples at an 8 kHz sampling rate. Every 20 ms a decision is made whether a frame is speech active or speech inactive. If a talker with data to send becomes speech inactive, the vocoder switches from active to inactive, allowing data to be sent in subsequent SID frames.

[0026] The transmission of non-voice data during non-speech time will become interrupted by required SID frames, re-transmission of previously transmitted corrupted data frames and active talker situations. If a frame is detected to be corrupt by the receiving mobile phone, a request is made for a re-transmission of the corrupted frame. The handling of the re-transmission is done through the interaction the RX (receive transmission) data receiver and the TX (transmission) data packetizer of the transmitting mobile phone. After a correct reception of the transmitted data, the data is further processed by decoding the data image (picture) and/or by storing the data on a flash card, RAM disk or equivalent.

[0035] In FIG. 3A is shown a block diagram of the present invention for transmitting a digital picture or other digital data concurrent with voice of the sending user of a mobile or cellular phone. In the case of a camera 60 that is integrated with a cellular phone, the picture is taken with the camera 60 by a user of the phone and stored into flash memory 61. The user of the cellular phone initiates the transmission of the picture while talking on the phone of a user of a second phone by selecting the feature on the sending mobile phone to transmit data (picture) during a phone call.

[0036] Upon initiating the transmission of the picture, the picture from flash memory 61 is coupled to a transmission data packetizer 62. The transmission and flag handler “TX Info & SP Flag Handler” 63, which is interposed between the TX SCR Handler 40 and the TX Radio Subsystem 41, selects data packets of the picture from the Packetized Data Bits 64 to fill unused time slots in the transmission of voice from the user of the cellular phone that contains the picture to be transmitted. Control Data 65 between the TX Data Packetizer 62 and the “TX Info & Sp Flag Handler” 63 provides status, selection and update information. The SP Flag 43 is used to encode the radio channel of the TX Radio Subsystem 41 and indicates whether a talker is active, or not, or already talking while taking into account any “hangover” time. The Info Bits 42 coming from the TX SCR Handler 40 contain only speech data, whereas the Info Bits 44 coupled from the TX Info &SP Flag Handler 63 contains either speech data or non-voice data. When the TX Info & SP Flag Handler 63 detects an SP Flag=0 (no speech), a request for NVD (non voice data) packet of around approximately 260 bits is made to the TX Data Packetizer 62 through the Control Data connection 65. The packetized data bits 64 are coupled to the TX Info & SP Flag Handler 63, which inserts the packetized data bits 62 into the Info Bits 44 that are coupled to the TX Radio Subsystem 41. The From/To RX Data Receiver 66 provides a control channel that allows control communication between the TX Data Packetizer 62 and the RX Data Receiver 70.

[0037] Continuing to refer to FIG. 3A, The “TX Info & SP Flag Handler” 63 selects the data packets through the Packetized Data Bits 64 and fills quiet voice frames, which are unused by the sending phone user, with data packets. The data packets are coupled from the TX Data Packetizer 62 through the TX Info & SP Flag Handler 63 to the TX Radio Subsystem 41 under the Control Data 65. The TX Info &SP Flag Handler coordinates the transmission of NVD and voice data through the TX Radio Subsystem 41. The quiet voice frames amongst the voice frames used for voice data are filled with picture data exclusive of a SID frame that is necessary to provide a recognition of the phone call being active. Continuing to refer to FIG. 3A, during the time that there is transmission of voice and data to a receiving mobile, or cellular, phone speech will have priority over picture data or any other non-speech data that is being transmitted since speech is temporal and has to be transmitted in real time whereas pictures and other data are not time dependent. The control of whether speech or data will be transmitted is controlled by the speech behavior of the sender. When the sender becomes inactive, taking a breath or just pausing, the VAD (Voice Activity Detector) 45 changes state from active to inactive signaling the “TX Info & SP Flag Handler” 63 that data packets can be inserted into the signal being transmitted to the receiving mobile, or cellular, phone while respecting the necessary SID frame transmission.

[0038] In FIG. 3B is shown a block diagram of the present invention for the receiving of a digital picture or other digital data concurrent with voice of the sending user of a mobile or cellular phone. Dedicated bits within the Info Bits 52 are used to identify an NVD (non-voice data) packet. The RX Data Receiver 70 communicates with the TX Data Packetizer 66 with control information that allows NVD packets to be sent from the TX Radio Subsystem 41 to the RX Access Network 50. The Data Receiver 70 couples Packetized Data Bits 73 from the RX handler 75 to the Flash Memory 71, which is then displayed on the LCD screen 72. The RX Access Network 50 couples Info Bits 52 containing voice and non-voice data to the RX Handler 75 along with SID frame information 53, BFI (Bad Frame Indication) 54 and the TAF (Time Alignment Flag) 55. The RX handler removes the NVD (non-voice data) 52 and couples the NVD to RX Data Receiver 70 by way of the Packetized Data Bits 73 using Control Data 74 to maintaining synchronization of operations between the RX Data Receiver 70 and the RX Handler 75. The RX Handler 75 couples the voice data to the RX SCR Handler 51 by means of the Info Bits 76 to the Speech Decoder within the RX SCR Handler 51. Since disturbances in the radio environment can cause errors, corrupted NVD frames are marked, and a request for retransmission is made by the RX Data Receiver 70. Corrupted voice data that cannot be recovered is handled separately by the vocoder by means of the error concealment. The RX SCR Handler 51 generates a Comfort Noise that is used to keep the user of the receiving mobile phone aware that the phone connection is still active.

[0039] Continuing to refer to FIG. 3B, if the NVD data that is being received is corrupt, a request is sent back to the TX Data Packetizer 66 and 62 for retransmission of the corrupted data. The “TX Info & Flag Handler” 63 allocates unused SID frames to the retransmission of the corrupted data and delays the transmission of picture data that has not yet been transferred. The use of unused SID frames for retransmission also respects the need for a SID frame to continue to indicate that the sending and receiving phones are still connected.

[0040] In FIG. 4A is shown a signal diagram of prior art in which time slots TS 80 are used to transmit voice conversation and data between two mobile or cellular phones using a GSM (Global Systems for Mobile communications). The GSM uses a combination of FDMA (Frequency Division Multiple Access) and TDMA (Time Division Multiple Access). This allows numerous available carrier frequencies at a 200 KHz spacing (a FDMA bit) and each carrier is broken into time slots that support 8 separate conversations (a TDMA bit). This leads to the Mobile phone, or the cellular phone being pulsed with a 1:8 duty cycle. Voice and data transmission are encoded into the time slots 80 using phase modulation with every 26^th pulse 81 being omitted for coding and control reasons. In FIG. 4B is shown a signal diagram of prior art of a single time slot TS 80. Speech 84 is distributed over the time slot 80 with intervening regions of silence 85. The silence is a result of one taking a breath or normal conversation breaks. A required SID frame 86 is shown to indicate that the phone conversation is still taking place even though no speech on the sending end is occurring.

[0041] In FIG. 4C is shown a signal diagram of the present invention in which speech 84, the required SID frame 86 and data frames 87 containing picture data or other digital data are transmitted within a same time slot. This allows the data 87 to be transmitted from a sending mobile, or cellular phone, concurrently to a receiving mobile or cellular phone. The data frames 87 are also used for retransmission of data that had previously been detected at the receiving phone to be contaminated. Thus the present invention allows the receiving phone to receive pictures, or other digital data, while a phone conversation is being carried out between the talker on the sending phone and the talker on the receiving phone without the need to make a separate phone calls, one for speech and one for data. The data frames shown herein could be transmitted to other receiving equipment that is configured to adapt to the requirements of the sending phone system.

[0042] While the invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the invention.