Push-to-talk mobile communication terminals

[0001] The present invention relates to mobile communication terminals and to a method for push-to-talk communication between a mobile communication terminal and at least one other mobile communication terminal via a communication network.

[0002] Nowadays several mobile telephone systems are known, among them the well-known GSM system. The users of the mobile phones used in this system enjoy a plurality of services, such as SMS or MMS. GPRS is a data transfer method under the GSM standard that is not dependent on call set-up.

[0003] Among all these services the Push-to-Talk (PTT) or Push-to-Talk Over Cellular (PoC) GPRS based service recently emerged.

[0004] Conventional mobile phones with PTT functionality are provided with dedicated PTT button. Basically, the method comprises pushing the PTT button, which causes a display to show the PTT phonebook in form of a list of PTT contacts. By using the up and down arrow keys, it is possible to highlight the person or person group the user want to contact. Then the user must push and hold de PTT button, and wait a period of time for a beep that confirms the connection. Next, the user can start speaking. At the other end, everyone in the person group hears a beep and then the voice of the user. When the user finishes talking, the user releases the PTT button and everyone in the person group hears another beep. The next person in the group can press his/her PTT button and can then respond. Anyone else in the group pressing their PTT button just thereafter gets a busy signal and has to wait for his/her turn.

[0005] There are mobile phones which do not have a dedicated PTT button, such as the Nokia 5140. In this case, the establishment of the connection must be done from inside of the PTT sub-menu. The user has to navigate to the PTT sub-menu and start the connection using softkeys. If the connection is established then the user has press a softkey which emulates the PTT button.

[0006] Basically, in the beginning of a PTT communication the mobile phone is in a latency state, waiting for a push of the PTT-button. When the PTT button is pushed, the mobile phone switches to an active state. When the PTT button is held, the mobile phone returns to the latency state, waiting a new activation of the PTT button.

[0007] Said PTT mobile phones have a drawback in that their use is difficult for their configuration because the user must continuously press and hold the PTT button during a PTT communication. It is very inconvenient to press a button while holding the mobile phone in a conventional position close to ear and face. Also, for example, a user cannot use a PTT mobile phone in a PTT communication when is driving a car. For the same reason it is not possible to use a hands-free headset. Another drawback is that the mobile phone must include another button in its keypad, which should though have as few keys as possible for size and ease of use considerations.

[0008] On this background, it is an object of the present invention to provide a mobile communication terminal of the kind referred to initially, which can overcomes the problems that can be associated with the prior art push-to-talk communication terminals described above.

[0009] This object is achieved in accordance with claim 1 by providing a terminal for use in a wireless communication network, the mobile communication terminal comprising a processor unit controlling the operation of the mobile communication terminal, a microphone, and a sound processing module for processing sounds captured by the microphone. The processor unit is configured to operate the terminal for push-to-talk communication with at least one other mobile communication terminal via the communication network, said processor unit operating said terminal during said push-to-talk communication in a latency state or in an active state in which sound captured by the microphone is processed by the sound processing module and sent to the at least one other mobile communication terminal, and said processor unit is also configured to change from the latency state to the active state in dependence of the sound captured by the microphone.

[0010] This mobile communication terminal according to the present invention provides a number of advantages. It allows to operate the terminal in a PTT communication by sounds (recognizing voice, detecting sounds, recognizing speech commands, etc.), switching the terminal from the latency state to the active state and vice versa in dependence of these sounds captured by the microphone, avoiding the drawbacks of requiring a PTT button and consequently of pressing and holding the PTT button in a PTT communication. Moreover, it is possible to use the mobile communication terminal as a baby-phone, detecting, for example, the sound of a crying baby and sending these sounds to at least one other mobile communication terminal, in a PTT communication.

[0011] Basically, the latency state is a state in which the terminal is ready for receiving PTT communication from other mobile phones and is a state in which the terminal monitors the sounds captured by the microphone, in order to decide if a switch to the active state should be made.

[0012] The active state is a state in which the terminal is sending the sound being captured by the microphone to the one other mobile communication terminal, the active state being able to comprise a waiting sub-state until the communication network accepts a speech request from the terminal, and a sending sub-state when the communication network accepts the speech request and the terminal sends the sound captured by the microphone and processed by the sound processing module to the at least one other mobile communication terminal. Alternatively, the active state can comprise a queuing sub-state when the terminal is in an incoming speech state and sends a speech request to the communication network.

[0013] Preferably, the processor unit can be configured to switch to the incoming speech state in which an incoming speech control module receives an incoming speech from the one other mobile communication terminal. The processor unit can also be configured to switch to the incoming speech state after an accepted speech command has been recognized by the speech command recognition module.

[0014] It is clear that it is possible to accept or reject the incoming speech. If the incoming speech is rejected, then the terminal is maintained in the latency state.

[0015] The processor unit can be configured to switch to the latency state after the incoming speech has been received by the incoming speech control module.

[0016] In one embodiment, the processor unit can be configured to switch to the active state when the sound level detected by the microphone exceeds a first given threshold, or can be configured to switch to the latency state when the sound level detected by the microphone drops—preferably at least for a given period—below a second given threshold.

[0017] In this embodiment the terminal only detects sounds and sends them to the one other mobile communication terminal. It is possible to use this embodiment in the baby-phone described above.

[0018] In another embodiment, the terminal can comprise a speech command recognition module, the processor unit being configured to switch to the active state when a given speech command is recognized by the speech command recognition module if the terminal is in the latency state, or to switch to the latency state when a given speech command is recognized by the speech command recognition module, if the terminal is in the active state.

[0019] The speech command can be a start word, such as the name of a PTT user, the name of a PTT user group, or a certain keyword, e.g. “go”. Further the speech command can be an end word such as “over” for stopping the sending to the one other terminal. Further the speech command can also be a word for accepting (“Accept”) or rejecting (“Reject”) an incoming speech.

[0020] In one embodiment, the terminal can comprise a voice recognition module and the processor unit can be configured to switch to the active state when a given voice, e.g. the voice of the owner of the phone, is recognized by the voice recognition module.

[0021] The voice recognition module can be used in different ways. Voice recognition can be done when the microphone detects sounds. If the detected sounds correspond to a predetermined voice, then the microphone continues the sound detection but the voice detection is finished.

[0022] Voice recognition can also be done before speech command recognition. If the detected sound corresponds to the predetermined voice, the processor unit changes from the latency state to the active state.

[0023] In another embodiment of the invention, the processor unit can be configured to switch to the latency state when the time of no or low capture of the microphone exceeds a third given threshold. Normally, this is used when the user of the terminal stops talking for a time period, indicating the end of the transmission.

[0024] In another embodiment, the mobile communication terminal can also comprise filtering means for preventing the microphone from capturing other sound sources different from human voices. The terminal is sensitive to human voices and filters other sound sources, such as the noise of a car passing by.

[0025] According to another aspect, the present invention provides a method for a push-to-talk communication between a mobile communication terminal and at least one other mobile communication terminal via a communication network, comprising the steps of (A) enabling a latency state of the terminal, (B) capturing a sound by means of a microphone of the terminal, and (C) switching the terminal to an active state, in dependence of the sound captured by the microphone.

[0026] In one embodiment, the active state can comprise the sub-steps of (AS.1) sending an speech request to the communication network, (AS.2) waiting a response from the communication network, (AS.3) receiving a response from the communication network, and (AS.4) sending the sound captured by the microphone to the other mobile communication terminal, if the response from the communication network is positive. If the response in the sub-step (AS.3) is negative, the terminal may switch to the latency state.

[0027] Further, the active state can comprise a sub-step (AS.5), between the sub-steps (AS.3) and (AS.4), comprising processing the sound captured by the microphone by means of a sound processing module, can comprise after sub-step (AS.4) the sub-steps of (AS.6) comparing a given speech command with at least one speech command stored in the terminal, and (AS.7) switching to the latency state, if the given speech command and one speech command stored in the terminal are identical.

[0028] On the other hand, the active state can comprise after sub-step (AS.4) the sub-steps of (AS.8) comparing a time of no capture of the microphone with a third given threshold, and (AS.9) switching the terminal to the latency state if the time of no capture of the microphone exceeds the third given threshold.

[0029] In one embodiment, step (C) can comprise the sub-steps of (C.1) comparing the sound level detected by the microphone with a first given threshold, and (C.2) switching to the active state, if the sound level detected by the microphone exceeds the first given threshold.

[0030] The step (C) can comprise the sub-steps of (C.3) comparing a given speech command with at least one speech command stored in the terminal, and (C.4) switching to the active state, if the given speech command and one speech command stored in the terminal are identical.

[0031] The step (C) can comprise the sub-steps of (C.5) comparing a given voice with at least one voice stored in the terminal, and (C.6) switching to the active state, if the given voice and one voice stored in the terminal are identical.

[0032] According to yet another aspect of the invention, there is provided a method for push-to-talk communication between a mobile communication terminal and at least one other mobile communication terminal via a communication network, comprising the steps of (D) enabling a latency state of the terminal, (E) alerting of incoming speech, (F) capturing a sound by means of a microphone of the terminal, and (G) switching the terminal to an incoming speech state, in dependence of the sound captured by the microphone.

[0033] In one embodiment, step (G) comprises the sub-steps of (G.1) comparing a given speech command with an accepting speech command stored in the terminal, and (G.2) switching to the incoming speech state, if the given speech command and the accepting speech command stored in the terminal are identical.

[0034] This cited incoming speech state can comprise the sub-steps of (IS.1) receiving an incoming speech from the one other mobile communication terminal, and (IS.2) switching to the latency state of the terminal.

[0042] In the following detailed description, embodiments of a mobile communication terminal according to the invention, in the form of a hand portable phone, preferably a cellular/mobile phone, will be described.

[0043] FIG. 1 illustrates in block diagram form the general architecture of the mobile phone constructed in accordance with the present invention. The mobile phone 1 comprises a processor 2 for controlling the operation of the mobile phone 1, said processor 2, a program memory (Flash ROM 4) for storing programs used by the mobile phone 1 and a Random Access Memory (RAM 5). Input/output circuits interface the processor 2 with a keypad 6, a display 7, a sound processing module 8, and a receiver/transmitter circuit 9. The receiver/transmitter circuit 9 is connected to an internal antenna 10. The sound processing module 8 provides analog audio outputs to a speaker 11 and accepts analog audio inputs from a microphone 12. The processor 2 also forms the interface to the peripheral units of the apparatus, including a SIM card 13, as well as power supply, etc.

[0044] FIG. 2 illustrates in more detail the push-to-talk software module 3 as stored in the Flash ROM 4. The module 3 comprises a speech command recognition module 14 for recognizing a given speech command captured by the microphone 12; a voice recognition module 15 for recognizing a given voice; a filtering module 16 for preventing the microphone 12 from capturing sound sources different from the human voice; and a incoming speech control module 17 for controlling and receiving incoming speech from another mobile phone. All cited modules are connected by means of a data bus 18 to the processor unit 2.

[0045] FIG. 3 illustrates in schematic diagram form the mobile phone 1 and one other mobile phone 1′ connected to a communication network 20 for a push-to-talk communication. Each mobile phone 1; 1′ has associated a push-to-talk user address A1; A1′ for identifying the users of the mobile phones 1, 1′ in the communication network 20, such as the GSM network. In the GSM network, the push-to-talk user address A1; A1′ is normally stored in the SIM card of the mobile phone 1; 1′, but in other networks this could be stored in the phone itself. When the mobile phone 1 want to establish a push-to-talk communication with the mobile phone 1′, said mobile phone 1 must select the user address A1′ of the mobile phone 1′ in the communication network 20. A user of mobile phone 1 can know if the mobile phone 1′ is connected to the network 20 by, for example, a drawing associated to the user address A1′ in the display 7.

[0046] On the other hand, it is possible a push-to-talk communication between the mobile phone 1 and several other mobile phones. The push-to-talk user addresses of these mobile phones are grouped in a push-to-talk user group address. In this case, the mobile phone 1 connects to the group address, not to the address of each mobile phone.

[0047] The mobile phone 1 also comprises an address book (not shown) stored in a memory of the mobile phone 1 and/or in the SIM card 13. The address book contains user names associated to push-to-talk user addresses and/or user group names associated to push-to-talk user group addresses. Each of theses addresses has associated a speech parameter for comparing with a given speech command (user name or group name) by the speech command recognition module 17 and communicating with the user address or group address corresponding to the given user name or group name. It is possible to access the address book via push-to-talk related menu items in a menu structure of the mobile phone.

[0048] The push-to-talk communication between mobile phones can be embodied in different ways. In the present description the push-to-talk communication is based on IP telephony over GPRS.

[0049] FIG. 4 is a flow chart illustrating a first preferred embodiment of a push-to-talk communication between the two mobile phones 1, 1′, in which the mobile phone 1 sends a sound previously detected by the microphone 12 to the mobile phone 1′. In this embodiment, the mobile phone 1′ is the default mobile phone. This configuration must be done in the corresponding push-to-talk related menu item in the menu structure of the mobile phone 1. The mobile phone 1′ is ready for receiving incoming speech (the phone is logged into the communication network 20 and the push-to-talk mode is enabled).

[0050] Firstly, the mobile phone 1 must be changed from an idle mode to the push-to-talk mode, in the latency state (step A). In this state the mobile phone 1 is ready for receiving sounds detected by the microphone 12 and establishing a push-to-talk communication (1 to 1 call) with the mobile phone 1′. This change can be embodied with a long key press over a predetermined softkey of the mobile phone 1 or by navigating from idle to the push-to-talk mode via the menu structure.

[0051] In the latency state, the microphone 12 is ready for capturing (step B) sounds. All detected sounds are compared (sub-step C.1) with a given sound threshold. When the level of a detected sound exceeds (sub-step C.2) the given sound threshold, the mobile phone 1 switches to the active state (step C). In this state, the mobile phone 1 sends (sub-step AS.1) a speech request for a push-to-talk communication with the mobile phone 1′ to the communication network 20 and waits (sub-step AS.2) for a response from the network 20. If the response (sub-step AS.3) is negative the mobile phone 1 returns to the latency state. If the response (sub-step AS.3) is positive (the phone 1′ is not sending an incoming speech), the phone 1 sends (sub-step AS.4) the sound detected by the microphone 12 and processed (sub-step AS.5) by the sound processing module 8 to the mobile phone 1′ in data packages via GPRS. Once the user of the mobile phone 1 stops talking for a time period, this time of no detection is compared (sub-step AS.8) with a given time threshold. If the time of no detection doesn't exceed the given time threshold, the phone is maintained in the active state. If the time of no detection exceeds the given threshold, the phone 1 switches (sub-step AS.9) to the latency state. At the other end, the mobile phone 1′ can accept or reject the incoming speech from the mobile phone 1.

[0052] In this embodiment, it is possible to use (sub-step C.5) voice recognition with the voice recognition module 15 after the detection of the sound by the microphone 12. In this case, if the voice recognition (sub-step C.5) is negative, the mobile phone 1 returns to the step B for capturing new sounds. On the other hand, if the voice recognition (C.5) is positive, the phone 1 proceeds to the sub-step C.1 for comparing the sound level with the sound threshold.

[0053] The mobile phone records the voice features to be able to recognize said voice for improving the voice recognition.

[0054] Further, after the sub-step AS.4, the phone 1 can also switch to the latency state if a speech command is given, such as “over”. In this case, the speech command recognition module 14 compares (AS.6) the speech command with, for example, a predetermined ending speech command stored in the mobile phone 1, and switches (AS.7) the phone 1 to the latency state if the given speech command and the predetermined ending speech command are identical.

[0055] The above description for FIG. 4 can also be applied for a push-to-talk communication between the mobile phone 1 and a group of mobile phones. In this case, the mobile phone 1 sends the sound detected by the microphone 12 as data packages via GPRS to each of the mobile phones of the group. The system uses a Client-Server architecture. There is a dedicated PTT backend server which is connected to every mobile phone. Thus the packages are sent from the respective mobile phones to the PTT backend server, which sends the packages to the other mobile phone(s). Each of these mobile phones can accept or reject the incoming speech.

[0056] Moreover, the described embodiment can be incorporated in a baby phone (not shown) or the mobile phone 1 can be used as a baby phone. In the latter case, the mobile phone 1 is placed near the baby in the latency state (step A). When the voice (cries, etc.) is detected (baby screaming) (step B) and it exceeds (sub-steps C.1, C.2) the sound threshold, the phone requests (sub-steps AS.1, AS.2) the speech to the communication network 20. If the phone has got (sub-step AS.3) permission to talk, granted by the communication network 20, the detected sound are transmitted (sub-step AS.4) to another mobile phone (e.g. the a parent's mobile phone). If the microphone 12 does not detect (sub-step AS.8) a voice during a time period, or if the sound level detected by the microphone 12 drops below a second sound threshold, the mobile phone 1 switches (sub-step AS.9) to the latency state.

[0057] When the voice of the baby is detected (step B, sub-steps C.1, C.2) the mobile phone 1 can also start to play a melody to comfort the baby or playback parental voice recordings. Further, if the mobile phone 1 comprises a camera, it is possible to send video streaming or stationary images. On the other hand, the parents can answer the baby via push-to-talk communication to comfort it.

[0058] FIG. 5 is a flow chart illustrating a second preferred embodiment of a push-to-talk communication between the two mobile phones 1, 1′, in which the mobile phone 1 sends a sound detected by the microphone 12 to a selected mobile phone (mobile phone 1′) with a user name in form of given speech command. In this embodiment, the mobile phone 1′ is also ready for receiving incoming speech (the phone is logged into the communication network 20 and the push-to-talk mode is enabled).

[0059] The mobile phone 1 must be changed from an idle mode to the push-to-talk mode, in the latency state (step A). In this state the mobile phone 1 is ready for receiving sounds by the microphone 12 and establishing a push-to-talk communication with the mobile phone 1′.

[0060] In the latency state, the microphone 12 is ready for capturing (step B) sounds. After the microphone 12 captures a speech command, e.g. the user name associated to the mobile phone 1′, the speech command recognition module 14 compares (sub-step C.3) this speech command with all user names and user group names stored in the address book. If one of the user names (the user name associated to the mobile phone 1′) and the speech command are (sub-step C.4) identical, then the mobile phone 1 switches to the active state (step C). In this state, the mobile phone 1 sends (sub-step AS.1) a speech request for a push-to-talk communication with the mobile phone 1′ to the communication network 20 and awaits (sub-step AS.2) a response from the network 20. If the response (sub-step AS.3) is negative the mobile phone 1 returns to the latency state. If the response (sub-step AS.3) is positive (i.e., the phone 1′ is not sending an incoming speech), the phone 1 sends (sub-step AS.4) the sound detected by the microphone 12 and processed (sub-step AS.5) by the sound processing module 8 to the mobile phone 1′. Once the user of the mobile phone 1 stops talking and gives an ending speech command (such as “over”), the speech command recognition module 14 compares (sub-step AS.6) the given ending speech command with, for example, predetermined ending speech commands stored in the mobile phone 1. If the given speech command is (sub-step AS.7) identical with one of the speech commands stored in the mobile phone 1, the phone 1 returns to the latency state. Otherwise the phone 1 remains in the active state. In the other end, the mobile phone 1′ can accept or reject the incoming speech from the mobile phone 1. If the incoming speech is accepted it is played back on mobile phone 1′. It is of course also possible in any of the embodiments to automatically accept all incoming PTT originated speech on mobile phone 1′.

[0061] In the present embodiment it is also possible to use (sub-step C.5) voice recognition with a voice recognition module 15 after the capture of speech by the microphone 12. In this case, if the voice recognition is negative, the mobile phone 1 returns to the step B for capturing new sounds. On the other hand, if the voice recognition (sub-step C.5) is positive, the phone 1 proceeds to the sub-step C.3 for comparing the given speech command with the user names and user group names stored in the address book of the phone 1. Alternatively (not shown), step C.5 leads directly to the active state.

[0062] Further, after the sub-step AS.4, the phone 1 can also switch (sub-step AS.9) to the latency state when the time of no detection by the microphone 12 is compared (sub-step AS.8) with a given time threshold and this time exceeds the given time threshold.

[0063] The above description for FIG. 5 can also be applied for push-to-talk communication between the mobile phone 1 and a group of other mobile phones. In this case, the mobile phone 1 sends the sound detected by the microphone 12 to each of the mobile phones of the group. Each of theses mobile phones can accept or reject the incoming speech.

[0064] The users can train and record the speech commands in the mobile phone for improving the speech recognition.

[0065] FIG. 6 is a flow chart illustrating a third preferred embodiment of a push-to-talk communication between the two mobile phones 1, 1′, in which the mobile phone 1 receives an incoming speech from the mobile phone 1′.

[0066] The mobile phone 1 must be changed from an idle mode to the push-to-talk mode, e.g. via the menu structure. The default state in the PTT mode is the latency state (step D). In this state the mobile phone 1 is ready for receiving incoming speeches.

[0067] In the latency state, the mobile phone 1 receives (step E) an alert of an incoming speech from the mobile phone 1′. In this situation, the incoming speech can be accepted or rejected by the user of mobile phone 1 by means of a speech command captured (step F) by the microphone 12. The speech command recognition module 14 compares (sub-step G.1) the given speech command with, for example, at least one speech command stored in the mobile phone 1. If the given speech command corresponds to a “reject” speech command, the mobile phone 1 remains in the latency state and doesn't receive the incoming speech. On the other hand, if the given speech command corresponds to an “accept” speech command (sub-step G.2), the mobile phone switches (step G) to a speech command state. In this state, the mobile phone receives (sub-step IS.1) the incoming speech from the mobile phone 1′ and returns (IS.2) to the latency state.

[0068] In this embodiment, it is also possible to do voice recognition for accepting the “accept” or “reject” speech command.

[0069] Although the present invention has been described in detail for purpose of illustration, it is understood that such detail is solely for that purpose, and variations can be made therein by those skilled in the art without departing from the scope of the invention.

[0070] Thus, while the preferred embodiments of the mobile communication terminals and methods have been described in reference to the environment in which they were developed, they are merely illustrative of the principles of the inventions. Other embodiments and configurations may be devised without departing from the scope of the appended claims.

[0071] For example, it is possible to prerecord speech sequences which are only recorded and not yet transmitted. If the user gives a certain speech command, such as “go”, the sequences are transmitted.