Teleconferencing server and teleconferencing system

[0001] 1. Field of the Invention

[0002] The present invention relates to a teleconferencing server and a teleconferencing system that utilizes a plurality of telephone terminals to realize teleconferencing.

[0003] 2. Description of the Related Art

[0004] There are in use today systems that enable users at respectively remote locations to hold a teleconference. In recent years, accompanying the reduction in the price of televisual phones, the spread of personal computers and the internet, and the expansion of the functionality of stationary telephones and mobile telephones, including cellular phones (hereinafter collectively referred to as telephone terminals), teleconferencing systems using a variety of types of telephone terminals have been proposed. According to these teleconferencing systems, the voice data from the telephone terminal of a teleconference participant that makes a transmission is subjected to a multiplexing process and transmitted to the telephone terminal of each participant to realize the teleconference. Among the proposed systems are systems in which an image data representing an image of the face of the transmitting party (the conference participant transmitting voice data) or an image data obtained by synthesizing an image of a virtual conference room in which an image of the face of each conference participant appears, is transmitted along with the voice data to impart a feeling close to that as if all the participants of the conference were present in the same conference room, and which record the contents of the conference and automate processes such as participant registration, billing, and the like with the aim of helping smooth the progress of the teleconference.

[0005] As the number of disabled persons hired by companies has increased in recent years, disabled and non-disabled persons are participating in the same conferences, even in international conferences. It goes without saying that under these conditions communication must be facilitated, for which it is necessary that the speech of non-disabled persons be translated into sign language or readable text for those with hearing or sight disabilities, and that sign language or written text be translated into speech so that all participants can communicate. However, such a system has not yet been realized.

[0006] The present invention has been developed in consideration of the forgoing circumstances, and it is an object of the present invention to provide a teleconferencing server and teleconferencing system that enables people with disabilities such as impaired hearing and the like to participate in teleconferences in a convenient manner.

[0007] The teleconferencing server according to the present invention is a teleconferencing server which realizes teleconferencing utilizing a plurality of telephone terminals, comprising:

[0008] an input format and reception format registration means for registering the input format and the reception format of each of the telephone terminals,

[0009] a receiving means for receiving the input data inputted from the telephone terminals by the input format of the respective telephone terminal,

[0010] a conversion means for converting the received input data to data conforming to the appropriate reception format of each of the plurality of telephone terminals, and

[0011] a transmitting means for transmitting the converted input data converted by the conversion means to the telephone terminal having the target reception format.

[0012] Here, it is preferable that the “input format” and “reception format” include at least three of voice, text, image, and Braille. Here, “image format” refers to a transmitting and receiving format for transmitting and receiving an image of the face of a conference participant or an image conveying what the transmitting party's hands are doing so as to enable conference participation by use of lip reading or sign language.

[0013] It is preferable that the teleconferencing server according to the present invention comprise a language type recording means for recording the language utilized by the user of each of the telephone terminals, and

[0014] a language type conversion means for converting the input data to the language type utilized by each user, wherein

[0015] the transmitting means is a means for transmitting the converted input data converted by the language type conversion means to the target telephone terminal.

[0016] The teleconferencing system according to the present invention is a teleconferencing system comprising a plurality of telephone terminals and a teleconferencing server, wherein

[0017] the telephone terminals transmit as distribution data the input data that is transmitted from each telephone terminal to the telephone terminals other than the telephone terminal that has transmitted said input data, further comprising

[0018] a communication means for performing the transmission of the input data from the telephone terminals to the teleconferencing server, and the reception of the distribution data from the teleconferencing server,

[0019] an input means for inputting the input data transmitted from the communication means to the teleconferencing server,

[0020] a reproduction format setting means for setting the reproduction format of the distribution data from the teleconferencing server which has been received by way of the communication portion,

[0021] a distribution data format converting means for converting the reproduction format of said distribution data to the format appropriate to that set by the reproduction format setting means, and

[0022] a reproduction means for reproducing the distribution data converted by the distribution data format converting means in the reproduction format set by the reproduction format setting means.

[0023] Therefore, according to the teleconferencing system of the present invention, the telephone terminals utilized thereby differ from conventional telephone terminals, which receive and reproduce data in the same format, e.g., a voice terminal receives voice data and reproduces voice and an image terminal receives image data and reproduces images. The teleconferencing system of the present invention receives data (here, distribution data) that is then converted to data conforming to a reproduction format set at the reproduction format setting means. The converted data is then reproduced in the reproduction format by the reproducing means.

[0024] According to the teleconferencing system of the present invention, it is preferable that the reproduction format setting means of the telephone terminal is a means capable of setting a plurality of reproduction formats,

[0025] the distribution data format converting means is a means for converting each distribution data to the respective the reproduction format set by the reproduction format setting means, and

[0026] the reproduction means is a means capable of reproducing, in the respective format, the distribution data converted by the reproduction format converting means.

[0027] Here, when the distribution data of a plurality of formats is reproduced by the reproduction means, the various reproduction formats can be reproduced simultaneously, or each in a time division manner for each reproduction format.

[0028] Further, for cases in which the distribution data that has been transmitted from the teleconferencing server is in the reproduction format conforming to the reproduction format that has been set at the reproduction format setting means, e.g., the distribution data is voice data and the reproduction format of the telephone terminal has been set to the voice format, it is preferable that the reproduction format converting means does not subject the distribution data to a conversion process. In this case “No conversion” can also be specified as a conversion option.

[0029] According to the teleconferencing server of the present invention, by use of a converting means it becomes possible to convert input data inputted from telephone terminal apparatuses having different input formats and receiving methods such as text format, voice format, image format and the like, to the receiving format of the receiving telephone terminal apparatus so that, for example, a voice format transmission can be converted to text for conference participants having a hearing or speech disability. Therefore, it becomes possible for persons with such disabilities to conveniently participate in teleconferences, which are for the most part generally conducted such that communication is mainly performed by voice transmission.

[0030] In the case that the teleconferencing server according to the present invention comprises a language type converting means for converting the input data to the desired language type of the user of a telephone terminal, the input data can be converted to the language type of the receiving terminal and transmitted, enabling teleconferencing by participants who speak different languages.

[0031] According to the teleconferencing system of the present invention, the distribution data format converting means converts the distribution data sent from the server, i.e., the input data from another telephone terminal, to data conforming to the reproduction format set by the reproduction format setting means, and the reproduction means reproduces the converted reproduction data in the corresponding reproduction format. Therefore, a disabled person having, for example, a hearing impairment can have distribution data that is voice data converted to text data if the reproduction format of the terminal of the hearing disabled person is set to text format, whereby it becomes possible to participate in a teleconference, even in a case that the teleconference is conducted by means of a teleconferencing server not provided with a function for converting the format of the distribution data.

[0032] Further, according to the teleconferencing system of the present invention, if the reproduction format setting means, the distribution data format converting means and the reproduction means of the telephone terminal are capable of supporting a plurality of reproduction formats, a plurality of persons wishing to use different reproduction formats can participate in a teleconference using the same telephone terminal.

[0039] Hereinafter the preferred embodiments of the present invention will be explained with reference to the attached drawings.

[0040] FIG. 1 is a block diagram of the configuration of a teleconferencing system A according to an embodiment of the teleconferencing server of the present invention. As shown in FIG. 1, the teleconferencing system A according to the present embodiment comprises: telephone terminals such as a personal computer 1 utilizing an internet phone, a cellular phone 2, a stationary telephone 3 equipped with a liquid crystal display, a televisual teleconferencing apparatus 4, and the like; and a server 10 that realizes a teleconference utilizing the aforementioned telephone terminals. The server 10 and each of the telephone terminals are connected by a public communications network such as a telephone network, the internet or the like.

[0041] FIG. 2 is a block drawing of the server 10 of the teleconferencing system A shown in FIG. 1. As shown in FIG. 2, the server 10 comprises: an input receiving portion 15 for receiving input from each of the telephone terminals; a registration portion 20 for prompting, via the telephone terminal of each conference participant, each user to register their name, terminal type, input format (text or voice), reception format (text or voice), and type of language L used; a memory portion 25 for storing the registration data for each participant registered by the registration means 20; a format conversion portion 30 for converting the format of input data that has been inputted, via the receiving means 15, from a transmitting party (a participant using a text input format is also referred to as a transmitting party) after the conference has begun to the reception format of each destination telephone terminal; a language type conversion portion 45 for converting, to the registered language type of the user of the respective destination telephone terminal, the input data converted by the format converting means 30; and a transmitting portion 50 for transmitting the output data obtained for each respective telephone terminal by the conversion processing performed by language type converting means 45 to each target telephone terminal.

[0042] FIG. 3 is a table illustrating one example of the memory content, which consists of the content registered by the registration portion 20 before the conference begins, of the memory portion 25. As shown in FIG. 3, the memory portion 25 records the terminal type utilized by the participating user, said user's name, said user's transmission inputting format, said user's reception format for receiving transmissions from other participants, and said user's language type L, for each user (User 1, User 2, etc.). In this fashion, the when the registration process has been completed by the registration portion 20, the preparations for opening the conference are complete.

[0043] Next, using the example shown in FIG. 3, the operation of the server 10 of the teleconferencing system A of the current embodiment after a teleconference has begun will be explained in more detail.

[0044] FIG. 4 is a flowchart of the operation of the server 10 after a teleconference has begun. As shown in FIG. 4, when a teleconference is started, the receiving portion 15 of the server 10 receives input data in the form of text or voice data from any of the telephone terminals (step S10), whereupon the format conversion portion 30 refers to the memory content of the memory portion 25 to confirm the reception format of each of the telephone terminals (step S15), and converts said input data to the reception format of each destination telephone terminal (step S20). In a case, for example, in which the transmitting party is user 2, because the input data is voice data, the format conversion portion converts the voice data from user 2 to the text format matching the reception format of user 1; however, because the reception format of user 3 is the same as that of user 2, that is, voice format, the transmission data to be sent to the stationary telephone apparatus of user 3 is the voice data, in unconverted form. Upon reception of the transmission data outputted from the format conversion portion 30, the language type conversion portion 45 first refers to the memory content of the memory portion 25 to compare the language type L used by the transmitting party to the language type utilized by each destination user (step S25). If the language type of the transmitting party and the receiving party is the same (step S25: No; e.g., when the transmitting party is user 1, and the destination user is user 3), the language type conversion portion 45 outputs the transmission data from the format conversion portion 30 as is, that is, in the format matching the reception format of the receiving party, to the transmitting portion 50; however, if the language type of the transmitting party and the receiving party is the different (step S25: Yes; e.g., when the transmitting party is user 1, and the destination user is user 2), the language type conversion portion 45 converts the transmission data from the format conversion portion 30 to the language type L used by the destination user and outputs the data obtained thereby to the transmitting portion 50 (step S30).

[0045] The format conversion portion 30 and the language type conversion portion 45 perform the processes of steps S15 through S30 for each destination telephone terminal (or user) to obtain the transmission data to be sent to each respective destination telephone terminal (or user).

[0046] The transmitting portion 50 sends the transmission data obtained by the format conversion portion 30 and the language type conversion portion 45 for each destination telephone terminal to each respective destination telephone terminal.

[0047] In this fashion, according to the teleconferencing system A of the current embodiment, by converting the format of the input data from the receiving party to the format matching the reception format of the receiving party, disabled persons having a hearing or speech disability are enabled to conveniently participate in teleconferences.

[0048] Further, according to the teleconferencing system A shown in FIG. 1, by converting the language type of the transmission data to that matching the language type utilized by the destination user, teleconferencing can be realized between participants who speak different languages.

[0049] Still further, according to the teleconferencing system A shown in FIG. 1, though only voice and text formats are used as reception and transmission formats, the present invention is not limited thereto; a system configuration enabling communication by sign language and lip reading, or a configuration for sending and converting Braille format can also be employed.

[0050] FIG. 5 is a block diagram of a teleconferencing system B according to another embodiment of the present invention. As shown in FIG. 5, the teleconferencing system B according to the present embodiment comprises: telephone terminals such as a personal computer 101 utilizing an internet phone, a cellular phone 102, a stationary telephone 103 equipped with a liquid crystal display, a televisual teleconferencing apparatus 104, and the like; and a server 100 that realizes a teleconference utilizing the aforementioned telephone terminals. The server 100 and each of the telephone terminals are connected by a public communications network such as a telephone network, the internet or the like.

[0051] The server 100 supports only voice format, that is, receives the input data, which is formed of voice data, from each telephone terminal, subjects the input data to a multiplex process to obtain a distribution data that is the same as the voice data, and transmits said distribution data to the telephone terminals other than that which has sent the input data to realize teleconferencing.

[0052] The portable phone 102 and the stationary phone 103 are telephone terminals that only support voice format; that is, the transmitting party sends voice data to the server 100, the portable phone 102 and the stationary phone 103 receive the distribution data, which is formed of said voice data, and reproduce the voice.

[0053] The personal computer 101 converts input data that has been inputted in text format to voice data, sends the voice data to the server 100, and reproduces the distribution data, which is formed of voice data, that has been received from the server 100, as voice. The conversion of text data to voice data by the personal computer 101 is realized by conversion software installed in the personal computer 101 and hardware capable of executing said software.

[0054] The televisual teleconferencing apparatus 104 shown in the block drawing of FIG. 6 is an apparatus for joint use by a plurality of participants. As shown in FIG. 6, the televisual teleconferencing apparatus 104 comprises: a mike 122 for transmitting parties transmitting in voice format; a text inputting portion 124 formed of a keyboard for transmitting parties transmitting in text format; a first conversion portion 126 for converting text data inputted by the text inputting portion 124 to voice data; a communication portion 110 for performing communication functions such as transmitting the voice data from the microphone 122 and the first conversion portion 126 to the server 100, receiving distribution data formed of voice data from the server 100, and the like; a speaker 142 for reproducing voice data; a screen 144 for reproducing text data; a reproduction format setting portion 130 for setting the reproduction format of the distribution data received from the server 100; and a second conversion portion 140 for converting distribution data to text format, for cases in which “text” has been set as the reproduction format by the reproduction setting portion 130, and outputting the text data to the screen 144, as well as outputting the distribution data as is to the speaker 142 without the subjection thereof to a conversion process, for cases in which “voice” has been set as the reproduction format on the one hand, and on the other hand, for outputting distribution data formed of voice data as is to the speaker 142 without the subjection thereof to a conversion process and converting distribution data formed of voice data to text data outputting the text data to the screen 144.

[0055] In this manner, according to the teleconferencing system B of the current embodiment, the televisual teleconferencing apparatus 104, which is one type of telephone terminal, can support a plurality of reproduction formats, wherein the distribution data received from the server 100 is converted to the reproduction format set by the reproduction format setting portion 130, outputted to the corresponding reproduction means (the speaker 142 or the screen 144), and reproduced in the respective format. Therefore, the distribution data sent from the server 100 can be reproduced in the format desired by the participant regardless of the reproduction format of said distribution data; whereby, even if the server side is not provided with a function for converting the input data to the format matching that used by the distribution destination, participants requiring a reproduction format that is different from the format of the distribution data can also participate in teleconferences. Further, by supporting a plurality of formats, a plurality of participants desiring respectively different reproduction formats can participate in teleconferences.

[0056] According to the teleconferencing system B shown in FIG. 5, by converting the respective input data of a plurality of types of telephone terminals, from portable phones 102 and stationary phones 103, to internet phones 101 and the televisual teleconferencing apparatuses 104, to voice data and transmitting the voice data to the server 100, a conventional teleconferencing server that only supports voice data can suffice, and the load on the server is reduced. For example, if on the one hand, each telephone terminal is provided with a function for converting input data to data conforming to a desired reproduction format and reproducing the thus converted data and the server side is not provided with a function for converting the input data to the format matching that of each respective distribution destination, and transmission and reception of each format is possible, conversion of the format of the input data is not performed on the telephone terminal side, the input data inputted in the respective input format of each telephone terminal is sent to the server, and the server can distribute to each telephone terminal distribution data in the format of the input data as is. Further, if the server side is provided with a function for converting the format of the input data, and it is made possible to specify whether or not the format of the distribution data is to be converted, the format to which the distribution data is to be converted in the case of conversion, and the like, the conversion to a specified format and subsequent distribution of the distribution data can be performed only for telephone terminals that have specified that the operations be performed.