Computer, internet and telecommunications based network

[0002] The present patent application is a continued prosecution application based on the provisional patent application Ser. No. 60/040,056, filed Mar. 3, 1997. The present patent application incorporates by reference herein provisional patent application Ser. No. 60/040,056.

[0003] Computer Program Listing Appendix

[0004] Compact disks containing a computer program listing are attached to this specification. The computer program listing contained on these compact discs is hereby incorporated by reference into the specification. The appendix comprises one compact disk containing the file “program_listing.txt” which is 1.09 MB in size. This file was created on Nov. 6, 2002 and contains the source code which was part of the provisional application with Ser. No. 60/040,056 to which this application claims priority. One duplicate copy of this compact disk is also included.

[0005] The present invention relates to a telecommunication system, and more specifically, the present invention relates to a network system based on internet, computer and telecommunication standards, utilizing internet and computer technology, a graphical user interface, integrated telecommunication applications and interactive voice recognition technology, facilitating the computation and telecommunication of voice and electronic data.

[0006] Individuals and business people seek to communicate with each other, obtain useful information, interact commercially and entertain themselves in an increasingly mobile society. In order to fulfill these needs, one requires the ability to send and receive messages, access information and entertainment, conduct business transactions, organize daily schedules and stay in touch with homes and offices from almost anywhere, at any time, as easily as making a telephone call.

[0007] Continued demand for products and services that address these needs is evidenced by the increasing number of electronic devices, and the explosive growth of the internet and network services. Advances in wireless telecommunication technologies led to the development of such devices as personal digital assistants, and enabled the growth of paging and cellular telephone networks. Devices such as notebook and sub-notebook computers with modems (both wireline and wireless) have allowed mobile professionals to connect to their PCs from almost any location, as well as to access on-line information and electronic mail services while traveling worldwide.

[0008] In addition, communication and information needs have stimulated the growth of the internet, on-line networks and corporate intranets. These networks now host a variety of services such as e-mail, database searching, conferencing, electronic commerce, games, software libraries and electronic newspapers and magazines. However, despite the proliferation of communication devices and the development of the internet, on-line networks and corporate intranets, significant barriers remain to fulfilling user needs for access to and management of personal, professional and public information.

[0009] The hardware designs and software technologies which enable today's communication are complex. Information, though widely available, can be either inaccessible or accessible only by navigating through a host of phone systems, operating system platforms, databases and networks. As a result significant amounts of time and effort are required of those who use and depend on these devices, networks and services to communicate and obtain information.

[0010] The problem of accessing and processing all of the information available from communication devices, networks and services is particularly acute for mobile business professionals. Today's mobile professional, working out of the home or small office, may have a cellular phone, a pager, a computer, a fax machine, an electronic mailbox on the internet, and a voice-mail service. Whether on the road, in a plane or at the office, success for the mobile professional depends in large part on the ability to easily and quickly access, sort through and respond to the messages delivered to each of these communication devices, and to obtain information necessary to the conduct of business from proliferating networks and services.

[0011] The present invention is a network system, which is based on internet, computing and telecommunications standards, utilizing computer and internet technology, an innovative graphical user interface, integrated communication applications and interactive voice recognition technology. The present invention is a unified messaging service which will be accessible from any standard communication device (telephone, computer or internet), and will give the user intuitive voice command of personal, professional and public information.

[0012] This unified messaging service is a useful tool to those whose time and resources are limited and for whom communication is critical, such as mobile business professionals in the small office, home office market. The mobile business professional must maintain access to personal and professional information and developments, respond to customers and communicate with colleagues, family and friends at any time and from any location. The unified messaging service is designed to meet these objectives by offering a single point of access to all communications, integrated with personal information management tools and customized public content delivery.

[0013] Small office, home office professionals, most of whom do not have access to dedicated information management systems or the benefit of administrative support staff, may derive unique value from this shared network solution.

[0014] An embodiment of the present invention is an Internet controlled telephony system that can be accessed either through a telephone handset or a web page. When accessed by a telephone handset it can be manipulated by DTMF or voice recognition. When accessed by a web page, it can be driven by Java or cgi.

[0015] An embodiment of the present invention works by giving each subscriber a local phone number, an 800 number or a 500 number. Through the use of this number the system may implement follow me calling. Follow me calling may also use a pager and can use pagers for notification or meet me paging.

[0016] In an embodiment of the present invention, incoming calls can be screened for both a message from the caller and playing the caller's identification.

[0017] An embodiment of the present invention also provides voice mail and all typical voice mail features.

[0018] An embodiment of the present invention also allows the user to make outbound calls from the handset.

[0019] Another embodiment of the present invention receives faxes on the same number as it receives phone calls. These faxes can be forwarded to email, another fax machine or can be stored and forwarded at a later time by a subscriber.

[0020] An additional embodiment enables email to be read to a subscriber through a handset and the system has the ability to read headers to inform the subscriber of the length of the message and to summarize the email.

[0021] In other embodiment of the invention, the system can ocr faxes and forward them to the subscriber.

[0022] An embodiment of the present invention allows the subscriber to make calls from his web page. This allows, among other things, international call back.

[0023] Another embodiment of the present invention enables the subscriber to see his voice mail on his web page. Information such as call duration and caller ID may be displayed. This information is updated as new messages are received.

[0024] An embodiment of the present invention enables the subscriber to respond to email messages using a voice attachment to an email.

[0025] In another embodiment of the present invention, the system allows the subscriber to change the status of his particular environment on the web or handset.

[0026] Another embodiment of the present invention allows a subscriber to obtain all billing information via a web page.

[0027] A further embodiment of the present invention allows the subscriber to display the Automatic Number Identification of a voice mail message and then return the call by clicking the appropriate button on the web page.

[0028] Another embodiment allows conference calls can be initiated either from the handset or a web page.

[0029] A still further embodiment allows calls to be received and screened while another call is active. Additionally, calls may be put on hold and retrieved.

[0030] Another embodiment of the present invention keeps and manages phone directories of the subscriber and allows the subscriber to call telephone numbers from other applications. These phone directories are available either from the web page or the handset.

[0031] An embodiment of the present invention, all or some of the information about follow me calling is maintained by and managed on the web page but may also be modified through the use of the handset.

[0032] Another embodiment of the present invention informs subscribers via a web page who is calling and allows the subscriber to decide whether to take the call.

[0033] An embodiment of the present invention will deal with security and fraud issues.

[0034] An embodiment of the present invention will have multiple prompt levels.

[0035] Another embodiment of the present invention will have the ability to create and send faxes from a computer application.

[0036] A further embodiment of the present invention will be able to do predictive dialing and leave messages. It will be able to make calls from a list using its predictive dialing features.

[0037] An embodiment of the present invention will keep a complete record of all calling activity.

[0038] An embodiment of the present invention will be able to make multiple calls from the web without hanging up. Only the outbound leg of the call will be terminated.

[0039] In another embodiment of the invention, the API of the system is open and published. With proper authorization, anyone using Java or other programming tool can program the system and create applications. This can be done from any client and any client can drive the server.

[0040] An embodiment of the invention has the ability to import phone directories.

[0041] A Preferred embodiments of the invention are explained below with references to the accompanying drawings in which:

[0042] FIG. 1 is a functional block diagram of the hardware platform embodying the present invention;

[0043] FIG. 2 is a functional block diagram of the internet platform embodying the present invention;

[0044] FIG. 3 is a general application flow chart embodying the present invention; and

[0045] FIGS. 4A-4R are detailed application flow charts embodying the present invention.

[0046] FIGS. 5A-5B are the functional block diagrams for the computer telephony platform and network architecture embodying the present invention.

[0047] FIG. 6 is the software architecture embodying the present invention.

[0048] The present invention is a network system that works, among other things, as your voice-mail system, using an 800/888 number that receives all your calls, faxes, pages and e-mail. The system provides a contact database facilitating the placing of calls, screening of calls, and tracking you down wherever you are.

[0049] Regardless of how the message was transmitted, every message is delivered to you through a single source, whether telephone, internet or computer. You can also review your latest call records and billing information and change or add to your phone listings, contact numbers and service preferences through this source.

[0050] The present invention utilizes a fault resilient redundant system, residing in two separate sites. There are multiple T-3 (45 Mbps) facilities going into each of those sites. Both sites sit on a fiber-channel fiber optic loop, which is theoretically “self healing” in case of a disaster and can route a phone call to either site, depending on where the route is broken.

[0051] The configuration at each site is a cluster of servers. FIG. 1 is a block diagram of the hardware platform showing one of these clusters 10 which consists of some voice servers 12, some mirrored Sybase database servers 14, and some web servers 16 where the web access and services are located. The computers (not shown) are 200 MHz Intel-based 19″ rackmount servers running a combination of Solaris and SCO UNIX operating systems. The voice server 12 includes certain functions, such as telephony, automatic speech recognition, text-to-speech, conferencing, etc. Subscribers are connected to these clusters by either normal telephone connections or by internet connections.

[0052] Each cluster can serve about 10,000 customers. The system is open-ended allowing for the addition of subscribers as needed. Further the design facilitates the easy addition of hardware and software.

[0053] FIG. 2 shows a block diagram of the internet platform. The system may be accessed via the internet instead of a normal telephone connection (voice or touchtone). The subscriber can access the web server 16 through an internet firewall 20. The subscriber merely enters the system's web site and then can access his account through a security program. Once in his account, the subscriber can access various features such as playing voice mail, reading e-mail and faxes, managing contacts and schedules, among other services. Further, the system can provide a private line 22 for corporate and other subscribers which can enter the web server 18 through an extranet firewall 24.

[0054] FIG. 3 shows a general application flow chart for an incoming call 26 to the system. The incoming call 26 whether by telephone connection or internet connection is directed either to customer service 28 (through an automatic call distribution-ACD), fax 30, call routing 32, or conference 34 function. Call routing 32 is determined by the incoming call control 38, previously set by the subscriber, and can include a message and notification to the subscriber, call screening, call waiting, and the transfer of the call. Further, if the incoming call 26 is a subscriber 36, the system will provide additional functions to the subscriber, such as controlling incoming calls 38, including call screening, call waiting and transferring calls. The subscriber may set priorities to certain callers allowing only certain callers to reach the subscriber while all others are sent to voice-mail to record a message for playback later.

[0055] Also, the subscriber will be able to manage 40 his account. Managing 40 includes setting the options for telephone calls 42, setting the options for sending and receiving messages, faxes and e-mail 44, managing the database containing the subscriber's contacts and other lists 46, and setting the parameters for outgoing call and setting up conferences 48.

[0056] FIGS. 4A through 4R show a more detailed flowchart of the present invention. FIG. 4A shows the First Menu encountered by a subscriber or an individual calling the system's 800 telephone number. The caller is explained the different options and then the system, if requested, attempts to recognize the subscriber or party's name or extension that the caller is trying to reach.

[0057] FIG. 4B shows the Party Menu which allows the caller to begin the transfer to the party he is trying to reach, leave a message, or, if the caller is a subscriber, open his mailbox. FIG. 4C shows the Mailbox Menu which allows the subscriber to listen to his messages, leave a message, make a call (using the database), dial a telephone number, request the system to follow the subscriber, transfer calls, and set other personal options, including the greeting, security codes, etc.

[0058] FIG. 4D shows the Listen to Messages Menu which allows the subscriber to listen to, forward, or return the message, along with other options such as adding a contact, etc. FIG. 4E shows the Message Menu such as forwarding the message, providing caller identification information, and updating the contact database.

[0059] FIG. 4F shows the Return a Call Menu which-will attempt to use caller identification to return the call. FIG. 4G shows the Leave a Message Menu which allows the caller to leave a message to the intended party. FIG. 4H shows the After Record Message Menu which allows the caller to listen to the message, re-record the message, send the message, or cancel the message. FIG. 4I shows the Make Call Menu which allows the subscriber to dial a number, cancel, or attempt to obtain a contact and transfer to that contact.

[0060] FIG. 4J shows the Dial a Number Menu which allows the subscriber to dial a telephone number. FIG. 4K is the Call Transfers Menu which allows the subscriber to transfer incoming calls to either his caller identification, a telephone number, or some other number of choice. FIG. 4L is the Follow Me Menu which allows the subscriber to receive calls wherever he may be located. FIG. 4M shows the Notification Menu which allows the subscriber to be notified either by pager or e-mail in certain situations. FIG. 4N shows the Telephone Numbers Menu which allows the subscriber to dial a telephone number either by depressing the telephone keypad or speaking the number.

[0061] FIG. 4O shows the Record a New Greeting Menu which allows the subscriber to record, listen, or re-record a greeting which a caller will hear upon reaching the subscriber. FIG. 4P shows the Name Recording Menu which allows the subscriber to set a particular name in the system. FIG. 4Q shows the Personal Options Menu which allows the subscriber to change the security code, the name recording, and the personal greeting. FIG. 4R shows the Set Security Code Menu which allows the subscriber to set a new security code.

[0062] FIG. 5A shows the computer telephony platform in accordance with FIG. 1 in more detail. FIG. 5B shows the network architecture in accordance with FIG. 2 in more detail. FIG. 6 shows the software architecture utilized in the present invention.

[0063] FIGS. 5A and 5B depict how the unified network system can be used to transmit an receive messages between subscribers and other callers using both telephone connections and internet connections. Turning to FIG. 5A, telephone 500 is a subscriber communication device through which a subscriber can access the unified network system 502. The subscriber can access the unified network system 502 using the telephone 500 via a first telephone connection 504. This telephone connection 504 uses the Public Switched Telephone Network (PSTN) to access one of the redundant sites of the unified network system 502. Additional callers may also access the unified network system 502 in a similar manner. These additional callers may be other subscribers or non-subscribers. The caller may use telephone 506 in FIG. 5A in an attempt to contact a subscriber. The caller would be connected to the unified network system over a second telephone connection 508 using the PSTN.

[0064] Users of the unified network system 502 can also transmit and receive messages via internet connections. FIG. 5B depicts how the unified network system 502 can be connected to the Internet 600. In the embodiment depicted in FIG. 5B, several T1 communication lines 602 are coupled with routers 604 to provide a plurality of internet connections between the system 502 and subscribers and non-subscribers. These users are able to connect to the unified network system 502 via a connection between a data device, such as personal computer, and the Internet 600. Through T1 lines 602 and routers 604, user can then access the unified network system 502 to transmit and receive messages to other users. FIG. 2 also depicts how the internet browser 21 of a customer's computer is connected via an internet connection 23 to the web servers 16 which are a part of the unified network system 502.

[0065] Because the unified network system 502 of the present invention includes both telephone connections and internet connections, messages, including telephone calls, can be transmitted to or from subscribers of the system 502 using both connection types. In an embodiment of the present invention, a caller wishing to contact a subscriber may access the system 502 using either telephone connection 508 or an internet connection 23 (FIG. 2) established using a portion of one of the T1 lines 602 (FIG. 5B). Once the caller establishes a connection with the system 502, the system 502 presents the caller with the “First Menu” options outlined in FIG. 4A. One option presented to the caller is to speak the name of a subscriber that the caller is attempting to reach. If the system 502 recognizes the spoken name, control is then transferred to the “Party Menu” shown in FIG. 4B. At this point, the caller may choose to contact the party by speaking “reach my party” or the caller my choose to simply leave a message by speaking “leave a message.” If the caller wishes to speak with the subscriber, the caller chooses the option “reach my party” and the system 502 will establish a connection with the subscriber using either the telephone connection 504 or an internet connection 23 (FIG. 2) (established using a portion of one of the T1 lines 602 (FIG. 5B)) according to the call routing instructions set up by the subscriber.

[0066] Alternatively, the caller may choose to simply “leave a message” for the subscriber. In this case, the caller is prompted to record a message as outline in FIG. 4G. After the message is recorded, the caller is presented with the options to listen to the message, send the message, cancel the message, or re-record the message as outlined in the “After Record Message Menu” depicted in FIG. 4H. Once the caller selects the option to “send the message”, the message is delivered to the subscriber using either the telephone connection 504 or an internet connection 23 (FIG. 2) (established using a portion of one of the T1 lines 602 (FIG. 5B)) according to the notification settings set up by the subscriber (see, e.g., FIG. 4M).

[0067] The subscriber can also initiate the transmission of messages, including telephone calls to other subscribers or non-subscribers. As discussed above, the subscriber accesses the system 502 using either a telephone connection 504 or an internet connection 23 (FIG. 2). Once connected with the system 502, a subscriber can perform several functions. For example, a subscriber can choose to make calls to other users via the “Make a Call Menu” depicted in FIG. 4I. The system 504 would then establish a connection with another user using either the telephone connection 508 or via an internet connection internet connection 23 (FIG. 2) established using a portion of one of the T1 lines 602 (FIG. 5B).

[0068] The system provides three ways for the subscriber to handle his communications. First and foremost is the voice recognition software using natural voice recognition (phonemes based), not pattern based as many of the current systems utilize. Therefore, the system does not have to be trained to identify your voice. Second, the subscriber may use the standard telephone touchtones. And third, the subscriber can utilize the internet to access a secure web site.

[0069] The system can act as a “follow me” service, capable of tracking you down whether you're at home, the office, airport, in a hotel room, in another office or in your car. The subscriber can configure the system to follow him, or the subscriber can disengage the follow me with a simple command. It also lets you know who is calling before you accept the call.

[0070] As for Web connections, you can boot up your computer, sign onto the internet, go through the system's secure web site and play your voice mails, read your e-mail and faxes, manage your contacts and schedule conferences. The website thus becomes a unified-messaging system. If you get a message from somebody who's not in your address book and you want to call him or her, you just go to the web site again and add a contact.

[0071] If you're on the secure website and you walk away, the system even times out after a few minutes so no one can sit at your computer and obtain your messages and contacts without your permission.

[0072] While on the system's web site, you'll be communicating over the internet via the Secure Socket Layer (SSL), a transport level technology (developed by Netscape) for authentication and data encryption between a Web server and a Web browser. SSL sends data over a “socket,” a secure channel at the connection layer existing in most TCP/IP applications.

[0073] The system also utilizes text-to-speech so you can listen to your e-mail over the phone, or the subscriber can display his e-mail on his computer where he can reply to it and send e-mail to his contacts with audio (using audio attachments). Further, using Vosaic's internet audio program, the system can deliver voice mail via streaming audio over the internet using Java without a plug-in.

[0074] During a session on the web site, using text-to-speech, you could type in a name like “Harry Newton” and his phone number so that, when you eventually use the system the phone and you say, “call Harry Newton at the office,” the system will recognize the name and dial the number you keyed in previously. Based on what you input now (“Harry Newton”) is what the system utters later and compares the phonemes of what you input now to what you'll be speaking later.

[0075] The system also facilitates conference calls by allowing the subscriber two ways in which to set up a conference call. First, inbound conference calls can be set up for 32 people if you've registered a pre-scheduled meeting time. Subscribers call in to the system to get an assigned conference number. The conference participants then call in and asks to “join the conference”. The system then asks for a conference number, which is entered via touchtones. All the parties are then connected and the conference begins.

[0076] Second, outbound conference calls can also be set up, even if you're “on the fly.” Whether you're at your desk, at a hotel or even a phone booth, you can simply dial up and tell the system to “set up a conference call.” Then you only have to dial up all the various parties to connect each of them to your conference.

[0077] The present invention is a compilation of hardware and software, including voice processing using Dialogic's SCSA extended bus and board-level resources, Purespeech speech recognition running on Dialogic Antares boards, and database management using Sybase System 10 and 11. Further, the system utilizes data networking, particularly TCP/IP and distributed systems, object-oriented design and programming, multi-processing with Intel hardware, SCO UNIX and Solaris operation systems, Java and JavaScript languages, U.S. and international long distance protocols, internet and web protocols, credit and payment processing, a help desk, customer service system, and network and service management.

[0078] For the voice and fax processing servers, the system relies on Dialogic hardware, including, voice boards, Antares cards (for speech recognition and fax) and digital switching cards. The system also uses the SCSA extended bus. The Purespeech ASR algorithms, which are used for speech recognition, run on the Antares cards plugged into the computers running the Solaris OS.

[0079] The system combines state-of-the-art speech recognition, computer and telephony technology. Along with the ability to recognize an extensive set of simple, intuitive, speaker-independent speech commands and respond by performing a wide variety of complex tasks. Each subscriber has their own secure Web page on which all the features can be accessed, allowing almost every aspect of the present invention to be maintained on-line. Subscribers can use voice commands to (1) build, edit and manage their contact lists, (ii) review, play back, read, reply to and/or reroute voice mail and e-mail, (iii) schedule conference calls with 800 number access, and (iv) maintain an itemized calling log listing all calls with a running total of all charges.

[0080] The system also transfers calls as instructed or upon command will follow the subscriber according to predetermined contact numbers for office, home, cellular, pager or other designated locations. Every time a subscriber calls in, the system logs the originating number for the inbound call and then uses that number to re-contact the subscriber.

[0081] In accordance with the present invention, every subscriber or participant is given their own 800 number that is then used by all contacts calling in to the subscriber. The 800 number can also be used in scheduling conference calls for up to 32 participants on a given day and time. Each participant uses the 800 number and calls in to join the conference call, thereby effecting call conferencing for a fraction of the cost otherwise incurred.

[0082] Basically, the system provides a unified solution to the many varied communications and messaging devices used daily by mobile professionals and active consumers. With simple voice commands, subscribers can easily access and respond to all of their communications and messaging media in the same session.

[0083] The system takes inbound calls and contacts the subscriber, using call transfer or follow me features, and advises the subscriber of the call, the number of the calling party and/or the callers identity from the subscribers contact list. If the subscriber is on the telephone, the system will whisper the pending call information, giving the subscriber the option of taking the call or sending the caller into voice mail. The subscriber can also set priorities for certain calls which the system will follow, permitting selected calls to be put on call waiting, transferred or directed through call forwarding, while other calls are direct to voice mail messaging. Subscribers can conveniently make calls from their contact list by voice commands giving the contacts name and, if applicable, the location to be called (i.e. “home,” “office,” “cellular,” etc.)

[0084] Subscribers can access and play back their voice mail from any telephone or from their personal Web page. Voice mail messages can be saved, retrieved, deleted or rerouted to other individuals, groups or broadcast and voice responses can be returned immediately to the caller. Also, e-mail messages can be viewed on the subscriber's personal home page or the system will read the e-mail to the subscriber from any telephone using text-to-speech technology. Subscribers can immediately respond to e-mail with voice messages, marking, saving or deleting messages during the same session. E-mail messages can also be sent to any fax machine. Further, subscribers can immediately respond to faxes rather than waiting to retrieve copies and delay responses. Incoming faxes are received, the subscriber is notified of the arrival of the new fax, the fax can then be stored for later viewing and/or redirected to any fax machine or e-mail address from the subscribers contact list or any other number. Subscribers can also be notified of any incoming communications and messages by pager, whether an inbound call, voice mail, e-mail or fax.

[0085] The system will automate conference calling and eliminate the need for conference call operators or complex, confusing PBX systems. The subscriber remains in control and can add or drop callers, mute the call and otherwise control all aspects of the conference call. By pre-scheduling conference calls by date and time, subscribers can notify participants, giving them an 800 number to call and join the conference. Up to 32 participants can be included in the present conference call feature.

[0086] The system further acts as an efficient secretary retaining complete contact logs of all call statistics. The subscriber maintains the contact list using simple voice or keyboard commands and can establish contact groups for broadcast communications and setting up conference calls. The contact database is easily accessible to all features.

[0087] The system includes a feature which enables subscribers to retrieve on demand or at predetermined intervals selected information from the internet or on-line service providers, allowing subscribers to establish “filter and forward” criteria specifying the type of information desired. A search engine will then retrieve the requested information, transmit the information to the system platform and notify the subscriber by page, telephone or other desired means. The system will provide direct access to news, weather, sports, financial, travel and other custom content directly from a computer or any telephone. The subscriber will then access the information by all available options, including text-to-speech capabilities.

[0088] The system provides long distance and international calling over the internet through the subscriber's personal home page, thereby significantly reducing the costs of long distance and international calling. The system further provides video conferencing features.

[0089] It is to be understood that the form of this invention is merely a preferred embodiment. Various changes may be made in the function and arrangement of parts; equivalent means may be substituted for those illustrated and described; and certain features may be used independently from others without departing from the spirit and scope of the invention as defined in the following claims.