Filter for modeling system and method for handling and routing of text-based asynchronous communications

[0002] This invention pertains to the arts of automatic analysis, classification, characterization and routing of text-based messages in electronic messaging systems. The text message filtering and modeling system and method disclosed is especially suitable for use in analyzing, classifying, routing, and directing large volumes of electronic messages with a wide variety of content, authorship, and intent directed generally at a single, large recipient such as a corporation.

[0003] Not applicable.

[0004] This invention was not developed in conjunction with any Federally-sponsored contract.

[0005] Not applicable.

[0006] Electronic mail and facsimile (“fax”) messaging have become critical tools of everyday personal and business life. Most corporations, government agencies, organizations, and institutions have established fax numbers and e-mail addresses for a wide variety of contact purposes, including requesting information such as literature and office locations from the entity, requesting investment information, requesting service on or technical support for a product, reporting a product problem or failure, submitting suggestions for products and service improvements, submitting complimentary comments, and in some cases, carrying on dialogues with personalities and celebrities associated with the entity. Fax and e-mail messaging have converged in electronic form, as messages originating in the form of fax are commonly captured by computers with fax/modem interfaces and optically converted to text files, and as many services offer low cost fax message delivery via e-mail-based interfaces.

[0007] Underlying the tremendous proliferation of fax and e-mail are several factors, including wide-spread availability of inexpensive e-mail clients such as personal computers, and inexpensive fax machines, and the development of common standards for exchange of electronic text messages between computers, including RFC821 Simple Mail Transfer Protocol (“SMTP”) from the Internet Network Information Center, and Recommendation X.400 from the International Telecommunications Union (“ITU”).

[0008] Consequently, corporations, government agencies, and other entities which successfully promote the availability of their fax telephone numbers and e-mail addresses can receive thousands to tens-of-thousands of messages per day. Traditionally, all of the messages are received in a general repository, or “mailbox”, and reviewed by human agents for their content, intent, and determination of the correct disposition of the e-mail is made. This may involve sending the author a standard reply, and/or copying or fowarding the e-mail to one or more divisions, departments, or individuals within the organization for further handling. In the later case where multiple parties must be consulted, the consolidation of replies from all of the parties can be cumbersome and overwhelming, given the volume of messages to be handled. For example, assuming a company receives five thousand messages per day, and if each one of those messages contains issues or requests that involve an average of 3 departments or individuals to respond, the original message must be read once by the reviewing agent and the receiving departments may read the forwarded message one to three times per department before it reaches the person who can respond. Under such circumstances, 5,000 received e-mails may result in up to 20,000 to 50,000 reviews of those messages in the company. In many cases, the final recipient may need to instigate a short dialogue including several message exchanges with the author in order to ascertain exactly what the author needs or how the author can be serviced. So, a daily volume of 5,000 new messages quickly accumulates to a total network volume and work load of tens-of-thousands to even a hundred-thousand messages per day.

[0009] Analogous situations exist in the telephone call center and paper mail paradigms. For example, a single toll-free telephone number may be used for customer orders, information requests, service reports, etc. In this paradigm, systems for handling large call volumes, known as Automated Call Distributors, have been developed to sort and route telephone calls to human agents. Systems known as “Interactive Voice Response” have been developed to allow many of the calls to be handled entirely automatically by providing bank-by-phone, tele-reservations, and other well-known telephone-based services. In the paper mail paradigm, automated sorting and routing systems have been developed using barcode markings and optical recognition of handwriting.

[0010] The following publications and standards provide additional information into the background of the arts of e-mail routing, natural language processing, and pattern recognition:

[0011] 1. Internet Network Information Center (“InterNIC”) Request for Comment 821, “Simple Mail Transfer Protocol” (SMTP), Filename RFC821.TXT from http://www.internic.net.

[0012] 2. International Telecommunciations Union (“ITU”) Recommendation X.400, available from the ITU, Berne, Switzerland, and from the ITU's website at www.itu.org.

[0013] 3. “Fuzzy and Neural Approaches in Engineering” by Lofteri H. Tsoukalas and Robert E. Uhrig, published by John Wiley and Sons, Inc., copyright 1997, ISBN number 0-47116-003-2.

[0014] 4. “Pattern Recognition and Image Analysis” by Earl Gose, Richard Johnsonbaugh, and Steve Jost, published by Prentice Hall, copyright 1996, ISBN number 0-13-23645-8.

[0015] 5. “Natural Language and Exploration of an Information Space: The ALFresco Interactive System”, a white paper by Olivero Stock, appearing starting on page 421 of the book “Readings in Intelligent User Interfaces”, edited by Mark T. Maybury and Wolfgang Wahlster, published by Morgan Kaufman Publishers, Inc., copyright 1998, ISBN number 1-55860-444-8.

[0016] 6. U.S. Pat. No. 5,768,505 to Gilchrist, et al.

[0017] 7. U.S. Pat. No. 5,859,636 to Pandit.

[0018] In the electronic messaging arts, United States patents have been issued for systems which route messages based on well-defined codes stored within the message, including the recipient's network address and a copy list of network addresses. There exist methodologies that are well-known which individually yield useful information and characterizations of written messages, including use of neural network, fuzzy logic, and statistical analysis techniques. However, there is an absence in the art of automatic systems which perform intelligent routing of messages which are addressed to a multipurpose network address, which employ these analysis and characterization techniques coupled with message routing technology.

[0019] Therefore, there exists a need in the art for an automated system and method to review large volumes of text messages for their content, intent, need, and purpose in order to expedite the time-to-response to the messages.

[0020] Further, there exists a need in the art for this automated system to use conventional technology and techniques which find practical application to the analysis of natural language written speech.

[0021] Additionally, there exists a need in the art for this system to provide for initial training of the rules and thresholds used in the analysis of the messages, and for the training, or “leaning”, of the algorithms to continue over time based on user input and changes to initial analysis conclusions, such that the utility of the system grows as it learns how to filter messages.

[0022] Still further, there exists a need for this system to be implemented using an architecture which allows the addition, removal, and upgrade of the methodologies in order to tune the system to particular applications of the system and to update the system's performance as new technologies become available.

[0023] For a more complete understanding of the invention, the following disclosure can be taken in conjunction with the presented figures.

[0024] FIG. 1 shows a high-level system view of the invention, and

[0025] FIG. 2 shows a detailed view of the method employed by the system.

[0026] An object of the invention disclosed herein is to provide an automated system for reviewing, characterizing, and classifying asynchronous text messages. A further object of this invention is to employ multiple analysis methodologies and techniques which are well known within the art to provide an economical and practical solution. Still another object of the invention is to allow a user to review the initial characterization and classification of individual messages through a user interface, to correct or modify the characterization and classification, and to input those changes to a learning network of analysis methodologies. A final object of the invention is to provide an architecture which is modular in construction, allowing new analysis techniques to be installed, and existing techniques to be removed or updated. The invention as disclosed finds practical use in large-volume e-mail and text-based message handling and routing systems.

[0027] The system and method disclosed herein provides for the automated and adaptive analysis and classification of text-based messages which may original as facsimile, email, Internet e-commerce, or website CGI forms. Generally, corporate websites have a “single point of contact” e-mail address or fax number for contacting the company, regardless of the intent, content, or nature of the message. A single e-mail address may receive customer service requests, new product literature, customer complaints, change of service request, investor information, sales quotes, etc. The message filtering and modeling system presented provides for the characterization of each message based on the author's attitude, issue or problem addressed, information or action requested, and the type and profile of the author including his or her educational level and personal interests.

[0028] The system and method yields tagged e-mails, in which the tags contain the relative scores or rankings of these properties, and further ranks each message within a general property category to sub-properties. The tagged e-mails can then be routed for review by one or more appropriate corporate divisions, departments, or individuals, or a reply could be automatically generated.

[0029] The following disclosure, when taken in conjunction with the presented figures, sets forth the invention which meets the objects of the invention set forth in the.

[0030] Turning to FIG. 1, the text message filtering and modeling system receives text messages (3), preferably in the form of Simple Mail Transfer Protocol (“SMTP”) e-mail messages. The SMTP standard, RFC821, defines a method to transfer electronic messages between networked computers. An SMTP e-mail message is a text message comprised of a header and a body. The header includes deterministic factors regarding the author's name, the author's return e-mail address, the intended recipient's e-mail address, such as the time of the e-mail transmission, his or her return e-mail address, a priority flag, a confidentiality flag, a copied recipients list, and a subject field. E-mails commonly contain a signature block of text, which may include the recipient's company, title, telephone and fax number. The signature block typically follows the header and the body in the message.

[0031] Another standard for transferring messages has been developed by the International Telecommunications Union (“ITU”), X.400, and is also well-known in the art. The use of SMTP is the preferred embodiment of the system, whereas SMTP is much more commonly used and less complex than the X.400 protocol. However, X.400 would provide a functional equivalent for an alternate embodiment. In fact, the invention disclosed herein is useful for filtering any text message in electronic form, such as letters, fax messages, and survey response cards which have been scanned and subjected to optical character recognition.

[0032] The body of the message, which contains the free-form, natural language message from the author, is analyzed by a filter and modeler (5). The filter and modeler (5) comprises a standard e-mail server hardware platform well-known within the art, including a computer, such as an IBM-compatible personal computer, and operating system, such as Microsoft Windows NT. The input means (4) is a 100 BaseT Ethernet interface, preferably. The filter and modeler (5) further comprises persistent data storage, such as a hard disk drive, a communications protocol stack, such as TCP/IP with secure sockets, and an application program which performs the method described infra and illustrated in FIG. 2.

[0033] The actual physical message input means can be any of many well-known methods, including an Ethernet or other Local Area Network interface (“LAN NIC”), using any appropriate data communications protocol such as Transfer Control Protocol/Internet Protocol (“TCP/IP”). Alternatively, a shared database, preferably with an open interface such as ODBC, or simple computer disk files can also be employed as the input means.

[0034] The tagged and characterized e-mail messages (7) are then output by the filter and modeler via a number of common data transfer means (6), including all of the means listed for receiving the message input described previously.

[0035] Turning to FIG. 2, details of the filter and modeler (5) process are set forth. The inventive combination of processes includes the steps of first performing feature extraction (21) using one or more known feature extraction methodologies, outputting one or more signals (22) to a clustering process (23) which employs one or more known clustering techniques, and then allowing for an optional human review of the assigned properties (24) to be input and “learned” by the network such that the knowledge base is improved.

[0036] As shown in FIG. 2, a received SMTP e-mail message (20) is first subjected to one or more feature extraction methods (21). The feature extraction methods can be any one or multiple methods of pattern recognition well known within the art, and in the preferred embodiment, minimally includes keyword analysis, morphology, natural language processing, thesauri, co-occurrence statistics, syllabic analysis and word analysis. The keyword analysis provides a measure of how often particular words are used in sentences, paragraphs and pages. The thesauri can be used to dimensionally reduce the output of the various characterization methods. Co-occurrence statistics indicate how often certain words appear near each other in the text. Syllabic analysis and word analysis yield an estimate of the education level of the author and his or her profile, such as his or her interests, hobbies, and socioeconomic status. The feature extractor outputs seven signals:

[0037] (a) keyword frequencies;

[0038] (b) co-occurrence statistics;

[0039] (c) a dimensionally-reduced representation of the keyword frequencies;

[0040] (d) phoneme frequencies;

[0041] (e) structural pattern statistics for sentences, paragraphs, and pages;

[0042] (f) estimated education level of the author based on word choices and complexity of sentence structure; and

[0043] (g) the customer type.

[0044] The structure of the feature extractor is preferably implemented using modular and object-oriented software design techniques, which allows the addition of new analysis methods, removal of others, and updating of existing methods in a modular fashion. As new methods and algorithms become available, they can be incorporated or substituted into the feature extractor. The algorithms themselves are well-known within the art.

[0045] The seven output signals (22) from the feature extractor (21) are received by a clustering process (23), which includes one or more commonly known clustering algorithms such as k-means algorithms, isodata techniques, simple learning algorithms such as small backpropagation algorithms, and auto-indexing methods. The first of the five properties assigned to the e-mail message is “attitude”. The tone of the e-mail message is ascertained by the choice of words and frequency of those words used in the message. An attitude property may be positive, neutral, or negative. The second of the five properties assigned to the message is “issue or problem”. One or more central themes are detected in the message, such as a problem being reported with a product. The third property assigned to the message is “request”, such as a request for information, e.g. an annual report, or request for consideration for employment. The fourth property assigned to the message is “customer type”, which indicates demographic information about the author of the message, such as the author is an avid collector of the product or an environmental activist. The fifth property assigned to the e-mail is the author's apparent educational level, based on syllabic and word analysis.

[0046] The five properties (24) generated by the clustering process (23) are then received by a learning process (25), which performs query by relevance ranking and query by example (“QBE”), both of which are well known in the art. A user interface (“UI”) allows a human operator to optionally review an e-mail and its assigned properties, change some or all of the properties, and submit it to the learning process (25) which then updates (26) the rules and thresholds used in the feature extractor and the clustering process. This human review and correction may be necessary as language used in a message changes meaning over time, such as the case with slang expressions. For example, when the feature extractor is originally configured, calling a product a “real bomb” may mean that it is a failure or a bad product, and therefore may generate a negative attitude property. However, in time, slang language may begin to use the term “bomb” as a good term, and the human operator review will update this as it occurs.

[0047] As the process is updated and the learning continues, the automated classification and assignment of properties of the messages improves. The output properties of the messages can then be used in consideration with other deterministic factors of the message, such as the subject field, to enable auto-responses, one-to-many routing by company division, department, and individual. Further, useful management statistics may be derived from the accumulated properties over time.

[0048] It will be understood by those in the art that many changes and modifications to the invention as set forth herein can be taken without departing from the spirit and scope of the invention, such as the use of a non-IBM computer, an alternative operating system, or the receipt of non-SMTP and non-email text messages. The techniques, process, and system disclosed are equally useful on a wide variety of computers, operating systems, and text-based message formats, such as using the system to categorize written comment cards which have been scanned and converted to text using optical character recognition techniques, or analyzing paper letters which have been likewise scanned and converted to text. Further, the platform on which the inventive process is executed can alternatively be any suitable computer system running an operating system, such as a Sun Microsystems workstation running Solaris or a Digital Equipment Corporation Alpha system running UNIX.