US 7,526,731 B2Grant
Method for integrating user models to interface design
Issue Date:2009-04-28
•20 Claims
•3 Drawing Sheets
Abstract
A method that incorporates a detailed, precise procedure of designing a user interface by utilizing agent behavioral models. This method applies quantitative and qualitative agent behavioral models derived through the Categorize Describe-Model (CDM) methodology to the iterative design stage of interface development. The method includes: (1) categorizing at least two users; (2) validating targeted user behaviors and preferences; (3) capturing emergent behaviors and preferences; (4) tracking design requirements and implementations; (5) accommodating diversity in performance and preference during interactive testing; and (6) customizing a user interface design to each of the at least two users.
Metadata
Assignee
- AT&T Labs, Inc.
Inventors
- Robert R. Bushey
- Thomas Deelman
- Jennifer M. Mauney
Application Information
Application Number:US 11/448,049
Filing Date:2006-06-07
Priority Date:1999-05-27
Art Unit:2179
Classifications
IPC:
G06F3/00G06F3/14
Patent Drawings (3 sheets)
Description
Cross-Reference to Related Applications
[0001] This is a continuation application of U.S. patent application Ser. No. 09/578,904, filed May 26, 2000, now U.S. Pat. No. 7,086,007 which claims the benefit of U.S. Provisional Application No. 60/136,406, filed May 27, 1999, the disclosures of which are herein expressly incorporated by reference in their entireties.
[0002] The present invention also relates to a method described in commonly-assigned co-pending U.S. patent application Ser. No. 09/089,403, “A Method for Categorizing, Describing, and Modeling Types of Systems Users”, filed Jun. 3, 1998, to R. Bushey et al., and to a method described in commonly-assigned and co-pending U.S. patent application Ser. No. 09/303,622, “Methods for Intelligent Routing of Customer Requests Using Customer and Agent Models”, filed May 3, 1999, to R. Bushey et al., the subject matter of both of which is expressly incorporated by reference herein.
Background of the Invention
[0003] 1. Field of the Invention
[0004] The present invention relates to the field of user interface design and analysis of human factors which are considered pertinent during the development stages of the user interface. In particular, this invention considers human factors, through behavioral modeling methods, and then incorporates such factors into the iterative design stage of interface development.
[0005] 2. Description of Background Information
[0006] The traditional view of user performance during interface design and testing is that variability in responses, preferences, and behavior reflects poor design. The common knowledge and practice in the industry is to represent the user population as having a single set of characteristics and behaviors. In current practice, this single set of characteristics and behaviors focuses on only one of three types: expert, novice, or composite. One group is represented to the exclusion of other groups' needs. This is a particularly inappropriate method of designing in that there is a substantial risk that very few users will be best accommodated by the interface. Subsequently, an interface is designed in such a way that variability would be reduced. As a consequence, the diversity of the user population is neglected and users' unique needs and preferences are effectively ignored.
[0007] The common knowledge and practice in the industry is twofold. First, it is common practice to take a single view of a user population, and second, to subsequently design system interfaces based on this view. For example, a system interface may be designed to accommodate the behavior of an expert user (e.g., customer service and sales representatives). Alternatively, interfaces can be designed to accommodate a novice user (e.g., interfaces used in automated teller machines for use by the general public). Thus, the current practice represents the user population with a single set of characteristics and behaviors. If users or agents are categorized in any way, they are done so in an informal manner, based primarily on the opinion and judgement of local operating management and not based on formal qualitative and quantitative models, statistical data, or similar objective empirical measures.
[0008] Since it is common practice to take a singular view of the user population, the interface is designed and tested to reflect average or prototypical end user performance. For instance, during usability testing it is typical to deem a workflow task or design implementation a failure if 5 of 10 users successfully perform the task or function even though the interface was designed superbly for 5 of the users. Similarly, a design implementation is commonly deemed acceptable it 10 of 10 users performed adequately even though a closer examination may reveal that the majority of users reflected outstanding performance while the remaining subset could not display the required behavior. In both of these examples, the variability or diversity in performance is not considered during design or testing. Distinctive behaviors that may be desirable are not tracked, captured, or accommodated since the emphasis has commonly focused on accommodating average behavior. The testing and design phase of interface development does not capitalize upon, or accommodate, variability in performance primarily because management and systems engineers typically accept the singular view of one user-representation.
[0009] Capturing the behavioral diversity of the user population is the first of two necessary steps toward the design and deployment of systems and processes that accommodate the specific needs of the user (agent) and facilitate business goals. The second necessary step is systematically integrating the agent models to the design and engineering of user interfaces.
[0010] Traditionally, the diversity of a user population has not been taken into account during the iterative design stage of interface development. Rather, a system is typically designed with the simplistic view of the “average” or prototypical user in mind. This approach does not accommodate the entire range of behaviors and characteristics of the user population. This single-view may hinder performance of a large proportion of users, given that their specific needs are not accommodated and management and systems interface engineers are unable to capitalize on the unique behavioral qualities that could facilitate performance and achieve business goals.
[0011] A solution to this approach is to consider the range of behavioral characteristics of the entire user population during the design phase of interface development. This broad range of behavior is ideally captured through use of behavioral models Once the user population is categorized into a reasonable number of groups, the resultant qualitative and quantitative models can be integrated into system design and testing.
[0012] Prior art which discloses behavioral models are U.S. patent application Ser. No. 09/089,403, filed on Jun. 3, 1998, entitled “A Method for Categorizing, Describing, and Modeling Types of Systems Users” and provisional U.S. patent application No. 60/097,174, filed on Aug. 20, 1998, entitled “A Method for Intelligent Call Routing Utilizing a Performance Optimizing Calculation Integrating Customer and Agent Behavioral Models”.
[0013] The Categorize Describe-Model (CDM) methodology, disclosed in U.S. patent application Ser. No. 09/089,403, is a technique used to categorize a diverse user population into a reasonable number of groups that share similar characteristics. The behaviors of users within these groups are then objectively described and subsequently quantitatively and qualitatively modeled. At any point in this process, the grouping characteristics may be validated and revised based on the data collected and modifications of bottom-line business goals. The end result of the CDM method is that a highly diverse user population is divided into a small number of behaviorally distinctive groups (e.g., 3-5 user-groups). The members of each group share similar characteristics and behaviors. In effect, by using the CDM methodology, the entire range of behavioral diversity of a user population can be captured and accommodated.
Brief Description of the Drawings
[0014] FIG. 1 illustrates a flow diagram of the interface customization selections entered on a user-profile screen, according to an aspect of the present invention.
[0015] FIG. 2 illustrates a flow diagram of the VaCTAC method of applying user models to interface design, according to an aspect of the present invention.
Detailed Description of the Invention
[0016] An objective of the disclosed invention is to establish a method that systematically and thoroughly applies user models derived through the CDM method to the design and testing phase of interface development. Rather than assuming a single set of behaviors or characteristics that represents the user population, the CDM method categorizes the user population into a small number of behaviorally distinctive groups. The present invention then extends this process and applies it directly to interface design.
[0017] This unique approach to usability testing and systems design ensures that the range of needs and preferences of the entire user population (e.g., each group derived through the CDM method) is considered. Customizing usability testing for each user group and allowing for flexibility in performance, not simply considering “average” behavior, allows for an improved understanding of the users and improved interface design leading to improved performance.
[0018] In contrast to the traditional approach, applying the CDM method to interface design involves accommodating variability in performance, and capitalizing on the diversity within the user population. Application of the CDM method to design and testing involves tracking design requirements and implementations on micro and macro levels, documenting pre-determined user characteristics, capturing new user characteristics that emerge, accommodating diversity in performance and preference during testing, and customizing system display and navigation. This process ultimately facilitates the maintenance of user models to expedite future enhancements and business decisions.
[0019] The final objective and end-result is that customer/agent negotiations and call center operations are improved because the negotiation system interface is engineered to accommodate usability needs of the entire user population, targeted behaviors, and preferences that facilitate meeting business objectives.
[0020] According to an aspect of the present invention, a method for designing a customized user interface is provided that categorizes a user population into groups using qualitative and quantitative models, and applies the models into interface design, interactive testing, and system deployment. The step of categorizing a user population into groups using qualitative and quantitative models may be based upon Categorize-Describe-Model (CDM) methodology.
[0021] According to a further aspect of the present invention a method for designing a customized user interface is provided that includes categorizing at least two users, validating targeted user behaviors and preferences, capturing emergent behaviors and preferences, tracking design requirements and implementations, accommodating diversity in performance and preference during interactive testing, and customizing a user interface design to each of the at least two users.
[0022] Further aspects of the present invention include incorporating the user interface into the following hardware systems: a graphical user interface (GUI) of a sales and billing negotiation system; a telephone system, graphical user interface (GUI) provided on the Internet; a interactive graphic user interface (GUI) system; an automated teller machine; a computer operating system; or a television programming interface.
[0023] In another aspect of the present invention, a method for designing a customized user interface is presented that includes categorizing a user population into distinctive groups in which the users' behaviors are described, modeling the categorized user population using Categorize-Describe-Model (CDM) methodology, documenting and validating pre-determined user characteristics as indicated by initially grouping characteristics, including targeted behaviors and preferences, derived through said CDM methodology. The method also includes capturing new user characteristics that emerge, simultaneously tracking design requirements and implementations on both micro and macro levels, accommodating variability and diversity in performance and preference during iterative testing by integrating user-customization into a design by creating a user-profile in which the users select various navigation preferences and information display choices that can be applied throughout the interface, and developing a customized user interface as an end-product.
[0024] One embodiment of how a user's interface may be modified based on user-group membership is illustrated in FIG. 1 . The initial step starts at a user-profile screen or multiple user-profile screens (2). A user profile screen is a segment of the interface where a user may configure or customize the interface to accommodate his/her needs.
[0025] Next, the CDM methodology would have pre-determined a user's behavioral characteristics and classified them into a specific user-group. In this example, the user would identify their group membership as the “blue” group (6) or “yellow” group (8). Ultimately, either the user or the system administrator would assign group membership at system log-on or registration.
[0026] Once the user identifies his/her group membership, the different functions (preference settings) within the interface are changed to accommodate the user-group's needs (10, 12). In this example, the user may also change his/her preference settings individually as well. Some examples of preference settings are: (1) short-cut keys—keys or macros that accelerate different functions; (2) pre-pop of account information—certain information that may be automatically presented on a screen at the users' discretion, such as account information; or (3) workflow maps—maps and help aids that indicate to the user what they should do during a negotiation. As an end result, the system interface would reflect functionality that is customized to the user's group membership (10, 12).
[0027] FIG. 2 illustrates a preferred embodiment of how the CDM method is ideally applied to design and testing phases of interface development. As a preliminary step toward applying user models to design, the user population must be categorized into distinctive groups, their behaviors described, and subsequently modeled (14).
[0028] Once the CDM methodology is complete (14), the interface design process is implemented (16). The next series of boxes (shown in a clockwise arrangement; 16) depicts the application of the CDM method to interface design. Application of the CDM method to design and testing involves, first documenting and Validating pre-determined user characteristics as indicated by the initial grouping characteristics derived through the CDM method (18). This would include targeted behaviors and preferences, and is a static process.
[0029] Second, Capturing new user characteristics that emerge is essential, given that new behaviors and characteristics are imminent with a new or enhanced system and must be quantified to enhance the initial grouping characteristics (20).
[0030] Third, design requirements and implementations must be Tracked (22) on both micro (within individual screens) and macro levels (how design alternatives fit within the user's work-flow). Tracking design implementations on micro levels refers to the detailed consideration of individual components of the interface (e.g., the placement and functionality of certain buttons on an individual graphical user interface (GUI) screen). Tracking design implementations on macro levels refers to the consideration of how all the interface components, being collectively the entire interface design, matches with the goals and the tasks of the user.
[0031] Fourth, Accommodating variability and diversity in performance and preference during iterative testing is paramount to taking the unique needs of the user population into consideration when developing final design requirements (24).
[0032] Finally, an extension of the process of accommodating variability and diversity is to integrate appropriate user-Customization in to the design (26). This would be accomplished through creating a user-profile in which the user would select various navigation preferences and information display choices that would be applied throughout the interface. Such alternatives and choices are determined based on behavioral characteristics of the user groups (derived via CDM phase) and business decisions from operations/management personnel.
[0033] The entire process of applying user models to interface design is referred to as the VaCTAC method (Validate, Capture, Track, Accommodate and Customize). The end-product of this technique is a new interface (28) that: (a) has enhanced usability, (b) facilitates behaviors and preferences that are consistent to meeting business goals and operational decisions, (c) the broad range of usability needs of the entire population are addressed and capitalized upon by operations management, (d) results in revised, enhanced, and validated quantitative and qualitative user models, and (e) the design of future releases and enhancements would be expedited by the thorough knowledge of the user population gathered by this process.
[0034] To better understand the invention, it is important to describe in further detail how the CDM methodology may be applied to interface design. The first portion of data that contributes to this process is the “screenflow” analysis of the present invention. This analysis also helps to add detail to the qualitative user models and provides the level of detail necessary to create quantitative models of service representative behavior. The approach taken is to analyze specific call types based on the customer's initial request and how this request is ultimately resolved. These specific call types can then be analyzed to determine the prototypical navigation behavior used for that particular type of call.
[0035] A primary aspect of determining prototypical navigation behavior is to indicate the most common number, type, and sequence of interface screens visited during the particular customer/representative negotiation. A detailed description of this process and the results are provided below. The data used for this analysis was captured during side-by-side observations of service representatives.
[0036] In order to determine a prototypical screen-flow, it is necessary to identify call-types that are essentially identical to one another. For instance, all calls in which the customer requests “caller ID” to be added to their service, would be considered virtually identical to one another since the task of the service representative should be the same in all cases. To this end, the majority of calls observed were from two categories, namely, “order” and “information (info)” types of calls. The data captured that was used in identifying exactly what kind of calls fell within order and information given from the customer's opening statement (e.g., “I want to get a second telephone line for my computer modem”) which was compared to the final resolution of the call (order, transfer, etc). It was determined that “information” types of calls included a wide variety of customer requests, so many in fact, that there was no single type of request that occurred frequently enough to warrant or allow subsequent analysis. However, there was sufficient consistency of customer requests under “order” call types to allow further analysis.
[0037] Therefore, all order type calls collected at call centers were categorized into sub-groups. A total of nine order call types were found, based on customers' opening statements and the observers' label of how the call was ultimately resolved. Four of the nine call types were subsequently analyzed, namely: new connects, moves, disconnect line, and caller ID. The problem and disconnect call types were not analyzed because further inspections of the screen flows indicated that these call types involved a wide range of navigation behavior that varied on a call-to-call basis. Therefore, a prototypical screen flow could not be determined for these call types. Additional line (ADL), call blocker, and name change types were not included in subsequent analyses because there was not a sufficient number of these call from which to base meaningful conclusions. Although the number of caller ID calls was similarly low, it included the highest number of calls that a customer requested a specific product or service, and was subsequently included to minimally represent this type of customer/service representative negotiation.
[0038] For each call, it is necessary to determine the prototypical screen flow (baseline). In other words, it is necessary to identify the primary screens that service representatives visit and in what order these screens are visited. A baseline can be determined by visually inspecting a sample of individual records of screen flows for a given call type. For example, about 10-12 records can be inspected to determine a baseline screen flow. This visual inspection should be conducted to identify patterns of the same screens that are visited in the same sequence. The result is an initial baseline screen flow from which all records of the particular call type may be compared. In this way, it is possible to assess the common screen flow pattern associated with a given call type. Many of the representatives also visited other screens during negotiations, but these screens were not visited with any regularity among representatives. These “tangents” that a given representative would make during a negotiation within the screen flow were also analyzed, but results did not show any distinctive patterns. Each record of screen navigation also included behavioral data such as the sequential occurrence of cross-selling attempts and sequential occurrence of when a representative used a “help aid” (help aids include: a calculator, help screens, assistance from a manager, etc.).
[0039] The methodology of applying CDM to interface design would proceed in the following manner: during the requirements gathering phase of the interface design, documents are generated that captured roadblocks to usability within the present system and alternative design ideas to address these roadblocks. These “paste-ins” provide the starting point to implement CDM to design. Specifically, each design idea and/or requirement should be rated in terms of accommodating the quantitative models of the user population. Each design idea and/or requirement would consist of a description of functionality and checked whether or not it accommodates a given CDM user population grouping (blue, yellow, etc). This may be expanded to include a description of how a given group's characteristics have been accommodated, or how a given group's characteristics have not been addressed to serve as a future aid to subsequent design enhancements. This could take the form of simply YES/NO binary coding, or as ratings based on subjective opinions of the designer(s) of the “level of accommodation”—(1—not accommodated; 7—group's characteristics fully addressed). In addition, ratings should be made with reference to how an individual “fits” in with design requirement (micro implement) “fits”-in with the over-all workflow, and /or across screen navigation.
[0040] The advantages and benefits provided to the user of the present invention are numerous. Revenue generated per customer call should increase, since the sales/negotiation system is more customized to the individual user, reducing mental workload on the user and thus allowing for more emphasis on sales rather than navigation/system manipulation. Opposing behaviors are accounted for, which would increase the operational efficiency of the call center. For instance, the interface supports speed oriented behavior (high volume, short duration/low revenue calls) while simultaneously supporting service-oriented behavior (low volume, long duration/high revenue calls).
[0041] Also, a more customized system will maximize user-efficiency and thereby decrease unnecessary time-on-the-line and increase customer accessibility. Agents using this method could out-perform other similar agents at other organizations. Other organizations would still be attempting to meet the needs and preferences of their systems-users without a systematic method of accomplishing these requirements. Thus, the method of the present invention also represents an opportunity to distinguish the user of this method from all other carriers.
[0042] The user of this invention can benefit from strengthening its image with agents. It gives agents a reason to enhance their opinion of the user of the method of the present invention as a company that does adjust to employee's needs and capabilities. Thus, it is possible the user of this method may become the carrier of choice for the next generation and top performing agents. Finally, the method of the present invention allows agents to be compatible with Wireless, Long Distance, and other future services. The methodology of accommodating the range of behavioral diversity of systems users can be transferred and applied to different sales negotiation systems and interface development teams.
[0043] Although the invention has been described with reference to several exemplary embodiments, it is understood that the words that have been used are words of description and illustration, rather than words of limitation. The method disclosed can be used to design interfaces for a variety of systems, including but not limited to interactive telephone systems, interactive voice response systems, Internet based systems, interactive graphic user interface systems, automated teller machines, computer systems, television programming interfaces, and any other system which has an user interface.
[0044] Changes may be made, without departing from the scope and spirit of the invention in its aspects. Although the invention has been described herein with reference to particular hardware, software, means, and embodiments, the invention is not intended to be limited to the particulars disclosed herein; rather, the invention extends to all functionally equivalent structures, methods and uses, such as are within the scope of the appended claims.
Claims
What is claimed:
1. A method for designing a customized user interface, comprising: categorizing a user population into at least two groups, describing the categorized groups, and modeling the described groups using qualitative and quantitative models, the categorizing, describing and modeling being based upon Categorize-Describe-Model (CDM) methodology; and
applying the models to interface design.
2. The method of claim 1, in which applying the models further comprises evaluating design ideas and/or design requirements with respect to each CDM group.
3. The method of claim 2, further comprising describing how a group's characteristics have been accommodated.
4. The method of claim 3, in which the accommodation describing further comprises rating based upon subjective opinions.
5. The method of claim 4, in which the rating further comprises evaluating how an individual fits in with design requirements.
6. The method of claim 4, in which the rating further comprises evaluating how an individual fits in with overall workflow.
7. The method of claim 4, in which the rating further comprises evaluating how an individual fits in across screen navigation.
8. The method of claim 2, further comprising describing how a group's characteristics have not been addressed.
9. The method of claim 8, in which describing how a group's characteristics have not been addressed further comprises rating with YES/NO coding.
10. The method of claim 1, in which applying the models further comprises analyzing screen flow.
11. The method of claim 10, in which the screen flow analysis further comprises determining a prototypical screen flow.
12. A method for designing a customized user interface, comprising:
categorizing a user population into at least two groups, describing the categorized groups, and modeling the described groups using qualitative and quantitative models, the categorizing, describing and modeling being based upon Categorize-Describe-Model (CDM) methodology; and
applying the models to interface design by customizing the user interface based on behavioral characteristics of the user groups.
13. A method for designing a customized user interface, comprising:
categorizing a user population into at least two groups, describing the categorized groups, and modeling the described groups using qualitative and quantitative models, the categorizing, describing and modeling being based upon Categorize-Describe-Model (CDM) methodology;
applying the models to interface design by analyzing screen flow including a prototypical screen flow; and
creating the quantitative models based upon the screen flow analysis.
14. The method of claim 13, further comprising indicating common interface screens visited during a customer/representative negotiation for at least one call type.
15. The method of claim 14, further comprising determining the at least one call type based upon customer request consistency.
16. The method of claim 13, in which applying the models further comprises evaluating design ideas and/or design requirements with respect to each CDM group.
17. The method of claim 13, further comprising describing how a group's characteristics have not been addressed.
18. The method of claim 17, in which describing how a group's characteristics have not been addressed further comprises rating based upon subjective opinions.
19. The method of claim 13, further comprising:
validating targeted user behaviors and user preferences of the model; and
tracking design requirements for the validated user behaviors and user preferences.
20. The method of claim 13, further comprising iteratively testing the design.
Patent Citations (193)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4310727(A) | 1982-01-01 | Lawser | Applicant |
| US4694483(A) | 1987-09-01 | Cheung | Applicant |
| US4761542(A) | 1988-08-01 | Kubo et al. | Applicant |
| US4922519(A) | 1990-05-01 | Daudelin | Applicant |
| US4930077(A) | 1990-05-01 | Fan | Applicant |
| US4964077(A) | 1990-10-01 | Eisen et al. | Applicant |
| US5115501(A) | 1992-05-01 | Kerr | Applicant |
| US5181259(A) | 1993-01-01 | Rorvig | Applicant |
| US5204968(A) | 1993-04-01 | Parthasarathi | Applicant |
| US5206903(A) | 1993-04-01 | Kohler et al. | Applicant |
| US5263167(A) | 1993-11-01 | Conner, Jr. et al. | Applicant |
| US5299260(A) | 1994-03-01 | Shaio | Applicant |
| US5311422(A) | 1994-05-01 | Loftin et al. | Applicant |
| US5323452(A) | 1994-06-01 | Dickman et al. | Applicant |
| US5327529(A) | 1994-07-01 | Fults et al. | Applicant |
| US5335268(A) | 1994-08-01 | Kelly, Jr. et al. | Applicant |
| US5335269(A) | 1994-08-01 | Steinlicht | Applicant |
| US5371673(A) | 1994-12-01 | Fan | Applicant |
| US5388198(A) | 1995-02-01 | Layman et al. | Applicant |
| US5420975(A) | 1995-05-01 | Blades et al. | Applicant |
| US5479488(A) | 1995-12-01 | Lennig et al. | Applicant |
| US5495567(A) | 1996-02-01 | Iizawa et al. | Applicant |
| US5500795(A) | 1996-03-01 | Powers et al. | Applicant |
| US5519772(A) | 1996-05-01 | Akman et al. | Applicant |
| US5530744(A) | 1996-06-01 | Charalambous et al. | Applicant |
| US5533107(A) | 1996-07-01 | Irwin et al. | Applicant |
| US5535321(A) | 1996-07-01 | Massaro et al. | Applicant |
| US5537470(A) | 1996-07-01 | Lee | Applicant |
| US5553119(A) | 1996-09-01 | McAllister et al. | Applicant |
| US5561711(A) | 1996-10-01 | Muller | Applicant |
| US5566291(A) | 1996-10-01 | Boulton et al. | Applicant |
| US5586060(A) | 1996-12-01 | Kuno et al. | Applicant |
| US5586171(A) | 1996-12-01 | McAllister et al. | Applicant |
| US5586219(A) | 1996-12-01 | Yufik | Applicant |
| US5594791(A) | 1997-01-01 | Szlam et al. | Examiner |
| US5600781(A) | 1997-02-01 | Root et al. | Applicant |
| US5615323(A) | 1997-03-01 | Engel et al. | Applicant |
| US5633909(A) | 1997-05-01 | Fitch | Applicant |
| US5657383(A) | 1997-08-01 | Gerber et al. | Applicant |
| US5659724(A) | 1997-08-01 | Borgida et al. | Applicant |
| US5666400(A) | 1997-09-01 | McAllister et al. | Applicant |
| US5668856(A) | 1997-09-01 | Nishimatsu et al. | Applicant |
| US5671351(A) | 1997-09-01 | Wild et al. | Applicant |
| US5675707(A) | 1997-10-01 | Gorin et al. | Applicant |
| US5684870(A) | 1997-11-01 | Maloney et al. | Applicant |
| US5684872(A) | 1997-11-01 | Flockhart et al. | Applicant |
| US5706334(A) | 1998-01-01 | Balk et al. | Applicant |
| US5710884(A) | 1998-01-01 | Dedrick | Applicant |
| US5727950(A) | 1998-03-01 | Cook et al. | Applicant |
| US5729600(A) | 1998-03-01 | Balha et al. | Applicant |
| US5734709(A) | 1998-03-01 | DeWitt et al. | Applicant |
| US5740549(A) | 1998-04-01 | Reilly et al. | Applicant |
| US5757644(A) | 1998-05-01 | Jorgensen et al. | Applicant |
| US5758257(A) | 1998-05-01 | Herz et al. | Applicant |
| US5771276(A) | 1998-06-01 | Wolf | Applicant |
| US5790117(A) | 1998-08-01 | Halviatti et al. | Applicant |
| US5793368(A) | 1998-08-01 | Beer | Applicant |
| US5802526(A) | 1998-09-01 | Fawcett et al. | Applicant |
| US5806060(A) | 1998-09-01 | Borgida et al. | Applicant |
| US5808908(A) | 1998-09-01 | Ghahramani | Applicant |
| US5809282(A) | 1998-09-01 | Cooper et al. | Applicant |
| US5812975(A) | 1998-09-01 | Komori et al. | Applicant |
| US5819221(A) | 1998-10-01 | Kondo et al. | Applicant |
| US5821936(A) | 1998-10-01 | Shaffer et al. | Applicant |
| US5822397(A) | 1998-10-01 | Newman | Applicant |
| US5822744(A) | 1998-10-01 | Kesel | Applicant |
| US5825856(A) | 1998-10-01 | Porter et al. | Applicant |
| US5825869(A) | 1998-10-01 | Brooks et al. | Applicant |
| US5832428(A) | 1998-11-01 | Chow et al. | Applicant |
| US5832430(A) | 1998-11-01 | Lleida et al. | Applicant |
| US5835565(A) | 1998-11-01 | Smith et al. | Applicant |
| US5848396(A) | 1998-12-01 | Gerace | Applicant |
| US5864605(A) | 1999-01-01 | Keshav | Applicant |
| US5864844(A) | 1999-01-01 | James et al. | Applicant |
| US5870308(A) | 1999-02-01 | Dangelo et al. | Applicant |
| US5872865(A) | 1999-02-01 | Normile et al. | Applicant |
| US5873068(A) | 1999-02-01 | Beaumont et al. | Applicant |
| US5875108(A) | 1999-02-01 | Hoffberg et al. | Applicant |
| US5884029(A) | 1999-03-01 | Brish, II et al. | Applicant |
| US5899992(A) | 1999-05-01 | Iyer et al. | Applicant |
| US5903641(A) | 1999-05-01 | Tonisson | Applicant |
| US5905774(A) | 1999-05-01 | Tatchell et al. | Applicant |
| US5920477(A) | 1999-07-01 | Hoffberg et al. | Applicant |
| US5923745(A) | 1999-07-01 | Hurd | Applicant |
| US5930764(A) | 1999-07-01 | Melchione et al. | Applicant |
| US5943416(A) | 1999-08-01 | Gisby | Applicant |
| US5953406(A) | 1999-09-01 | LaRue et al. | Applicant |
| US5963965(A) | 1999-10-01 | Vogel | Applicant |
| US5974253(A) | 1999-10-01 | Nahaboo et al. | Examiner |
| US5991735(A) | 1999-11-01 | Gerace | Applicant |
| US5999611(A) | 1999-12-01 | Tatchell et al. | Applicant |
| US5999908(A) | 1999-12-01 | Abelow | Applicant |
| US6014638(A) | 2000-01-01 | Burge et al. | Applicant |
| US6016336(A) | 2000-01-01 | Hanson | Applicant |
| US6026381(A) | 2000-02-01 | Barton, III et al. | Applicant |
| US6032129(A) | 2000-02-01 | Greef et al. | Applicant |
| US6035283(A) | 2000-03-01 | Rofrano | Applicant |
| US6035336(A) | 2000-03-01 | Lu et al. | Applicant |
| US6038560(A) | 2000-03-01 | Wical | Applicant |
| US6044355(A) | 2000-03-01 | Crockett et al. | Applicant |
| US6052693(A) | 2000-04-01 | Smith et al. | Applicant |
| US6055542(A) | 2000-04-01 | Nielsen et al. | Applicant |
| US6058163(A) | 2000-05-01 | Pattison et al. | Applicant |
| US6058179(A) | 2000-05-01 | Shaffer et al. | Applicant |
| US6058435(A) | 2000-05-01 | Sassin et al. | Applicant |
| US6061433(A) | 2000-05-01 | Polcyn et al. | Applicant |
| US6067538(A) | 2000-05-01 | Zorba et al. | Applicant |
| US6088429(A) | 2000-07-01 | Garcia | Applicant |
| US6099320(A) | 2000-08-01 | Papadopoulos | Applicant |
| US6104790(A) | 2000-08-01 | Narayanaswami | Applicant |
| US6128380(A) | 2000-10-01 | Shaffer et al. | Applicant |
| US6128624(A) | 2000-10-01 | Papierniak et al. | Applicant |
| US6134315(A) | 2000-10-01 | Galvin | Applicant |
| US6134530(A) | 2000-10-01 | Bunting et al. | Applicant |
| US6148063(A) | 2000-11-01 | Brennan et al. | Applicant |
| US6157808(A) | 2000-12-01 | Hollingsworth | Applicant |
| US6160877(A) | 2000-12-01 | Tatchell et al. | Applicant |
| US6161130(A) | 2000-12-01 | Horvitz et al. | Applicant |
| US6163607(A) | 2000-12-01 | Bogart et al. | Applicant |
| US6166732(A) | 2000-12-01 | Mitchell et al. | Applicant |
| US6170011(B1) | 2001-01-01 | Macleod Beck et al. | Applicant |
| US6173053(B1) | 2001-01-01 | Bogart et al. | Applicant |
| US6173279(B1) | 2001-01-01 | Levin et al. | Applicant |
| US6201948(B1) | 2001-03-01 | Cook et al. | Applicant |
| US6212502(B1) | 2001-04-01 | Ball et al. | Applicant |
| US6219665(B1) | 2001-04-01 | Shiomi | Applicant |
| US6230197(B1) | 2001-05-01 | Beck et al. | Applicant |
| US6236395(B1) | 2001-05-01 | Sezan et al. | Applicant |
| US6236955(B1) | 2001-05-01 | Summers | Applicant |
| US6236990(B1) | 2001-05-01 | Geller et al. | Applicant |
| US6243375(B1) | 2001-06-01 | Speicher | Applicant |
| US6249579(B1) | 2001-06-01 | Bushmell | Applicant |
| US6263052(B1) | 2001-07-01 | Cruze | Applicant |
| US6269153(B1) | 2001-07-01 | Carpenter et al. | Applicant |
| US6278976(B1) | 2001-08-01 | Kochian | Applicant |
| US6282404(B1) | 2001-08-01 | Linton | Applicant |
| US6289084(B1) | 2001-09-01 | Bhshmell | Applicant |
| US6292909(B1) | 2001-09-01 | Hare | Applicant |
| US6295551(B1) | 2001-09-01 | Roberts et al. | Applicant |
| US6296376(B1) | 2001-10-01 | Kondo et al. | Applicant |
| US6308172(B1) | 2001-10-01 | Agrawal et al. | Applicant |
| US6330326(B1) | 2001-12-01 | Whitt | Applicant |
| US6332154(B2) | 2001-12-01 | Beck et al. | Applicant |
| US6334627(B1) | 2002-01-01 | Heym et al. | Applicant |
| US6336109(B2) | 2002-01-01 | Howard | Applicant |
| US6338050(B1) | 2002-01-01 | Conklin et al. | Applicant |
| US6349290(B1) | 2002-02-01 | Horowitz et al. | Applicant |
| US6353661(B1) | 2002-03-01 | Bailey, III | Applicant |
| US6353825(B1) | 2002-03-01 | Ponte | Applicant |
| US6357017(B1) | 2002-03-01 | Bereiter et al. | Applicant |
| US6366879(B1) | 2002-04-01 | Coxhead et al. | Applicant |
| US6374260(B1) | 2002-04-01 | Hoffert et al. | Applicant |
| US6389403(B1) | 2002-05-01 | Dorak, Jr. | Applicant |
| US6389538(B1) | 2002-05-01 | Gruse et al. | Applicant |
| US6400807(B1) | 2002-06-01 | Hewitt et al. | Applicant |
| US6405149(B1) | 2002-06-01 | Tsai et al. | Applicant |
| US6405159(B2) | 2002-06-01 | Bushey et al. | Applicant |
| US6405170(B1) | 2002-06-01 | Phillips et al. | Applicant |
| US6411687(B1) | 2002-06-01 | Bohacek et al. | Applicant |
| US6434714(B1) | 2002-08-01 | Lewis et al. | Applicant |
| US6448980(B1) | 2002-09-01 | Kumar et al. | Applicant |
| US6483523(B1) | 2002-11-01 | Feng | Examiner |
| US6487277(B2) | 2002-11-01 | Beyda et al. | Applicant |
| US6516051(B2) | 2003-02-01 | Sanders | Applicant |
| US6564197(B2) | 2003-05-01 | Sahami et al. | Applicant |
| US6587127(B1) | 2003-07-01 | Leeke et al. | Applicant |
| US6598022(B2) | 2003-07-01 | Yuschik | Applicant |
| US6618715(B1) | 2003-09-01 | Johnson et al. | Applicant |
| US6624803(B1) | 2003-09-01 | Vanderheiden et al. | Applicant |
| US2001/0014863(A1) | 2001-08-01 | Wiiliams, III | Applicant |
| US2001/0014868(A1) | 2001-08-01 | Herz et al. | Applicant |
| US2001/0041562(A1) | 2001-11-01 | Elsey et al. | Applicant |
| US2002/0055868(A1) | 2002-05-01 | Dusevic et al. | Applicant |
| US2002/0133394(A1) | 2002-09-01 | Bushey et al. | Applicant |
| US2002/0196277(A1) | 2002-12-01 | Bushey et al. | Applicant |
| US2003/0026409(A1) | 2003-02-01 | Bushey et al. | Applicant |
| US2003/0143981(A1) | 2003-07-01 | Kortum et al. | Applicant |
| US2003/0156133(A1) | 2003-08-01 | Martin et al. | Applicant |
| US2003/0156706(A1) | 2003-08-01 | Koehler et al. | Applicant |
| US2003/0158655(A1) | 2003-08-01 | Obradovich et al. | Applicant |
| US2004/0006473(A1) | 2004-01-01 | Mills et al. | Applicant |
| US2004/0032935(A1) | 2004-02-01 | Mills et al. | Applicant |
| US2004/0042592(A1) | 2004-03-01 | Knott et al. | Applicant |
| US2004/0240635(A1) | 2004-12-01 | Bushey et al. | Applicant |
| US2005/0035582(A1) | 2005-02-01 | Kim | Applicant |
| US2005/0082807(A1) | 2005-04-01 | Kwon | Applicant |
| GB128396.9 | 2000-05-01 | Applicant | |
| GB2367167 | 2002-03-01 | Applicant | |
| JP2001-199299 | 2001-07-01 | Applicant | |
| KR2003-016896 | 2003-03-01 | Applicant | |
| WO/33548 | 2000-06-01 | Applicant | |
| WO/73968 | 2000-12-01 | Applicant | |
| WO3/013111 | 2003-02-01 | Applicant |
Non-Patent Literature (37)
- Kelly, “From Intelligent Call Routing to Intelligent Contact Management,” Call Center Solutions, v19, n3, Sep. 2000.Applicant
- “Call Center Roundup,” Teleconnect, Dec. 1998.Applicant
- “Call Centers: sales, service and competitive advantage,” Canadian Business, v70, n2, Feb. 1997.Applicant
- Foster, “Advanced Definity call centers: Working for you and your customers,” AT&T Technology, v9, n2, Summer 1994.Applicant
- Ameritech Corp., “Ameritech Phone-Based UI Standards: Dialogue Design”, http://www.ameritech.com/corporate/testtown/library/standard/pbix4.html>, 1998.Applicant
- InterVoiceBrite, Inc., “AgentConnect Call Center Platform Brochure”, no date available.Applicant
- “ACD Learning Center Tutorial Series”, ACD Call Center Online Learning Center, copyright dated 1998-1999, <http://www.call-center.net/ivr-series.htm>.Applicant
- “Customer Management Technology”, TeleTech, <http://www.teletech.com/solutions/cmt.htm>, printed on Dec. 18, 2001.Applicant
- “Products & Services—Interactive Voice Response (IVR)”, Prairie Systems, copyright dated 2001, <http://www.prairiesys.com/PSI/p—s—interactive—sol.htm<.Applicant
- “RVS Voice”, iMessaging Systems, Inc., <http://www.imessagingsystems.com/imsprods/rvsvoice/rvsvoice.htm>, no date available.Applicant
- “What's Next in Interactive Voice Response”, International Nortel Networks Meridian Users Group, <http://www.innmug.org/information/kirvan.html<, which was published in the Dec. 2000 issue of InnTouch.Applicant
- “PADIS—An automatic telephone switchboard and directory information system,” by A. Kellner et al., Speech Communication, Oct. 1997.Applicant
- “Natural Language Call Routing: a Robust, Self-Organizing Approach,” by Carpenter et al., Lucent Technologies Bell Laboratories (1998).Applicant
- “Lucent Technologies announces trial of natural language call routing technology,” a press release dated Dec. 3, 1997.Applicant
- “A spoken language system for automated call routing,” 1997 IEEE International Conference on Acoustics,. Speech, and Signal Processing by G. Ricardi et al., AT&T Bell Labs.Applicant
- Kaoru Kobayashi, “Information Presentation based on Individual User Interests,” 1998, Second International Conference, IEEE, pp. 375-383.Applicant
- Nikitas SGOUROS, Dynamic Dramatization of Multimedia Story Presentations, 1997 ACM, pp. 87-94.Applicant
- Michael Murtaugh, “The Automatist Storytelling System,” 1996 Massachusetts Institute of Technology, Masters Thesis.Applicant
- K. M. Brooks, “Do Agent Stories Use Rocking Chairs: The Theory and Implementation of One Model for Computational Narrative,” Processing's of the Fourth ACM International Multimedia Conference on Intelligent User Interfaces, ACM Press 1996.Applicant
- M. Maybury, Intelligent Multi-Media Interfaces, AAAI/MIT Press, Cambridge, MA, 1993, Chapter 5: S.K. Fiener et al., “Automating the Generation of Coordinated Multimedia Explanations”.Applicant
- P. Szekely, “Retrospective and Challenges for Model-Based Reasoning,” USC Information Sciences Institute, Marina del Rey, CA, 1996.Applicant
- C. Stanfill et al., Toward Memory-Based Reasoning, Communications of the ACM, vol. 29, No. 12, ACM Press, Dec. 1986.Applicant
- J. Orwant, “Doppleganger Goes to School: Machine Learning for User Modeling,” MIT MS Thesis Sep. 1993.Applicant
- J. Orwant, “For want of a bit the user was lost: Cheap User Modeling,” IBM Systems Journal, vol. 35, Nos. 3 & 4, pp. 398-416, 1996.Applicant
- U. Shardanand, “Social Information Filtering for Music Recommendation,” MIT MS Thesis, 1994.Applicant
- P. Meyer, From Animals to Amimats 2 Proceedings of the Second International Conference on Simulation of Adaptive Behavior, MIT Media Laboratory 1992, Behavior Based Artificial Intelligence.Applicant
- Henry Leiberman et al., “Let's Browse: A Collaborative Web Borwsing Agent”, Jan. 5-8, 1999, Proceedings of IUI 99. CPP Conference Paper, 5 pages.Applicant
- Card, S.K.; Moran, T.P.; and Newell A. (1983). The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum.Applicant
- Hart S.G.; and Staveland, L.E. (1988). Development of the NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In P.A. Hancock and N. Meshkati (Eds.), Human Mental Workload. (pp. 139-183) Amsterdam: North-Holland.Applicant
- John, B.E.; and Kieras, D.E. (1996). Using GOMS for User Interface Design and Evaluation: Which technique? ACM Transactions on Computer-Human Interaction, 3 (4). 287-319.Applicant
- Shingledecker, C.A. (1980). Operator-Strategy: A Neglected Variable in Workload Assessment.Applicant
- English Language abstract of JP 2001-199299.Applicant
- English Language abstract of KR 2003-0016896.Applicant
- U.S. Appl. No. 11/305,089, filed Dec. 19, 2005.Applicant
- Applicants particularly call the Examiner's attention to pp. 28-38.Applicant
- Wierwille, W.W. and Eggemeier, F.T. (1993). Recommendations for Mental Workload Measurement in a Test and Evaluation Environment. Human Factors, 35 (2), 263-281.Applicant
- Wei, Z. G. (1997), “Mental Load and Performance at Different Automation Levels.” The Netherlands: Delft University.Applicant