US 7,029,280 B2Grant

E-learning course editor

Issue Date:2006-04-18

•76 Claims

•13 Drawing Sheets

Abstract

A course editor includes an input to accept author commands. An interface processes and displays the author commands to facilitate the creation of a course. The interface may include a workspace to display and assemble the structural elements into the course. The workspace may include a menu of structural elements that may be added to the course. The workspace is configured to display a structural element in response to an author command selecting the structural element from the menu. The structural elements may be a sub-course, a learning unit, and/or a knowledge item.

Metadata

Assignee

SAP AG

Inventors

Andreas S. Krebs
Michael Altenhofen
Joachim Schaper
Wolfgang Gerteis
Torsten Leidig

Application Information

Application Number:US 10/184,112

Filing Date:2002-06-28

Priority Date:2002-02-11

Art Unit:3714

Classifications

IPC:

G09B19/00

Patent Drawings (13 sheets)

Description

[0001] This application is a continuation-in-part of U.S. application Ser. No. 10/134,676, filed Apr. 30, 2002, and titled E-LEARNING SYSTEM, and also claims the benefit of U.S. Provisional Application No. 60/354,945, filed Feb. 11, 2002, and titled FLEXIBLE INSTRUCTIONAL ARCHITECTURE FOR E-LEARNING, both of which are hereby incorporated by reference in their entirety for all purposes.

Technical Field

[0002] The following description relates generally to e-learning and in particular to a course editor for e-learning courses.

Background

[0003] Systems and applications for delivering computer-based training (CBT) have existed for many years. However, CBT systems historically have not gained wide acceptance. A problem hindering the reception of CBTs as a means of training workers and learners is the compatibility between systems. A CBT system works as a stand-alone system that is unable to use content designed for use with other CBT systems.

[0004] Early CBTs also were based on hypermedia systems that statically linked content. User guidance was given by annotating the hyperlinks with descriptive information. The trainee could proceed through learning material by traversing the links embedded in the material. The structure associated with the material was very rigid, and the material could not be easily written, edited, or reused to create additional or new learning material.

[0005] Newer methods for intelligent tutoring and CBT systems are based on special domain models that must be defined prior to creation of the course or content. Once a course is created, the material may not be easily adapted or changed for different learners' specific training needs or learning styles. As a result, the courses often fail to meet the needs of the trainee and/or trainer.

[0006] The special domain models also have many complex rules that must be understood prior to designing a course. As a result, a course is too difficult for most authors to create who have not undergone extensive training in the use of the system. Even authors who receive sufficient training may find the system difficult and frustrating to use. In addition, the resulting courses may be incomprehensible due to incorrect use of the domain model by the authors creating the course. Therefore, for the above and other reasons, new methods and technology are needed to supplement traditional computer based training and instruction.

Summary

[0007] According to one general aspect a course editor includes an input to accept author commands. An interface processes and displays the author commands to facilitate the creation of a course. The interface may include a workspace to display and assemble the structural elements into the course.

[0008] The workspace may include a menu of structural elements that may be added to the course. The workspace is configured to display a structural element in response to an author command selecting the structural element from the menu. The structural elements may be a sub-course, a learning unit, and/or a knowledge item.

[0009] The workspace also may include one or more tabs. Each tab corresponds to a content aggregation level and displays structural elements corresponding to the content aggregation level.

[0010] The workspace may be used to create relations between structural elements. The relations are used to indicate a dependency between the structural elements. The workspace includes a menu of relations configured to enable an author to select a relation from the menu and to insert the relation between two structural elements displayed in the workspace. The relation may be inserted by receiving an author command selecting a first structural element and dragging an indication of the relation (e.g., a line or an arrow) from the first structural element to the second structural element.

[0011] The relation may be subject taxonomic or non-subject taxonomic. A subject taxonomic relation may be hierarchical, such as a part/whole relation and an abstraction relation. The subject taxonomic relation also may be associative, such as determines, side-by-side, alternative to, opposite to, precedes, context of, process of, values, means of, and affinity. An example of a non-subject taxonomic relation includes a relation that indicates a structural element should be completed before proceeding to a related structural element or a relation that indicates that a structural element belongs to another structural element.

[0012] The interface may include a dialog box displaying one or more fields corresponding to a structural element displayed in the workspace. Examples of fields include a name field, a theme field, a content field, a media type field, a learning time field, a thumbnail field, and an attribute field. The dialog box also may include one or more tabs to select different fields. Examples of tabs include a general tab (e.g., with fields to receive information about the content associated with the structural element), an annotation tab (e.g., with a field to receive notes regarding the structural element), a keyword tab (e.g., including a field to receive keywords to help search for a corresponding structural element), and a competency tab (e.g., including fields to receive competencies gained from the content associated with structural element).

[0013] The interface may include a course overview to display structural elements and relations of the course. The interface may be configured to receive an author command selecting a structural element from the course overview and to display the selected structural element in the workspace. The dialog box may be configured to automatically correspond to the selected structural element. The interface may be configured to receive an author command selecting a relation from the course overview and to display the selected relation and associated structural elements in the workspace.

[0014] The interface also may be configured to receive an author command selecting a learning strategy and to generate a navigation path for display to the author based on the selected learning strategy.

[0015] According to another general concept, a graphical user interface for a course editor includes a workspace window to edit and display structural elements of a course, an overview window to display and select a representation of the structural elements of the course, and a dialog box window to display data fields corresponding to structural elements shown in the workspace window.

[0016] The graphical user interface may include a menu bar to display course edit menus including functions to control and interact with the course editor. The graphical user interface also may include a button bar including one or more button to invoke course editor function to interact with the windows and their displayed contents.

[0017] A structural element may be displayed as a rectangle in the workspace. The rectangle may be color-coded, each type of structural element having a different color.

[0018] The graphical user interface may be configured to display a learning strategy window to indicate a selected strategy and to generate a navigation path window to display a suggested sequence of structural elements based on the selected learning strategy.

[0019] The graphical user interface also may be configured to automatically size the windows to fit on a corresponding display. The windows may include a vertical scroll bar and/or a horizontal scroll bar to access and display portions of the window that are not displayed.

[0020] Other features and advantages will be apparent from the description, the drawings, and the claims.

Description of Drawings

[0021] FIG. 1 is an exemplary content aggregation model.

[0022] FIG. 2 is an example of an ontology of knowledge types.

[0023] FIG. 3 is an example of a course graph for e-learning.

[0024] FIG. 4 is an example of a sub-course graph for e-learning.

[0025] FIG. 5 is an example of a learning unit graph for e-learning.

[0026] FIGS. 6 and 7 are exemplary block diagrams of e-learning systems.

[0027] FIG. 8 is an exemplary course editor interface that may be implemented using an authoring tool.

[0028] FIG. 9 is an exemplary course overview of the course editor interface.

[0029] FIG. 10 is an exemplary dialog box of the course editor interface.

[0030] FIG. 11 is an exemplary workspace of the course editor.

[0031] FIG. 12 is an example showing ν as the vertex that represents the learning unit LU where ν₁, ν₂are the vertices.

[0032] Like reference symbols in the various drawings indicate like elements.

Detailed Description

E-learning Content Structure

[0033] The e-learning system and methodology structures content so that the content is reusable and flexible. For example, the content structure allows the creator of a course to reuse existing content to create new or additional courses. In addition, the content structure provides flexible content delivery that may be adapted to the learning styles of different learners.

[0034] E-learning content may be aggregated using a number of structural elements arranged at different aggregation levels. Each higher level structural element may refer to any instances of all structural elements of a lower level. At its lowest level, a structural element refers to content and may not be further divided. According to one implementation shown in FIG. 1, course material 100 may be divided into four structural elements: a course 110, a sub-course 120, a learning unit 130, and a knowledge item 140.

[0035] Starting from the lowest level, knowledge items 140 are the basis for the other structural elements and are the building blocks of the course content structure. Each knowledge item 140 may include content that illustrates, explains, practices, or tests an aspect of a thematic area or topic. Knowledge items 140 typically are small in size (i.e., of short duration, e.g., approximately five minutes or less).

[0036] A number of attributes may be used to describe a knowledge item 140, such as, for example, a name, a type of media, and a type of knowledge. The name may be used by a learning system to identify and locate the content associated with a knowledge item 140. The type of media describes the form of the content that is associated with the knowledge item 140. For example, media types include a presentation type, a communication type, and an interactive type. A presentation media type may include a text, a table, an illustration, a graphic, an image, an animation, an audio clip, and a video clip. A communication media type may include a chat session, a group (e.g., a newsgroup, a team, a class, and a group of peers), an email, a short message service (SMS), and an instant message. An interactive media type may include a computer based training, a simulation, and a test.

[0037] A knowledge item 140 also may be described by the attribute of knowledge type. For example, knowledge types include knowledge of orientation, knowledge of action, knowledge of explanation, and knowledge of source/reference. Knowledge types may differ in learning goal and content. For example, knowledge of orientation offers a point of reference to the learner, and, therefore, provides general information for a better understanding of the structure of interrelated structural elements. Each of the knowledge types is described in further detail below.

[0038] Knowledge items 140 may be generated using a wide range of technologies, however, a browser (including plug-in applications) should be able to interpret and display the appropriate file formats associated with each knowledge item. For example, markup languages (such as a Hypertext Markup language (HTML), a standard generalized markup language (SGML), a dynamic HTML (DHTML®), or an extensible markup language (XML)), JAVASCRIPT®(a client-side scripting language), and/or FLASH® may be used to create knowledge items 140.

[0039] HTML may be used to describe the logical elements and presentation of a document, such as, for example, text, headings, paragraphs, lists, tables, or image references.

[0040] FLASH® may be used as a file format for FLASH® movies and as a plug-in for playing FLASH® files in a browser. For example, FLASH® movies using vector and bitmap graphics, animations, transparencies, transitions, MP3 audio files, input forms, and interactions may be used. In addition, FLASH® allows a pixel-precise positioning of graphical elements to generate impressive and interactive applications for presentation of course material to a learner.

[0041] Learning units 130 may be assembled using one or more knowledge items 140 to represent, for example, a distinct, thematically-coherent unit. Consequently, learning units 130 may be considered containers for knowledge items 140 of the same topic. Learning units 130 also may be considered relatively small in size (i.e., duration) though larger than a knowledge item 140.

[0042] Sub-courses 120 may be assembled using other sub-courses 120, learning units 130, and/or knowledge items 140. The sub-course 120 may be used to split up an extensive course into several smaller subordinate courses. Sub-courses 120 may be used to build an arbitrarily deep nested structure by referring to other sub-courses 120.

[0043] Courses may be assembled from all of the subordinate structural elements including sub-courses 120, learning units 130, and knowledge items 140. To foster maximum reuse, all structural elements should be self-contained and context free.

[0044] Structural elements also may be tagged with metadata that is used to support adaptive delivery, reusability, and search/retrieval of content associated with the structural elements. For example, learning object metadata (LOM) defined by the IEEE “Learning Object Metadata Working Group” may be attached to individual course structure elements. The metadata may be used to indicate learner competencies associated with the structural elements. Other metadata may include a number of knowledge types (e.g., orientation, action, explanation, and resources) that may be used to categorize structural elements.

[0045] As shown in FIG. 2, structural elements may be categorized using a didactical ontology 200 of knowledge types 201 that includes orientation knowledge 210, action knowledge 220, explanation knowledge 230, and reference knowledge 240. Orientation knowledge 210 helps a learner to find their way through a topic without being able to act in a topic-specific manner and may be referred to as “know what.” Action knowledge 220 helps a learner to acquire topic related skills and may be referred to as “know how.” Explanation knowledge 230 provides a learner with an explanation of why something is the way it is and may be referred to as “know why.” Reference knowledge 240 teaches a learner where to find additional information on a specific topic and may be referred to as “know where.”

[0046] The four knowledge types (orientation, action, explanation, and reference) may be further divided into a fine grained ontology as shown in FIG. 2. For example, orientation knowledge 210 may refer to sub-types 250 that include a history, a scenario, a fact, an overview, and a summary. Action knowledge 220 may refer to sub-types 260 that include a strategy, a procedure, a rule, a principle, an order, a law, a comment on law, and a checklist. Explanation knowledge 230 may refer to sub-types 270 that include an example, a intention, a reflection, an explanation of why or what, and an argumentation. Resource knowledge 240 may refer to sub-types 280 that include a reference, a document reference, and an archival reference.

[0047] Dependencies between structural elements may be described by relations when assembling the structural elements at one aggregation level. A relation may be used to describe the natural, subject-taxonomic relation between the structural elements. A relation may be directional or non-directional. A directional relation may be used to indicate that the relation between structural elements is true only in one direction. Directional relations should be followed. Relations may be divided into two categories: subject-taxonomic and non-subject taxonomic.

[0048] Subject-taxonomic relations may be further divided into hierarchical relations and associative relations. Hierarchical relations may be used to express a relation between structural elements that have a relation of subordination or superordination. For example, a hierarchical relation between the knowledge items A and B exists if B is part of A. Hierarchical relations may be divided into two categories: the part/whole relation (i.e., “has part”) and the abstraction relation (i.e., “generalizes”). For example, the part/whole relation “A has part B,” describes that B is part of A. The abstraction relation “A generalizes B” implies that B is a specific type of A (e.g., an aircraft generalizes a jet or a jet is a specific type of aircraft).

[0049] Associative relations may be used refer to a kind of relation of relevancy between two structural elements. Associative relations may help a learner obtain a better understanding of facts associated with the structural elements. Associative relations describe a manifold relation between two structural elements and are mainly directional (i.e., the relation between structural elements is true only in one direction). Examples of associative relations include “determines,” “side-by-side,” “alternative to,” “opposite to,” “precedes,” “context of,” “process of,” “values,” “means of,” and “affinity.”

[0050] The “determines” relation describes a deterministic correlation between A and B (e.g., B causally depends on A). The “side-by-side” relation may be viewed from a spatial, conceptual, theoretical, or ontological perspective (e.g., A side-by-side with B is valid if both knowledge objects are part of a superordinate whole). The side-by-side relation may be subdivided into relations, such as “similar to,” “alternative to,” and “analogous to.” The “opposite to” relation implies that two structural elements are opposite in reference to at least one quality. The “precedes” relation describes a temporal relationship of succession (e.g., A occurs in time before B (and not that A is a prerequisite of B)). The “context of” relation describes the factual and situational relationship on a basis of which one of the related structural elements may be derived. An “affinity” between structural elements suggests that there is a close functional correlation between the structural elements (e.g., there is an affinity between books and the act of reading because reading is the main function of books).

[0051] Non Subject-Taxonomic relations may include the relations “prerequisite of” and “belongs to.” The “prerequisite of” and the “belongs to” relations do not refer to the subject-taxonomic interrelations of the knowledge to be imparted. Instead, these relations refer to the progression of the course in the learning environment (e.g., as the learner traverses the course). The “prerequisite of” relation is directional whereas the “belongs to” relation is non-directional. Both relations may be used for knowledge items 140 that cannot be further subdivided. For example, if the size of the screen is too small to display the entire content on one page, the page displaying the content may be split into two pages that are connected by the relation “prerequisite of.”

[0052] Another type of metadata is competencies. Competencies may be assigned to structural elements, such as, for example, a sub-course 120 or a learning unit 130. The competencies may be used to indicate and evaluate the performance of a learner as the learner traverse the course material. A competency may be classified as a cognitive skill, an emotional skill, an senso-motorical skill, or a social skill.

[0053] The content structure associated with a course may be represented as a set of graphs. A structural element may be represented as a node in a graph. Node attributes are used to convey the metadata attached to the corresponding structural element (e.g., a name, a knowledge type, a competency, and/or a media type). A relation between two structural elements may be represented as an edge. For example, FIG. 3 shows a graph 300 for a course. The course is divided into four structural elements or nodes (310, 320, 330, and 340): three sub-courses (e.g., knowledge structure, learning environment, and tools) and one learning unit (e.g., basic concepts). A node attribute 350 of each node is shown in brackets (e.g., the node labeled “Basic concepts” has an attribute that identifies it as a reference to a learning unit). In addition, an edge 380 expressing the relation “context of” has been specified for the learning unit with respect to each of the sub-courses. As a result, the basic concepts explained in the learning unit provide the context for the concepts covered in the three sub-courses.

[0054] FIG. 4 shows a graph 400 of the sub-course “Knowledge structure” 350 of FIG. 3. In this example, the sub-course “Knowledge structure” is further divided into three nodes (410, 420, and 430): a learning unit (e.g., on relations) and two sub-courses (e.g., covering the topics of methods and knowledge objects). The edge 440 expressing the relation “determines” has been provided between the structural elements (e.g., the sub-course “Methods” determines the sub-course “Knowledge objects” and the learning unit “Relations”.) In addition, the attribute 450 of each node is shown in brackets (e.g., nodes “Methods” and “Knowledge objects” have the attribute identifying them as references to other sub-courses; node “Relations” has the attribute of being a reference to a learning unit).

[0055] FIG. 5 shows a graph 500 for the learning unit “Relations” 450 shown in FIG. 4. The learning unit includes six nodes (510, 515, 520, 525, 530, 535, 540, and 545): six knowledge items (i.e., “Associative relations (1)”, “Associative relations (2)”, “Test on relations”, “Hierarchical relations”, “Non subject-taxonomic relations”, and “The different relations”). An edge 547 expressing the relation “prerequisite” has been provided between the knowledge items “Associative relations (1)” and “Associative relations (2).” In addition, attributes 550 of each node are specified in brackets (e.g., the node “Hierarchical relations” includes the attributes “Example” and “Picture”).

E-learning Strategies

[0056] The above-described content aggregation and structure associated with a course does not automatically enforce any sequence that a learner may use to traverse the content associated with the course. As a result, different sequencing rules may be applied to the same course structure to provide different paths through the course. The sequencing rules applied to the knowledge structure of a course are learning strategies. The learning strategies may be used to pick specific structural elements to be suggested to the learner as the learner progresses through the course. The learner or supervisor (e.g., a tutor) may select from a number of different learning strategies while taking a course. In turn, the selected learning strategy considers both the requirements of the course structure and the preferences of the learner.

[0057] In the classical classroom, a teacher determines the learning strategy that is used to learn course material. For example, in this context the learning progression may start with a course orientation, followed by an explanation (with examples), an action, and practice. Using the e-learning system and methods, a learner may choose between one or more learning strategies to determine which path to take through the course. As a result, the progression of learners through the course may differ.

[0058] Learning strategies may be created using macro-strategies and micro-strategies. A learner may select from a number of different learning strategies when taking a course. The learning strategies are selected at run time of the presentation of course content to the learner (and not during the design of the knowledge structure of the course). As result, course authors are relieved from the burden of determining a sequence or an order of presentation of the course material. Instead, course authors may focus on structuring and annotating the course material. In addition, authors are not required to apply complex rules or Boolean expressions to domain models thus minimizing the training necessary to use the system. Furthermore, the course material may be easily adapted and reused to edit and create new courses.

[0059] Macro-strategies are used in learning strategies to refer to the coarse-grained structure of a course (i.e., the organization of sub-courses 120 and learning units 130). The macro-strategy determines the sequence that sub-courses 120 and learning units 130 of a course are presented to the learner. Basic macro-strategies include “inductive” and “deductive,” which allow the learner to work through the course from the general to the specific or the specific to the general, respectively. Other examples of macro-strategies include “goal-based, top-down,” “goal-based, bottom-up,” and “table of contents.”

[0060] Goal-based, top-down follows a deductive approach. The structural hierarchies are traversed from top to bottom. Relations within one structural element are ignored if the relation does not specify a hierarchical dependency. Goal-based bottom-up follows an inductive approach by doing a depth first traversal of the course material. The table of contents simply ignores all relations.

[0061] Micro-strategies, implemented by the learning strategies, target the learning progression within a learning unit. The micro-strategies determine the order that knowledge items of a learning unit are presented. Micro-strategies refer to the attributes describing the knowledge items. Examples of micro-strategies include “orientation only”, “action oriented”, “explanation-oriented”, and “table of contents”).

[0062] The micro-strategy “orientation only” ignores all knowledge items that are not classified as orientation knowledge. The “orientation only” strategy may be best suited to implement an overview of the course. The micro-strategy “action oriented” first picks knowledge items that are classified as action knowledge. All other knowledge items are sorted in their natural order (i.e., as they appear in the knowledge structure of the learning unit). The micro-strategy “explanation oriented” is similar to action oriented and focuses on explanation knowledge. Orientation oriented is similar to action oriented and focuses on orientation knowledge. The micro-strategy “table of contents” operates like the macro-strategy table of contents (but on a learning unit level).

[0063] In one implementation, no dependencies between macro-strategies and micro-strategies exist. Therefore, any combination of macro and micro-strategies may be used when taking a course. Application of learning strategies to the knowledge structure of a course is described in further detail below.

E-learning System

[0064] As shown in FIG. 6 an e-learning architecture 600 may include a learning station 610 and a learning system 620. The learner may access course material using a learning station 610 (e.g., using a learning portal). The learning station 610 may be implemented using a work station, a computer, a portable computing device, or any intelligent device capable of executing instructions and connecting to a network. The learning station 610 may include any number of devices and/or peripherals (e.g., displays, memory/storage devices, input devices, interfaces, printers, communication cards, and speakers) that facilitate access to and use of course material.

[0065] The learning station 610 may execute any number of software applications, including an application that is configured to access, interpret, and present courses and related information to a learner. The software may be implemented using a browser, such as, for example, NETSCAPE COMMUNICATOR®, MICROSOFT® INTERNET EXPLORER®, or any other software application that may be used to interpret and process a markup language, such as HTML, SGML, DHTML®, or XML.

[0066] The browser also may include software plug-in applications that allow the browser to interpret, process, and present different types of information. The browser may include any number of application tools, such as, for example, JAVA®, ACTIVEX®, JAVASCRIPT®, AND FLASH®.

[0067] The browser may be used to implement a learning portal that allows a learner to access the learning system 620. A link 621 between the learning portal and the learning system 620 may be configured to send and receive signals (e.g., electrical, electromagnetic, or optical). In addition, the link may be a wireless link that uses electromagnetic signals (e.g., radio, infrared, to microwave) to convey information between the learning station and the learning system.

[0068] The learning system may include one or more servers. As shown in FIG. 6, the learning system 620 includes a learning management system 623, a content management system 625, and an administration management system 627. Each of these systems may be implemented using one or more servers, processors, or intelligent network devices.

[0069] As shown in FIGS. 6 and 7, the administration management system 627 may be implemented using a server, such as, for example, the SAP R/3 4.6C+LSO Add-On. The administration management system 627 may include a database of learner accounts and course information. For example, the learner account may include demographic data about the learner (e.g., a name, an age, a sex, an address, a company, a school, an account number, and a bill) and his/her progress through the course material (e.g., places visited, tests completed, skills gained, knowledge acquired, and competency using the material). The administration management system 627 also may provide additional information about courses, such as course title, description, courses offered, the author/instructor of a course, and the most popular courses.

[0070] The content management system 625 may include a learning content server 730. The learning content server 730 may be implemented using a WebDAV® server. The learning content server may include a content repository. The content repository may store course files and media files that are used to present a course to a learner at the learning station 610. The course files may include the structural elements that make up a course and may be stored as XML files. The media files may be used to store the content that is included in the course and assembled for presentation to the learner at the learning station 610.

[0071] The learning management system 623 may include a content player 720. The content player 720 may be implemented using a server, such as an SAP® J2EE Engine. The content player 720 is used to obtain course material from the content repository. The content player 720 also applies the learning strategies to the obtained course material to generate a navigation tree or path for the learner. The navigation tree or path is used to suggest a route through the course material for the learner and to generate a presentation of course material to the learner based on the learning strategy selected by the learner. Course navigation is described in further detail below.

[0072] The learning management system 623 also may include an interface for exchanging information with the administration management system 627. For example, the content player 720 may update the learner account information as the learner progresses through the course material to indicate, for example, competencies gained, tests passed, courses completed.

Course Author Station

[0073] As shown in FIGS. 6 and 7 an e-learning system may also include an author station 630. The author station 630 may be implemented using a workstation, a computer, a portable computing device, or any intelligent device capable of executing instructions and connecting to a network. The author station 630 may include any number of devices and/or peripherals (e.g., displays, memory/storage devices, input devices, interfaces, printers, communication cards, and speakers) that facilitate access to, presentation of, and creation of courses and their associated content.

[0074] The author station 630 may execute any number of software applications including an author tool 740 that is configured to create, access, interpret, and present courses (and related course data/information). The author tool 740 may include a course editor 750 and a browser, such as, for example, NETSCAPE COMMUNICATOR®, MICROSOFT® INTERNET EXPLORER®, or any other software application that may be used to interpret and process a markup language, such as HTML, SGML, DHTML®, or XML. The browser also may include software plug-in applications that allow the browser to interpret, process, create, and present different types of information. The browser may include any number of application tools, such as, for example, JAVA®, ACTIVEX®, JAVASCRIPT®, and FLASH®.

[0075] The course author tool 740 may access content and associate the content with structural elements. The author tool 740 also may associate knowledge types, relations, and metadata with the structural elements. The author tool 740 may be used to build the structure of a course, i.e., its structural elements and relations. The author tool 740 may save the structural elements and metadata as course files and the associated content as media files.

[0076] The author station 630 also may include an embedded learning management system 760. The embedded learning management system 760 is an application program that is similar to the learning management system 623 and enables the author to preview a course by applying learning strategies to the course (e.g., that is being created/modified by the author) in order to view the navigation path that is suggested to a learner based on the applied strategy. Based on the different suggested navigation paths, the author may determine how to create structure for the course and how the created structure is interpreted by the learning management system 623. As a result, the author may edit, modify, or add structure to the course before publishing the course to the learning system 620.

[0077] The author station 630 also may include a communications interface 631. After a course is created, the author station 630 may use the communication interface 631 to connect to the learning system 620 to publish the course so that a learner may book and take the course. In particular, the communication interface 631 of the author station 630 may connect to the content management system 625 using a communications link 635. To publish the course on the learning system 620, the author station 630 transfers the course structure and content (e.g., the course files and media files) to the content management system 625. As previously described, the course files may be formatted according to a markup language (e.g., XML). The communications link 635 may be implemented using any permanent or temporary communications link configured to transfer the course files and associated media files (e.g., a communications medium configured to transfer data signals as electrical, electromagnetic, or optical waves). The content management system 625 stores the course files and associated media files in the content repository for access by the content player 720.

[0078] The communication interface 631 of the author station 630 also may connect to the administration management system 627 using a communication link 637. The communication link may be implemented by any communication medium that may be configured to send and receive signals (e.g., electrical, electromagnetic, or optical). The author station 630 provides the administration management system 627 with course information (e.g., title, author, description, credits, prerequisites, and competencies gained/required) that is used by a learner, for example, to book a course. Once the course is published, the administration management system 627 makes the course information available to the learning station 610 using the learning portal.

Course Editor

[0079] The author tool 740 and author station 630 may include a course editor 750 that can be used in conjunction with a browser to create, modify, build, assemble, and preview course structures and their associated content. The course editor 750 may be used to structure content for use in a course. The course editor 750 includes a course editor interface.

[0080] The course editor 750 may be used to create the structure for the course content. The structure may be saved as metadata. The metadata may be interpreted by the content player 720 of the learning management system 623 to present a course to a learner according to a learning strategy selected at run time. In particular, the course editor 750 enables the author to classify and describe structural elements, assign attributes to structural elements, assign relations between structural elements, and build a subject-taxonomic course structure. The course editor 750 primarily generates the structure of the course and not structure of the content (although structure of content may be provided for as well).

[0081] As shown in FIG. 8, the course editor interface 800 may include a menu bar 810, a button bar 820, a course overview 830, a dialog box 850, and work space 860. The menu bar 810 may include various drop-down menus, such as, for example, file, edit, tools, options, and help. The drop-down menus may include functions, such as create a new course, open an existing course, edit a course, or save a course. The button bar 820 may include a number of buttons. The buttons may be shortcuts to functions in the drop down menus that are used frequently and that active tools and functions for use with the course editor 750. The remaining portions of the course editor interface 800 may be divided in to three primary sections or windows: a course overview 830, a dialog box 850, and a workspace 860.

[0082] Each of the sections may be provided with horizontal or vertical scroll bars or other means allowing the windows to be sized to fit on different displays while providing access to elements that may not appear in the window.

[0083] As shown in FIG. 9, the course overview 830 may be used to select and view components within a course. The author may select various components within the course overview 830 to open and close the components, for example, the structural elements. The components in the course overview 830 may be arranged in an explorer format. The course overview 830 may include a directory 920 of components including files and folders. Files and folders may be expanded to view their contents. However, unlike an explorer, the course overview 830 distinguishes between structural elements 930 and relations 940 (e.g., which may contain learning content). Sub-courses 120, learning units 130, and knowledge items 140, as well as their relations, may be displayed in the course overview 830 using icons. To access a sub-course 120 or learning unit 130 shown in the overview, the author may right click and select open sub-course 120 or learning unit 130. Knowledge items 140 may be opened by double clicking on the associated icon.

[0084] As shown in FIG. 10, the dialog box 850 may be used to interact with and edit course components. For example, the dialog box 850 may be arranged with tabs (e.g., general, annotations, keywords, and competency) that may be used to describe the structural elements. Each tab may be used to edit a structural element. The dialog box 850 shown in FIG. 10 includes the tabs general 1010, annotations 1020, and keywords 1030. The dialog box 850 shown in FIG. 10 also includes the fields theme 1040, content 1050, learning time 1060, LOM file 1070, and thumbnail 1080. An author may add content (e.g., an HTML page) and attributes (e.g., a name, a knowledge type, a media type, a LOM, and a competency) to the structural elements using the dialog box 850. The dialog box 850 is automatically configured to correspond to any structural element that has been selected or created in the workspace 860.

[0085] The general tab 1010 enables the author to determine general information and/or attributes that are associated with a selected structural element. A name of a structural element may be provided in a name field (not shown). A thumbnail 1080 may be used to give the author an impression of the content associated with the structural element. A theme 1040 may be included to describe a topic, an attribute, or a knowledge type of the structural element. A learning time 1060 may be used to indicate the average amount of time that a learner may need to complete the content associated with the structural element. A LOM file 1060 may be included to add comprehensive metadata to the structural element.

[0086] The competency tab (not shown) may be used to classify competencies that are acquired by completing or viewing the structural elements. Examples of competencies include, cognitive, emotional, sensomotoric, and social. Competencies also may be included that are needed or recommended to use the associated structural element.

[0087] The annotations tab 1020 may be used to insert comments regarding the content associated with a structural element. For example, notes or a description of the content associated with the structural element may be inserted.

[0088] The keyword tab 1030 may be used to enter keywords that are used to search for and/or organize structural elements. Keywords also may be used to classify a structural element.

[0089] As shown in FIG. 11, the workspace 860 may be used to create the structure of a course. The workspace 860 displays structural elements and relations between the structural elements. Structural elements selected in the overview may be displayed in the workspace 860. Similarly, new structural elements and any associated relation may be created in the workspace 860.

[0090] Structural elements may be represented in the workspace 860 as rectangles. The rectangles may be color coordinated to indicate the type of structural element (e.g., sub-course 120, learning unit 130, knowledge item 140) and whether the structural element is selected or active. Alternatively, the structural elements may be represented in the workspace by a thumbnail indicative of the content associated with the structural element (e.g., as specified in 1080). Relations may be indicated as lines (i.e., non directional relations) or arrows (i.e. directional relations). The displayed rectangles, lines, and arrows may be labeled with a corresponding name (e.g., assigned using the dialog box 850). The workspace 860 also may include tabs 1110 that correspond to each aggregation level. For example, the structural elements belonging to each aggregation level may be accessed by selecting a corresponding tab.

[0091] As shown in FIG. 11, the tab “Course Creation With L3” indicates the course that is currently viewed in the workspace. The tabs “course”, “basic concepts”, and “knowledge structure” correspond to the aggregation levels within the course. The tab “knowledge structure” is selected and the corresponding structural elements and relations are shown. The tab may be populated with a name corresponding to a structural element or aggregation level, which may be assigned using the dialog box 850.

[0092] Structural elements may be added to a course and structured using the workspace 860. For example, a pop-up menu may be accessed by right clicking on the workspace 860. The pop-up menu includes any available structural elements that may be added to the selected tab. To generate a structural element, the author chooses the appropriate button from the pup-up menu corresponding to the type of structural element to be added.

[0093] For example, to generate a sub-course 120, the author selects sub-course 120 from the pop-up menu. Upon selecting the button new sub-course 120, the menu presents a choice of Empty or User. The empty option may be selected to open an empty sub-course 120. The user option may used to open a sub-course 120 with predefined content, such as learning units 130 and/or knowledge items 140. A dialog box 850 corresponding to the sub-course 120 is automatically configured. Using the corresponding dialog box 850 the author may enter a name, attributes, annotations, and keywords for the sub-course 120. The sub-course 120 is added to the course overview 830 and a rectangle with the color-coding corresponding to a sub-course (e.g. green) is added to the workspace 860.

[0094] To generate a learning unit 130, the author may choose the appropriate button from the pop-up menu. Upon selecting the button new learning unit 130, the menu presents a choice of Empty or User. The empty option may be selected to open an empty learning unit 130. The user option may used to open a learning unit 130 with predefined content, such as knowledge items 140. A corresponding dialog box 850 prompts the author to enter a name, attributes, annotations, and keywords for the learning unit 130. The learning unit 130 is displayed in the course overview 830 and appears as a rectangle with the corresponding color-coding (e.g. violet) in the workspace 860. To create a knowledge item 140, the author chooses the appropriate button from the pop-up menu. For example, selecting the button create knowledge item 140 automatically configures a dialog box 850 corresponding to the knowledge item 140. The dialog box 850 may be used to enter a name, attributes, annotations, and keywords corresponding to the knowledge item 140. The knowledge item 140 appears in the course overview 830, and the workspace 860 is populated with a rectangle with the corresponding color-coding (e.g. brown). The dialog box 850 also enables the author to assign content to the knowledge item 140. For example, the content field 1050 in the dialog box 850 may be used to establish a reference to a media file corresponding to the knowledge item 140. The media file may be any media that may displayed by a browser. The author also may assign an appropriate knowledge type (e.g., orientation, explanation, action, reference) and media type (e.g., text, images, diagrams, pictures, sounds, films, video, audio, chat groups, email, video conferences, whiteboards, phones, and PDAs) to the knowledge item 140.

[0095] The pop-up menu also may be used to create tests and collaborative scenarios. When test is selected from the pop-up menu the dialog box 850 appears. The dialog box 850 includes the tabs general, test parameters, annotations, and keywords. The user may use the general tab to insert a name, content, time, and LOM file. In addition, a rectangle test with the corresponding color-coding appears in the workspace. The test parameters tab may be used to indicate a type of test (e.g., pre-test, exercise, self test, or post test. A collaboration scenario may be used to provide an opportunity for the learner to interact with other learners.

[0096] To create a relation between structural elements, the author selects a structural element in the workspace 860. The author then selects a relation from the pop-up menu. The author may drag a line or arrow corresponding to the relation from the selected structural element to a second structural element. The author also may edit and remove unwanted relations by selecting an existing relation in the workspace and using the pop-up menu to edit or delete the relation.

[0097] After completing the course and the associated course structure, the author may activate the embedded learning management system 760 to preview the course. The embedded learning management system 760 applies selected strategies to the course. To preview the course, the author activates the embedded learning management system 760 using the authoring tool. The author then selects a strategy. The embedded learning management system 760 applies the selected strategy to the course structure and determines a navigation path. The navigation path is presented to the author (in a manner that is similar to the display a learner would receive). The author may continue to select other strategies and view the corresponding course navigation path views. Once the author is satisfied with the course structure, the author may transfer the course to the learning system 620 to publish the course.

Course Navigation

[0098] The structure of a course is made up of a number of graphs of the structural elements included in the course. A navigation tree may be determined from the graphs by applying a selected learning strategy to the graphs. The navigation tree may be used to navigate a path through the course for the learner. Only parts of the navigation tree are displayed to the learner at the learning portal based on the position of the learner within the course.

[0099] As described above, learning strategies are applied to the static course structure including the structural elements (nodes), metadata (attributes), and relations (edges). This data is created when the course structure is determined (e.g., by a course author). Once the course structure is created, the course player processes the course structure using a strategy to present the material to the learner at the learning portal.

[0100] To process courses, the content player 720 grants strategies access to the course data and the corresponding attributes. The strategy is used to prepare a record of predicates, functions, operations, and orders that are used to calculate navigation suggestions, which is explained in further detail below.

[0101] The content player 720 accesses files (e.g., XML files storing course graphs and associated media content) in the content repository and applies the learning strategies to the files to generate a path through the course. By applying the learning strategies the content player 720 produces a set of course-related graphs (which is simply an ordered list of nodes) that are used to generate a navigation tree of nodes. The set of nodes may be sorted to generate an order list of nodes that may be used to present a path through the material for a learner. A path maybe generated using the embedded learning management system 760 in the same manner. In general graphs and strategies may “interact” in the following ways:

[0102] 1. A strategy implements a set of Boolean predicates that can be applied to graph nodes. For example: isCompleted(node).

[0103] 2. A strategy may be informed by an event that some sort of action has been performed on a graph node. For example: navigated(node).

[0104] 3. A strategy may provide functions that are used to compute new node sets for a given node. For example: NavigationNodes(node).

[0105] 4. A strategy provides an ordering function that turns node sets computed number 3 into ordered lists.

[0106] 5. A strategy may decide to alter certain strategy-related node attributes. For example: node.setVisited(true).

[0107] Note that the last point is used because a strategy does not keep any internal state. Instead, any strategy-related information is stored in graph nodes' attributes allowing strategies to be changed “on the fly” during graph traversal.

[0108] As described there are sets of nodes that may be used to generate a path through a course. One set of nodes is “navigation nodes.” Navigation nodes may include all nodes that the strategy identifies that may be immediately reached from the current node. In other words, the navigation nodes represent potential direct successors from a current node. Another set of nodes is “start nodes.” Start nodes are potential starting points when entering a new graph. The more starting points this set contains, the more choices a learner has when entering the unit. As a consequence, any strategy should implement at least two functions that can compute these sets and the ordering function that transforms those sets into ordered lists. The functions are described in further detail below using the following examples.

[0109] In the following examples, these definitions are used:

- [0110] C is the set of all courses.
- [0111] G is a set of graphs.
- [0112] V is a set of vertices (e.g., knowledge items, references to learning units, references to sub courses, and test) Vertices are used when talking about graphs in a mathematical sense (whereas nodes may used to refer to the resulting course structure)
- [0113] E is a set of edges (e.g., relations types as used in a mathematical sense).
- [0114] TG={sc,lu} is the set of graph types such that:
- [0115] sc=sub-course; and
- [0116] lu=learning unit.
- [0117] TC={sc,lu,co,tst} is the set of content types such that:
  - [0118] sc=sub-course;
  - [0119] lu=learning unit;
  - [0120] co=content; and
  - [0121] tst=test.
  - [0122] (With respect to assigning competences to a learner when passing a test, only pretests and posttests are defined as tests; self-tests and exercises are content rather than tests.)
- [0123] TK={ . . . } is the set of all knowledge types (e.g., as described in the section E-learning content structure).
- [0124] TR={ . . . } is the set of all relation types(e.g., as described in the section E-learning content structure).
- [0125] BOOL={true,false} is the Boolean set with the values true and false.
- [0126] MAC={ . . . } is the set of macro-strategies (e.g., as described in the section E-learning strategies).
- [0127] MIC={ . . . } is the set of micro-strategies (e.g., as described in the section E-learning strategies).
- [0128] COMP={ . . . } is the set of all competences.
- [0129] LCOMP⊂COMP is the set of a learner's competences.
- [0130] TST={pre,post} is the set of test types, such that:
  - [0131] pre=pretest; and
  - [0132] post=posttest.

[0133] A course c=(G_c,g_s,mac,mic)εC may be defined such that:

- [0134] G_cis the set of all sub-courses and learning units that are members of c;
- [0135] g_sis the start graph of course c, in particular g_sεG;
- [0136] macεMAC is the macro-strategy that has been chosen for navigating the course; and
- [0137] micεMIC is the micro-strategy that has been chosen for navigating the course.

[0138] Processing of the course begins with the start graph. A graph g=(V_g,E_g,t_g,comp_g)εG may be defined such that:

- [0139] V_gis the set of all vertices in g;
- [0140] E_g⊂V_g×V_g×TR is the set of all edges in g;
- [0141] t_gεTG is the graph type of g; and
- [0142] comp_g⊂COMP Are the competencies of the graph.

[0143] In the following description the term content graph is used to identify the sub-graph to which a vertex refers, rather than a graph that includes the vertex. One can think of the vertex representing the “placeholder” of the sub-graph. A vertex ν=(νs_ν,tc_ν,gc_c,tk_ν,tt_ν,mscore_ν, ascore_ν)εV is defined such that:

- [0144] νs_νεBOOL is the visited status of ν;
- [0145] tc_νεTC is the content type of ν;
- [0146] gc_νεG is the content graph of ν;
- [0147] tk_νεTK is the knowledge type of ν;
- [0148] tt_νεTST is the test type of ν;
- [0149] mscore_ν is the maximum possible test score of ν; and
- [0150] ascore_ν is the test score actually attained for ν.
  An edge or relation type e=(ν_S,ν_E,tr_e)εE may be defined such that:
- [0151] ν_SεV is the starting vertex of e;
- [0152] ν_EεV is the end vertex of e; and
- [0153] tr_eεTR is the relation type of e.
  A predicate is a mapping p:V→BOOL that assigns a value b_pεBOOL to each vertex νεV. Therefore:
  b_p=p(ν).
  An order is a mapping ord:V×V→BOOL that assigns a value b_ordεBOOL to a pair of vertices ν₁,ν₂εV. Therefore:
  b_ord=ord(ν₁,ν₂).
  The mapping sort:Vⁿ,ord→Vⁿis a sorting function from a set of vertices Vⁿto a set of vertices (ν₁, . . . , ν_n)={overscore (V)}ⁿwith the order ord, provided that:

[0154] (ν₁, . . . , ν_n)=sort(Vⁿ,ord) such that

[0155]

\underset{i, j \in (1 \dots n), i \neq j}{\forall} v_{i}, v_{j} \in V^{n} : ord (v_{i}, v_{j}) = true

for i≦j.

[0156] The following description explains the use of attributes. Attributes are used to define and implement the learning strategies.

[0157] Let g=(V_g,E_g,t_g,comp_g)εG be a graph with the following attributes:

- [0158] g.nodes=V_gAre the vertices of g;
- [0159] g.type=t_gis the type of g; and
- [0160] g.comp=comp_gis the graph's competencies.

[0161] Let ν=(νs_ν,tc_ν,gc_c,tk_ν,tt_ν,mscore_ν,ascore_ν)∈V be a vertex with the following attributes:

- [0162] ν.visited=νs_ν is the visited status of vertex ν (initially this value is false);
- [0163] ν.graph={g=(V_g,E_g,t_g)εG|νεV_g} is the graph that contains ν;
- [0164] ν.contentType=tc_ν is the content type of ν;

[0165]

v . contentGraph = {\begin{matrix} g^{'} \in G : {tc}_{v} = sc ⋁ {tc}_{v} = lu \\ undef : otherwise \end{matrix}

is the content graph of ν;

- [0166] ν.knowType=tk_ν is the knowledge type of ν;

[0167]

v . testType = {\begin{matrix} {tt}_{v} \in TST : {tc}_{v} = tst \\ undef : otherwise \end{matrix}

is the test type of ν;

- [0168] ν.mscore=mscore_ν is the maximum possible test score of ν (initially this value is 0);
- [0169] ν.ascore=ascore_ν is the actual test score attained for ν (initially this value is −1

[0170] Let e=(ν_S,ν_E,tr_e)εE be an edge with the following attributes:

- [0171] e.start=ν_Sis the starting vertex of e;
- [0172] e.end=ν_Eis the end point of e;
- [0173] e.type=tr_eis the relation type of e;

[0174] An edge's logical direction does not necessarily have to agree with the direction indicated by the course player, because the course player displays an edge in the “read direction.” This applies to the following edge, for example, e=(ν_S,ν_E,“is a subset of”). The following explanation refers to the logical direction, in other words, the direction of the edge in the above-described cases is considered to be “rotated.” In the following, undirected edges are treated as two edges in opposite directions.

[0175] Predicates are “dynamic attributes” of vertices. The strategy computes the dynamic attributes for an individual vertex when necessary.

[0176] The following are examples of predicates:

- [0177] Visited(ν): the vertex ν has already been visited;
- [0178] Suggested(ν): the vertex ν is suggested;
- [0179] CanNavigate(ν): the vertex ν can be navigated; and
- [0180] Done(ν): the vertex ν is done.

[0181] If a vertex is within a learning unit (i.e., ν.graph.type=lu), then the micro-strategy is used to compute the predicates. The macro-strategy that is chosen is responsible for determining all other vertices.

[0182] Functions are used to compute the navigation sets (vertices that are displayed). A function should return a set of vertices. The strategies implement the functions.

[0183] For example, the following functions are:

- [0184] {overscore (V)}=StartNodes(g)={{overscore (ν)}|{overscore (ν)} is a starting vertex of g} is the set of all starting vertices of graph g. Starting vertices are the vertices of a graph from which navigation within the graph may be initiated in accordance with a chosen strategy.
- [0185] {overscore (V)}=NextNodes(ν)={{overscore (ν)}|{overscore (ν)} is a successor of ν} is the set of all successor vertices of vertex ν.

[0186] For micro-strategies, the chosen macro-strategy calls the functions as needed. When entering a learning unit the macro-strategy selects the appropriate (selected) micro-strategy.

[0187] Operations provide information to the chosen strategy about particular events that occur during navigation of a course. The strategy may use them to change the attributes. The operations are:

- [0188] navigate(ν); The runtime environment calls this operation as soon as the vertex ν is navigated during the navigation of the course.
- [0189] testDone(ν,MaxScore,ActScore); The runtime environment calls this operation if the vertex ν is a test (ν.contentType=tst) that has been done. MaxScore contains the maximum possible score, ActScore the score actually attained.

[0190] If a vertex is in a learning unit, which means that ν.graph.type=lu, then the micro-strategy computes these operations. The macro-strategy is responsible for all other vertices.

[0191] The runtime environment uses the sorting function to order the navigation sets that have been computed. The order determines the sequence in which the vertices are to be drawn. The “most important” vertex (e.g., from the strategy's point of view) is placed at the start of the list (as the next vertex suggested). The strategies implement these sorting functions and the runtime environment provides them. The following examples of sorting functions may be defined:

[0192] sortNav(V) is used to sort the set of navigation vertices.

[0193] The sorting functions are called automatically as soon as the functions have returned sets of vertices to the strategy in question. It is consequently necessary that each macro and micro-strategy have a sorting function at its disposal.

[0194] The following description explains the predicates, operations, functions, and sorting functions associated with macro-strategies.

[0195] The following is an example of how a top-down (deductive) learning strategy may be realized.

[0196] The predicates for the top-down strategy may be defined as follows:

- [0197] Visited (ν):ν.visited
- [0198] The vertex's “visited” attribute is set.
- [0199] Suggested(ν):∀({overscore (ν)},ν,tr)εE such that tr=prerequisite we have:
- [0200] Done({overscore (ν)})=true
- [0201] All of the vertex's prerequisites are satisfied.
- [0202] CanNavigate(ν):Suggested(ν)
- [0203] Is used in this example like Suggested.
- [0204] Done(ν):
- [0205] (ν.contentTypeε{sc,lu}ν.contentGraph.comp≠Ø⊂LCOMP)
- [0206] (ν.contentType≠tst ν.visited=true (∀{overscore (ν)}εStartNodes(ν.contentGraph):Done({overscore (ν)})=true)) (c.contentType≠tst (ν.ascore*2)≧ν.mscore)
- [0207] The vertex ν is considered done if at least one of the following conditions holds:
  - [0208] It includes a learning unit or sub-course that has at its disposal a nonempty set of competences that the learner already possesses;
  - [0209] It does not contain a test, is visited, and all of the content graph's starting vertices have been done; and/or
  - [0210] It deals with a test and at least half of the maximum score has been attained.
    The functions for the top-down strategy may be defined as follows:

[0211]

StarNodes (g) = {\begin{matrix} g = undef : Ø \\ g . type = lu : c . mic . StartNodes (g) \\ g . type = sc : {v \in V_{g} | \forall (v^{*}, v, tr) \in E : tr \neq heirarchical} \end{matrix}

- [0212] If g is undefined, which means that vertex does not have any content graphs, then the set is empty.
- [0213] If g is a learning unit, the StartNodes( ) function of the chosen micro-strategy will be used.
- [0214] If g is a sub-course, all vertices that do not have any hierarchical relations referring to them will be returned.
- [0215] NextNodes(ν)={{overscore (ν)}εV_νgraph|∃(ν,{overscore (ν)},tr)}∪StartNodes(ν.contentGraph)
- [0216] All vertices connected to ν by an externally directed relation, plus all vertices that are starting vertices of the content graph of ν.

[0217] The operations for top-down may be defined as follows:

- [0218] navigate(ν):ν.visited=true
- [0219] The vertex's “visited” attribute is set to true.
- [0220] testDone(ν,MaxScore,ActScore):ν.mscore=MaxScore,ν.ascore=ActScore
- [0221] if

[0222]

{\begin{matrix} Done (v) = true : LCOMP = LCOMP ⋃ v . graph . comp, \forall \overline{v} \in v . graph : \overline{v} . visited = true \\ Done (v) = false : \forall \overline{v} \in v . graph : \overline{v} . visited = false \end{matrix}

- [0223] The maximum test score and the test score actually attained for the vertex are both set.
- [0224] If the test is passed, the learner competences will be enlarged to include the competences of the graph, and all of the graph's vertices will be set to “visited.”
- [0225] If the test is not passed, all of the graph's vertices are reset to “not visited.”

[0226] The sorting function sortNav(V) may be defined upon an order relation <:V₁×V₂→bool on a set of vertices. This requires that the following auxiliary functions be defined:

- [0227] 1. An order relation for vertices with respect to the vertex ID
- [0228] <_id:V×V→bool
- [0229] ν₁≦_idν₂:ν₁.id<ν₂.id
- [0230] 2. A comparison relation for vertices with respect to the vertex ID
- [0231] =:V×V→bool,
- [0232] ν₁=ν₂:ν₁.id=ν₂.id
- [0233] 3. An order relation on the test types and unit types
- [0234] <_test:(TC×TST)×(TC×TST)→bool
- [0235] (tst,pre)<(co,undef)<(lu,undef)<(tst,post)
- [0236] 4. An order relation based on 3. for vertices with respect to the test types and unit types.
- [0237] <_test:V×V→bool
- [0238] ν₁<_testν₂:(ν₁.contentType,ν₁.testType)<_test(ν₂.contentType,ν₂.testType
- [0239] 5. A comparison relation for vertices with respect to the test types and unit types
- [0240] =_test:V×V→bool
- [0241] ν₁=_testν₂:(ν₁.contentType,ν₁.testType)=(ν₂.contentType,ν₂.testType)
- [0242] 6. An order relation on the knowledge types based on one of the micro-strategies (see micro-strategies)
- [0243] <_micro:TK×TK→bool
- [0244] 7. An order relation based on 6. on the vertices with respect to the micro-strategies.
- [0245] <_micro:V×V→bool
- [0246] ν₁<_microν₂:ν₁.knowType<_microν₂.knowType
- [0247] 8. A comparison relation to the vertices in regard to the knowledge types
- [0248] =_micro:V×V→bool
- [0249] ν₁=_microν₂:ν₁.knowType=ν₂.knowType

[0250] Using these definitions the function <:V₁×V₂→bool may be defined as follows:

[0251]

v_{1} < v_{2} :⇔ {\begin{matrix} v_{1} . contentType \neq tst ⋀ \\ \exists v \in V_{1} : [(v_{1}, v, prereq) \in E_{1} ⋀ v . contentType \neq tst ⋀ v_{1} < v ⋀ v \leq v_{2}] \\ ⋁ v_{1} <_{test} v_{2} \\ ⋁ v_{1} =_{test} v_{2} ⋀ v_{1} <_{id} v_{2} & if & g_{1} = g_{2}, t_{1} \neq lu \\ v_{1} . contentType \neq tst ⋀ \\ \exists v \in V_{1} : [(v_{1}, v, prereq) \in E_{1} ⋀ v . contentType \neq tst ⋀ v_{1} < v ⋀ v \leq v_{2}] \\ ⋁ v_{1} <_{test} v_{2} \\ ⋁ v_{1} =_{test} v_{2} ⋀ v_{1} <_{micro} v_{2} \\ ⋁ v_{1} =_{test} v_{2} ⋀ v_{1} =_{micro} v_{2} ⋀ v_{1} <_{id} v_{2} & if & g_{1} = g_{2}, t_{1} = lu \\ \exists v = (vs, t_{1}, g_{1}, tk, tt, ms, as) \in V_{2} : (v, v_{2}, tr) \in E_{2} ⋀ tr \in {prereq, hierarchical} & if & g_{1} \neq g_{2}, t_{1} = lu, t_{2} \neq lu \\ false & otherwise \end{matrix}

[0252] Note, if g₁=g₂, then it is obvious that V₁=V₂, E₁=E₂, t₁=t₂and comp₁=comp₂. In addition, in case 3, a situation is maintained in which no direct relation between the vertices exists, but there does exist a relation to the higher-order vertex. The order relation will then also apply to all of the vertices in this vertex's content graph. This situation is depicted in FIG. 12, where ν is the vertex that represents the learning unit and ν₁,ν₂are the vertices under consideration.

[0253] The function sortNav(V) is the sort of the set V in accordance with the order relation <.

[0254] The following process is one method of implementing the function sortNav(V):

- [0255] 1. V_preTest={νεV|ν.contentType=tstν.testType=pre}: the set of all pretests.
- [0256] 2. V=V−V_preTest: remove all pretests from V.
- [0257] 3. V_postTest={νεV|ν.contentType=tstν.testType=post}: the set of all posttests.
- [0258] 4. V=V−V_postTest: remove all posttests from V.
- [0259] 5. V_preReq={νεV|∃({overscore (v)},ν,tr)εE:tr=prerequisite}: the set of all vertices that have a prerequisite relation directed toward them.
- [0260] 6. V=V−V_preReq: remove all vertices in V_preReqfrom V.
- [0261] 7. L=V_preTest: add all pretests into the sorted list.
- [0262] 8. L=L∪{νεV|ν.contentType=co},V=V−L: enlarge the sorted list to include all vertices that have a learning unit and then remove these vertices from V.
- [0263] 9. L=L∪{νεV|ν.contentType=lu},V=V−L: enlarge the sorted list to include all vertices that contain a learning unit and then remove these vertices from V.
- [0264] 10. L=L∪V: enlarge the sorted list to include the remaining vertices from V.
- [0265] 11. Search for all vertices in νεV_preReq:
  - [0266] the vertex νεL such that
  - [0267] (ν*,ν,prerequisite)εEdist(ν*)=MAX (the vertex that is located farthest back in Land that possesses a prerequisite relation to ν).
  - [0268] Add ν into L behind ν*.
- [0269] 12. L=L∪V_postTest: enlarge the sorted list to include all posttests.
- [0270] 13. Return the sorted list L as the result.

[0271] The subsets determined in steps 7–12 are themselves sorted by the order relation <_id.

[0272] The following is an example of how a bottom-up (Inductive) learning strategy may be implemented.

[0273] The predicates for this strategy may be the same as those used for the macro-strategy, top-down. The functions for bottom-up may be defined as follows:

[0274]

StartNodes (g) = {\begin{matrix} g = undef : \emptyset \\ g . type = lu : c . mic . StartNodes (g) \\ g . type = sc : {v \in V_{g} | \forall (v^{*}, v, tr) \in E : tr \neq hierarchical} \end{matrix}

- [0275] If g is undefined, the vertex doesn't have a content graph and the set is empty.
- [0276] If g is a learning unit, then the StartNodes( ) function of the chosen micro-strategy will be used.
- [0277] If g is a sub-course, then all vertices that do not have any hierarchical relations referring to them will be returned.

[0278]

NextNodes (v) = {\overline{v} \in V_{v graph} ❘ \exists (\overline{v}, v, tr)} ⋃ {\begin{matrix} v . contentType = le ⋀ \exists (v, v^{*}, tr) \in E : tr = hierarchic ⋀ Done (v^{*}) = false : \\ OrientationOnly . StartNodes (v . contentGraph) \\ else : \\ StartNodes (v . contentGraph) \end{matrix}}

- [0279] All vertices that are connected to ν by an externally directed relation.
- [0280] If the vertex contains a learning unit and one of the hierarchically subordinate vertices has not yet been visited, enlarge the set to include the learning unit's starting vertex using the micro-strategy “orientation only.” Otherwise, enlarge the set to include all vertices that are starting vertices of the content graph of ν.

[0281] The operations and sorting function for the bottom-up strategy are the similar to the macro-strategy top-down and therefore are not repeated.

[0282] Linear macro-strategies represent a special case of the macro-strategies that have already been described. In linear macro-strategies, the elements of the sorted sets of vertices are offered for navigation sequentially, rather than simultaneously. This linearization may be applied to any combination of macro and micro-strategies.

[0283] The following description includes examples of how a micro-strategy may be realized. In this example, an orientation only micro-strategy is described.

[0284] The predicates for the micro-strategies may be defined as follows:

- [0285] Visited (ν):ν.visited
- [0286] The vertex's “visited” attribute is set.
- [0287] Suggested(ν):∀({overscore (ν)},ν,tr)εE such that tr=prerequisite we have:
- [0288] Done({overscore (ν)})=true
- [0289] All of the vertex's prerequisites are already satisfied.
- [0290] CanNavigate(ν):Suggested(ν)
- [0291] This may be used like Suggested.
- [0292] Done(ν):
- [0293] (ν.contentType≠tst ν.visited=true)
- [0294] (c.contentType=tst (ν.ascore*2)≧ν.mscore)
- [0295] The vertex ν is considered done if:
  - [0296] It does not contain a test and has already been visited.
  - [0297] It deals with a test and at least half of the maximum score has been attained.
- [0298] The functions may be defined as follows:
  - [0299] StartNodes(g)={νεV_g|ν.knowType=Orientation}∪{νεV_g|∃(ν,{overscore (ν)},tr)εE:tr=prereq{overscore (ν)}.knowType=Orientation}
  - [0300] The set of all vertices with knowledge type orientation, plus all vertices that have a prerequisite relation to a vertex with knowledge type orientation.
  - [0301] NextNodes(ν)=Ø
  - [0302] For this micro-strategy, this is always the empty set. In other words, no successor vertices exist because all relevant vertices are contained in the set of starting vertices.
- [0303] The operations may be defined as follows:
- [0304] navigate(ν):ν.visited=true
- [0305] The vertex's “visited” attribute is set to true.
- [0306] testDone(ν,MaxScore,ActScore):ν.mscore=MaxScore,ν.ascore=ActScore
- [0307] if

[0308]

{\begin{matrix} Done (v) = true : LCOMP = LCOMP ⋃ v . graph . comp, \forall \overline{v} \in v . graph : \overline{v} . visited = true \\ Done (v) = false : \forall \overline{v} \in v . graph : \overline{v} . visited = false \end{matrix}

- [0309] The maximum test score and the test score actually attained for the vertex are both set.
- [0310] If the test is passed, the learner competences will be enlarged to include the competences of the graph, and all of the graph's vertices will be set to “visited.”
- [0311] If the test is not passed, all of the graph's vertices are reset to “not visited.”

[0312] The micro-strategy orientation only may use a sorting function that is similar to sorting function for the macro-strategy top-down and, therefore is not repeated.

[0313] The following is an example of the implementation of an example oriented micro-strategy. The predicates for this strategy are identical to those for the micro-strategy orientation only and are not repeated.

[0314] The functions may be defined as follows:

- [0315] StartNodes(g)=V_g
- [0316] All vertices that are contained in the learning unit.
- [0317] NextNodes(ν)=Ø
- [0318] For this micro-strategy, this is always the empty set.
- [0319] In other words, no successor vertices exist because all relevant vertices are contained in the set of starting vertices.

[0320] The operations for the example-oriented micro-strategy are identical to those for the micro-strategy “orientation only,” and, therefore, are not repeated.

[0321] The sorting function for example-oriented is defined as follows:

[0322]

v_{1} < v_{2} :⇔ {\begin{matrix} v_{1} <_{test} v_{2} ⋁ \\ v_{1} =_{test} v_{2} ⋀ v_{1} <_{td} v_{2} & if & v_{2} . contentType = tst \\ \exists (v_{1}, v_{2}, tr) \in E : tr = prereq ⋁ \\ (v_{1} . knowType = Example ⋀ v_{1} <_{id} v_{2}) & if & v_{2} . knowType = Example \\ v_{1} . knowType = Example ⋁ \\ v_{1} <_{id} v_{2} & otherwise \end{matrix}

[0323] Steps for executing sortNav(V):

- [0324] 1. V_examp={νεV|ν.knowType=Example}∪{νεV|∃(ν,{overscore (ν)},tr)εE:tr=prereq{overscore (ν)}.knowType=Example}: the set of all vertices that contain examples, plus the prerequisites of these vertices.
- [0325] 2. V_remain=V−V_examp: the remaining vertices from V.
- [0326] 3. L_examp=TopDown.sortNav(V_examp): sort the set of examples using the sorting algorithm from the top-down strategy.
- [0327] 4. L_remain=TopDown.sortNav(V_remain): sort the set of remaining vertices using the sorting algorithm from the top-down strategy.
- [0328] 5. L=L_examp∪L_remain: form the union of the two sorted lists.
- [0329] 6. Return the sorted list L as the result.

[0330] The predicates, functions, and operations for the micro-strategy explanation-oriented are identical to those for the micro-strategy example-oriented, and, therefore are not repeated. The sorting function for the explanation-oriented micro-strategy is similar to the sorting function of the micro-strategy example-oriented (the only difference being that explanations, rather than examples, are used to form the two sets).

[0331] The predicates, functions, and operations for the micro-strategy action-oriented are identical to those for the micro-strategy example-oriented, and, therefore are not repeated. The sorting function for the action-oriented micro-strategy is similar to the sorting function of the micro-strategy example-oriented (the only difference being that actions, rather than examples, are used to form the two sets).

[0332] A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, advantageous results may be achieved if the steps of the disclosed techniques are performed in a different order and/or if components in a disclosed system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components. Accordingly, other implementations are within the scope of the following claims.

Claims

What is claimed is:

1. One or more machine-readable media that store executable instructions which, when executed, generate a course editor for an electronic course, the course editor comprising:

an input to accept author commands; and

an interface to edit the electronic course in response to the author commands, the interface comprising:

a workspace to display structural elements that comprise the electronic course, the workspace displaying the structural elements graphically as the structural elements relate to one another in the electronic course, the workspace providing functionality that allows an author to edit, interactively on the workspace, content of the structural elements and relationships among the structural elements, the relationships among the structural elements defining a flow through the electronic course;

wherein display of the structural elements is dictated by a learning strategy that is applied to the structural elements to affect the flow through the electronic course, the structural elements storing attributes relating to the learning strategy, and the learning strategy altering at least one of the attributes when the learning strategy is applied to the structural elements.

2. The machine-readable media of claim 1, wherein the workspace comprises a menu of structural elements that may be added to the electronic course.

3. The machine-readable media of claim 2, wherein the workspace displays a new structural element in response to an author command selecting the new structural element from the menu.

4. The machine-readable media of claim 1, wherein the structural elements comprise at least one of a sub-course, a learning unit, and a knowledge item.

5. The machine-readable media of claim 1, wherein the workspace comprises one or more tabs, each tab corresponding to a content aggregation level to display structural elements corresponding to the content aggregation level.

6. The machine-readable media of claim 1, wherein the workspace provides a relation between at least two structural elements that is used to indicate a dependency between the at least two structural elements.

7. The machine-readable media of claim 6, wherein the relation is true in one direction only.

8. The machine-readable media of claim 6, wherein the relation is true in two directions.

9. The machine-readable media of claim 6, wherein the relation comprises a subject taxonomic relation.

10. The machine-readable media of claim 9, wherein the subject taxonomic relation comprises a hierarchical relation.

11. The machine-readable media of claim 10, wherein the hierarchical relation comprises one of a part/whole relation and an abstraction relation.

12. The machine-readable media of claim 9, wherein the subject taxonomic relation comprises an associative relation.

13. The machine-readable media of claim 12, wherein the associative relation comprises one of determines, side-by-side, alternative to, opposite to, precedes, context of, process of, values, means of, and affinity.

14. The machine-readable media of claim 6, wherein the relation comprises a non-subject taxonomic relation.

15. The machine-readable media of claim 14, wherein the non-subject taxonomic relation comprises a relation that indicates that a target structural element should be completed before proceeding to a related structural element.

16. The machine-readable media of claim 14, wherein the non-subject taxonomic relation comprises a relation that indicates that a target structural element belongs to another structural element.

17. The machine-readable media of claim 1, wherein the workspace comprises a menu of relations that enable an author to select a relation from the menu and to insert the relation between a first structural element and a second structural element displayed in the workspace.

18. The machine-readable media of claim 17, wherein the interface inserts the relation into displayed structural elements in response to receiving author commands selecting the first structural element and dragging the relation from the first structural element to the second structural element.

19. The machine-readable media of claim 1, wherein the interface comprises a dialog box displaying one or more fields corresponding to a structural element displayed in the workspace.

20. The machine-readable media of claim 19, wherein the one or more fields comprise a name field.

21. The machine-readable media of claim 19, wherein the one or more fields comprise a theme field.

22. The machine-readable media of claim 19, wherein the one or more fields comprise a content field to assign content to a structural element displayed in the workspace.

23. The machine-readable media of claim 19, wherein the one or more fields comprise a media type field.

24. The machine-readable media of claim 19, wherein the one or more fields comprise a learning time field.

25. The machine-readable media of claim 19, wherein the one or more fields comprise a thumbnail field.

26. The machine-readable media of claim 19, wherein the one or more fields comprise an attribute field to assign a knowledge type to a structural element displayed in the workspace.

27. The machine-readable media of claim 19, wherein the dialog box comprises one or more tabs to select different fields.

28. The machine-readable media of claim 27, wherein the one or more tabs comprise a general tab having fields to receive information about content associated with structural elements.

29. The machine-readable media of claim 27, wherein the one or more tabs comprise an annotation tab having a field to receive notes regarding content associated with the structural elements.

30. The machine-readable media of claim 27, wherein the one or more tabs comprise a keyword tab having a field to receive a keyword for use in searching for a structural element that corresponds to the keyword.

31. The machine-readable media of claim 27, wherein the one or more tabs comprise a competency tab having fields to receive competencies gained from content associated with a structural element.

32. The machine-readable media of claim 1, wherein the interface comprises a course overview to display constituent structural elements of the electronic course and relations among the constituent structural elements in the electronic course.

33. The machine-readable media of claim 32, wherein the interface receives an author command selecting a constituent structural element from the course overview and displays a selected constituent structural element in the workspace.

34. The machine-readable media of claim 33, wherein the interface automatically displays a dialog box corresponding to the selected constituent structural element.

35. The machine-readable media of claim 32, wherein the interface receives an author command selecting a relation from the course overview and displays a selected relation and associated structural elements in the workspace.

36. One or more machine-readable media that store executable instructions which, when executed, generate a graphical user interface of a course editor for an electronic course, the graphical user interface comprising:

a workspace window to edit and to display structural elements of the electronic course, the workspace window displaying the structural elements graphically as the structural elements relate to one another in the electronic course, the workspace window providing functionality that allows an author to edit, interactively on the workspace window, content of the structural elements and relationships among the structural elements, the relationships among the structural elements defining a flow through the electronic course, wherein display of the structural elements in the workspace window is dictated by a learning strategy that is applied to the structural elements to affect the flow through the electronic course, the structural elements storing attributes relating to the learning strategy, and the learning strategy altering at least one of the attributes when the learning strategy is applied to the structural elements;

an explorer window to display the structural elements as icons in explorer format; and

a dialog box window to display data fields corresponding to structural elements displayed in the workspace window.

37. The machine-readable media of claim 36, further comprising a menu bar to display course editor menus comprised of functions to control, and to interact with, the course editor.

38. The machine-readable media of claim 36, further comprising a button bar comprising one or more buttons to invoke course editor functions to interact with the workspace, explorer and dialog box windows and contents of the workspace, explorer and dialog box windows.

39. The machine-readable media of claim 36, wherein a structural element is displayed as a rectangle in the workspace window.

40. The machine-readable media of claim 36, wherein the rectangle is color-coded, each type of structural element having a different color.

41. The machine-readable media of claim 36, wherein the workspace window comprises a workspace menu of structural elements that may be added to the electronic course.

42. The machine-readable media of claim 41, wherein the workspace window displays a structural element selected from the workspace menu.

43. The machine-readable media of claim 36, wherein the structural elements comprise at least one of a sub-course, a learning unit, and a knowledge item.

44. The machine-readable media of claim 36, wherein the workspace window comprises one or more tabs, each tab corresponding to a content aggregation level to display structural elements corresponding to the content aggregation level.

45. The machine-readable media of claim 36, wherein the workspace window displays a relation between two structural elements that indicates a dependency between the two structural elements.

46. The machine-readable media of claim 45, wherein the dependency between the two structural elements is indicated by an arrow, the arrow indicating that the dependency applies in one direction only.

47. The machine-readable media of claim 45, wherein the dependency between the two structural elements is indicated by a line, the line indicating that the dependency applies in two directions.

48. The machine-readable media of claim 45, wherein the dialog box specifies that the relation is subject taxonomic.

49. The machine-readable media of claim 48, wherein the dialog box specifies that the relation is hierarchical.

50. The machine-readable media of claim 49, wherein the dialog box specifies that the relation is one of a part/whole relation and an abstraction relation.

51. The machine-readable media of claim 48, wherein the dialog box specifies that the relation is one of determines, side-by-side, alternative to, opposite to, precedes, context of, process of, values, means of, and affinity.

52. The machine-readable media of claim 45, wherein the dialog box specifies that the relation comprises a non-subject taxonomic relation.

53. The machine-readable media of claim 52, wherein the dialog box specifies that the non-subject taxonomic relation comprises a relation that indicates a target structural element should be completed before proceeding to a related structural element.

54. The machine-readable media of claim 52, wherein the dialog box specifies that the non-subject taxonomic relation comprises a relation that indicates that a target structural element belongs to another structural element.

55. The machine-readable media of claim 36, wherein the workspace window comprises a menu of relations and the workspace window displays a relation selected from the menu.

56. The machine-readable media of claim 55, wherein the relation selected from the menu is inserted between structural elements displayed in the workspace window by indicating a first structural element in the workspace window, displaying an indication of the relation extending from the first structural element, and connecting the relation to a second structural element displayed in the workspace window.

57. The machine-readable media of claim 36, wherein the dialog box displays one or more fields corresponding to a structural element displayed in the workspace window.

58. The machine-readable media of claim 57, wherein the one or more fields receive data characterizing a structural element.

59. The machine-readable media of claim 57, wherein the one or more fields comprise a name field.

60. The machine-readable media of claim 57, wherein the one or more fields comprise a theme field.

61. The machine-readable media of claim 57, wherein the one or more fields comprise a content field to assign content to a structural element.

62. The machine-readable media of claim 57, wherein the one or more fields comprise a media type field.

63. The machine-readable media of claim 57, wherein the one or more fields comprise a learning time field.

64. The machine-readable media of claim 57, wherein the one or more fields comprise a thumbnail field.

65. The machine-readable media of claim 57, wherein the one or more fields comprise an attribute field to assign a knowledge type to a structural element displayed in the workspace window.

66. The machine-readable media of claim 57, wherein the dialog box comprises one or more tabs each populated with one or more fields.

67. The machine-readable media of claim 66, wherein the one or more tabs comprise a general tab including fields to receive information about content associated with the structural elements.

68. The machine-readable media of claim 66, wherein the one or more tabs comprise an annotation tab that comprises a field to receive notes regarding content associated with the structural elements.

69. The machine-readable media of claim 66, wherein the one or more tabs comprise a keyword tab including a field to receive a keyword for use in searching for a structural element that corresponds to the keyword.

70. The machine-readable media of claim 66, wherein the one or more tabs comprise a competency tab comprising a field to receive competencies gained from the content associated with the structural elements.

71. The machine-readable media of claim 36, wherein the explorer window displays an indication of a selected structural element and the workspace window displays the selected structural element.

72. The machine-readable media of claim 71, wherein the dialog box window automatically adjusts display in accordance with the selected structural element.

73. The machine-readable media of claim 36, wherein the graphical user interface displays a learning strategy window to specify the learning strategy and to generate a navigation path window to display a suggested sequence of structural elements based on the learning strategy.

74. The machine-readable media of claim 36, wherein the workspace, explorer and dialog box windows are automatically sized to fit on a corresponding display.

75. The machine-readable media of claim 74, wherein one or more of the workspace, explorer and dialog box windows comprises a vertical scroll bar to access and to display window portions.

76. The machine-readable media of claim 74, wherein one or more of the workspace, explorer and dialog box windows comprises a horizontal scroll bar to access and to display window portions.

Patent Citations (83)

Patent	Date	Inventor	Cited By
US5008853(A)	1991-04-01	Bly et al.	Applicant
US5310349(A)	1994-05-01	Daniels et al.	Examiner
US5395243(A)	1995-03-01	Lubin et al.	Applicant
US5584699(A)	1996-12-01	Silver	Examiner
US5675802(A)	1997-10-01	Allen et al.	Applicant
US5692125(A)	1997-11-01	Schloss et al.	Applicant
US5727950(A)	1998-03-01	Cook	Applicant
US5788508(A)	1998-08-01	Lee et al.	Examiner
US5802514(A)	1998-09-01	Huber	Examiner
US5881315(A)	1999-03-01	Cohen	Applicant
US6011949(A)	2000-01-01	Shimomukai	Applicant
US6014134(A)	2000-01-01	Bell et al.	Examiner
US6029043(A)	2000-02-01	Ho et al.	Applicant
US6091930(A)	2000-07-01	Mortimer et al.	Examiner
US6099320(A)	2000-08-01	Papadopoulos	Examiner
US6112049(A)	2000-08-01	Sonnenfeld	Applicant
US6134552(A)	2000-10-01	Schroeder et al.	Applicant
US6148338(A)	2000-11-01	Lachelt et al.	Applicant
US6149438(A)	2000-11-01	Richard et al.	Applicant
US6149441(A)	2000-11-01	Pellegrino et al.	Examiner
US6162060(A)	2000-12-01	Richard et al.	Examiner
US6164974(A)	2000-12-01	Carlile et al.	Applicant
US6175841(B1)	2001-01-01	Loiacono	Examiner
US6315572(B1)	2001-11-01	Owens et al.	Examiner
US6336813(B1)	2002-01-01	Siefert	Applicant
US6347333(B1)	2002-02-01	Eisendrath et al.	Applicant
US6347943(B1)	2002-02-01	Fields et al.	Applicant
US6368110(B1)	2002-04-01	Koenecke et al.	Applicant
US6370355(B1)	2002-04-01	Ceretta et al.	Applicant
US6381444(B1)	2002-04-01	Aggarwal et al.	Applicant
US6397036(B1)	2002-05-01	Thean et al.	Applicant
US6398556(B1)	2002-06-01	Ho et al.	Applicant
US6430563(B1)	2002-08-01	Fritz et al.	Applicant
US6470171(B1)	2002-10-01	Helmick et al.	Applicant
US6471521(B1)	2002-10-01	Dornbush et al.	Applicant
US6514085(B1)	2003-02-01	Slattery et al.	Applicant
US6527556(B1)	2003-03-01	Koskinen	Applicant
US6587668(B1)	2003-07-01	Miller et al.	Applicant
US6606480(B1)	2003-08-01	Pezzuti et al.	Applicant
US6622003(B1)	2003-09-01	Denious et al.	Applicant
US6633742(B1)	2003-10-01	Turner et al.	Applicant
US6643493(B1)	2003-11-01	Kilgore	Applicant
USRE38432(E)	2004-02-01	Fai et al.	Applicant
US6701125(B1)	2004-03-01	Lohse	Applicant
US6709330(B1)	2004-03-01	Klein et al.	Examiner
US6729885(B1)	2004-05-01	Stuppy et al.	Applicant
US6801751(B1)	2004-10-01	Wood et al.	Applicant
US2001/0044728(A1)	2001-11-01	Freeman et al.	Applicant
US2001/0047310(A1)	2001-11-01	Russell	Applicant
US2002/0006603(A1)	2002-01-01	Peterson et al.	Applicant
US2002/0042041(A1)	2002-04-01	Owens et al.	Applicant
US2002/0061506(A1)	2002-05-01	Catten et al.	Applicant
US2002/0073063(A1)	2002-06-01	Faraj	Applicant
US2002/0138841(A1)	2002-09-01	Ward	Applicant
US2002/0142278(A1)	2002-10-01	Whitehurst et al.	Applicant
US2002/0188583(A1)	2002-12-01	Rukavina et al.	Applicant
US2003/0013073(A1)	2003-01-01	Duncan et al.	Applicant
US2003/0049593(A1)	2003-03-01	Parmer et al.	Applicant
US2003/0073063(A1)	2003-04-01	Dattaray et al.	Applicant
US2003/0073065(A1)	2003-04-01	Riggs	Applicant
US2003/0082508(A1)	2003-05-01	Barney	Applicant
US2003/0113700(A1)	2003-06-01	Simon	Applicant
US2003/0129576(A1)	2003-07-01	Wood et al.	Applicant
US2003/0152899(A1)	2003-08-01	Krebs et al.	Applicant
US2003/0152900(A1)	2003-08-01	Krebs et al.	Applicant
US2003/0152901(A1)	2003-08-01	Altenhofen et al.	Applicant
US2003/0152902(A1)	2003-08-01	Altenhofen et al.	Applicant
US2003/0152903(A1)	2003-08-01	Theilmann	Applicant
US2003/0152904(A1)	2003-08-01	Doty, Jr.	Applicant
US2003/0152905(A1)	2003-08-01	Altenhofen et al.	Applicant
US2003/0152906(A1)	2003-08-01	Krebs et al.	Applicant
US2003/0157470(A1)	2003-08-01	Altenhofen et al.	Applicant
US2003/0163784(A1)	2003-08-01	Daniel et al.	Applicant
US2003/0175664(A1)	2003-09-01	Frangenheim et al.	Applicant
US2003/0175676(A1)	2003-09-01	Theilmann et al.	Applicant
US2003/0195946(A1)	2003-10-01	Yang	Applicant
US2003/0211447(A1)	2003-11-01	Diesel et al.	Applicant
US2003/0224339(A1)	2003-12-01	Jain et al.	Applicant
US2004/0081951(A1)	2004-04-01	Vigue et al.	Applicant
GB2373625(A)	2002-09-01		Applicant
WO99/09490	1999-02-01		Applicant
WO2/21379	2002-03-01		Applicant
WO2/073442(A)	2002-09-01		Applicant

Non-Patent Literature (20)

Jörg Siekmann et al., “Adaptive Course Generation and Presentation,” ITS Workshop on Adaptive and Intelligent Web-Based Foundation System, Montreal, The Omega Group; pp. 1-10, 2000.Applicant
Lai Jin et al., “An Ontology-Aware Authoring Tool—Functional structure and guidance generation,” Proceedings of AIED '99, pp. 85-92, LeManns France, 1999.Applicant
Dietrich Albert et al., “Adaptive and Dynamic Hypertext Tutoring Systems Based on Knowledge Space Theory,” AIED '97 Artificial Intelligence in Education, Amsterdam vol. 39 of Froulier in Artificial Intelligence and Application, 1997.Applicant
Sylvie Ranwez et al., “Description and Construction of Pedagogical Material using an Ontology based DTD,” AIED '99 Workshop 2 proceedings “Ontologies for Intelligent Educational Systems”, pp. 1-4, 1999.Applicant
Michael Jungmann et al., “Adaptive Hypertext in Complex Information Spaces,” Daimler-Benz Research & Technology, Technical University of Illmenau, pp. 1-5, Mar. 8, 1997.Applicant
Nicola Henze et al., “Modeling Constructivist Teaching Functionality and Structure in the KBS Hyperbook System,” University of Hannover, pp. 1-12, Jun. 4, 1999.Applicant
Max Mühlhäuser, “Cooperative Computer-Aided Authoring and Learning,” University of Karlsruhe, pp. 107-130, 145-161, 165-192, 273-291, 293-318, 1995.Applicant
Professor Jouko Paaso, “A New Environment for Courseware Development, Course Delivery and Training,” Proceedings of the ED-Media 97, Toronto, 1997.Applicant
U.S. Appl. No. 60/201,500, Adams, filed May 3, 2000.Applicant
U.S. Appl. No. 60/272,251, Ward, filed Feb. 28, 2001.Applicant
U.S. Appl. No. 60/329,088, Riggs, filed Oct. 12, 2001.Applicant
U.S. Appl. No. 60/334,714, Diesel, filed Nov. 1, 2001.Applicant
U.S. Appl. No. 60/400,606, Diesel, filed Aug. 1, 2002.Applicant
Hewlett Packard, “HP OpenView Integration Guide for Developers,” Jul. 2002, [Online], [retrieved from the Internet on Mar. 24, 2004: http://h21007.www2.hp.com/dspp/files/unprotected/OpenView/IntegrationGuide/OV—Integration—Guide—7—30.pdf], pp. 67-92, XP002274908.Applicant
Hewlett Packard, “hp OpenView Service Navigator for hp OpenView Operations 7.x for UNIX Product Brief,” May 2002, [online], [retrieved from the Internet on Mar. 24, 2004: http://www.pervigil.com/PDF/HP/sernav—pb—jun02.pdf], 2 pgs., XP002274906.Applicant
Sun Microsystems, “Developing Web Services with SUN™ Open Network Environment,” Mar. 2002, [online], [retrieved from the Internet Mar. 24, 2004: http:wwws.sun.com/software/sunone/wp-spine/spine.pdf], pp. 1-32, XP002274909.Applicant
Trythall, Steve, “JMS and CORBA Notification Interworking,” Dec. 12, 2001, [online], [retrieved from the Internet Mar. 24, 2004: http://www.onjava.com/pub/a/onjava/2001/12/12/jms—not.html], XP002274907.Applicant
Lipkin, Daniel, “Universal Learning Format Technical Specification,” Jan. 13, 2001, retrieved from the Internet on Jul. 29, 2004, at http://xml.coverpages.org/ulf.html, XP002290517, pp. 1-3.Applicant
Eugster, Patrick, et al., “Distributed Asynchronous Collections: Abstractions for Publish/Subscribe Interaction,” Agilent Lab. and Lombard Odier Co., Jan. 10, 2000, pp. 1-34, SP002171795.Applicant
Shorshita, Teruji et al., “A Large-scale Contents Distribution Architecture Based on Reliable Multicast,” Proceedings Internet Workshop, 1999, IWS '99 Osaka, Japan, Feb. 18-20, 1999, pp. 75-80, XP010365597.Applicant

Abstract