Method and system for accessing multimedia data in an interactive format having reporting capabilities

[0002] The present invention relates generally to multimedia data distribution via computer links and, more particularly, to interactive multimedia data events with recording and reporting capabilities in a computer linked arrangement. More particularly still, the present invention relates to the ability to provide multimedia data to a computer user in an interactive mode that allows a server providing the multimedia data to record and report the user's activity level during a multimedia presentation session and credit the user for reviewing and gaining proficiency in the session subject.

[0003] Computers have become pervasive in all aspects of the business and educational worlds. Computers allow for the generation, storage, retrieval, and interaction with data in useful ways. For example, business uses allow for large amounts of data to be correlated together in the form of data bases or spread sheets that allow a user to categorize and view relationships more rapid than was previously possible without the aid of the computer.

[0004] Computers have also allowed for the dissemination of information either to limited groups or to large audiences via such communication channels as local area networks (LANs), wide area networks (WANs), and the Internet. Within this transmission of information, multimedia presentations have expanded to broaden the information dissemination and educational opportunities available over LANs, WANs, and the Internet.

[0005] The multimedia capabilities of today allow for students or interested persons to view information at their own pace, without needing to attend a class in the traditional sense of a teacher directly teaching students in a classroom setting. A teacher can now video tape a lecture and place it on a communications server so that students can access the lecture according their own schedule. The computer system also provides interactive participation with the lecture so the student, after the lecture has been presented, or at any time during the presentation of the lecture, may pause and reflect upon the subject matter presented in the lecture. This is done by providing a brief question and answer session to gauge the student's understanding. The student can view his or her results and review the lecture to fill in the gaps of information lacking during the evaluation.

[0006] Unfortunately, what has been lacking is the ability to obtain information from various users of the education system and report that information back to a supervisor, such as an instructor (such as a teacher or professor), principal, administrator, or employer of the users in a meaningful and helpful manner for evaluation or review of the user's understanding of the subject matter. For example, educational systems require that teachers continue to improve their teachings skills and understanding of information taught by them in their classrooms. The ability to view a lecture and then evaluate on their own their understanding of the material presented in the lecture is helpful to the teacher, but does not convey to the teacher's supervisor what level of understanding the teacher has obtained. Further, the supervisor of the user would also be interested in knowing more about how long the user took to review the information, how the user performed in the evaluation, what level of interaction did the user have with the lecture presented, how the collective group or groups of educators are doing, and so forth.

[0007] The Internet has provided interactivity where an Internet user is able to browse among various web sites for information. Upon finding a site of interest to the user, that site at times is able to glean information from the user that would be helpful for the web provider in a commercial or social context. For example, a user may visit a commercial site that sells widgets. The widget provider questions the user about what the user's needs are in order for the widget provider to best serve the needs of its clientele. This information is reported back to the widget provider so the widget provider can provide the best commercial site possible based on the needs of its clients.

[0008] Likewise, in a social setting, an advocacy group may provide a web site that invites all to view its positions. The advocacy web site may also solicit input from those that view its web site in order to find out the views and values of those visiting to refine its approach in achieving its goals. Both of these situations are different from the training or educational situation previously described in that the individual providing feedback to the commercial or social sites is not directly associated with the organization, nor is the user being evaluated for comprehension and learning of the disclosed subject matter.

[0009] Accordingly, what is needed is an interactive process that allows for educational and professional development via a computer system coupled to an Internet channel that allows an end user to view a presentation, be evaluated on the understanding gained by the user after the presentation, and reporting the results of the user's activity and evaluation to a supervisor that uses that data to verify, evaluate, and enhance educational or teacher development, which data can also be used for professional development credit or even college credit.

[0010] These and other benefits and features of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.

[0011] According to the present invention, a method and system for managing the teaching, evaluation, and reporting of an instructional segment to a given user, or groups of users, accessing the instructional segment via a computer system are disclosed. The system for managing the instructional segment and providing the evaluation, teaching, and reporting of the user's activity with the instructional segment is implemented within a computer system, typically a network connected system that has access to the Internet. The managing system includes means for streaming the instructional segment to the user for review by the user, means for evaluating the user's comprehension of the instructional segment, and means for reporting the user's evaluation results of the instructional segment to an instructional supervisor or administrator. Further included are means for granting the user access to the instructional segment via a user handle and a private password that are corroborated by the database system during the user accessing the instructional segment.

[0012] The streaming means comprise an electronic data communications channel connected to the user with the computer system. As previously stated, this electronic data communications channel can include a local area network connection, a wide area network connection, or an internet connection that can access such networks as the World Wide Web. The internet connection can be via a LAN connection or direct dial.

[0013] The reporting means includes a database for organizing, storing and retrieving the results of an evaluation performed by the user. The evaluation means electronically generates an exam to be taken by the user and records the results of that evaluation for subsequent review. The reporting means is further capable of reporting the length of time required by the user to complete the evaluation, which is helpful in evaluating how quickly the user assimilates the reviewed materials. The report also includes the results of the evaluation, which may be reported back to the user for the user's own understanding of his or her grasp of the subject matter.

[0014] The reporting means further reports whether the user completed the evaluation and how much of the evaluation has been completed, which instructional segment has been reviewed by the user, as well as whether the user completed the evaluation on the date the user viewed the segment materials. The report can further include the date and time of the evaluation, the I.P. address of the machine on which the user reviewed the materials, whether the activity and response has been verified and when verified, and whether any response or feedback has been sent to the user. This response can be via email or posted on the network accessed by the user using the login and password scheme described earlier. The responses from the users participating in reviewing the sessions can be reviewed real time as the information is provided across the communications link, or it may be saved for offline review and evaluation by the instructional supervisor.

[0015] The method for managing at least one instructional segment to be accessed by a user for providing a teaching, evaluation, and reporting program of that management operation. The method includes streaming the instructional segment to the user for review by the user, evaluating the user's comprehension of the instructional segment, and reporting the user's evaluation results of the instructional segment to an administrator. Further, the reports can be accessed and reported to varying or more than one administrative levels with specific summary data appropriate to the reviewing administrator. At the school level this can include reports to the teacher, department/grade level, school level, which can be organized into feeder zones, area/subdistricts, districts, regions, and finally, state levels.

[0016] In order that the manner in which the above-recited and other advantages and objects of the invention are obtained, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments of the invention and are not therefore to be considered limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:

[0017] FIG. 1 depicts a prior art computer system upon which the management program operates in accordance with the principles of the present invention;

[0018] FIG. 2 illustrates a networked system connecting various user computer systems of FIG. 1 to a management and database system in accordance with the present invention;

[0019] FIG. 3 is a flowchart of the procedure taken by a user to access, review, and be evaluated by the management program in accordance with the present invention;

[0020] FIG. 4 is a flowchart illustrating the procedure of an administrator managing the management program in accordance with the principles of the present invention;

[0021] FIG. 5 illustrates a graphical user interface image of a view of the instructional segment site accessed by a user in accordance with the present invention;

[0022] FIG. 6 illustrates a graphical user interface screen of a log-in screen where the user or administrator gains entry to the resources provided at the instructional site;

[0023] FIG. 7 illustrates a graphical user interface of a user option screen in accordance with the present invention;

[0024] FIG. 8 illustrates a graphical user image title screen in accordance with the principles of the present invention;

[0025] FIG. 9 illustrates a graphical user interface of a segment being viewed by a user, which segment includes a video portion and a still image portion in accordance with the present invention;

[0026] FIG. 10 illustrates a graphical user interface of that of FIG. 9 wherein the still image portion displays text corresponding to the instruction given in the video portion;

[0027] FIG. 11 illustrates a graphical user interface of a questions screen in accordance with the present invention;

[0028] FIG. 12 illustrates a graphical user interface of an administrative user update screen in accordance with the present invention;

[0029] FIG. 13 illustrates a graphical user interface of a questions feedback and response screen in accordance with the present invention;

[0030] FIG. 14 illustrates a graphical user interface of a user report showing viewing history and assignment data in accordance with the present invention;

[0031] FIG. 15 illustrates a graphical user interface of a district setup screen in accordance with the present invention;

[0032] FIG. 16 illustrates a graphical user interface of a department/grade level setup screen in accordance with the present invention;

[0033] FIG. 17 illustrates a graphical user interface of a user maintenance and setup screen in accordance with the present invention;

[0034] FIG. 18 illustrates a graphical user interface of a user setup screen in accordance with the present invention, and

[0035] FIG. 19 illustrates a graphical user interface of a sample feeder zone report screen in accordance with the present invention.

[0036] FIG. 1 illustrates the system architecture for a conventional computer system, such as personal computer that is either IBM- or Macintosh-compatible. The exemplary computer on which the inventive security system can operate. The exemplary computer system of FIG. 1 is for descriptive purposes only. Though the description below may refer to terms commonly used in describing particular computer systems, such as an IBM- or Macintosh-compatible personal computer, the description and concepts equally apply to other systems, including systems having architectures dissimilar to FIG. 1.

[0037] The exemplary computer 100 includes a central processing unit (“CPU”) 105, which may include a conventional microprocessor; a system random access memory (“RAM”) 110 for temporary storage of information and a read only memory (“ROM”) 115 for permanent storage of information. A memory controller 120 is provided for controlling system RAM 110; a bus controller 125 is provided for controlling bus 130; and an interrupt controller 135 is used for receiving and processing various interrupt signals.

[0038] Mass storage may be provided by a diskette 142, a CD-ROM disk 147 or a hard disk 152. The diskette 142 can be inserted into a diskette drive 141, which is, in turn, connected to bus 130 by a controller 140. Similarly, the CD-ROM disk 147 can be inserted into a CD-ROM drive 146, which is also connected by a controller 145 to bus 130. Finally, hard disks 152 are part of a fixed disk drive 151, which is connected to bus 130 by controller 150.

[0039] Input and output to computer system 100 are provided by a number of devices. For example, a keyboard and mouse controller 155 connects to bus 130 for controlling a keyboard input device 156 and a mouse input device 157. A DMA controller 160 is provided for performing direct memory access to system RAM 110. A visual display is generated by a video controller 165, which controls a video output display 170. The computer also includes a communications adapter 190 which allows the system to be interconnected to a local area network (LAN) 195, a wide area network (WAN), as well as provide a Internet connect either via direct dial, or via the LAN or WAN, which is schematically illustrated by bus 191.

[0040] The computer 100 is generally controlled and coordinated by operating system software, such as the Windows 95, 98, or NT, or other compatible operating systems. In the Macintosh systems, the operating system conforms to 7.5.5 and higher. Workstation compatible systems typically use a UNIX-type operating system. Conventional operating systems control and schedule computer processes for execution, perform memory management, provide file system, networking, and I/O services, and provide a user interface, such as a graphical user interface (“GUI”), among other things. User applications, such as editors, spread sheets, and Internet browsers, directly or indirectly rely on these and other capabilities of the operating system.

[0041] Computer 100 connects to a network 195, which provides access to an instructional server database 200, which is shown in FIG. 2. Server database 200 includes a data server 202, communications server 204, and a video server 206. These all may be incorporated in a server computer system similar to computer 100 in hardware configuration, which utilizes an internet browser to provide access to a multitude of instructional media by an end user at computer 100. Further, server database system 200 provides for reporting of a user's interaction to a supervisor. For example, the principal of the school would be a supervisor of a teacher viewing the instructional media. The instructional media provides an interactive session with the teacher, who may answer questions, simple answer or multiple choice, or complete an essay exam or based on the information conveyed during the interactive session. A report of the user's performance and responses are what are forwarded to the supervisor in this example. Other examples include providing test results of a student taking an online instructional course, professionals reviewing continuing professional education requirements such as required in law, accounting or medicine.

[0042] Communications link 191 can be a direct line connecting to database server 200, such as a MODEM connection, DSL connection, ISDN, T-1, satellite, or the like. Link 191 may also be via a network that has an Internet server connected thereto. Further, system 200 may be part of a LAN or WAN and have the instructional media stored there on with management systems resident thereon for organizing and managing the feedback information received from the users which is to be reported back to the appropriate supervisor.

[0043] Server 204 controls the access to the learning resources that are stored within database server 202. Server 204 allows end users, via their computers 100 to access the instructional materials available via the communication channel 191. A user utilizes a web browser, such as, for example, NetScape Navigator™, Microsoft Internet Explorer™, or other web browsers known to those skilled in the art. The instructional materials are down loaded via video server 206 in multimedia form that include streaming or broadcasting video as well as video, audio, and text portions. A streaming video program is utilized as a plug-in to the web browser to allow viewing of the streaming video portion of the instructional segment. Examples of functional streaming video applets include RealPlayer™ provided by RealNetworks, as well as other streaming video products such as Window Media Player provided by MicroSoft, Inc. and QuickTime Player, provided by Apple Corporation.

[0044] The instructional segments are streamed across the communications channel, i.e. the Internet, on demand to the end users. Also, the segments may be stored on a proxy cache server for non-internet access should the net connection be disconnected as well as to increase bandwidth. The users gain access to the authorized programs following a log-in and password sequence. Once logged on, the users can choose from several titles that are within their course materials. FIG. 3 is a block diagram illustrating the method of granting access to the instructional segments, evaluating the user's understanding of the viewed materials, and providing report information back to the user's supervisors in accordance with the principles of the present invention. FIG. 4 is a block diagram illustrating the method of granting an authorized supervisor of one or more users access to user(s) records relating to information viewed and accessed by the user(s). FIGS. 5-12 illustrate screen images of a GUI viewed by either a user, administrator, or both in accessing the instruction materials, the report materials, or other evaluation materials contemplated within the present invention.

[0045] In block 310, the user accesses database server 200 by selecting the appropriate instructional resource, either as web-based URL location via a web browser utilized by the user on the user's computer system 100. Upon accessing the appropriate web page, information is downloaded across the communications channel to the end user's system 100 for display. FIG. 5 illustrates a screen image of a user or administrator accessing an Internet or other computer or network accessible site. View 510 provides the user with several options, including accessing a Professional Development section, or accessing an Educator, Presenter, or Career section. Further, an online bookstore may be included, as well as other options as considered by the developer of the Web site. In this illustration, it is shown that the user is using Microsoft Internet Explorer as a web browser, which is readily available either at a commercial site, store, or free from many well known web sites. Just as the instructional sections are accessible by more than one user, so to the administrative sections can be accessed by more than one instructional leader or administrator.

[0046] For an overview, the system has the user login to access the system. The login is verified before presenting instructional titles for view. The user selects a given title with an appropriate bit rate for viewing and the program begins. The timing of the program begins simultaneously with the program. The system presents questions and content points to the user at the beginning as well. The content then plays for the user's review until end. Once the end is reached, the user reviews and answers the questions, which may be essay or multiple choice or a combination of the two. The questions are then submitted for evaluation and saved on the server.

[0047] The reports used by the administrators are reached after performing a login and verification to access the database. After the login and verification, the administrator views the authorized screen to make his or her selection. The administrator selects either the report or administration section. After making the selection, a data summary is provided for the users within the selected group. At this point, the administrator and select one of the users, review the user's exam, provide feedback to the user and verify the user's completion of the selected instructional segment. The reports also have the ability to auto email the users within the group of their standing re: the instructional segments. This includes notifying the user of his or her results or that the user must review the material and complete the associated exam. The invention will now be described with the continuation from where the user accesses the initial presentation screen.

[0048] The user then makes a selection. At this point a log-in procedure is provided for the user in block 312 that requires the user to enter in a password and log-in handle. FIG. 6 depicts a GUI illustration of the USER LOGIN screen 610. There is a USER login handle 612 and a password field 614. The user clicks on the SUBMIT button 616 to submit the login and user handle information. The system performs the handshake operation to verify the access rights of the user based on the appropriate login handle and password. Upon verification, the system, as shown in block 314, grants access to the title page to allow the user to select among the instructional segments provided for view. Other optional features include joining a chat discussion on the subject matter of a given segment as well as providing a threaded discussion group for review and correspondence among fellow users. The title page 710 is illustrated in the GUI panel of FIG. 7. Further illustrated is a list of exemplary options, such as VIEW VIDEOS, VERIFY RESPONSES, MAINTENANCE hierarchy, REPORTING, MAINTAIN LICENSES, and LOGOUT. Within the MAINTENANCE portion, the administrator, depending upon granted access rights, can access hierarchies at the State/Province, Region, District, School, Department levels. The administrator also has access to the users in the Maintain Educators selection. Other options of course are possible depending upon the subject matter and interest of the system designer.

[0049] If the user is a student and only has access to the VIEW VIDEOS section, then the user will be taken right to a screen image 810 as that shown in FIG. 8, where the user is given a list of titles from which to choose. The underlined titles or options shown in any of the screens may be accessed or activated by highlighting the desired section with the cursor and clicking on it with cursor manipulation device, typically a mouse. The active titles can be hyperlinks to licensed media, such as a video segment, and unlicensed media would be shown as plain text. Further, the user is shown the length of time each segment requires to view as well as whether the user has viewed the segment and whether the segment has been completed, which includes the evaluation or testing portion following the completion of viewing the segment.

[0050] Next, in block 316, the user selects a program along with parameters that define the program by selecting a title as well as the streaming bit rate of the program. Streaming bit rates depend upon the communications connection between the user and server 200. The user informs the server 200 what type of connection the user has and the server then optimizes the transfer of data based on the actual transfer rate established between the user and server. Of course the transfer rates can be determined automatically during the connection protocol sequence used by the server and user's computer. Upon selection of a desired title, database server 200 begins transmitting information over the communications channel to the end user at the selected transfer rate. Prior to the commencement of the instructional material, the questions or content points for the user to review can be provided. This makes the user aware of what to observe during the presentation of the program. Additionally, the user may print the questions or points for review and awareness during the instruction portion of the presentation.

[0051] FIG. 9 is a sample image of a segment screen 910 that includes a video window 912, where video is streamed for the user's review, as well as slide window 914, where text or still images are presented to the user. Server 200 streams program information from its database storage sites to the end user, as shown in block 318. A plurality of still images 914 can be provided with the streaming video portion of the instructional segment as shown in block 320. The still images are displayed in window 914 along side the streaming video, shown in window 912, using timing codes. The user can pause the video window 912 via video controls 916. Video controls 916 also allow the user to replay portions of the video, backtrack, pause, stop, or skip ahead as well as control the volume as needed. The timing of the video is based on the URLs of the slides that are played, which is merely one example of the timing that may be used. Another method to provide timing is to cue the slides to the video, or even to be independent so the teacher or user can select the next slide when ready.

[0052] FIG. 10 illustrates a subsequent window 910 where the still image window 914 displays text. The text is timed to enhance and emphasis points being made by the instructor shown in window 912. In both FIGS. 9 and 10, the user has the ability to select any new Title Index, provide Feedback, access reports designated for that user, as well as obtain Help or Logout of the site by utilizing the appropriate buttons 918 depicted within window 910.

[0053] The still images are an option that supplement the discussion provided with the streaming video by highlighting important points in the instructional segment, which may include dates of interests, formulas relevant to the discussion, illustrative graphics, or lists of related matters for expanding understanding of a given subject. Thus, after selecting a title, the instructional segment streams across the communications channel from the server to the user's computer. As the program begins to stream, a slide presentation is also presented, which is linked to the synchronized time code of the program and video. Instructions are also provided to the user prior to the beginning of the video. The segment contains questions that are presented at the end of the program, as well as questions that are featured at the beginning to stimulate the viewer to be aware of specific strategies, theories, and applications. Each instructional segment lasts between 5 to 90 minutes, including the comprehension test at the conclusion of the session. The actual time varies according to the content level, user sophistication, and bandwidth availability, among others. The system designer can vary the time to under 5 minutes or greater than 90 minutes in accordance with the designer's preferences.

[0054] At the end of the presentation portion of the instructional segment, the assessment questions are automatically posted for the user to answer as depicted in block 324. FIG. 11 illustrates a screen image of a window 1110 displaying a sample questions segment in accordance with the present invention. The user's name, which may be pulled automatically from the login data of step 312, is placed in the NAME field 1112 and the association of the user is placed in DISTRICT/SCHOOL field 1114, which may be re-labeled as BUSINESS/GROUP or SUBJECT/INSTRUCTOR depending on whether the user is part of a group within a given business or is a student studying a particular SUBJECT taught by a given INSTRUCTOR. Other options will be readily apparent to those skilled in the art. As the user answers the questions 916, the user writes the answer within answer window 1118 and then submits the answers back to server 200, shown in block 326. The questions and answers are stored on database server 200 as illustrated in block 328. Database server 200 may be SQL compatible so that the stored answers may be retrieved quickly for viewing by a supervisor having access rights to that particular user's file log. SQL is but one type of compatible databases that may be utilized, other similar database systems may be substituted within the ordinary skill of the artisan. Further, the system can automatically forward the answers to the pertinent administrator for review as depicted in block 330. Or the answers may be held for review offline off the server. Next, in block 332, the answers given by a user(s) are verified and given to the user of the verified answers. Feedback is also provided to the administrator as shown in block 334. The feedback of the evaluation of the user's performance in answering the questions can be given via a direct email to a valid email addressed provided by the user or posted back to the user's personal access point entered via the password and login portion of the site. Of course, the results can be printed and mailed to the user as an option to provide the user with a validated hard copy. Once an instructional segment is completed, the user is allowed to select another title to review or is allowed to log out thereby completing the instructional session. Further, if some user's fail to participate in a timely manner, reminders can be sent to the user via email, voice messaging, or a letter, to remind the user to complete the programs within the allotted time prescribed.

[0055] Administrative reports are generated based upon a user's accessing the instructional segments in accordance with the present invention. These reports are used to provide feedback to instructional leaders or administrators that, in an example of a teacher participating in a teacher development and enhancement program, includes the identity of the faculty member logging accessing the interactive training segment module, the duration of each faculty members time on line, and the results of the comprehension test/activity at the end of each segment or module. The information can further include access date and time, IP address of the machine used by the user, assignment completion, and exam/assignment verification. Administrators or administrators at all levels use this data to verify, evaluate, and enhance staff development throughout their school districts. Likewise, if this were the case of a teacher providing instructional materials on-line for students, the teacher would receive evaluation reports that would include much of the same information. For example, a teacher would want to know how long each student spent on-line viewing the instructional material and how long each student took to answer the comprehension exam at the end of the segment. This would allow the teacher to gauge which subjects and concepts the class as a whole is struggling with as well as what subjects each student comprehends and those topics the student does not comprehend. This allows the teacher to customize the feed back to the student in helping the student understand the content of the lecture material for the comprehensive exam that is to follow.

[0056] FIG. 4 outlines the type of tracking and reporting functionality and information provided by database server 200 to the appropriate supervisor or administration in accordance with principles of the present invention. In block 410, and as shown in FIG. 6, the administrator performs a login authorization and password verification step where server 200 checks the login and password provided by the administrator to verify the administrator can access the system and what rights the administrator has and what database sections are open to the administrator. Next, in block 412, the system manages and verifies the user license segments authorization. At this point, the administrator is allowed access, as shown in Window 710 of FIG. 7, to various levels of information provided for each individual user utilizing the instructional segments for learning and comprehension. System 200, for each individual user, tracks which segments that have been reviewed by the user in block 414, tracks the view time of each segment, as shown in block 416, and tracks when the segment was viewed as well as shown in block 418. The system also tracks the date the segment is viewed (block 420), the IP addresses of the programs being viewed (block 422), and which segments were completed (block 424). Furthermore, the system tracks when the segments were completed (block 426), how much of the segment was actually completed (block 428), and which segment assignments that have been checked and verified by the administrator (block 430). Once the administrator has reviewed the report of the user's access of the instructional segments, the administrator then generates, in block 432, a feedback report to the user regarding the assignment answers to be posted either via E-mail (or as an amended message on the user's assignment page on the server, or through a hard printed report sent through the mail, or a combination of the three, among others. Further, the system, in block 434, displays whether an assignment has been verified or has been completed.

[0057] System 200 further allows an administrator to create and manage various groups as shown in block 436. FIG. 14 illustrates a group of teachers in window 1410. In the example of the teacher participating in a teacher development type instructional program, the administrator, typically the school principal at which the teacher teaches, can generate and manage teacher groups, administrative groups, or other groups according to the desires of the administrator. Since the administrator is authorized to establish groups, the administrator can update the group as shown in block 438 as well as update any other information relating to the teacher group, administrative group, student group, or other types of information. The administrator, as shown in block 440, also has the ability to assign educators, i.e. teachers, the right to verify the responses from other educators to each question used in a particular video instructional segment. Once an individual has the right to verify responses from others, the verifier is given the ability to provide feedback to the question responses a shown in block 442. FIG. 13 illustrates a screen shot of a Question and Feedback view 1310. A Question field 1312 provides the text of the question. A Response field 1314 provides the response given by the user. A Feedback field 1316 allows the reviewer to give feedback back to the user for the response. The user in this case can be either the teacher answering the question or the administration asking the question and providing a sample response or answer to the question. A Verification button 1318 allows for the user to verify a question.

[0058] The system also allows for reporting of information to be given at various levels of stewardship, which include state, regional, district, area/subdistrict, feeder zone, school, department, educator levels, and teacher as shown in block 444. FIG. 15 illustrates a screen image of a District setup screen report 1510 in accordance with the principles of the present invention. The setup screen 1510 shows the District ID, the district Description, Region ID, Feeder System, and Sub District information. Viewing History and Assignment Data of the users in the group. The administrator can also add new feeder zones in field 1520 as well as add new contacts in field 1522. Once the new information is entered, the administrator selects the Update button 1524 to update the fields of District ID, Description, Region ID, Feeder System, and SubDistrict. A Feeder zone field 1526 shows which feeder zones have been established and how many school or organizations have been assigned thereto.

[0059] FIG. 16 illustrates a Department/Grade Level setup window 1610 very similar to the window 1510 of FIG. 15. In window 1610, the administrator establishes the departments in Department field 1626 with the number of educators or users assigned thereto. The administrator can change the feeder zone assignment via feeder zone assignment window 1628.

[0060] FIG. 17 illustrates a sample User Setup area window 1710 in accordance with the present invention. Window 1710 includes an alphabetical listing for quick access to a user. By selecting one of the listed letters, the administrator will be given a listing of those users (teachers) having a last name beginning with the selected letter. The user profiles include the user's name, first and last, active status, email address, user type, last login information, and total login count. Selection of a users UserName causes the system to pull up the user's profile window 1810 shown in FIG. 18.

[0061] FIG. 18 illustrates a User Setup Screen window 1810 in accordance with the present invention. The window 1810 allows for the administrator to define a given user. The user is given login information in field 1812, which has an Educator ID as well as a Username, which defaults to the user's email address if one is not provided. A password is assigned and an active status is defined (active or inactive). Further, the user's email address is provided with a definition of what level of access the user has. In this example, the user is defined as an administrator (admin.) After the login information is completed, the user's personal information is provided in field 1814, which includes full name, address, city, state, zip code etc. Once the user information is added or modified, the information is saved and the administrator returns back to the list of users in FIG. 17.

[0062] Additionally, summary statistics of the above data is provided by teachers, department, grade level, school, district, regional, and state levels as depicted in block 446. This information may also be provided at a national level where a country has a small enough population to manage all the teachers, or the country has a national education policy that supervises all the sub groups within the educational department. FIG. 19 illustrates a report window 1910 that reports information related to a selected Feeder zone 1 in this example. Feeder zone 1 includes 12 schools ranging from elementary to high schools. Included are the feeder schools to the high school, such as the junior high and middle schools. The report includes number of segments offered, the total number of segments expected to be viewed, the actual number of segments viewed, the number of assignments completed, a calculated participation percentage, and the number of users licensed per building, referring to the school or site in the feeder zone. A total is provided for each school and then a Feeder zone Total 1912 is provided in the report as well.

[0063] Lastly, the system also provides summary and detailed data information that may be viewed by day, week, month, year, since the inception of the evaluation program, or by any other user-created date desired. In the example of FIG. 14, one user is illustrated that has completed one segment, listed by Segment Title and Assignment completed. This is also verified by the date shown. The time at which the segment was viewed along with the date and machine are also shown.

[0064] In another alternative embodiment, the invention may be implemented as a computer program product for use with a computer system. Such implementation may include a series of computer instructions fixed either on a tangible medium, such as a computer readable media (e.g. diskette 142, DVD or CD-ROM 147, ROM 115, or fixed disk 152 as shown in FIG. 3) or transmittable to a computer system, via a modem or other interface device, such as communications adapter 190 connected to the network 195 over a medium 191. Medium 191 may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques). The series of computer instructions embodies all or part of the functionality previously described herein with respect to the invention. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems. Furthermore, such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies. It is expected that such a computer program product may be distributed as a removable media with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over a network (e.g., the Internet or World Wide Web).

[0065] The present invention may be embodied in other specific forms without department from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.