System for network-based debates

[0002] This Application claims benefit of U.S. Provisional patent application Ser. No. 60/173,885 filed Dec. 30, 1999.

[0003] The present invention relates generally to the fields of computers and knowledge management, and more particularly to a system and method for filtering and evaluating information through on-line debates conducted over a network, such as the Internet.

[0004] There has recently been a tremendous growth in the number of computers connected to the Internet. A client computer connected to the Internet can download digital information from server computers. Client application software typically accepts commands from a user and obtains data and services by sending requests to server applications running on the server computers. A number of protocols are used to exchange commands and data between computers connected to the Internet. The protocols include the File Transfer Protocol (FTP), the Hyper Text Transfer Protocol (HTTP), the Simple Mail Transfer Protocol (SMTP), and the Gopher document protocol.

[0005] The HTTP protocol is used to access data on the World Wide Web, often referred to as “the Web.” The Web is an information service on the Internet providing documents and links between documents. It is made up of numerous Web sites located around the world that maintain and distribute electronic documents. A Web site may use one or more Web server computers that store and distribute documents in a number of formats, including the Hyper Text Markup Language (HTML). An HTML document contains text and metadata (commands providing formatting information), as well as embedded links that reference other data or documents. The referenced documents may represent text, graphics, or video.

[0006] A Web Browser is a client application or an integrated operating system utility that communicates with server computers via FTP, HTTP and Gopher protocols. Web browsers receive electronic documents from the network and present them to a user. The Web is continually evolving with new standards and protocols: Cascading Style Sheets, client-side JavaScript, and XML to name a few. Moreover, the Web is evolving from the passive serving of static documents to an environment of dynamic and distributed processing. Java applets, ActiveX controls, DCOM, Server side scripting and others have stretched the boundaries of what was traditionally “the Web”.

[0007] An intranet is a local area network containing Web servers and client computers operating in a manner similar to the World Wide Web described above. Typically, all of the computers on an intranet are limited to one company or organization.

[0008] The present invention is most suited to, but not limited to, uses in connection with the Internet. It may also be deployed on intranets and extranets utilizing Internet standards and protocols as well as other LANs and WANs. It is not limited to any particular network protocol, such as TCP/IP or HTTP, or any particular client or server technology, such as a particular browser, Web server, or operating system.

[0009] The Internet and related technologies are enabling unprecedented levels of communication and access to information. Under the weight of this abundance of information, traditional mechanisms for filtering and evaluating information are breaking down, with negative results for society and public policy. It is becoming very difficult for citizens to determine what is “true”, or even to identify the key points of contention, in areas as diverse as science, medicine, domestic policy, foreign policy, and history. Anybody can erect a Web site, gaining wide audiences for distortions, lies, and misinformation (e.g., holocaust denial). And once the information is made accessible via the Internet, people can consume it without understanding its source or its veracity. Quackery is put on par with peer-reviewed research.

[0010] The problem of filtering and evaluating information impacts all aspects of modern life:

[0011] An overworked doctor trying to understand the best treatment for high blood pressure in the face of an explosion in alternatives and conflicting research results.

[0012] A day-trader led astray by Internet “news” of dubious origin and intent.

[0013] A housewife lured into a pyramid scheme.

[0014] A lawyer making sense of the maze of laws, regulations, and rulings on emerging topics.

[0015] Traditionally, information sources were responsible for filtering and evaluation. Newspapers and TV news organizations had fact checkers, editorial review, and strict standards of reporting. Academic journals had double-blind peer review of articles. The more rigorous the filtering and evaluation, the more respected the source, hence information from the New York Times is more credible than that from other less respected publications.

[0016] This system is strained to breaking in the Internet world. Rather than a few widely known sources, information consumers are confronted with thousands of sources. The amount and velocity of information (and related competitive pressures) are so great that even established sources are diluting, compromising, or abandoning their role as information gatekeepers.

[0017] A goal of the present invention is to provide a system for helping individuals filter and evaluate conflicting information through the process of on-line debates among a community of interested and informed individuals. The present invention is particularly, but not necessarily, intended for use in supporting on-line debates over the Internet.

[0018] The present invention provides an Internet technology-based infrastructure and processes for supporting on-line debates among a community of interested and informed individuals with the goal of helping individuals filter and evaluate conflicting information, claims, arguments and evidence regarding complex issues of fact, policy or belief. Unlike the centralized control over filtering and evaluation inherent in traditional published information sources (e.g., a newspaper), the present invention leverages the inter-connection of the Internet to tap the expertise of users anywhere in the world: filtering and evaluation emerges dynamically from the process of discussion and Debate among interested parties.

[0019] The core of the invention is the Argument Base and a Rating Process. The Argument Base organizes discussion into a network of Debates comprising a Proposition under contention and Arguments and Evidence supporting or denying that Proposition. The Rating Process operates to allow the best Arguments and Evidence to be easily identified as well as to identify the key points of controversy in a complex debate. Ratings operate in the Debates much as currency does in an economic system: as a measure of value and as a limited resource that must be conserved and allocated efficiently by participants in order to maximize their interests. Incentives and controls are established so that self-interested behavior by individual participants yields desirable global results: in this case, quality discourse.

[0020] In the presently preferred implementation, the infrastructure includes a database, a multi-dimensional direct and indirect Rating Process, Community Services, mechanisms for site organization and operations, and user interfaces. These elements of the invention may be summarized as follows:

[0021] The database, in addition to the Argument Base, includes a Reference Library, a Community Directory, Comments and Evaluations, and various supporting information.

[0022] The Rating Process “weights” Arguments, References, and users based on the collective expertise and beliefs of participants. Stronger Arguments and Evidence, higher quality sources, and individual expertise will “bubble” up. It is this mechanism that supports the filtering and evaluation functions of the invention.

[0023] The Community Services control access to, and the ability to contribute to, the Debates. The quality of a Debate is directly related to the quality of participants. The invention incorporates Community Services to support Members as well as hold them accountable to the community. Community Services tracks users' Credentials and contributions and makes this information available to the Rating Process and, where authorized, other users.

[0024] Mechanisms for site organization and operations organize the Debates and Arguments in a way that is meaningful to, and easily navigated by, users. In the presently preferred implementation, the Argument Base is organized into Issue Rooms which are grouped into a topic hierarchy. This supports navigation as well as administration of the site.

[0025] User Interfaces are the means by which users interact with the system. In the preferred implementation, users interact with the Argument Base through a “T-Account” interface showing the pro and con Arguments and Evidence sorted by strength as measured by the Rating Process. This allows easy apprehension and navigation of complex discussions.

[0026] The present invention allows professionals and interested others to quickly understand the key points of argument surrounding important issues, without time consuming research. It supports achieving consensus where possible on issues of truth or policy. Where consensus is not possible, the structure of the Argument Base supported by the Rating Process help to identify the key facts or assumptions that are in contention, channeling Debate towards key or pivotal issues and reducing effort spent on extraneous and misleading rhetoric. The structure of the Argument Base and the Reference Library support further drilling down to explore specific points of interest in more detail. The more egregious problems of public discourse are reduced:

[0027] “Red Herring” issues can be countered.

[0028] “Talking past” opponents is reduced, as the strength of a Proposition depends not only on the strength of support, but on the weakness of opposition. A proponent cannot ignore a strong counter-argument.

[0029] The common tactic of equating repetition with truth is countered as a statement can be made only once. After that, one can support it or counter it, but cannot just say it again.

[0030] It is difficult to misquote or take statements out of context when the original source is a hyperlink away.

[0031] The implications of effective, Internet-supported Debates are significant, altering areas as diverse as professional education, scientific research, and political decision-making. The present invention is a step in this direction. These and other aspects of the present invention are described in greater detail below.

[0032] FIG. 1 schematically depicts a network-based system for filtering and evaluating information through on-line Debates in accordance with the present invention.

[0033] FIG. 2 depicts the currently preferred implementation of the data model supporting the argument base and reference library in the present invention.

[0034] FIG. 3 schematically shows a schema for organizing a Web site in the presently preferred implementation.

[0035] FIG. 4 depicts an illustrative user interface display (screen shot) for use with a Web site in accordance with the present invention.

[0036] The present invention provides an Internet technology-based infrastructure and processes for supporting on-line Debates among a community of interested and informed individuals with the goal of helping individuals filter and evaluate conflicting information, claims, arguments and evidence regarding complex issues of fact, policy or belief. As noted earlier, the presently preferred implementation includes a database, a Rating Process, Community Services, mechanisms for site organization and operation, and user interfaces. These elements are shown schematically in the appended drawings. After discussing the technical architecture implementation, we explore the implementation of each of these elements in more detail. We conclude with a review of some of the deployment options for the preferred implementation.

[0037] (a) Technical Architecture

[0038] The technical architecture of the presently preferred implementation includes the following elements (see FIG. 1):

[0039] A standard Web browser (element 1a) such as Netscape Communicator or Microsoft Internet Explorer running on a user's computer and supporting client-side scripting such as JavaScript or VBScript.

[0040] One or more server computers (element 1b) running one or more instances of the server processes.

[0041] A communications network connecting the client computer(s) to the server computer(s) (element 1c). In the preferred implementation, the network supports the Internet protocols TCP/IP and HTTP.

[0042] A standard Web server (element 1d) such as Microsoft Internet Information Server supporting connectivity to the application server processes through Microsoft Active Server Pages (ASP) and ActiveX Server controls. The Web-server/application server connectivity processes (element 1e) render the user interface into HTML plus client side JavaScript for transmission to the user's Web browser. They also translate the user's commands and information into a format understandable by the application server processes for processing.

[0043] Application server processes (element 1f) that perform the processing tasks of the application, including the Rating Process, Community Services, Site Organization and Operation, and the User Interface. These processes are discussed in more detail in subsequent sections.

[0044] Database Management System (DBMS) (element 1g), such as Oracle and SQL Server, are server processes that connect the application server processes to the application database (element 1h).

[0045] The invention is by no means limited to this architecture. Alternatives include (but are not limited to):

[0046] In the preferred implementation, the user interface (UI) is implemented through HTML rendered by the server with minimal client processing through client side JavaScript. More processing could be distributed to the client computer through the use of Java applets, ActiveX controls, or other distributed computing technology. Alternatively, a pure HTML interface could be implemented with no client-side scripting.

[0047] In the preferred implementation, the communications network is the Internet. Alternatively, the invention could be implemented on an intranet, extranet, LAN, or WAN.

[0048] In the preferred implementation, the client and network communications are based on widely accepted Internet standards (TCP/IP, HTTP, HTML, JavaScript, etc.). Alternatively, the invention could be implemented with a proprietary client process or with other network and distributed processing protocols, such as Netware, DCom, or CORBA.

[0049] In the preferred implementation, interaction between the application and the Web servers is implemented through Microsoft Active Server Pages with ActiveX Server Controls. This interaction could be implemented with lower level Application Programming Interfaces (API) or through Java Server Applets. Alternatively, Web server functionality could be built directly into the application server.

[0050] The implementation may also include middleware, such as Microsoft Transaction Server or Tuxedo transaction processor.

[0051] The implementation may employ new tools, standards, and protocols as they develop.

[0052] (b) Database

[0053] The application database (element 1h) stores the information used by and manipulated by the application server process. The key areas of information stored in the application database include:

[0054] The Argument Base (element 1h(i))—Debate and discussion stored as a network of propositions linked by logical relationships.

[0055] The Reference Library (element 1h(ii))—Information on sources outside of the debate that are inform the debate and are linked to specific statements and assertions in the argument base.

[0056] Evaluations (element 1h(iii))—Individual users' judgements about elements in the argument base and reference library and other objects in the system (including other users). These judgements include numerical ratings that are used by the rating process to filter the information in the system.

[0057] Community Directory (element 1h(iv))—Information on members and contributors, including their profiles and credentials.

[0058] Other Supporting Information (element 1h(v))—Additional information to support the organization and operation of the system.

[0059] The key entities relationships in the application database are depicted in FIG. 2 and are discussed below.

[0060] Argument Base

[0061] The heart of the system is the Argument Base. The Argument Base represents the structure and evidence of argumentation at a level high enough to be easy to understand and navigate, yet low enough to facilitate control of the Debate process and to permit evolution of the controls as more is learned about the dynamics of on-line Debates. In particular, the Argument Base structures discussion, argumentation, and Debate to:

[0062] Enable quick and comprehensive understanding of all positions on an issue;

[0063] Allow distillation of the an issue's key points, central issues, and critical facts;

[0064] Simplify drill-down to supporting detail, evidence, references, and sources, “separating the wheat from the chaff”.

[0065] Discourage unproductive repetition of points.

[0066] Compel joinder of argument, i.e., that Debaters address opposing points and not “talk past” them.

[0067] Encourage logical, as opposed to emotional, argument and rhetoric.

[0068] Limit manipulation of information, and misinformation.

[0069] The basic objects in the Argument Base are Propositions (element 2a) and Relationships (element 2b). A Proposition is a statement of fact or belief, such as “There is no fossil evidence of evolution,” or “All life evolved through the mechanism of natural selection.” Of course, the truth or falsity of most Propositions will likely be in contention.

[0070] A Proposition may be supported by, or attacked by, other Propositions and evidence. In turn, that same Proposition may support or attack other Propositions. In the preferred implementation, these links are termed Relationships and may be of the following types:

[0071] Supports—for Propositions A and B, A supports B when if you accept A as true, you are compelled to believe that B is true. This is related to the formal logic implication operator, but admits degrees of support.

[0072] Denies—for Propositions A and B, A denies B when if you accept A is true, you are compelled to believe B is false. This is related to the formal logic implication operator plus negation, but again admits degrees of denial.

[0073] Equivalence—for Propositions A and B, A is identical to B.

[0074] The architecture of the preferred embodiment is general enough to accommodate more advanced logical operators and constructions, such as AND and OR. The architecture also permits using relationships to construct logical statements out of other relationships (element 2c). The Argument Base is thus a network of Propositions linked by rules of logic and evidence.

[0075] Reference Library

[0076] In the preferred embodiment, argumentation is ultimately grounded in sources external to the Debate. The Reference Library is a catalog of books, journal articles, Web articles, and other published material. The Reference Library contains a bibliographic reference at a minimum, which are termed Titles (element 2d). It may also contain a link to an electronic version of the document. References (element 2e) are links between Titles and Propositions or RelationshipsRelationships. They are the mechanism used to link sources to the debate as represented in the argument base. Users are able to navigate to sources from the points in the Debates where those sources are used as well as navigate from sources to the points in the debates where those sources are used.

[0077] Evaluations

[0078] Member judgements about Propositions, Relationships, Titles, References, and even other Members in the system are stored in the database as Evaluations (element 2f). Evaluations include numerical ratings that are used by the Rating Process (discussed below) to filter and prioritize objects in the Reference Library and Argument Base.

[0079] Community Directory

[0080] The application database also tracks information on users of the system, i.e. members of the debate community (element 2g). The User entity tracks a member's profile information, credentials, and other information that supports the operation of the system and work of the community. A user is also linked to his contributions, including Evaluations and submitted Propositions, Relationships, Titles, and References. This information is available to the community to enhance responsibility and accountability.

[0081] Functions of the system to support individual members and the operation of the community are discussed further below under Community Services.

[0082] Other Database Entities

[0083] Other entities in the Database include:

[0084] Comments—Member comments and elaborations not part of formal argument structure and evaluations. (Discussed further under Rating Process below.)

[0085] Topics—Hierarchy of Topic Areas for categorizing and navigating the Argument Base. (Discussed further in Site Organization and Operation.)

[0086] Issues—Catalog of Issue Rooms for accessing and navigating the Argument Base. (Discussed further in Site Organization and Operation.)

[0087] The Database also includes a complete chronological Archive of all activity in the system. This supports the transparency of the process as well as improves usability (Members can easily review new activity).

[0088] (c) Rating Process

[0089] Not all sources are equal—peer reviewed primary research from New England Journal of Medicine counts more than a newspaper article. For that matter, not all arguments or opinions are created equal. This brings us to the role of the rating process (element 1f(i)).

[0090] A goal of the present invention is decentralized, distributed control over the filtering and evaluation process. That is, filtering and evaluation occurs as the result of a dynamic process of discussion and ratings by different Members of the community with different points of view, information, and expertise. The strongest Propositions, Arguments and sources will have the highest ratings and will “bubble up” to the top of the Argument Base. To this end, every object and action in the system is subject to comment and rating by the community, even other Members. A simple rating system may easily be manipulated to serve individual interests. The present invention envisions a rating process combined with transparency, incentives and controls to support objective and quality discourse. Transparency, the ability for all Members of the community to see all activity in the rating process, increases Member accountability and peer pressure enforcement of group norms. Incentives in the rating process seek to construct a system where individual self-interest serves the objectives of the community, much as the tax code seeks to incent behavior for the benefit of the nation. Controls are more direct restrictions on the rating process designed to limit dysfunctional behavior.

[0091] The idea of Web-based community rating (individual users assigning or selecting a numerical rating of an item and those ratings being combined in some fashion to form a Summary Rating of that item) is not new. Amazon.com allows readers to comment on and rate books, with the Summary Rating being the average of the individual direct ratings. eBay permits community rating of other users. More recently, Amazon.com has even permitted rating the ratings. The present invention differs from existing community rating processes in several respects:

[0092] User ratings of an item may be multi-dimensional and dependent on what type of object the item is. Rather than have just one type of object in the system (e.g., books) and just one dimension for rating (e.g. quality), the invention envisions multiple types of objects (e.g., Proposition, Relationship, Source, etc.) each of which may have multiple rating dimensions that can differ among the object types.

[0093] Summary Ratings for multiple objects may be combined to form Indirect Ratings of other objects. In particular,

[0094] the Summary Rating of a Member combined with his Credentials can increase or decrease the weight of that Member's ratings of other objects. Thus, a highly rated Member's ratings count for more in the system than a lowly rated Member.

[0095] the Summary Rating of a Proposition is a function of the ratings of the Arguments and Evidence supporting or denying that Proposition.

[0096] The ratings process includes transparency, incentives and control to improve the quality of ratings.

[0097] The ratings process is combined with community processes to improve the quality of ratings.

[0098] Direct Ratings

[0099] In the presently preferred implementation of the invention, each registered Member may comment on and rate any object in the system: Propositions, Relationships, Reference Library Items, References, or other Members. These are termed “Direct Ratings” as they require direct action by Members. Ratings are numerical values entered or selected by the user. The scales for ratings are parameter driven. The number of and meaning of ratings differ based on what type of object is being rated. In the present embodiment, the following ratings are defined (though the architecture is flexible enough to easily add/modify/delete new ratings dimensions):

[0100] Propositions—Propositions are directly rated by degree of subjective belief in the “objective” truth or falsity of the Proposition. For example, a Member may give the Proposition “suburbs lead to the decay of community” a “truth” rating of 6 on a scale from 0 to 10, indicating that he or she believes the Proposition to be slightly more likely to be true than not.

[0101] Relationships—the truth of a Proposition is different from the truth of a logical statement using that Proposition. For example, the statement “IF Proposition A is true THEN Proposition B MUST be true” may be believed to be true even though it is believed that Proposition A is in fact false or even that Proposition B is in fact True. In the current implementation, Relationships are directly rated by degree of subjective belief in the “objective” truth or falsity of the logical statement or Argument created by the Relationship between two Propositions.

[0102] Reference Library items—Library items are directly rated by subjective assessments of quality and novelty. In addition, Members can rate and comment on authors and editorial sources

[0103] References (links between a source and a Proposition or Relationship)—References are directly rated by accuracy/relevance, i.e., whether or not the source really says or concludes the Proposition or Relationship.

[0104] Members—Members are directly rated based on subjective assessments of knowledge and quality of discourse.

[0105] Indirect Ratings

[0106] In this invention, the Summary Rating of an object depends not just on the Direct Ratings of that object by the Members, but also Indirect Ratings. Direct Ratings are subject to manipulation. Individuals may use their ratings to damage opposing views or help their own views regardless of the merits of the individual Propositions or Arguments. A point of view that can mobilize the largest number of advocates will tend to prevail in a direct rating system. The present invention seeks to moderate the distortions and abuses of a direct rating system by incorporating Indirect Ratings, that is, the Summary Rating of an object depends on the Summary Ratings of related objects. By designing the appropriate linkages among objects and ratings, incentives arc created that guide self-interested behavior of individuals towards the global objectives of objectivity and quality discourse.

[0107] The two most important indirect rating relationships are Member-weighted Ratings and Debate Ratings. In the present invention, all Members are NOT created equal. Each Member has a Contribution Weight that is determined by that Member's reputation, Credentials, and history in the community. This Contribution Weight determines how important that Member's ratings are to the system, enabling the system and the community to discipline and reward Members. For example, a partisan extremist may, over time, receive a very low Contribution Weight that would act to discount his ratings. (Contribution Weights are discussed more under Community Services below.)

[0108] Indirect Ratings are also critical to the Debate process in this invention. As noted earlier, a Proposition in the Argument Base can be directly rated by Members, but it can also be attacked or supported by Argument (other Propositions and Relationships) or Evidence (Reference Library items and References). In the present invention, the Summary Rating of a Proposition is a function of the Summary Ratings of the supporting or attacking Arguments and Evidence. Of course, those Arguments and Evidence are also subject to further Arguments and Evidence. These indirect Debate ratings create an incentive for proponents and opponents to expand the Debate. It is not enough to simply expound your point of view, you must also counter your opponent's Arguments and Evidence.

[0109] In the current preferred implementation, the following Summary Ratings are used:

[0110] Members—a Member's Summary Rating is a function of Member-weighted Direct Ratings (knowledge and quality of discourse) and History quality (Summary Rating increases with the number and value of contributions and decreases by number of low-rated contributions).

[0111] Library Sources—Summary Rating is a function of Member-weighted Direct Ratings of the source (quality and novelty), the type of source (e.g. primary research weighted higher than a survey), the Member-weighted Direct Ratings of the author, and the Member-weighted Direct Ratings of the editorial source (e.g. New York Times weighted higher than the National Inquirer).

[0112] Propositions—the Summary Rating is a function of Member-weighted Direct Ratings of the Proposition, Summary Ratings of supporting and denying Propositions weighted by the Member-weighted direct rating of the Relationship, and Summary Ratings of Library sources weighted by the Member-weighted direct rating of the reference link.

[0113] The Summary Rating of Propositions is a recursive algorithm. The algorithm terminates at Propositions with no supporting or attacking Arguments, at Reference Library items, or where circuit detector logic detects that the Proposition has been “visited” before.

[0114] Additional Controls and Incentives

[0115] In addition, there are additional controls and incentives in the preferred implementation to improve the quality of discourse:

[0116] 1. Each Member can have only one vote per object (to prevent “stuffing the ballot box”).

[0117] 2. Each Member's vote is public information.

[0118] 3. At any Proposition, each Member is given a set number of “votes” (essentially ratings points) to deploy among the Propositions and inferences supporting that Proposition. For example, if a Proposition, A, has 5 Arguments FOR and 5 Arguments AGAINST, a proponent cannot score all 5 Arguments FOR as 10 (0 to 10 scale) and all Arguments AGAINST as negative 10; users have a fixed number of points, say 30, that they can apply either for or against the various Arguments—this forces judgement. The number of votes is a function of the number of supporting links and is parameter-driven. This creates an incentive NOT to add similar or redundant propositions as that will simply dilute the strength of your position.

[0119] Initially the roll-up algorithms will be based on linear combinations, but the system is flexible enough to experiment with alternative formulas and evolve the process as more is learned about the dynamics of online Debate. Moreover, the currently preferred implementation allows weightings to be defined for each Issue Room to allow editors to tailor the rating process to the needs of the specific issue and community. For example, an issue of fact (“Is a high-protein diet effective for heart disease?”) may warrant an extremely LOW weight on Direct Ratings and a HIGH weight on indirect Debate ratings. This increases the incentive to add Arguments and Evidence to the Debate. Alternatively, an issue of belief (“Is human life sacred?”) may not warrant a high weight on indirect Debate ratings.

[0120] To facilitate transparency and participation while not compromising the Argument Base, the current implementation supports unlimited Comments. Like ratings, any object in the system can be commented upon. These Comments can be viewed from the Argument Base and appear in the chronological discussion archive, but have no impact on the permanent argument or ratings.

[0121] (d) Community Services

[0122] The quality of a community depends on accountability. In the present invention, not all contributions are created equal: a Nobel laureate in the topic area is different from an interested and informed amateur who is different from a narrow-minded ideologue. But in a Web environment who is who? The present invention's Community Services (element 1f(ii)) supports these realities.

[0123] Basic Membership

[0124] At the highest level, a user may be a Visitor or a Member. Anyone can visit the site. Visitors may view and comment, but their Evaluations do not “count” (i.e., are not included in the Rating Process). Moreover, a Visitor may not contribute new Arguments or Evidence. A Member, on the other hand, is a user who has registered with the system and who has the right to full participation in the Debates, including the right to rate objects and to contribute Arguments and Evidence. Transparency and accountability are supported through four basic Community Services—Profiles, History, Evaluations, and Credentials.

[0125] Community Transparency and Accountability

[0126] Members (registered users) may not be anonymous to the system in the current implementation. They must provide basic identification information and confirm their identity with a credit card. Members are encouraged to keep their identities and profiles public to the Debate community. For privacy concerns, they may choose to not make their identity and profile public to the community, although the current implementation supports imposing a penalty on their Contribution Weights (see below) for anonymity.

[0127] The current embodiment also supports transparency and accountability by making each user's (Visitor or Member) contribution history public. The contribution history tracks all Propositions, Relationships, Reference Library items, and references contributed, as well as all Comments and ratings submitted. Each user (Visitor or Member) may also be rated and commented on by other Members. All of the Ratings and Comments are public.

[0128] Users with published identities (credentialing is not available to anonymous Members) may chose to submit their credentials (degrees, positions, publications, etc.). The Member identifies the topics they are interested in being credentialed for and what level of credential they seek (level 1 through 5). Credentials are reviewed by the editorial staff and are published to the Membership. Other Members can challenge Credentials on fact, but the determination of level and areas is up to the editorial staff.

[0129] Contribution Weight

[0130] Each Member has a Contribution Weight, which is a function of the Member's Summary Rating and Credentials and is used in the rating process to calculate Member-weighted Direct Ratings. Each user's (Visitor or Member) has a Summary Rating which is calculated based on:

[0131] Other Members' (only Members' ratings “count”) Direct Ratings of that user. The current implementation supports ratings of the user's knowledge and quality of discourse. These Direct Ratings are weighted by the raters' Contribution Weights.

[0132] Contribution history. In the current implementation, Summary Ratings increase with the number and average quality (as measured by that object's Summary Rating) of objects contributed. There is also an additional penalty factor for the number of low quality objects contributed.

[0133] The Contribution Weight used in the calculation of Member-weighted Direct Ratings is the Member's Summary Rating except for Propositions, Relationships, References, and Library items that have been categorized in topics for which the Member has Credentials. For those items, the Contribution Weight increases to reflect the Credentials.

[0134] The current implementation includes some flexibility and safeguards in implementing the Contribution Weights. Ratings by other Members can be appealed by the Member and can be overridden by the editors. The effect of Member ratings on a Members' Contribution Weight can be varied and will typically be the discretion of each Issue Room's Moderator.

[0135] Other Community Roles

[0136] The current preferred implementation includes the following roles for the Debate communities:

[0137] The Issue Room Moderator (or simply Moderator) is a Topic Area expert that has intellectual control over an Issue Room. Any issues of content or decorum are the responsibility of the Moderator.

[0138] Editors are employees who are responsible for day to day monitoring of activity. They will typically be assigned specific Topic Areas and Issue Rooms for which they are responsible. They have the authority to delete or modify posts to insure the quality and standards of the Issue Rooms. They are support for the Moderator.

[0139] Member Editors are Members that have been additionally screened to insure they have sufficient Credentials for their assigned Issue Rooms and that they agree to abide by the rules of the site. Member Editors are used in fully moderated Issue Rooms: all posts are routed to several Member Editors who vote on whether to include the post (See discussion of Organization and Operations below).

[0140] (e) Site Organization and Operation

[0141] Topics and Issue Rooms

[0142] The currently preferred implementation is a Web site organized into a hierarchy of Topic Areas and Issue Rooms (FIG. 3). Issue Rooms (element 3a) are defined by a narrowly drawn question or issue that is controversial either in fact or values/belief, i.e. a Proposition in the Argument Base.

[0143] Issue Rooms are organized in a hierarchy of Topic Areas (element 3b) that aid navigation and search. For example, the main Topic Area may be “Science” (element 3c), with a sub-area of “Biology” (element 3d) containing the Issue Room for the “Evolution vs. Creationism” debate (element 3e). An Issue Room is “owned” by only one branch of the Topic Area tree, but may be accessible from multiple trees. For example, the “Evolution versus Creation” Issue Room may be owned by Science:Biology, but may also be accessible through Religion:God and Science (element 3f).

[0144] In the current implementation, Topic Areas and Issue Rooms are set up by site editorial staff based on editorial and operational decisions of the site editorial organization. The Topic Area hierarchy is a fixed division of the “world”. Topic Areas are also the categories used for user Credentials (see Community Services). Users may suggest changes in the topic hierarchy, but these are ultimately up to the Issue Room Editors to decide.

[0145] Issues also may be suggested by Members. In the presently preferred embodiment, issues require a moderator to be assigned and possibly also a sponsor. Issue Rooms are assigned to one or more nodes in the Topic Area hierarchy by the editorial staff.

[0146] Issue Room Organization

[0147] Issue Rooms are organized into three areas:

[0148] Debate (element 3g)—A hierarchical view into the Argument Base and References. The “root” of the hierarchy is the issue defining Proposition. Arguments and Evidence in support forms one “branch” of the hierarchy and Arguments and Evidence attacking is another “branch”. Each of those Arguments and Evidence can lead to further Arguments and Evidence. As noted earlier, the Argument Base is implemented as a network, that is, a subsection of the Argument Base may be a part of multiple debates. However, the user's view and navigation is as a hierarchy.

[0149] Library (element 3h)—Each Issue Room has a Library of sources that have been used in the Debate. This is actually a filtered view into the Reference Library. By default, the sources are listed in decreasing Summary Rating order, but the user may customize the sort order, as well as to search.

[0150] Discussion Archive (element 3i)—The Issue Room also contains a chronological record of all activity in the Issue Room—Comments, ratings, new Propositions, new Relationships, new Library items, and new References. All editorial actions also appear in the discussion archive. The user has the ability to filter and sort the discussion archive as well as to search.

[0151] Subscriptions and Restricted Rooms

[0152] The present invention contemplates the ability to host Issue Rooms with varying levels of restriction.:

[0153] Public—Public Issue Rooms are open to all Members and Visitors

[0154] Restricted—Restricted Issue Rooms allow all Members to view and comment, but only subscribers may contribute and evaluate.

[0155] Private—Access and participation limited to specified Members. Private Issue Rooms do show up in the main index and topic hierarchy.

[0156] Private Label—Specialized Private Issue Rooms that appears as part of the host's Web site and not as part of the main site (e.g. as a service to other sites that desire the functionality).

[0157] The present invention supports invitations and subscription requests. The Issue Room moderator may send out invitations, which are tracked and when accepted permit the moderator to set the invited Member up as a subscriber. Alternatively, a Member may request a subscription to a particular Issue Room. The system tracks requests and the Issue Room moderator may either accept or deny the request. If accepted, the Member is set up as a subscriber.

[0158] Editorial Process Options

[0159] The presently preferred embodiment of the invention supports three models for adding to the knowledge base:

[0160] Editorial Oversight—Full distributed operation with editors stepping in only in the case of emergencies. Member contributions are immediately reflected in the knowledge base and sink or swim based on their Summary Ratings.

[0161] Public Comment—As above, editors are for oversight only. New submissions are posted for public discussion and after a period are either added to the knowledge base or discarded.

[0162] Fully Moderated—All submissions go through peer editorial review prior to entry into the knowledge base. A new submission will be routed to a number (parameter selectable by Issue Room) of Member Editors. If a certain number (again parameter selectable by Issue Room) of the editors accept the submission, it is added.

[0163] In the current implementation, all submissions for the Reference Library must go through review by Reference Library staff to check for accuracy and completeness and to determine whether the source is or can be made electronically available.

[0164] Revenue Models

[0165] The current implementation supports several different revenue sources:

[0166] Membership and Subscriptions. The system as the ability to require Membership or subscription payments at the Topic Level or at the Issue Room level.

[0167] Advertising and Sponsorship. The current implementation uses standard technologies to implement and track advertising and “click-throughs”. Advertising space is sold by Issue Room as a sponsorship of that particular Issue Room.

[0168] Library Access. The current implementation supports charging for access to electronic sources. Access fees are charged to the Member's Library card which is periodically charged against the Member's credit card on file.

[0169] (f) User Interfaces

[0170] In the current embodiment, user interfaces are implemented as HTML documents and HTML forms, with some client scripting. The basic interface for navigating the Argument Base is the “T-Account” (FIG. 4), showing the Proposition under consideration at the top (element 4a) and two columns below, one for Arguments and Evidence FOR the Proposition (element 4b) and one for Arguments and Evidence AGAINST the Proposition (element 4c). Arguments and Evidence FOR and AGAINST are sorted by Summary Ratings, with the highest rated items first.

[0171] Clicking (pointing with the mouse and depressing the left mouse button) on an argument displays a pop-up window that gives the user the option of 1) navigating to a page that displays more information about the argument and allows the user to rate the argument; or 2) “drill down” into the Argument Base, displaying that Proposition as the top of the “T-Account” and displaying Arguments and Evidence for and against that Proposition in the columns below. Clicking on an evidence item displays a pop-up window that gives the user the option of 1) navigating to a page that displays more information about the reference and title and allows the user to rate those objects; 2) navigate to the bibliographic record for the title in the Reference Library; or 3) navigate to the source document for the Title, if it is available.

[0172] The basic “T-account” page also allows the user to search the issue room or the entire site and navigate to the Reference Library or Discussion Archive for the Issue Room (element 4d).

[0173] (g) Deployment Options

[0174] The present invention has broad and various applications, including, but not limited to, the management of myriad intellectual, policy, scientific, and policy debates and discussions, e.g.,

[0175] Medical: What is the best treatment for . . . (high blood pressure, diabetes, depression, etc.)? How is managed care affecting quality of care? Is the residency system harmful or useful?

[0176] Legal: Are civil awards too high? Is there a legal basis for suing gun manufacturers?

[0177] Philosophy/Theology/Ethics: Is abortion/euthanasia moral? What is consciousness? Is vegetarianism more “moral” than meat-eating?

[0178] Sociology: Is affirmative action effective? Is gun control effective at reducing crime? Are welfare limits effective in increasing self-reliance?

[0179] Economics: Is the current economy a speculative bubble? Are business cycles dead in an information economy?

[0180] Politics: Should sanctions on Iraq be lifted? Should we sanction China for espionage and human rights abuses? What is the best solution for saving social security?

[0181] Education: Do school vouchers improve education quality and access? How does discipline/lack of discipline affect learning in high schools? Should elementary schools focus on fostering creativity or rote skills?

[0182] In addition, the inventors foresee various practical applications of the system, e.g., to support, enhance, and/or manage dispute resolution, strategic planning, market research, opinion polling, legislation, etc.

[0183] The current implementation supports several different business models for deployment:

[0184] Branded public Debate-oriented Web sites, supported by sponsors/advertisers, library access charges and/or membership fees.

[0185] Limited access private networks belonging, e.g., to professional associations, corporations, universities, governments, etc.

[0186] Enhancements of discussion areas, chat rooms, and communities for existing Web sites operators, e.g., Yahoo, AOL

[0187] Of course, the invention is not limited to these deployments.

[0188] (h) Conclusion

[0189] In sum, the present invention provides an improved system and method for filtering and evaluating information through a process of on-line Debates. The invention is particularly well-suited for (but not limited to) deployment over the Internet.

[0190] It is understood, however, that the invention is susceptible to various modifications and alternative constructions. It should be understood that there is no intention to limit the invention to the specific constructions described herein. On the contrary, the invention is intended to cover all modifications, alternative constructions, and equivalents falling within the scope and spirit of the invention.

[0191] It should also be noted that the present invention may be implemented in a variety of database and database management applications. The various techniques described herein may be implemented in hardware or software, or a combination of both. Preferably, the techniques are implemented in computer programs executing on programmable computers that each include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Program code is applied to data entered using the input device to perform the functions described above and to generate output information. The output information is applied to one or more output devices. Each program is preferably implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Each such computer program is preferably stored on a storage medium or device (e.g., ROM or magnetic diskette) that is readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the procedures described above. The system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner.