US 7,536,320 B2Grant
Method, system, and computer readable medium for the selection of content items for presentation to users
Issue Date:2009-05-19
•26 Claims
•9 Drawing Sheets
Abstract
Various computer-implemented methods are disclosed for selecting content items, including but not limited to user-submitted blurbs, to present to users. One such method comprises storing user-specific item selection history data identifying particular items, such as catalog items, selected by particular users, and recording responses of a plurality of the users to a content item. The method further comprises determining whether the content item should be presented to a target user based, at least in part, on a degree to which the item selection history of the target user is similar to item selection histories of users who responded favorably to the content item.
Metadata
Assignee
- Amazon.com, Inc.
Inventors
- Clyde D McQueen, III
- Michael Irvin Hyman
- Richard Brinkerhoff
Application Information
Application Number:US 11/941,818
Filing Date:2007-11-16
Priority Date:2003-08-13
Art Unit:3625
Classifications
IPC:
G06Q30/00G06F17/30
Patent Drawings (9 sheets)
Description
Related Applications
[0001] This application is a continuation of U.S. application Ser. No. 10/640,512, filed Aug. 13, 2003 now U.S. Pat. No. 7,310,612, the disclosure of which is hereby incorporated by reference.
Background of the Invention
[0002] 1. Field of the Invention
[0003] The present invention relates to personalization algorithms for providing personalized content to users.
[0004] 2. Description of the Related Art
[0005] Web sites and other types of interactive systems commonly host electronic catalogs for assisting users in locating and evaluating various types of items. The items may, for example, include physical products, journal articles, movie and music titles, downloadable software, services, stock assets, businesses, and/or any other type of item that may be represented in a database. Electronic catalog systems also commonly support the ability for users to conduct various types of item-related transactions, such as purchasing an item, downloading an item, or selling an item.
[0006] To enhance the browsing experiences of users, electronic catalog systems commonly implement various types of features for assisting users in efficiently locating and evaluating catalog items. For example, some systems implement recommendation algorithms for recommending specific catalog items to users. The items are commonly recommended based on the purchase histories, browsing histories, and other types of user profile data reflective of users' interests.
[0007] Some systems also allow users to post reviews on specific catalog items. The reviews submitted for a particular item are typically displayed on a detail page for that item. In some cases, the associated user interface provides an option for users to vote on whether a particular review is helpful. A current tally of the votes submitted on a particular review is typically displayed to assist readers in assessing the review. The vote tallies may also be used to inhibit the display of poor quality reviews. In addition, the votes are used in some systems to generate and display ratings of specific reviewers, such that the readers of a given review can take into consideration the reputation of the associated reviewer.
[0008] Despite the existence of these and other features, electronic catalogs commonly lack the types of compelling content needed to attract and maintain the interests of users. One reason for this deficiency is that the operators of such systems typically lack the resources needed to generate such content. The present invention seeks to address this deficiency.
Summary
[0009] Various computer-implemented methods are disclosed for selecting content items, including but not limited to user-submitted blurbs, to present to users. One such method comprises storing user-specific item selection history data identifying particular items, such as catalog items, selected by particular users, and recording responses of a plurality of the users to a content item. The method further comprises determining whether the content item should be presented to a target user based, at least in part, on a degree to which the item selection history of the target user is similar to item selection histories of users who responded favorably to the content item.
[0010] Neither this summary nor the following detailed description is intended to define the invention. The invention is defined by the claims.
Brief Description of the Drawings
[0011] FIG. 1 illustrates an electronic catalog system according to one embodiment of the invention.
[0012] FIGS. 2 and 3 illustrate example screen displays of the blurb authoring pipeline of FIG. 1 .
[0013] FIG. 4 illustrates a personal web log or “plog” page according to one embodiment of the invention.
[0014] FIG. 5 depicts a personalized gateway page showing how new plog entries may be represented in a condensed form.
[0015] FIG. 6 illustrates a preferred embodiment of the personalized blurb selection component of FIG. 1 .
[0016] FIG. 7 illustrates the process flow associated with one method that may be used to personalize the selection of blurbs, and/or other types of content items, for specific users.
[0017] FIG. 8 illustrates a set of web site components that may be used to implement the system of FIG. 1 .
Detailed Description of the Preferred Embodiments
I. Overview
[0018] FIG. 1 illustrates an electronic catalog system 30 according to a preferred embodiment of the invention. The system 30 includes a user interface (UI) 32 that is accessible to Internet users via user computers 33 and/or other types of devices (PDAs, mobile telephones, etc.). The user interface 32 is preferably implemented as a collection of web pages, but may more generally be implemented using any platform that supports interactive browsing (e.g., online services networks, voice-based browsing systems, interactive television systems, etc.).
[0019] The user interface 32 preferably provides functionality for users to browse an electronic catalog of items, and to perform transactions with respect to such items. The items may, for example, be physical products (new and/or used), newspaper or journal articles, music files, software downloads, stocks and bonds, online auctions, and/or any other type of item commonly represented within an electronic catalog. The catalog may be that of a single business entity or a collection of business entities. Descriptions of the items represented in the electronic catalog are maintained in an item descriptions database 34. Each catalog item represented within the database 34 typically has unique item ID.
[0020] In one embodiment, users can obtain detailed information about, and initiate purchases of, specific items by browsing to corresponding item detail pages. The catalog may also include a browse tree, a search engine, and/or other tools for assisting users in locating specific catalog items. The types of transactions supported by the system may vary by item type, but may include, for example, purchases, sales to others, downloads, bids, and/or submissions of item reviews or ratings. For instance, the user interface 32 may support the ability for users to search for and purchase physical or downloadable products from a catalog of products. The user interface also includes functionality for users to set up and manage personal accounts. The user interface features for navigating the electronic catalog, performing transactions, and setting up/managing user accounts, are generally represented in FIG. 1 by the component 36 labeled “catalog transactions.”
[0021] The catalog transactions component 36 accesses and updates a user profiles database 38 in response to actions performed by online users. This database 38 preferably maintains user-specific profiles that reflect user affinities for specific items and/or item categories. For example, the database 38 may maintain for each user an “item selection history” specifying all catalog items the respective user has purchased, reviewed, rated, viewed via an item detail page, downloaded, added to a personal wish list or shopping cart, and/or for which the user has performed some other type of item-affinity-evidencing action. The types of affinity-evidencing actions for which user-specific histories are maintained will generally vary depending upon the nature and purpose of the system 30 (e.g., user opinions, retail sales, user-to-user sales, online access to media content, music downloads, etc.). The user profiles may also include information about, for example, the item categories selected by each user for browsing, the search queries submitted by each user, and/or community memberships. More generally, the user profiles database 38 may store any information reflective of users' preferences for specific items and/or item categories (generally referred to herein as “user preference data”).
[0022] As further illustrated in FIG. 1 , the user interface 32 preferably also includes a blurb authoring pipeline 40 through which users can author and submit pieces of content called “blurbs.” The blurbs are typically in the form of text, although images and other types of content may also be supported. The blurb authoring pipeline 40 may include one or more tools for assisting blurb authors in adding references to specific items or item categories of the catalog. For example, a link generation tool may be provided for creating and inserting links to specific item detail pages and browse node pages. A tool may also be provided for looking up the unique IDs of specific items. The blurb authoring pipeline 40 may require users to log in before posting a blurb, such that the blurbs can be reliably attributed to their respective authors.
[0023] Blurbs posted via the blurb authoring pipeline 40 are stored in a blurbs database 44. As discussed below, blurbs are selected from this database 44 to present to specific users according to one or more personalized blurb selection algorithms. As depicted by the “blogs” user interface component 46 in FIG. 1 , users of the system 30 can also preferably view the blurbs created via the authoring pipeline 40 in an author-specific blog format. For example, users may visit a page associated with a particular author to view a chronological log of the blurbs submitted by that author, or equivalently, to view that author's blog. Each blurb created using the blurb authoring pipeline 40 thus preferably becomes an entry within the corresponding author's publicly-accessible blog. Author-specific blogs may alternatively be omitted (i.e., blurbs created via the blurb authoring pipeline 40 need not be displayed as blog entries).
[0024] If author-specific blogs are provided, each such blog may be published using RSS (“RDF Site Summary” or “Rich Site Summary”)—an XML format for syndicating web content—so that blog aggregators and other types of web sites can re-publish the content contained in such blogs. The use of RSS to share and license web content across web sites is well known in the art. User's may also be given the option to control whether their respective blogs are to be made available via RSS.
[0025] As depicted in FIG. 1 , the blurbs database 44 may also be populated with blurbs obtained from one or more external sources. For example, in the preferred embodiment, blurbs are periodically uploaded to the database 44 via RSS feeds from various external web sites that host blogs, newsletters, and/or other forms of user-created content. An RSS feed is generally an RSS-format web page that is used as a recurring source of content. Each such RSS page may is preferably retrieved periodically, such as several times a day, to check for new items (blog entries, news articles, etc.). Some or all of the new items located through this process are added to the blurbs database 44 as blurbs. New RSS feeds are preferably discovered using a spider program that starts with a known list of RSS feeds (e.g., from a known RSS feed aggregator), retrieves RSS pages from such feeds, and scans these pages for references to other feeds. The user interface 32 may also include a form for enabling users to specify the locations of RSS feeds.
[0026] Blurbs created via the blurb authoring pipeline 40 are referred to herein as “internal blurbs,” and blurbs obtained from other sources are referred to as “external blurbs.” An external blurb may be represented within the blurbs database 44 without actually copying over the entire blurb to the database 44. Although both internal and external blurbs are used in the preferred embodiment, as will be recognized, the invention may be practiced using only one type of blurb (internal or external) and not the other. Further, the system may 30 include an API (application program interface) through which users of the system 30 can edit their blogs, and/or add new blog entries (blurbs), using web services. A web service is typically in the form of machine-readable SOAP (Simple Object Access Protocol) message.
[0027] According to one aspect of the invention, blurbs are also selected from the database 44 to present to specific users based the preference data of such users. The task of selecting the blurbs is performed by a “personalized blurb selection” component 52, which implements one or more blurb selection algorithms as described below. The personalized blurb selection component 52 selects blurbs to present to a given user based at least in part on one or more of the aforementioned types of user preference data. For example, a set of blurbs may be selected to present based on the target user's item selection history or a selected portion of that history. More generally, blurbs may be selected based in-whole or in-part on any information reflective of the user's preferences for specific items and/or item categories.
[0028] As discussed in further detail below, the blurbs are preferably selected using a set of personalized blurb selection algorithms that take into account the item selection histories of users. One such algorithm selects blurbs from authors having item selection histories similar to the item selection history of the target user. Another personalized blurb selection algorithm evaluates each blurb as a selection candidate by evaluating the extent to which those with similar item selection histories to that of the target user responded favorably to the blurb. Yet another personalized blurb selection algorithm selects blurbs that reference catalog items that (a) have been selected by the target user, and/or (2) are similar to items selected by the target user.
[0029] The blurbs selected to present to a target user are preferably presented in the form of a personalized log or “plog.” As with blogs, plogs are preferably in the form of chronological sequences of blurbs. Unlike a blog, a plog will typically contain entries (blurbs) from many different authors, and will be specific to a particular target user (i.e., plogs generally are not publicly accessible). A selected number of new blurbs (e.g., ten or twenty) may be added to each user's plog periodically, such as once per day. In one embodiment, each user of the system 30 can access a plog page to view his or her plog (see FIG. 4 , discussed below). A condensed representation of the plog may also be displayed on a home or gateway page of the catalog system (see FIG. 5 ), and possibly on other types of pages associated with the catalog.
[0030] Where external blurbs are included within the plogs, the amount of blurb text displayed may be selected based on the type of license involved. For example, blurbs obtained from external blogs with “by attribution” licenses may be displayed in full. For other types of blog licenses such as “non-commercial” or “no derivative works,” a selected excerpt of each external blurb may be displayed (e.g., the title plus the first twenty words), together with a link to the originating site.
[0031] In addition to providing plogs (personalized logs of selected blurbs), blurbs may be selected to present to users based on the contexts of the users' browsing sessions. For example, one or more blurbs may be selected based on the item or item category currently being viewed by the user, based on the item or item categories viewed during the current browsing session, and/or based on the contents of the user's shopping cart. These context-dependent blurbs may be presented on any appropriate page, such as an item detail page or a browse node page of the electronic catalog.
[0032] As depicted by the “blurb voting” component 54 in FIG. 1 , users are preferably given the option to rate some or all of the blurbs they review by casting votes. The votes may be cast according to a specified rating scale (e.g., “poor,” “average,” and “good”), and may be based on quality, relevance, or any other appropriate criteria. The option to vote on a blurb may be presented whenever that blurb is displayed, or may be presented only when the blurb is displayed as the result of a selection algorithm. Each vote is preferably recorded in the blurbs database 44, and preferably affects the frequency with which the corresponding blurb is subsequently selected to present to other users. Although the votes are preferably blurb-specific, the system may additionally or alternatively allow users to vote on an entire blog that contains many blurbs from the same author. Further, as discussed below, implicit forms of voting may be used.
[0033] As depicted by the arrow labeled “author votes” in FIG. 1 , a vote on an internal blurb (or blog) also preferably serves as a vote on the corresponding author, and is thus recorded by the blurb voting component 54 in association with the author's user ID. Authors of blurbs can thus develop “reputations” over time, which may in turn be taken into consideration by the personalized blurb selection component 52. For example, when an author creates a new blurb, the author's reputation may be used to select an initial injection rate for injecting the blurb into the plogs of users; thereafter, the injection rate may be adjusted based on feedback (votes) from readers of the blurb. An author's reputation may be represented as a reputation score or grade that is based on the following and/or other criteria, the number of blurbs written, the total number of votes cast on such blurbs, and the average rating of such votes. Author vote and reputation data is preferably maintained for all authors of internal blurbs, and may also be maintained for authors of external blurbs.
[0034] A vote cast in response to the personalized selection and display of a blurb may be treated as a vote on the quality of the particular selection algorithm used to select the blurb. For example, if several different competing selection algorithms are used (as discussed below), the associated blurb votes may be used over time to evaluate the relative accuracy of each such algorithm. Selection algorithms that perform poorly relative to the others may be dropped or modified, or may be accorded a lesser weight in selecting blurbs to present. Further, if a given user has consistently responded favorably to blurbs nominated by a particular selection algorithm, that selection algorithm may be treated as being more reliable for that particular user.
[0035] In addition to the blurb selection and display methods mentioned above, the system 30 may provide various other navigation features for assisting users in locating blurbs and blogs. For example, the system may also use the aforementioned votes to generate and display a publicly accessible page that lists or contains the blurbs that are currently the most popular among the entire user population, or that are currently gaining in popularity the fastest.
[0036] The internal and external blurbs are preferably represented within the blurbs database 44 together with various elements of associated data. The data stored for a given blurb may include, for example, a unique blurb ID, the ID of the author, the date of creation, the author's reputation as of the blurb's creation date, the number of votes within each rating category, the contexts of such votes (e.g., whether in response to a personalized blurb selection algorithm versus some other blurb surfacing method), IDs of any items referenced by the blurb, whether the blurb is internal versus external, etc. These and other data elements may be used by the personalized blurb selection component 52. A background process (not shown) may automatically prune the database 44 of blurbs that are outdated or have unfavorable vote tallies.
[0037] A given blurb may also be stored in the database together with one or more author-specified “hints” that identify classes of target readers. For example, the author of a blurb may specify that the blurb should be displayed to users who have purchased a particular item, to users who reside in a particular region, or to users who belong to a particular community. Any hints provided by the authors may be taken into consideration by the personalized selection algorithms.
[0038] The system depicted in FIG. 1 thus provides users with fresh, personalized content (blurbs) from numerous authors during visits to the electronic catalog, increasing the likelihood of frequent return visits by such users. In many cases, the selected blurbs also include information that assists users in making informed item selection decisions. For example, a given blurb may reference one or more items that are of interest to the target user, and may indicate the author's opinion about such items. The system also preferably enables users to maintain their own publicly accessible blogs.
[0039] The foregoing functions may be implemented within executable software that runs on one or more general purpose computers. The invention may be embodied within a web site, an online services network, or any other type of multi-user system that supports interactive browsing of catalog content. One example of a general web site architecture that may be used is shown in FIG. 8 and is discussed below.
II. Example Screen Displays
[0040] FIGS. 2 and 3 illustrate two example screens of the blurb authoring pipeline 40. The first screen (FIG. 2 ) provides instructions for creating a blurb, and includes an area for entering the headline and body of the blurb. In this example, blurb authors are encouraged to add links to specific items in the catalog, and are provided with a tool for doing so. The author can also insert links to other web sites.
[0041] Once the blurb text has been entered, the author selects the “preview” button to view a “preview your blurb” screen of the type shown in FIG. 3 . In this example, the author has added a link to a particular catalog item, and more specifically, to a particular book title. A graphic associated with this book title has automatically been added to the display. Subsequent screens of the blurb authoring pipeline may allow the user to add one or more hints regarding the target audience for the blurb, as explained above. The author may also be required to log in before posting the blurb.
[0042] Once the blurb has been posted, it preferably appears on the author's publicly accessible blog page as an entry within a chronological log of entries. In addition, the blurb becomes available to the personalized blurb selection algorithms, and to any other selection algorithms used to select blurbs for display.
[0043] FIG. 4 illustrates a portion of an example plog page, with a single plog entry (blurb) 60 shown in its entirely. Each entry within the plog is a blurb that was selected for the target user (the plog's “owner”) by the personalized blurb selection component 52. The plog is presented in reverse chronological order such that the most recent entries appear at the top of the page. The blurb 60 is displayed together with the following information: the date and time of creation, the name of the author (displayed as a link to the author's blog page), a graphic of the referenced item, an indication of the number of users who have viewed the blurb 60, and a relevancy rating reflective of a score generated by a personalized selection algorithm.
[0044] Also displayed is a set of icons 62 for voting on the blurb. In this example, three rating levels are supported: good, neutral, and poor. The voting interface may alternatively use a different number of rating levels. For example, a 2-level scale may be used in which users are asked whether they liked the blurb, or a 5-level scale may be used in which users are asked to rate the blurb on a scale of 1-5.
[0045] With further reference to FIG. 4 , a “more options” drop down menu allows the plog's owner to access other options, such as an option to send the blurb to a friend, and an option to create a new blurb that references the displayed blurb 60. Certain types of user actions, such as sending the blurb to a friend, may optionally be treated as votes in favor of the blurb (i.e., implicit voting may be supported). The plog page also includes a search engine box and various links for searching and browsing the catalog.
[0046] FIG. 5 illustrates an example home or “gateway” page as personalized for a particular user. The gateway page includes a “plogette” portion 64 that includes a condensed representation of the user's plog or of a most recent portion of the plog. The condensed representation preferably includes short excerpts of the plog entries most recently added to the user's plog (two shown), together with links to these entries. The gateway page may also be populated with descriptions of various items selected from the catalog.
[0047] As mentioned above, blurbs selected by the personalized blurb selection component 52 may also be presented on various other types of catalog pages, including browse node pages and item detail pages. In such instances, the context of the user's browsing session (e.g., the item or item category being viewed) may be taken into consideration in selecting blurbs to present.
III. Personalized Blurb Selection Algorithms
[0048] In the preferred embodiment, blurbs are selected to inject into specific plogs using a plurality of competing blurb selection algorithms, each of which uses different selection criteria. The use of multiple competing selection algorithms tends to provide greater diversity of entries within each plog. Although the use of multiple competing selection algorithms is preferred, the blurbs may alternatively be selected, e.g., using a single selection algorithm, or by rotating among a set of alternative selection algorithms.
[0049] FIG. 6 illustrates the general process by which newly created blurbs are selected to present to a specific user. Each of multiple blurb selection algorithms 52A uses its respective selection criteria to assign relevance scores to specific blurbs that have recently been added to the database 44. At least some of these algorithms take information about the target user into consideration in generating the relevance scores, although different selection algorithms may consider different elements or types of user preference data.
[0050] As illustrated, each selection algorithm 52A may nominate one or more blurbs to present to a given target user. An arbiter component 52B considers these nominations, including the associated relevance scores, and selects the blurbs that are ultimately to be added to the target user's plog or otherwise presented to the target user. As part of this process, the blog scores generated by the various selection algorithms 52A may be normalized and compared. The arbiter 52B may use a variety of different criteria to make the ultimate blurb selections. For example, to provide a degree of variation, the arbiter 52B may ensure that the target user sees blurbs nominated by each of the selection algorithms 52A, or may otherwise ensure that the target user's plog is not dominated by the nominations of any particular selection algorithm 52A. In addition, the arbiter 52B may give significantly greater weight to any blurb that was nominated by more than one selection algorithm 52A.
[0051] As depicted in FIG. 6 , the arbiter 52B may also take into consideration the reader feedback that has been provided on each nominated blurb. In addition, the arbiter 52B may take into consideration the feedback provided by the particular user in connection with each selection algorithm 52A. For example, if the target user has consistently responded favorably to blurbs nominated by a particular selection algorithm 52A, the nominations of that selection algorithm may be selected more frequently for that particular target user.
[0052] Several examples of the types of blurb selection algorithms 52A that may be used are provided below.
[0053] Item-referencing blurbs by item selection history: This selection algorithm 52A nominates blurbs that reference catalog items that appear within the item selection history (e.g., purchase history or review submission history) of the target user. The algorithm may also nominate blurbs that reference items that are similar to items in the item selection history of the target user. To implement this algorithm, a global reverse index is periodically generated that maps referenced items, and items similar to such referenced items, to specific blurbs that refer to the referenced items. Each such mapping carries a strength, with direct-reference mappings carrying a greater weight than similar item mappings. To select or nominate blurbs for a target user, the reverse index is initially accessed to identify the item-to-blurb mappings that correspond to the user's selection history. If two or more of these mappings are to the same blurb, the weightings associated with these mappings are summed to generate a user-specific weight for that blurb. Finally, the blurbs with the highest weights are selected.
[0054] Reader/Writer Selection History Similarity: This selection algorithm 52A identifies internal blurb authors that have similar item selection histories to that of the target user, and nominates blurbs by such “similar authors.” Conventional collaborative filtering algorithms may be used to identify the authors that are the most similar to the target user. In one embodiment, several hundred authors are selected based on selection history overlap and the age of each author's most recent blurb. The vote-based reputations of these authors are then considered in selecting specific blurbs to nominate. This algorithm is based on the assumption that blurb authors who selected catalog items similar to those selected by the target user are likely to author content that is interesting to the target user. A variation of this algorithm is to identify authors that have similar voting histories to that of the target user, and to nominate blurbs from these similar-voting authors.
[0055] Readers with similar selection histories liked it: This selection algorithm 52A selects blurbs that were liked by users having similar item selection histories to that of the target user, as reflected by explicit and/or implicit user feedback. This algorithm is preferably implemented using a mapping of specific blurbs to catalog items selected by readers of such blurbs, as depicted in Table 1. In one embodiment, each time a reader casts a positive or negative vote on a particular blurb, the associated mapping is updated to increase (if a positive vote) or decrease (if negative) the blurb-specific scores associated with each item in the reader's item selection history. For a given blurb, each item in the catalog can thus have a blurb-specific score that is positive, negative, or zero.
[0056]
| TABLE 1 | ||||
|---|---|---|---|---|
| Item 1 | Item 2 | . . . | Item N | |
| Blurb 1: | 0 | 5 | −4 | |
| Blurb 2: | 12 | −6 | 0 | |
| . | . | |||
| . | . | |||
| . | . | |||
| Blurb N: | −2 | 5 | 0 | |
[0057] To evaluate whether a candidate blurb should be nominated for a particular target user, the associated blurb-specific scores of those items appearing in the target user's selection history are summed to generate a blurb score. The blurb scores of all candidate blurbs are then considered in combination to select specific blurbs. Other criteria, such as the reputations of the authors of the candidate blurbs, may also be taken into consideration. This algorithm is based on the assumption that readers that have similar item selection histories will like similar blurbs.
[0058] This algorithm may also be used to personalize the selection of other types of content items, such as blogs, music files, product descriptions, or web sites. Further, rather than solely using explicit votes, the algorithm may additionally or alternatively use implicit votes on the blurb or other content item. For instance, when a user forwards a particular blurb to a friend or responds to the blurb by selecting the author's blog for viewing, the user may be deemed to have cast a favorable vote on the blurb. The algorithm may also be appropriately modified to rely solely on favorable votes, or possibly to rely solely on unfavorable votes.
[0059] FIG. 7 illustrates the general process flow associated with this selection algorithm, as applied to a particular content item such as a blurb. As depicted in block B1, the content item is presented to users over time together with an option to explicitly and/or implicitly vote on the content item. As mentioned above, this option may, in some embodiments, consist of an option to implicitly or explicitly vote favorably, without any option to vote unfavorably. As depicted by block B2, the item selection histories of some or all of the voters are associated with the content item, such as by generating a mapping of the type shown in Table 1. The mapping may be updated as votes are cast, or may be generated periodically using previously-recorded votes. As depicted by block B3, to evaluate whether the content item should be presented to a particular target user, the degree of similarity between the target user's item selection history and the item selection histories of those who voted favorably on the content item is calculated. In embodiments in which unfavorable votes are recorded, the degree to which the target user's item selection history differs from those who voted unfavorably on the content item may also be considered, as is the case in the embodiment depicted by Table 1. Finally, as depicted by block B4, the calculated degree of similarity (and optionally dissimilarity) is used as at least one factor in deciding whether the content item should be presented to the target user.
[0060] Content-based: This blurb selection algorithm analyzes blurb content to search for blurbs that are related to the item and/or category preferences of the target user. Author reputations may also be taken into consideration.
[0061] Weighted random: This selection algorithm weights blurbs based on freshness and/or author reputation, then selects specific blurbs to nominate using a weighted random selection algorithm.
[0062] For the above and other blurb selection algorithms that rely on the item selection histories of users, different types of item selection histories may be used to achieve different results. For example, to identify blurbs that correspond closely to the target user's current browsing session, an item selection history consisting only of those items viewed during the current session may be used. In addition, although the system 30 may keep track of many different types of item selection actions (detail page views, purchases, review submissions, etc.), the blurbs may be selected using item selection histories that reflect only a subset of these monitored actions (e.g., purchases only).
[0063] In addition, rather than scoring and evaluating individual blurbs as described above, the system 30 may seek to identify entire blogs that are of interest to the target user. Once the most relevant blogs have been identified for a target user, the most recent entries within such blogs may be selected to present to the user. Selection algorithms similar to those described above may be used to select the most relevant blogs.
IV. Example Web Site Architecture
[0064] FIG. 8 illustrates one example of a web site architecture that may be used to implement the system 30 of FIG. 1 . In this embodiment, the system includes a web server component 70 that communicates with various service applications, including a catalog service application 72, a blurbs service application 74 and a user accounts service application 76. Numerous other service applications may be provided for handling such tasks as authenticating users, processing orders, generating personalized item recommendations, etc. An RSS feed component 86 is also provided in this example for populating the blurbs database 44 with blurbs obtained from external sources, such as other web sites. The RSS feed component 86 preferably performs the aforementioned tasks of locating new RSS pages, periodically checking known RSS pages for new entries, and adding new entries to the database 44 as external blurbs.
[0065] The web server 70 includes or communicates with a template processor 80 that accesses a database 82 of web page templates. These templates specify the basic layout of the author pipeline pages (FIGS. 2 and 3 ), plog pages (FIG. 4 ), gateway pages (FIG. 5 ), item detail pages, and various other web pages of the web site. The templates also specify service calls that are to be made to populate requested web pages and to make updates to various databases.
[0066] The catalog service application 72 is generally responsible for providing the catalog content displayed throughout the various web pages of the site, as maintained in the item descriptions database 34 and possibly other databases. The blurbs service application 74 is generally responsible for handling blurb submissions and votes, responding to requests from the web server 70 for blurb content, and notifying the user accounts service 76 of events that affect the profiles of specific users. The above-described functionality for personalizing the selection of blurbs may also be included in this service component 74. The users accounts service application 76 is generally responsible for responding to requests for user account information (including item selection histories, vote and reputation data, etc.), and for updating the profiles of users in response to certain types of events. A “user” may generally be an individual, or a group of individuals that share a common computer or account.
[0067] The various application components shown in FIG. 8 may, for example, run on general purpose computers that are interconnected on a local area network.
[0068] Although this invention has been described in terms of certain preferred embodiments and applications, other embodiments and applications that are apparent to those of ordinary skill in the art, including embodiments which do not provide all of the features and advantages set forth herein, are also within the scope of this invention. Accordingly, the scope of the present invention is intended to be defined only by reference to the appended claims.
Claims
What is claimed is:
1. A computer-implemented method of selecting content items for presentation to users, the method comprising:
storing user-specific item selection history data in computer storage, said item selection history data identifying particular items selected by particular users;
recording user responses of a plurality of said users to a content item, said content item being distinct from the items represented in said item selection history data, said user responses including at least favorable responses to the content item and unfavorable responses to the content item; and
automatically determining, by a personalized selection system that comprises computer hardware, whether the content item should be presented to a target user based, at least in part, on a degree to which an item selection history of the target user is similar to item selection histories of users who responded favorably to the content item, as determined using said item selection history data and said recorded user responses, wherein automatically determining whether the content item should be presented to a target user further comprises taking into consideration a degree to which the target user's item selection history is dissimilar to item selection histories of users who responded unfavorably to the content item.
2. The method of claim 1, wherein the user-specific item selection history data comprises purchase history data that identifies catalog items purchased by the users from an electronic catalog of items.
3. The method of claim 1, wherein determining whether the content item should be presented to the target user comprises determining, for each of a plurality of catalog items selected by the target user, an extent to which users who have selected the respective catalog item have tended to respond favorably to the content item.
4. The method of claim 1, wherein the content item is a blurb submitted by a user of said electronic catalog.
5. The method of claim 4, wherein the method further comprises receiving the blurb via a blurb submission pipeline of a web site that hosts the electronic catalog, said blurb submission pipeline enabling users to author and submit blurbs for viewing by other users.
6. The method of claim 1, wherein determining whether the content item should be presented to the target user comprises:
for each of a plurality of catalog items selected by the target user, looking up a corresponding score, said score reflecting an extent to which responses to the content item by other users who have selected the respective catalog item have been favorable responses; and
combining said scores to generate a cumulative score for the content item, said cumulative score reflecting a degree to which the item selection history of the target user is associated with favorable user responses to the content item.
7. The method of claim 1, wherein the item selection history data identifies particular catalog items selected from an electronic catalog by particular users, and the method comprises using the favorable and unfavorable responses in combination to generate, for specific catalog items, respective scores that reflect degrees to which such catalog items are associated with favorable and unfavorable user responses to the content item.
8. The method of claim 1, wherein recording the user responses comprises, in response to a first user responding favorably to the content item, adjusting item-specific scores for each catalog item in an item selection history of the first user, said item-specific scores being non-user-specific.
9. The method of claim 8, wherein automatically determining whether the content item should be presented to the target user comprises combining the item-specific scores associated with each of a plurality of catalog items identified in the target user's item selection history to generate a cumulative score that represents a degree of association between the content item and the target user's item selection history.
10. The method of claim 1, wherein the content item is a unit of content other than a blurb.
11. The method of claim 1, further comprising, when a determination is made that the item should be presented to the target user, adding the content item to personal log of the target user.
12. The method of claim 1, wherein the method is performed automatically by a system that comprises a plurality of computers interconnected by a network.
13. A computer-readable storage medium that stores executable software that, when executed by a computer system, causes the computer system to perform a method that comprises:
storing user-specific item selection history data in computer storage, said item selection history data identifying particular items selected by particular users;
recording user responses of a plurality of said users to a content item, said content item being distinct from the items represented in said item selection history data, said user responses including at least favorable responses to the content item and unfavorable responses to the content item; and
automatically determining whether the content item should be presented to a target user based, at least in part, on a degree to which an item selection history of the target user is similar to item selection histories of users who responded favorably to the content item, as determined using said item selection history data and said recorded user responses, wherein automatically determining whether the content item should be presented to a target user further comprises taking into consideration a degree to which the target user's item selection history is dissimilar to item selection histories of users who responded unfavorably to the content item.
14. A system for selecting content items to present to users, the system comprising:
a data repository that stores user-specific item selection history data identifying particular items selected by particular users, said data repository comprising computer hardware;
a response recording system that records user responses to particular content items, including at least favorable responses, said content items being distinct from the items identified in the item selection history data, said response recording system comprising computer hardware; and
a personalized selection system that selects particular content items to present to particular users, said personalized selection system configured to select particular content items to present to a particular user based, at least in part, on a degree to which an item selection history of the particular user is similar to item selection histories of users that responded favorably to the particular content items, as determined from the user-specific item selection history data and the recorded user responses, said personalized selection system comprising computer hardware;
wherein the personalized selection system, in determining whether a particular content item should be presented to a particular user, additionally takes into consideration a degree to which the particular user's item selection history is dissimilar to item selection histories of users that have responded unfavorably to the content item.
15. The system of claim 14, wherein the user-specific item selection history data comprises purchase history data that identifies catalog items purchased by the users from an electronic catalog.
16. The system of claim 15, wherein the content items are blurbs submitted by users of said electronic catalog.
17. The system of claim 16, further comprising a blurb submission system that enables the users of the electronic catalog to author and submit said blurbs for viewing by other users.
18. The system of claim 14, wherein the user responses include positive and negative votes explicitly cast by users on particular content items, and the personalized selection system uses said positive and negative votes in combination to identify content items that tend to be liked by users with item selection histories similar to an item selection history of a target user.
19. The system of claim 14, wherein the personalized selection system is configured to assess whether a candidate content item should be presented to a target user, at least in part, by determining, for each of a plurality of catalog items identified in the target user's item selection history, an extent to which users that have selected the respective catalog item have tended to respond favorably to the candidate content item.
20. The system of claim 14, wherein the response recording system is responsive to a first user responding favorably to a first content item by adjusting item-specific scores for each of a plurality of catalog items identified in an item selection history of the first user, said item-specific scores not being specific to any particular user.
21. The system of claim 14, wherein the content item is a unit of content other than a blurb.
22. The system of claim 14, further comprising a personal log component that enables users to view personal logs containing the content items selected for such users by the personalized selection system.
23. The system of claim 14, wherein the item selection history data identifies particular catalog items selected by particular users from an electronic catalog.
24. The system of claim 23, wherein the personalized selection system, in determining whether to select a particular content item to present to a target user, is operative to:
look up, for each of a plurality of catalog items selected by the target user, a respective score, said score reflecting an extent to which responses to the content item by other users who have selected the respective catalog item have been favorable responses; and
combine said scores to generate a cumulative score for the particular content item, said cumulative score reflecting a degree to which the item selection history of the target user is associated with favorable user responses to the content item.
25. The system of claim 14, wherein at least some of the content items are blog entries submitted by users.
26. The system of claim 14, further comprising at least one web server machine that is operative to serve personalized web pages that include personalized content selected by the personalized selection system.
Patent Citations (30)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US6092049(A) | 2000-07-01 | Chislenko et al. | Examiner |
| US6598026(B1) | 2003-07-01 | Ojha et al. | Applicant |
| US6606744(B1) | 2003-08-01 | Mikurak | Examiner |
| US6947922(B1) | 2005-09-01 | Glance | Examiner |
| US6950804(B2) | 2005-09-01 | Strietzel | Examiner |
| US7069234(B1) | 2006-06-01 | Cornelius et al. | Examiner |
| US7072888(B1) | 2006-07-01 | Perkins | Applicant |
| US7076443(B1) | 2006-07-01 | Emens et al. | Applicant |
| US7113917(B2) | 2006-09-01 | Jacobi et al. | Examiner |
| US2001/0014868(A1) | 2001-08-01 | Herz et al. | Applicant |
| US2001/0021914(A1) | 2001-09-01 | Jacobi et al. | Examiner |
| US2002/0010625(A1) | 2002-01-01 | Smith et al. | Applicant |
| US2002/0019763(A1) | 2002-02-01 | Linden et al. | Examiner |
| US2002/0022999(A1) | 2002-02-01 | Shuster et al. | Applicant |
| US2002/0103692(A1) | 2002-08-01 | Rosenberg et al. | Examiner |
| US2002/0111904(A1) | 2002-08-01 | Gruber et al. | Examiner |
| US2002/0116291(A1) | 2002-08-01 | Grasso et al. | Examiner |
| US2002/0120564(A1) | 2002-08-01 | Strietzel | Examiner |
| US2002/0178057(A1) | 2002-11-01 | Bertram et al. | Examiner |
| US2002/0198882(A1) | 2002-12-01 | Linden et al. | Applicant |
| US2003/0065520(A1) | 2003-04-01 | Jutzi et al. | Examiner |
| US2003/0083961(A1) | 2003-05-01 | Bezos et al. | Examiner |
| US2003/0233422(A1) | 2003-12-01 | Csaszar et al. | Applicant |
| US2005/0033657(A1) | 2005-02-01 | Herrington et al. | Applicant |
| US2005/0125307(A1) | 2005-06-01 | Hunt et al. | Examiner |
| US2005/0171855(A1) | 2005-08-01 | Westphal | Examiner |
| US2005/0171861(A1) | 2005-08-01 | Bezos et al. | Applicant |
| US2006/0195362(A1) | 2006-08-01 | Jacobi et al. | Examiner |
| US2006/0253542(A1) | 2006-11-01 | McCausland et al. | Applicant |
| WO1/15002(A2) | 2002-03-01 | Applicant |
Non-Patent Literature (13)
- “Amazon Maps Path to Web Success for Other Retailers Technology of Site Leads to Spinoff Firm”. Helen Jung The Associated Press. South Florida Sun—Sentinel. Fort Lauderdale, Fla.: Jun. 29, 2003. p. 3.G.Examiner
- Riggs, T., and Wilensky, R., “An Algorithm for Automated Rating of Reviewers,” International Conference on Digital Libraries, Proceedings of the First ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 381-387 (2001) (of-record in the parent application).Applicant
- Four web pages printed from www.newsmonster.org site on Aug. 8, 2003; namely web pages at www.newsmonster.org/profile.html (3 printed pages), www.newsmonster.org/reputation.html (1 printed page); www.newsmonster.org/intro-SortbyReputation.html (1 printed page), and www.newsmonster.org/feature-breakdown.html (2 printed pages) (of-record in the parent application).Applicant
- Searls, D., and Sifry, D., “Building with Blogs,” Linux Journal, vol. 2003, Issue 107, p. 4, dated Mar. 2003 (of-record in the parent application).Applicant
- Roscheisen, M., Mogensen, C., and Winograd, T., “Beyond Browsing: Shared Comments, Soaps, Trails, and On-Line Communities,” Proceedings of the Third International World-Weide Web Conference, Computer Networks and ISDN Systems 27, pp. 739-749, dated Apr. 10-14, 1995 (of-record in the parent application).Applicant
- Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J., “GroupLens: An Open Architecture for Collaborative Filtering of Netnews,” Proceedings of ACM 1994 Conference on Computer Supported Cooperative Work, pp. 175-186 (1994) (of-record in the parent application).Applicant
- Prior art description at paragraphs 3-5 of present application.Applicant
- English translation of office action dated Aug. 27, 2008 in counterpart Japanese Patent Application No. 2006-523334.Applicant
- English abstract of Japanese Patent Publication JP2003085433, published Mar. 20, 2003.Applicant
- English abstract of Japanese Patent Publication JP2003216636, published Jul. 31, 2003.Applicant
- English abstract of Japanese Patent Publication JP2004015690, published Jan. 22, 2004.Applicant
- English abstract of Japanese Patent Publication JP2002123633, published Apr. 26, 2002.Applicant
- English abstract of Japanese Patent Publication JP2002215665, published Aug. 2, 2002.Applicant