Computer-based document management system

[0002] The present invention relates to computer-based document management systems. More particularly, the present invention relates to a computer-based document management system that has the capability of importing, organizing, browsing, searching and viewing paper-based documents and electronic documents of any type or format.

[0003] In today's business environment, most businesses, from small businesses to large corporate entities, organize and maintain a tremendous amount of information, particularly information in the form of paper-based documents and electronic documents. The task of organizing and maintaining such a large number of documents, as well as document types, can, and typically is, a time consuming and costly matter.

[0004] In response, the computer industry, particularly the computer software industry, offers a number of computer application programs designed to help mitigate this problem. Some of these computer application programs work in conjunction with optical scanners to automatically import paper-based documents into the host computer. Other application programs are directed more specifically at providing electronic file management services for existing electronic documents. Some of the more advanced computer application programs attempt to integrate a number of different capabilities into a single application program. Among the capabilities that some of the more advanced programs provide are automated document importing, storage, manipulation, retrieval, indexing, archiving, exporting and document annotation. Included among these more advanced application programs are PageKeeper by Caere Inc., PaperPort by Visioneer, and PAGIS by Xerox.

[0005] Despite the many features already offered by various software products currently on the market, there is still a tremendous need to provide a more efficient product. This is especially true regarding the way in which existing computer application programs store and/or archive electronic documents. For example, a user may wish to periodically review a document collection for the purpose of identifying documents that have been previously archived. Documents that a user may wish to archive might include documents that the user has not accessed for a long period of time, documents that the user does not anticipate accessing in the near future or on a regular basis, or documents that pertain to a particular business matter or client. If the document collection is extremely large, the task of reviewing, identifying, indexing and archiving each document would be extremely difficult and time consuming even with the computer programs currently available.

[0006] Similarly, a user may, on occasion, wish to retrieve one or more electronic documents that have been previously archived onto various removable storage media. Again, if the number of documents and/or the number of removable storage media used to store archived document's is large, the task becomes quite difficult even with the computer programs currently available. Therefore, a computer-based electronic document-management program that has the ability to efficiently automate the process of identifying, indexing, archiving and retrieving documents to and from various archived storage media would be extremely desirable.

[0007] The present invention is directed to a method for managing documents in a computer-based system. The present invention provides a number of improvements over prior methods, particularly, the way in which the present invention indexes, categorizes and stores a wide range of documents and document types in its electronic database.

[0008] Accordingly, it is an object of the present invention to automatically index and categorize a large quantity of paper-based and electronic documents and document types. It is another object of the present invention to efficiently and automatically store a large quantity of paper-based and electronic documents.

[0009] It is still another object of the present invention to automatically modify and/or manipulate a large quantity of paper-based and electronic documents.

[0010] In accordance with one aspect of the present invention, the foregoing and other objects are achieved by a method and/or a computer-readable storage medium stored therein a program for archiving an electronic document. The method and/or program involves defining an archiving precondition, analyzing a document attribute of an electronic document, and archiving the electronic document if the document attribute matches the archiving precondition.

[0011] In accordance with another aspect of the present invention, the foregoing and other objects are achieved by a method and/or a computer-readable storage medium stored therein a program for retrieving an archived, electronic document. The method and/or program involves selecting an archive index entry and prompting a user to make a particular storage medium available to the computer-based electronic document management system, based upon information stored in the selected archive index entry. An electronic document corresponding to the selected archive index entry is then imported from the particular storage medium.

[0012] The objects and advantages of the invention will be understood by reading the following detailed description in conjunction with the drawings, in which:

[0013] FIG. 1A is a diagram of a general purpose computer which could be used to implement the present invention;

[0014] FIG. 1B is a diagram illustrating some of the features and utilities employed by the present invention;

[0015] FIG. 2A is an exemplary representation of an STG file associated with a document;

[0016] FIG. 2B is an exemplary representation of an STG file associated with a clipped document;

[0017] FIG. 3 depicts the hierarchical organization of an exemplary document collection in accordance with the present invention;

[0018] FIG. 4 is a screen display of the user interface associated with the change notification utility;

[0019] FIG. 5 is a screen display of a first scanner preferences user interface;

[0020] FIG. 6 is a screen display of a second scanner preferences user interface;

[0021] FIG. 7 is a screen display of a third scanner preferences user interface;

[0022] FIG. 8 is a screen display of a fourth scanner preferences user interface;

[0023] FIG. 9 is a screen display of the scanner control interface;

[0024] FIG. 10 is a screen display of a first Browser utility user interface;

[0025] FIG. 11 is a screen display of a second Browser utility user interface;

[0026] FIG. 12 is a screen display of the second Browser utility user interface with a customizable application toolbar;

[0027] FIG. 13 is a screen display of a third Browser utility user interface containing icons representing transitional documents;

[0028] FIG. 14 illustrates the user interface for conducting a basic document search;

[0029] FIG. 15 illustrates the user interface for conducting an advanced document search;

[0030] FIG. 16 is a screen display of the document viewing utility user interface;

[0031] FIGS. 17A-D illustrate a drag and drop operation in conjunction with the creation of a clipped document;

[0032] FIG. 18 is a screen display of the file helper user interface;

[0033] FIG. 19 is a screen display of, a secondary file helper utility user interface;

[0034] FIG. 20 is a screen display of the directory monitor user interface;

[0035] FIG. 21 is a screen display of the task manager user interface; and

[0036] FIG. 22 is a screen display of the system task bar illustrating the task manager icon.

[0037] The present invention involves a system and/or method for managing electronic documents in a general purpose computer, such as the general purpose computer 100 illustrated in FIG. 1A. The present invention further includes a system and/or method for importing electronic documents and electronic representations of paper-based documents from any number of different sources. For example, the present invention is capable of importing electronic representations of paper-based documents from a scanner 105, word processing documents from an internal memory such as a RAM (not shown) or an external memory 115 (e.g., a hard drive), e-mail from an internet connection 120, or a document containing graphical image data from a server 125 supporting a local-area network, to which the general purpose computer 100 is connected. Once a document has been imported, the present invention employs a system and/or method for automatically categorizing, indexing, browsing, viewing and otherwise manipulating the document, along with each of the other documents contained in what is herein referred to as the document collection. As one skilled in the art will readily appreciate, the present invention can be implemented in software, using standard programming methods and techniques which are well known in the art.

[0038] The present invention employs a number of core features 150 as well as a number of document management utilities as illustrated in FIG. 1B. The core features 150 refer to certain attributes or characteristics that the present invention employs and/or executes in the background to support the various document management utilities. For the purpose of simplicity, the following description of the present invention is divided into the various core features 150 and document management utilities. The order in which each invention feature and/or utility is presented herein below is not intended to limit the present invention in any way. Rather, the scope of the invention is given by the appended claims.

[0039] Data Storage (STG) Files

[0040] The first core feature 150 of the present invention is a unique data storage (STG) structure referred to herein as an STG file. The present invention maintains an STG file for each document in the document collection. A new STG file is created for each new document, and an existing STG file may be updated if the corresponding document is modified.

[0041] Each STG file contains a number of standardized data fields. This provides a way to maintain various attribute data and other information for a given document in a common, standardized format regardless of the document's type (e.g., text document versus image document) or the document's format (e.g., JPEG versus HTML). In a preferred embodiment, all STG files are stored in a common disk directory.

[0042] FIG. 2A represents an exemplary STG file 200 along with some of the data fields that may be contained therein. For example, STG file 200 may include a data field 205 which contains a file name, e.g., “001.5TG”, to identify the corresponding STG file 200. The STG file 200 may also include a data field 210 and a data field 215 which reflects the memory location of the corresponding document and a bit map defining a representative thumbnail respectively. The STG file 200 may also contain a data field 220 which reflects the raw text associated with the corresponding document. The raw text data is primarily used for indexing purposes. Indexing is described in greater detail below. In addition, the STG file 200 is likely to contain a number of other data fields (not shown) for such attributes as document author, publishing date, word count, annotations, and/or key words if the document belongs to a particular category. Categories and categorization of documents are also explained in detail below. If the document corresponding to the STG file is an image document, data fields may be included for such attributes as image type (e.g., color, black and white, or gray scale)., image dimension, and/or image meta-text with text positioning information.

[0043] An STG file also exists for each clipped document stored by general purpose computer 100. A clipped document is a special type of compound document data structure. Typically, a clipped document incorporates a number of related or component documents in a particular document order similar to attaching a number of physical documents together with a paper clip. When a clipped document is created, an STG file is generated. Unlike STG files associated with individual documents, an STG file associated with a clipped document includes a data field having its own file name, e.g., “002.5TG” and a number of additional data fields which contain the identity of the STG files corresponding to the component documents. FIG. 2B shows an exemplary STG file 250 that is associated with a clipped document. As illustrated, STG file 250 links the clipped document with four component documents, wherein the STG files that correspond with the four component documents are identified by their file names as follows: 100.5TG, 101.5TG, 211.5TG and 084.5TG. Clipped documents are described in greater detail below.

[0044] Aside from creating an STG file for each new document and each new clipped document, an existing STG file may be updated if the corresponding document or clipped document is edited or modified in some way. For example, if a user modifies an existing word processing document, upon saving the modified version of the document, the corresponding STG file is updated, if necessary, particularly the text data field 120.

[0045] Organization of the Document Collection

[0046] In a preferred embodiment, the document collection is organized into a hierarchy of files, clipped documents, and electronic folders, wherein electronic folders may, in turn, contain additional files, clipped documents and nested folders. The data that defines how the hierarchy of files, clipped documents and electronic folders are organized with respect to each other is maintained in a compound data structure referred to herein as the document collection organization (DCO) file.

[0047] The DCO file is the second core feature described herein, and it contains, in essence, all of the information necessary to resurrect or reconstruct the document collection hierarchy, which takes on the appearance of an organizational “tree” 300, as illustrated in FIG. 3. For example, the DCO file contains the information necessary to establish that folder F₁contains two nested folders F₂and F₃. In addition, this exemplary DCO file contains the information necessary to establish that there are a number of documents D₁, D₂, D₃and D₄directly associated with folder F₁; that there are two documents D₃and D₄directly associated with folder F₂; that there are two documents D₅and D₆, as well as a nested folder F₄associated with folder F₃; and that folder F₄contains a document D₄and a clipped document S.

[0048] In accordance with another aspect of the present invention, each user, in a multiple-user environment, has the ability to create a user profile for a local terminal or workstation. The user profile, in essence, defines a “local” version of the primary document collection and the document collection hierarchy, which are, in turn, defined by the various STG files and the DCO file respectively, as described above. The user profile may define the local document collection such that it includes all of, or a portion of, the documents in the primary document collection. The user profile may also define the local document collection such that it reflects a different document collection hierarchy than the one defined by the DCO file for the primary document collection.

[0049] This is accomplished, in part, by maintaining a local STG file for each document in the local document collection. In addition, a local version of the DCO file is maintained, which defines the hierarchy of the documents in the local document collection. Although a user can, of course, alter the content of an existing document in the primary document collection by manipulating the document locally, and hence, the content of the STG file associated with that document, the user profile cannot alter the document collection hierarchy defined by the DCO file for the primary document collection.

[0050] Virtual Document Storage

[0051] The present invention also employs a virtual document storage scheme. Virtual document storage is the third core feature described herein.

[0052] FIG. 3 illustrates the concept of this virtual document storage feature. It will be recognized that document D₄appears in several folders within the organizational hierarchy 300. First, it is associated with folder F₁. Next, it is associated with folder F. Finally, it is associated with folder F₄. However, in accordance with a preferred embodiment of the present invention, this does not mean that three copies of document D₄are stored in the DCO file. On the contrary, the content of document D₄, as with each and every document in the document collection, is stored in its entirety in but one memory location, and the DCO file links folders F₁, F₂and F₄to the one copy of document D₄by providing a pointer from each folder F₁, F₂and F₄to the STG file 310 associated with the document D₄.

[0053] The virtual document storage feature saves memory space, it simplifies the task of updating files, and it guarantees document integrity by maintaining but one version of a given document, as one skilled in the art will readily understand. For example, if a user modifies an existing document, such as document D₄, the modifications are reflected in the affected data fields in the corresponding STG file 310. Consequently, these modifications are reflected whenever the user, at a later time, accesses the document D₄through folder F₁, F₂or F₄.

[0054] Indexing and Retrieving

[0055] In addition to the core features 150 described above, the present invention employs a number of document management utilities. The first of these utilities is the indexing and retrieving utility 157, the focus of which is an index and retrieval engine. The index and retrieval engine, among other things, maintains an indexing database comprising an index or list of each document in the document collection and a cross-reference between each document in the document collection and various key terms and/or document attributes that are stored for each document in the corresponding STG file. The indexing database, in turn, is primarily used to support the document search function, which is described in greater detail below. Briefly, however, the present invention employs a search engine which has the ability to compare the information in the indexing database with one or more user-supplied search terms or attributes. Documents whose indexing information match the user-supplied search terms or attributes are then identified and/or retrieved.

[0056] The index and retrieval engine also continuously updates the indexing database. For example, when a new document becomes part of the document collection, an STG file is created for that document, as explained above. In a preferred embodiment, the index and retrieval engine also creates a new entry in the indexing database for the new document, cross-referenced with key terms and other attributes extracted from the new document's STG file.

[0057] In addition, the index and retrieval engine continuously monitors the contents of existing STG files. If a document is modified, and if the modification is reflected in the corresponding STG file, the index and retrieval engine updates the indexing database accordingly.

[0058] Another related utility is the Universal Resource Locator (URL) indexing module. Essentially, a URL is a World Wide Web site that furnishes information regarding the location and, in some cases, the content of particular Web sites and/or Web documents. The URL indexing module provides the ability to index this information so that a user can more effectively access a Web site or retrieve a particular web document as if it were any other document stored in the document collection.

[0059] In the present invention, there are three exemplary embodiments for implementing the URL indexing module. The first exemplary embodiment involves auto-indexing “bookmarks”. A bookmark is an entry in a list of commonly used web sites. In accordance with this embodiment, an STG file is created for each bookmark. The second exemplary embodiment involves physically copying a URL into memory, and indexing information relating to that URL. In this embodiment, an STG file is created for the URL. The third exemplary embodiment involves viewing a particular document located at or identified by a particular URL. Again, information relating to this document may be indexed as with any document in the document collection.

[0060] Moreover, an STG file is created for the document, and the document can be imported through the Browser utility, which is described below.

[0061] Categories and Categorization of Documents

[0062] The present invention also employs a categorization utility 159 that provides different levels of automated assistance in organizing the document collection. A category is a logical grouping of documents that share some common attribute or attributes, sometimes referred to as category criteria. For example, a category may consist of a number of documents that share a common author, a number of documents that contain at least a predefined number of words, a number of documents that contain certain key words, or a number of documents that share a common concept. A more specific example might be a category called “company press releases” or a category called “all e-mails I've sent out”. Categories can also be defined hierarchically. In other words, a category may have a subcategory. For example, “all e-mails I've sent out to my group” might be a subcategory of “all e-mails I've sent out”.

[0063] The categorization utility 159 implements a category by associating a corresponding set of category criteria with a folder in the document collection hierarchy; however, it will be recognized that not every folder in the document collection hierarchy is associated with a category. For example, in FIG. 3, folder F₂is associated with a category as indicated by the symbol “*”. However, folders F₁, F₃and F₄are not associated with a category.

[0064] Folders that are associated with a-category are, in general, referred to herein as “smart” folders. They are referred to as smart folders because the categorization utility 159 continuously searches through the STG file directory, or a portion thereof, for documents that match the category criteria associated with each smart folder. If a match is identified, the categorization utility 159 generates a link between the smart folder and the matching document, through the matching document's STG file, thus creating the appearance that smart folders automatically collect matching documents without user interaction.

[0065] As stated, the categorization utility 159 may only search a portion of the STG directory for documents that match the category criteria of a given smart folder. In an exemplary embodiment of the present invention, the categorization utility 159 limits its search of the STG directory to only those STG files associated with documents that are linked to the smart folder's parent folder. For example, in FIG. 3, F₂is a smart folder. In accordance with this exemplary embodiment, the categorization utility 159 searches the STG files associated with F₁, wherein F₁is the parent folder of F₂. Accordingly, the categorization utility 159 only searches through the STG files associated with the documents D₁, D₂, D₃and D₄. At present, only the documents D₃and D₄match the category criteria associated with the smart folder F₂.

[0066] Generating a link between a document and a smart folder may occur after an STG file is created for a new document, or it may occur after an existing STG file has been updated due to the modification of its corresponding document, wherein the modification caused the document to meet the category criteria of the smart folder. Similarly, if a document is modified such that the modification causes the document to no longer meet the category criteria of a particular smart folder, the link between that document's STG file and the smart folder may-be eliminated.

[0067] In accordance with a preferred embodiment of the present invention, the categorization utility 159 categorizes documents under various smart folders using one of three possible categorization methods: auto categorization; semi-automatic categorization; or manual categorization.

[0068] With manual categorization, a document, through its corresponding STG file, is linked with a particular category, hence a particular folder, when a user physically “drags and drops” a display screen representation of the document onto a display screen representation of the folder. As the categorization utility 159 did not previously nor automatically categorize the document with this folder, the folder is either not a smart folder or it is an inactive smart folder, or the folder is an active smart folder, but the document does not otherwise match the corresponding category criteria. Active versus inactive smart folders are explained in more detail below.

[0069] Semi-automatic categorization involves categorizing a document into any one or more categories with minimal user interaction. Here, the user constructs category criteria in the form of a query. The query, in turn, comprises one or more key terms and/or document attributes which define the category. The user may also restrict the scope of the query, for example, to particular directories or document types. The category criteria are then associated with a folder, i.e., a smart folder, and the categorization utility 159 continuously searches through all or a portion of the STG files for documents that have attributes matching the category criteria. If a matching document is identified, a new link is established between the corresponding smart folder and the matching document through the document's STG file.

[0070] Automatic categorization involves categorizing a document into one or more categories without any user interaction. Here, each category is represented by a smart folder that initially contains a “seed”document. The “seed” document is then analyzed by the categorization utility 159, and the category criteria (i.e., the key words and/or attributes) are automatically extracted. Existing documents and new documents that match the automatically extracted category criteria are linked with the smart folder through their corresponding STG files.

[0071] The categorization utility 159 can utilize the indexing information to examine the relationship between the various documents within a particular category. This feature scores or ranks the relationships. For example, documents that share a large number of key terms are considered closely related; those that do-not share a large number of key terms are considered less related. The categorization utility 159 can display the results in the form of an organization hierarchy “tree”. Branching high in the organizational hierarchy denotes a close relationship, while branching low in the hierarchy denotes a more distant relationship.

[0072] In a preferred embodiment, a user can modify the category criteria associated with a smart folder. This is accomplished through a “modify category criteria” user interface. Changing category criteria may result in the categorization utility 159 purging documents from the corresponding category if the documents no longer match the category criteria. In addition, the categorization utility 159 initiates a search using the modified category criteria, to identify additional documents in the document collection that are now relevant given the new category criteria.

[0073] In a preferred embodiment of the present invention, a user may designate a smart folder as active or non-active. For each active smart folder, the categorization utility 159 continuously searches the STG file directory, as described above for documents that match the category criteria associated with each of the smart folders. For inactive smart folders, the categorization utility 159 does not continuously search the STG file directory for documents that match the category criteria of the various inactive smart folders; however, a user is able manually categorize a document with a non-active smart folder. Active smart folders are sometimes referred to as “hungry” folders.

[0074] Smart folders can also be reactive. In accordance with a preferred embodiment of the present invention, a user can program a smart folder with particular behavioral characteristics, such that a particular task or tasks are automatically performed on or with the documents linked with that smart folder. For example, the user may program a smart folder to automatically e-mail all documents stored therein to a particular e-mail address. In another example, the user may program a smart folder to periodically display folder updates, such as the addition or deletion of new documents.

[0075] With respect to semi-automatic and automatic categorization, there are two filter types associated with each smart folder. The first filter type generates an inclusion list. The inclusion list identifies those documents that were not automatically included in the category associated with the smart folder during the categorization process. The inclusion list may provide the user with an indication that the category criteria associated with that category are too restrictive. The second filter type generates an exclusion list. The exclusion list identifies those documents that were not automatically excluded from the category associated with the smart folder during the categorization process. The exclusion list may provide the user with an indication that the category criteria associated with that category are not restrictive enough (i.e., the category criteria is too aggressive). Both lists are manually manipulated by the user. Accordingly, the user can modify the two lists as needed.

[0076] As explained above, the data defining the links that are established between the various smart folders and the documents in the document collection are maintained in the DCO file. If a user modifies the contents of a document and that modification causes a change in the link or links between that document, through its corresponding STG file, and one or more smart folders, a change notification utility (not shown in FIG. 1B) updates the DCO file to reflect the changes accordingly. More specifically, the change notification utility modifies the DCO file to reflect the newly created links and/or the deletion of links. The change notification utility also updates the thumbnail representations if needed. And if the user deletes a document in its entirety, the change notification utility deletes all of the links associated with that document from the DCO file.

[0077] The user interface for the change notification utility is illustrated in FIG. 4. This user interface allows the user to select a few preferences with respect to the change notification utility. More particularly, the user can select how often the utility is to perform the updates, as well as the type of file changes that triggers an update notification.

[0078] Importing Documents

[0079] The present invention also employs a document importing utility 161. The document importing utility permits the present invention to import electronic documents or electronic representation of paper-based documents from various sources. For example, the document importing utility 161, as shown in FIG. 1A, can import documents from a scanner, from an external memory such as a hard drive, from a LAN, or from the internet.

[0080] The first feature associated with the document importing utility 161 is the scanner module. The scanner module controls a scanner connected to the host computer system. More specifically, the scanner module allows the user to set-up the scanner. It also controls the scanning process and the process of saving the electronic representation of the document being scanned.

[0081] In a preferred embodiment of the present invention, there are a number of user interfaces associated with the scanner module. The first user interface is the scanner preferences interface, and there are four display options associated with the scanner preferences interface. The first display option allows the user to define various scanner options, as illustrated in FIG. 5. The second display option is for defining image file options, as illustrated in FIG. 6. The third display is for setting-up scan-to-category options, as illustrated in FIG. 7. This option permits the user to scan a document directly into a desired category. The fourth is for defining options with respect to multiple page documents, as illustrated in FIG. 8.

[0082] With particular regard to the multiple page option interface illustrated in FIG. 8, this set of user-defined options is for controlling the scanner's automatic document feeder (ADF). Of course, this particular scanner preference option is enabled only if the scanner has an ADF. If the user selects the “Check ADF continuously” box 805, the scanner is polled at a predefined interval to determine whether there is paper in the ADF waiting to be scanned. If there is paper in the ADF, it is scanned, and the document is saved according to the other above-identified scanner preference options. If there is more than one page being scanned, there are a number of additional options as illustrated in FIG. 8. If the user selects the “prompt for more pages at the end of the scan” box 810, the user will be prompted to append additional pages to the document at the end of the current scanning operation.

[0083] The second user interface associated with the scanner module is the scanner control interface. The scanner control interface is illustrated in FIG. 9. When the scan button 905 in the center of the scanner control interface is selected, the scanner module begins scanning a document in accordance with the scanner preference options described above. If the user selects the scanner control interface title bar 910, the scanner preferences interface described above is be displayed, thus allowing the user to accept or change the current scanner preference options.

[0084] As previously stated, an STG file is created for each new document in the document collection. In addition, the index and retrieval engine indexes each new document based on the attribute data in the corresponding STG file, and the categorization utility 159 links each new document with the appropriate smart folders. Each of these features holds true for new documents that have been scanned into the document collection as well as those which have entered the document collection via other mechanisms. This saves the user from having to physically interact with a particular document or documents after they have been scanned.

[0085] The second feature associated with the document importing utility 161 is the file import module. The file import module is responsible for extracting and saving attribute information in the STG file of a newly imported document. The attribute information extracted from each document by the file import module depends, to some extent, upon the file type. With regard to word processing type documents, the file import module extracts and saves the raw text information. The file import module also extracts a 96×96 pixel map for generating a thumbnail image of the first page of each document. Thumbnails contain actual document information, and are primarily used in conjunction with the Browser utility to help a user quickly identify specific files. FIG. 10 illustrates an exemplary display from the Browser utility which contains a number of thumbnail representations 1005 for the category entitled “My Documents” as indicated in text box 1010. For image files, the file import module extracts a thumbnail map and any meta-text associated with the image file. Meta-text contains the content and position information for any alpha-numeric information appearing in the image. The file import module then converts the alpha-numeric information into plain text. The plain text can then be used by the index and retrieval engine as described above. Therefore, image files can be indexed and categorized just like word processing and other text files.

[0086] When a color image containing text is to be scanned, the user can specify that the color image is to be scanned using a two-pass scanning process. The first pass is a low resolution scan which converts the document into a desired image format, e.g., TIFF, JPEG etc. . . . The second pass is a higher resolution pass that is conducted on a non-color or non-gray scale version of the image. This second scanning pass is used to obtain the position of the meta-text described above.

[0087] The third feature associated with the document importing utility 161 is the failed import recovery feature. If, upon importing a document into the document collection, the file import module is unable to determine the document format, the user is prompted to define the format.

[0088] Browsing Documents

[0089] The present invention includes a document browsing utility 163. The Browser utility 163 permits the user to quickly and efficiently review the document collection or a portion thereof. Moreover, it allows the user to view the documents and the document categories as they are logically arranged in the organizational tree described above. In addition, the Browser utility 163 permits the user to manipulate documents and document categories to copy, move and delete documents and document categories; to view and print documents; and to bundle multiple documents into a compound document entity referred to as a clipped document. Clipped documents are described in greater detail below.

[0090] There are two basic user interfaces associated with the Browser utility 163. The first is referred to as My Computer, as illustrated in FIG. 10. When viewing documents and document categories with the My Computer interface, there is one display panel 1015 for displaying a representation of each document, clipped document or folder. In FIG. 10, the document representations are displayed as thumbnails, although other representations are available such as small or large icons. The second user interface is referred to as the Explorer interface, as illustrated in FIG. 11. In contrast, Explorer has two display panels: a right display panel 1105 and a left display panel 1110. While the left panel 1110 displays the folders and/or document categories, including the one currently opened, the right panel 1105 displays a representation of each document, clipped document and/or folder associated with the currently opened folder or document category. Again, the representations appearing in the right panel 1105 can take the form of thumbnails, small icons, or large icons. In FIG. 11, the representations are in the form of small icons.

[0091] The Browser utility 163 allows the user to interact with the documents in the document collection in a number of different ways. Using a mouse or cursor, the user can open documents in a corresponding host application. The user can open a category and display the documents, clipped documents, folders and/or subcategories associated therewith. The user can open a context menu 1115 for a given document, as shown in FIG. 11, wherein the context menu 1115 provides the user with a number of additional options as illustrated.

[0092] These two user interfaces associated with the Browser utility 163, My Computer, a's illustrated in FIG. 10, and Explorer, as illustrated in FIG. 11, each have a number of standard pull-down menus. The FILE pull-down menu, for example, allows the user to, among other options, open documents, clipped documents, or document categories; send documents or clipped documents as e-mail messages; create new categories; import new documents from the scanner; delete, rename and/or list the properties of documents, clipped documents and categories. The EDIT menu allows the user to copy, paste, select all or part of a document. This menu also allows the user to clip or unclip documents. The VIEW menu, among other options, allows the user to display a customizable application toolbar, to be described below, and to control the arrangement and display representation of each document. In addition, there is also a TOOLS, TEST and a HELP menu.

[0093] In order to import a document into the system's document collection from the Browser utility 163, a user can exercise one of several options. For example, a user can drag a document from the computer operating system desktop environment and drop it onto a Browser utility icon also appearing on the desktop. If one of the two above-identified Browser utility interfaces is active, the user can drag a document from the desktop environment and drop it into one of the aforementioned panels in a location that is unoccupied by another icon or thumbnail. As described above, the categorization utility 159 automatically categorizes these documents based on the document attributes extracted and then stored in their corresponding STG files. The user can also drag a document from the desktop environment into a particular category representation appearing in the Browser interface, thus, manually categorizing the document. Finally, the user can cut and paste all or part of a document, or the user can scan in a document.

[0094] The user can also initiate a scanning operation from the Browser utility 163. A representation of the scanned-image can be displayed on the desktop or scanned directly into one or more categories based on the user specified scanner options described above. This too is handled by a task manager utility 165 which is described in greater detail below.

[0095] The user may also opt to display the customizable application toolbar, mentioned above, with either of the two Browser interfaces. An exemplary toolbar 1205 is illustrated in FIG. 12. The toolbar 1205 makes it easier for the user to directly interact with documents maintained in the document collection. For example, by employing the toolbar 1205, the user is able to drag and drop application program icons or buttons (i.e., buttons or icons which, if selected, launch an application program such as Microsoft Excel, Microsoft Word, Netscape, or Wordperfect), thus allowing the user to quickly open one or more application programs and to convert, view and/or edit documents on-the-fly. This on-the-fly document conversion is accomplished by employing conversion filters to convert the various file formats. As stated, the user is able to quickly execute other functions with the customizable application toolbar, such as send e-mail, transmit facsimiles, and initiate print jobs.

[0096] The Browser utility 163 is also capable of displaying a representation for one or more transitional documents. A transitional document is a document that is currently being processed by the importing utility 161. During the period in which a document is being processed by the importing utility 161, the Browser utility 163 displays an “in-transition” icon for that document, for example, the in-transition icons 1305 shown in FIG. 13. However, an in-transition icon is a temporary representation. When the importing utility 161 finishes processing the document, the Browser utility 163 automatically replaces the in-transition icon with the appropriate thumbnail representation., a small icon or a large icon, depending upon the current Browser utility display settings described above. In-transition icons provide the user with an easily recognizable representation for each of the one or more transitional documents.

[0097] Searching Documents

[0098] The present invention also includes a document searching utility 167. The searching utility 167, in turn, employs a search engine that globally searches the document collection (i.e., the STG files in the STG file directory) and retrieves documents that fit or match a number of user-defined conditions with respect to text, meta-text, and/or other file attributes (e.g., document author, date, size, format).

[0099] In a preferred embodiment of the present invention, there are two search types which the user can initiate: a basic search and an advanced search. The basic search allows the user to search the document collection using a search query that contains only words or phrases. The advanced search allows the user to build a query that contains words and/or phrases as well as other file attributes, and it allows the user to combine the various words, phrases and other file attributes with boolean operators.

[0100] Whether the user invokes a basic search or an advanced search, the searching procedure is essentially the same. The user enters a desired query, then selects a FIND NOW option in the corresponding user interface, which is described in greater detail below. The results are then displayed. The user then selects one or more of the identified documents, if desired.

[0101] As stated, there is a user interface for the basic search and a user interface for the advanced search. The user interface for the basic search is illustrated in FIG. 14. As shown in FIG. 14, the user interface is divided into an upper portion 1405, which is reserved for building search queries, and a lower portion 1410, where the results of a given search are displayed. The lower portion 1410 is referred to as the results listbox.

[0102] After the user builds a basic search query, the user selects the FIND NOW option 1415 on the user interface to initiate the search. The search engine then performs the search for that query. As the indexing engine finds a document that matches the search criteria defined by the search query, the indexing engines informs the search utility 167. The search utility 167, in turn, displays the name of the document in the results listbox 1410 of the basic search user interface. At any time during the search, the user can select the STOP-option 1420 on the user interface, which forces the indexing engine to terminate the search.

[0103] With regard to the results listbox 1410, the user can view the identified documents as small icons, large icons, thumbnails, or as a detailed list of documents. In an exemplary embodiment, the search utility 167 creates one or more smart folders and displays them in the results listbox 1410. Each of the one or more smart folders has category criteria associated with a particular level of relevance (e.g., a number of search hits). Documents identified during the search are linked to one of these smart folders depending upon the actual relevancy of the document. For example, the search utility 167 may create two smart folders. The first smart folder's category criteria may be documents identified during the search operation having 10 or more search hits. In contrast, the second smart folder's category criteria may be documents identified during the search having less than 10 search hits. The search utility 167 then links the documents identified during the search to either the first or the second smart folder accordingly. The smart-folders, along with the documents linked thereto are then displayed in the results listbox 1410. In another example, the search operation may create a number of smart folders which are displayed in the listbox 1410, wherein each smart folder may be linked to a group of documents that share a certain number of key search terms. Alternatively, each smart folder may be linked to a group of documents containing key search terms that exhibit a certain semantic similarity.

[0104] In accordance with another exemplary embodiment, the search operation may identify one or more existing categories whose category criteria, in whole or in part, overlaps the key search query criteria. The search results might then be organized such that the one or more existing categories are listed. The user could then view those documents associated with each category that meet the search query criteria.

[0105] The user can also select any number of retrieved documents, and then select the SIMILAR DOCS 1425 option on the basic search user interface. The search utility 167 then queries the indexing engine to identify all documents similar to those selected. For example, the indexing engine might identify all documents that are similarly categorized. The newly identified documents are then displayed in the results listbox 1410.

[0106] The advanced search user interface is accessed through the basic search user interface by selecting the ADVANCED option 1430. The advanced search user interface is illustrated in FIG. 15. As stated above, the primary difference between a basic search and an advanced search is that with an advanced search, the user can conduct more sophisticated searches with words, phrases, file attributes and/or a combination thereof using boolean operators. A file attribute refers to any number of file characteristics, for example, document size, publication date, author, or document source (i.e., files with a particular extension such as *.TIF, *.TXT, *.HTM).

[0107] Although the advanced search user interface, like the basic search user interface, includes an upper portion 1505 for building search queries, and a lower portion 1510 for displaying search results, the advanced search user interface also includes a number of additional options not available for basic searching. For example, the user can modify the scope of an advanced search by entering a specific category in the SCOPE EDIT BOX 1515. By selecting the BROWSE option 1520, a category tree is displayed, which allows the user to select, therefrom, a category for limiting the scope of the advanced search. Accordingly, the selected category is displayed in the SCOPE EDIT BOX 1515. The user can also limit the scope of an advanced search to the contents of each document, excluding document annotations; or the user can include the annotations; or the user can limit the search to only document annotations. This is accomplished by selecting the box 1525 entitled “Include Documents” and/or the box 1530 entitled “Include Annotations”. Finally, the user can return to the basic search user interface by selecting the BASIC option 1535. If the user selects this option, all search conditions are lost except those containing exclusively words and/or phrases.

[0108] Viewing Documents

[0109] The next utility employed by the present invention is the document viewing utility 169. The document viewing utility 169 allows the user to view an entire document regardless of document type or document format, even if the corresponding host application cannot be launched.

[0110] The document viewing utility 169 user interface, as illustrated in FIG. 16, is accessed through the Browser utility 163. The document viewing user interface comprises two panes, a right pane 1605 and a left pane 1610, as illustrated in FIG. 16. The left pane 1610 displays an icon or thumbnail of the document that is being viewed in the right pane 1605. In a preferred embodiment, a thumbnail representation is used if the document is an image. If, instead of a document, a clipped document is being viewed, then the icons or thumbnails for each individual document associated with the clipped document is displayed in the left pane 1610.

[0111] The document viewing user interface, like the browser user interfaces includes a customizable application toolbar 1615 as illustrated in FIG. 16. Again, the toolbar 1615 is customizable in that the user can drag and drop functional buttons into the toolbar 1615 as described above, particularly buttons that, when selected, launch an application program which the user may need to properly view the documents. In addition, the toolbar 1615 may contain a number of functional buttons. In FIG. 16, the toolbar 1615 includes, from left to right, buttons for opening, saving, printing, hand scrolling, annotating, zooming, and advancing forward or back one page of the document being viewed.

[0112] The document viewing utility 169 also highlights category criteria. In other words, it highlights the various key words, phrases, and/or attributes in the document being viewed, which make up the category criteria, assuming, of course, the document has been categorized.

[0113] Clipped Documents

[0114] The present invention also utilizes a document clipping utility 171. This utility allows a user to combine several documents into a compound document entity herein referred to as a clipped document. More specifically, a clipped document is a form of compound document that contains zero or more documents of any type or format. For example, a clipped document may contain an image document, a. Microsoft Word document a Wordperfect document and a web page in HTML format.

[0115] Clipped documents are different from ordinary file folders. First, clipped documents maintain the order in which each component document appears. In other words, each of the component documents that are associated with a clipped document maintains a relative position within the clipped document with respect to the other component documents. Second, clipped documents provide the user with the ability to quickly and simply manipulate a set of related documents as a group. For example, a user can e-mail a clipped document to another user, and the other user actually receives the documents as a clipped document. If the host computer being operated by the other user is not executing the present invention, the other user receives each of the documents individually.

[0116] Although the user can manipulate the component documents as a group, there are other instances when the component documents associated with a clipped document are manipulated individually. For example, the search engine, in performing a basic or advanced search, identifies each component document within a clipped document, assuming they meet the search criteria, including the level of relevance of each individual component document.

[0117] As explained above, the present invention employs a virtual document storage feature. Accordingly, clipped documents do not physically contain a copy of each component document. Rather, each clipped document has a corresponding STG file, as described above, and as illustrated in FIG. 2B. The STG file associated with a clipped document contains a link to the STG file of each component document (see FIG. 2A). Once again, this virtual document storage feature saves valuable memory space and it helps maintain document integrity (i.e., a single, up-to-date version of each document).

[0118] Just as individual documents can belong to more than one category, clipped documents can belong to more than one category. A clipped document can also belong to no categories.

[0119] In a preferred embodiment, there are six ways in which a user can create a clipped document. First, from the Browser utility 163, a user can drag the representation of a source document D₁and drop it onto the representation of a destination document D₂, as illustrated in FIGS. 17A-17D. The Browser utility 163 creates a new clipped document S in the category containing the destination document D₂. A representation of the new clipped document S then appears to subsume the representation of the destination document D₂. At the same time, the source document D₁remains in the source category or be removed from the source category depending upon whether the user executes a copy operation or move operation.

[0120] Second, from the Browser utility 163, a user can drag the representation of an existing clipped document and drop it onto a destination document. The Browser utility 163 causes the destination document to become concatenated with the clipped document, which in turn appears to subsume the representation of the destination document. A representation of a new clipped document, once again, appears in the category containing the destination document. Also, the existing clipped document remains in or is removed from the source category depending upon whether the user executes a copy operation or a move operation.

[0121] Third, from the Browser utility 163, a user can drag the representation of a source document and drop it onto the representation of an existing clipped document in a destination category. Here, the source document is appended to the existing clipped document in the destination category. Again, the source document remains in or is removed from the source category depending upon whether the user executes a copy operation or a move operation.

[0122] Fourth, from the Browser utility 163., a user can drag the representation of a clipped document from a source category and drop it onto a representation of a clipped document in a destination category. Accordingly, the component documents associated with the source clipped document are appended to the destination clipped document. The source clipped document remains in or is removed from the source category depending upon whether the user executes a copy operation or a move operation.

[0123] Fifth, from the Browser utility 163, a user can simply create a new clipped document. The user can then designate that the clipped document is to be associated with a particular category.

[0124] Sixth, from the document viewing utility 169, a user can drag the representation of a document in a source category or the representation of a clipped document in a source category and drop it onto the representation of the document being viewed. The document or documents associated with the clipped document are appended to the document being viewed, thus creating a new clipped document in the category containing the document being viewed. Once again, the source document or source clipped document remains in or is removed from the source category depending upon whether the user executes a copy operation or a move operation.

[0125] A user can also unclip a clipped document. Upon executing an unclipping operation, the representation of the clipped document is removed and the representations of the component documents are made visible in the corresponding Browser user interface. Additionally, the user can delete a clipped document, either locally or globally. From within a particular category, the user merely executes a delete clipped document command, wherein the Browser utility 163 deletes the clipped document, along with the component documents, from that category. From the “My Documents” category, a user can execute a delete clipped document command, wherein the Browser utility 163 deletes the clipped document from every category.

[0126] Other software applications, such-as Microsoft Office, employ compound document entities; however, these entities differ from clipped documents. For example, Microsoft Office uses “binders”. Unlike clipped documents, binders only allow a user to mix Microsoft Excel, Powerpoint and Word documents. But binders do not allow the user to bind non-Microsoft Office formatted documents. Another major difference between binders and clipped documents is that binders are monolithic documents. In other words, the component documents cannot be individually manipulated. In addition, a user of Microsoft Office cannot e-mail a binder to another person unless the other person is running Microsoft Office. Yet another difference between Microsoft Office binders and clipped documents is the fact that binders maintain a physical copy of each component document whereas the present invention employs a virtual document storage feature. As explained above, this is an inefficient usage of memory space, and it can lead to multiple versions of a single document, since a single document may be stored in more than one binder.

[0127] File Helper

[0128] A next utility is the file helper or archiving utility 173. The file helper utility keeps the document collection tidy. More specifically, the file helper utility automatically archives files onto removable media, if, in general, those files have not been accessed or modified for a long period of time. The file helper utility also notifies the user if files have old dates; it notifies the indexing engine and the DCO file when files are taken off-line; it monitors the document collection for document duplicates; and it organizes a separate index of off-line documents.

[0129] The file helper utility has a user interface, as illustrated in FIG. 18. As one skilled in the art will readily appreciate, the user interface illustrated in FIG. 18 permits the user to select one or more various conditions that trigger the automatic archiving process. The file helper utility also prompts a user, if the user so desires, before the system archives a document in accordance with the user selected options. In addition, there are a number of secondary user interfaces associated with the file helper utility 173, for example, the user interface illustrated in FIG. 19. The secondary user interfaces are utilized for entering more specific archiving conditions, such as the exact size of a document or the age of a document that trigger this archiving utility 173. The file helper utility continues to maintain a link to or an index of each archived-document, by storing a thumbnail representation of each archived document and/or the STG file associated with each archived document. Therefore, if a user wishes to run a search involving archived documents, the search engine is capable of searching the content of the thumbnail representations and/or the STG file data fields of each archived document. If the search identifies one or more archived documents, the file helper utility prompts the user to make the appropriate removable storage medium available (e.g., prompt the user to insert a particular floppy disk) in the event the user wishes to access the archived document.

[0130] Directory Monitor

[0131] There is also a directory monitor utility 175 that monitors specific user-identified directories, categories, and/or folders on a particular storage device for newly stored documents. When the directory monitor utility 175 identifies newly stored documents, the categorization utility 159 automatically categorizes these documents into the appropriate categories or smart folders, as described above. Again, there is a user interface associated with the directory monitor utility 175 as illustrate in FIG. 20. As shown, the user interface provides the user with a vehicle to select the particular directories to be monitored.

[0132] Task Manager

[0133] The task manager utility 165 is yet another utility employed by the present invention. The task manager utility 165 is a multi-threaded single instance utility that is launched when the host computer is booted after loading the software associated with the present invention or upon a first request for one of its services after the utility has been turned off. Its main function, however, is to facilitate background or batch processing jobs such as importing documents into the document collection.

[0134] The task manager utility 165 has a corresponding user interface, as illustrated in FIG. 21. The user interface includes a queue for displaying a list 2105 of the various tasks currently being undertaken by the task manager utility 165.

[0135] When the task manager utility 165 is first initiated, for example, if the user executes a document import request, a small icon 2210 appears in the system task bar at the bottom of the display, as illustrated in FIG. 22. If the user selects the icon (with a mouse/cursor), the task manager utility 165 responds by opening the task manager utility 165 user interface.

[0136] The task manager utility 165 user interface also includes a number of “pull-down” menus, as illustrated in FIG. 21, including a QUEUE menu and a JOB menu. The QUEUE menu includes, among other options, the option of stopping the task manager utility 165 from scanning or indexing a document, purging the queue, and terminating the task manager utility 165. The JOB menu provides options that include purging a document from the queue, and changing the priority in which the task manager utility 165 executes the jobs in the queue.

[0137] Annotations

[0138] The present invention has an annotations utility 177 which provides the user with the option of adding annotations to a document before a scanning operation is completed. This feature allows the user to automatically manipulate an image document, including the added annotations, immediately upon completion of the scan. The user is also permitted to add annotations of almost any type. For example, text annotations, free-form annotations (i.e., pictures and graphs), and waveform (i.e., audio) annotations. Drag and drop annotations are also available, if a user wishes to insert an annotation from one document into another document. The user can even print annotations apart from the remainder of the accompanying document.

[0139] Property Sheets

[0140] The present invention also has a property sheet utility 179. The property sheet utility 179 allows a user to display a property sheet for each individual category, clipped document and/or document. Property sheets are yet additional user interfaces which convey specific summary information about a given category, document and/or clipped document. This summary information may include particular document attributes such as document size, date, author, or the number of key words or attributes contained in a document. Moreover, the summary information for a particular document is stored in the STG file corresponding to that document. Table I contains a list of potential attributes that might appear in a property sheet depending upon whether the property sheet pertains to a category, a clipped document or a document. Property sheets might also include a brief synopsis or abstract describing the contents of a given document. In accordance with a preferred embodiment, property sheets can be accessed either through the Browser utility 163 or the document viewing utility 169.

[0141] The invention has been described with reference to a preferred exemplary embodiment. However, it will be readily apparent to those skilled in the art that it is possible to embody the invention in forms other than those of the preferred embodiment described above. This may be done without departing from the spirit of the invention. The preferred embodiment is merely illustrative and should not be considered restrictive in any way. The scope of the invention is given by the appended claims, rather than the preceding description, and all variations and equivalents which fall within the range of the claims are intended to be embraced therein.