Management of non-persistent data in a persistent database

[0002] This application is related to the following applications, all of which are filed on the same day and assigned to the same assignee as the present application:

[0003] “Use of Relational Databases for Software Installation” —Ser. No. 09/158,125.

[0004] “System and Method for Repairing a Damaged Application” —Ser. No. 09/158,126.

[0005] “Method and System for Restoring a Computer to its Original State After an Unsuccessful Installation Attempt” —Ser. No. 09/158,124.

[0006] “A Method for Categorizing and Installing Selected Software Components”—Ser. No. 09/157,695.

[0007] “System and Method for Managing Locations of Software Components Via A Source List”—Ser. No. 09/157,974.

[0008] “Method for Optimizing the Installation of a Software product onto a Target Computer System”—Ser. No. 09/157,853.

[0009] “Software Installation and Validation Using Custom Actions”—Ser. No. 09/157,776.

[0010] “Internal Database Validation”—Ser. No. 09/157,828.

[0011] “Method and System for Advertising Applications”—Ser. No. 09/158,125.

[0012] “Software Implementation Installer Mechanism”—Ser. No. 09/158,021.

[0013] This invention relates generally to databases, and more particularly to management of non-persistent data in a persistent database.

[0014] A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. The following notice applies to the software and data as described below and in the drawings attached hereto: Copyright© 1998, Microsoft Corporation, All Rights Reserved.

[0015] A prevalent type of database today is a relational database. A relational database is a collection of data items organized as a set of formally-described tables from which data can be accessed in many different ways without having to reorganize the database tables. A view is a particular way of accessing the data items in a database. A single database can support numerous different views. Typically, a view arranges the data in some order and makes only certain components of the data visible. The different views do not affect the physical organization of the database tables.

[0016] Each table (also referred to as a relation) contains one or more data categories organized in columns. The names of the columns of the table are referred to as attributes. A row of a table contains a unique instance of data for the categories defined by the columns. Each row has one component for each attribute of the table. The name of the table and the set of attributes for the table are together referred to as the schema for that particular table.

[0017] Although the rows of a table are frequently modified, it is less common for the schema of a table to change. However, there are situations where a user might want to add or delete attributes. Schema changes, while possible in commercial database systems, are very expensive and inefficient because each one of the perhaps millions of rows need to be rewritten to add or delete components. If an attribute is added, for example, it may be difficult or even impossible to find the correct value for the new component of the rows.

[0018] When a database is extended to include additional data such as new rows or columns, the additional data becomes a permanent part of the database. However, a user often does not want to modify the data permanently. For example, in some cases it is desirable to enhance or manipulate large amounts of data that already exists in a database while retaining the original state of the database. One method of enhancing and manipulating data without changing the original state of a database is to store the new data separate from the original data. For example, new data is stored in a separate table. However, performance suffers when this method is used. More time and system resources are required to access and manipulate data stored in multiple locations than if the data were integrated and stored in the same location.

[0019] Therefore, a database system is needed which permits new data to be added to a table without requiring that the original state of the table be modified. What is also needed is a database system that permits the new data to be seamlessly integrated with the original data for manipulation.

[0020] The above-mentioned shortcomings, disadvantages and problems are addressed by the present invention, which will be understood by reading and studying the following specification. This invention relates to management of non-persistent data in a persistent database.

[0021] A method of managing non-persistent data in a persistent database includes adding the non-persistent data to the database in the form of a temporary entry. The temporary entry can be a temporary row or column, a temporary table or a temporary database with temporary tables. The method also includes tracking the non-persistent data in order to maintain the original state of the persistent database. A column of temporary bits is added to track the rows, and the temporary columns are tracked via a bit in the schema.

[0022] A computerized system for managing non-persistent data in a persistent database includes a database containing persistent data and a database engine for maintaining the relational database. A database application program interface has special options for adding an entry containing non-persistent data to the relational database. The database engine integrates the non-persistent data into the relational database with the persistent data while the database exists in memory of a computer. The database engine ignores the non-persistent data in the relational database when writing the relational database to a computer readable medium so that an original state of the persistent data is preserved.

[0023] Non-persistent temporary entries can be added to any relational database to extend data while maintaining the original state of the database. Using temporary entries is advantageous when a large amount of data already exists in a database and a user needs to enhance and/or manipulate the data while still retaining the original or updated state of the data.

[0024] The present invention describes systems, methods, computers and computer-readable media of varying scope. In addition to the aspects and advantages of the present invention described in this summary, further aspects and advantages of the invention will become apparent by reference to the drawings and by reading the detailed description that follows.

[0025] FIG. 1 is a block diagram of the hardware and operating environment in conjunction with which embodiments of the invention may be practiced.

[0026] FIG. 2 is a block diagram illustrating a system-level overview of an exemplary embodiment of the invention.

[0027] FIG. 3 is a flowchart of a method to be performed by a computer according to an exemplary embodiment of the invention.

[0028] FIG. 4 is a diagram of an example data table integrating rows and columns of persistent and non-persistent data.

[0029] In the following detailed description of exemplary embodiments of the invention, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific exemplary embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and it is to be understood that other embodiments may be utilized and that logical, mechanical, electrical and other changes may be made without departing from the spirit or scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.

[0030] The detailed description is divided into five sections. In the first section, the hardware and the operating environment in conjunction with which embodiments of the invention may be practiced are described. In the second section, a system level overview of the invention is presented. In the third section, methods for an exemplary embodiment of the invention are provided. In the fourth section, a particular implementation of the invention is described that operates as part of Microsoft Corporation's Windows Installer product. Finally, in the fifth section, a conclusion of the detailed description is provided.

[0031] FIG. 1 is a diagram of the hardware and operating environment in conjunction with which embodiments of the invention may be practiced. The description of FIG. 1 is intended to provide a brief, general description of suitable computer hardware and a suitable computing environment in conjunction with which the invention may be implemented. Although not required, the invention is described in the general context of computer-executable instructions, such as program modules, being executed by a computer, such as a personal computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types.

[0032] Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

[0033] The exemplary hardware and operating environment of FIG. 1 for implementing the invention includes a general purpose computing device in the form of a computer 20, including a processing unit 21, a system memory 22, and a system bus 23 that operatively couples various system components include the system memory to the processing unit 21. There may be only one or there may be more than one processing unit 21, such that the processor of computer 20 comprises a single central-processing unit (CPU), or a plurality of processing units, commonly referred to as a parallel processing environment. The computer 20 may be a conventional computer, a distributed computer, or any other type of computer; the invention is not so limited.

[0034] The system bus 23 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory may also be referred to as simply the memory, and includes read only memory (ROM) 24 and random access memory (RAM) 25, a basic input/output system (BIOS) 26, containing the basic routines that help to transfer information between elements within the computer 20, such as during start-up, is stored in ROM 24. The computer 20 further includes a hard disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for reading from or writing to a removable optical disk 31 such as a CD ROM or other optical media.

[0035] The hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive interface 33, and an optical disk drive interface 34, respectively. The drives and their associated computer-readable media provide nonvolatile storage of computer-readable instructions, data structures, program modules and other data for the computer 20. It should be appreciated by those skilled in the art that any type of computer-readable media which can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROMs), and the like, may be used in the exemplary operating environment.

[0036] A number of program modules may be stored on the hard disk, magnetic disk 29, optical disk 31, ROM 24, or RAM 25, including an operating system 35, one or more application programs 36, other program modules 37, and program data 38. A user may enter commands and information into the personal computer 20 through input devices such as a keyboard 40 and pointing device 42. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 21 through a serial port interface 46 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port, or a universal serial bus (USB). A monitor 47 or other type of display device is also connected to the system bus 23 via an interface, such as a video adapter 48. In addition to the monitor, computers typically include other peripheral output devices (not shown), such as speakers and printers.

[0037] The computer 20 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer 49. These logical connections are achieved by a communication device coupled to or a part of the computer 20; the invention is not limited to a particular type of communications device. The remote computer 49 may be another computer, a server, a router, a network PC, a client, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 20, although only a memory storage device 50 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local-area network (LAN) 51 and a wide-area network (WAN) 52. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

[0038] When used in a LAN-networking environment, the computer 20 is connected to the local network 51 through a network interface or adapter 53, which is one type of communications device. When used in a WAN-networking environment, the computer 20 typically includes a modem 54, a type of communications device, or any other type of communications device for establishing communications over the wide area network 52, such as the Internet. The modem 54, which may be internal or external, is connected to the system bus 23 via the serial port interface 46. In a networked environment, program modules depicted relative to the personal computer 20, or portions thereof, may be stored in the remote memory storage device. It is appreciated that the network connections shown are exemplary and other means of and communications devices for establishing a communications link between the computers may be used.

[0039] The hardware and operating environment in conjunction with which embodiments of the invention may be practiced has been described. The computer in conjunction with which embodiments of the invention may be practiced may be a conventional computer, a distributed computer, or any other type of computer; the invention is not so limited. Such a computer typically includes one or more processing units as its processor, and a computer-readable medium such as a memory. The computer may also include a communications device such as a network adapter or a modem, so that it is able to communicatively couple other computers.

[0040] A system level overview of the operation of an exemplary embodiment of the invention is described by reference to FIG. 2. As shown in FIG. 2, a non-persistent data management system 200 comprises one or more inputs 202, one or more processing modules 204, one or more outputs 206, and one or more data structures 208.

[0041] The inputs 202 to the non-persistent data management system 200 represent requests from a database client application 210 to enhance or manipulate persistent data. In an example embodiment of the invention further described in the section entitled “Microsoft Windows Installer Implementation,” the application 210 is a software installation application designed to provide a robust and easy to use interface for installing software applications from an installation medium to a user's computer system. In one embodiment, the software installation application requests that temporary columns be added to data tables in a software installation database. The temporary columns represent a current state of a computer before and during the installation process as well as a desired state of the computer upon completion of the installation process. The outputs 206 of the non-persistent data management system represent the results of the requests from the database client application 210.

[0042] Processing modules 204 comprise program modules that perform actions requested by the application 210. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular functions or implement particular abstract data types. In one embodiment, processing modules 204 comprise database engine 212 and database application program interface (API) 214.

[0043] Database engine 212 is a computer program responsible for maintaining a database. Database engine 212 is an interface between client applications, such as application 210, and the database. Database engine 212 performs various operations such as reading data from the database in response to application program queries and writing data to the database when an application program inserts, deletes, or updates a row or a column in the database. In the non-persistent data management system 200 of the present invention, both non-persistent data and persistent data are written to and read from a database by database engine 212.

[0044] Database API 214 is an application program interface used by a database client application. The API defines the interface between a database client and the database engine 212. Typically, database API 214 is a set of function calls allowing a database client to create a database table; insert, update and delete rows within a table; query for rows in a table meeting certain criteria; and read data from rows in a table. In one embodiment of the non-persistent data management system 200 of the present invention, database API 214 provides one or more calls for adding temporary entries to database tables. In an alternate embodiment, temporary entries are added to database tables with SQL (Structured Query Language) statements specifying the keyword “TEMPORARY.” Data structures 208 comprise one or more databases, such as database 216. Database 216 is a conventional relational database. Database 216 contains a plurality of data tables 218. Each one of the data tables 218 has one or more columns 220 having a defined data type such as integer, real, string, or binary data. Each one of the data tables 218 also has one or more rows 222. The data tables 218 are typically used to hold application specific data. In one embodiment of the invention further described in the section entitled “Microsoft Windows Installer Implementation,” database 216 is a database containing software application installation data such as file names, directory names, registry keys and identifiers.

[0045] In the non-persistent data management system 200 of the present invention, data tables 218 integrate rows and columns of persistent and non-persistent data. Non-persistent data is also referred to as temporary data or temporary entries. The temporary data is integrated with the persistent data in at least one data table 218 of the database 216 while the data table 218 exists in memory of a computer such as local computer 20 of FIG. 1. When the data table 218 is removed from memory and written to permanent storage on another form of computer readable media, the rows and columns containing temporary data are ignored. That is, the rows and columns containing temporary data are not written to the permanent storage; only the persistent data is written. In one embodiment, the temporary data exists in a table of the database loaded in memory only as long as the table is referenced by any views associated with the table. As a result, new data can be added to a database for manipulation while the original schema of the database is maintained.

[0046] The system level overview of the operation of an exemplary embodiment of the invention has been described in this section of the detailed description. The nonpersistent data management system 200 of the present invention permits new data to be added to a database in the form of temporary entries to a data table without requiring that the original state of the table be modified.

[0047] In this section, the particular methods performed by a computer, such as local computer 20 of FIG. 1, in an exemplary embodiment are described by reference to a flowchart. The methods to be performed constitute computer programs made up of computer-executable instructions. Describing the methods by reference to a flowchart enables one skilled in the art to develop such programs including such instructions to carry out the methods on suitable computerized systems (the processor of the computer executing the instructions from a computer-readable media).

[0048] FIG. 3 is a high level flowchart of methods to be performed by a computer according to an exemplary embodiment of the invention. This flow chart indicates the acts to be performed by the non-persistent data management system in order to manage non-persistent data in a persistent database. In the example embodiment shown in FIG. 3, the non-persistent data management system creates an entry in a persistent database (block 302). The non-persistent data management system identifies the entry as a entry containing non-persistent data (block 304). The non-persistent data management system ignores the entry when writing the persistent database to a computer readable medium so that an original state of the persistent database is preserved (block 306). Each one of the acts shown in FIG. 3 is now described in further detail.

[0049] As shown in block 302 of FIG. 3, the non-persistent data management system creates an entry in a persistent database loaded in memory of a computer. The entry can be a temporary row or a temporary column, a temporary table or a temporary database in which all tables are temporary. In one embodiment, the temporary entry is created with a query language such as SQL (Structured Query Language). According to one embodiment of the present invention, common SQL statements such as “CREATE TABLE,” “ALTER TABLE,” and “INSERT INTO” accept a new keyword “TEMPORARY.” The keyword “TEMPORARY” designates that the added row or column is not to be persisted. Additionally, common SQL statements such as “ALTER TABLE” and “CREATE TABLE” accept a new keyword “HOLD.” The keyword “HOLD” keeps the temporary data present in memory beyond the lifetime of one or more views associated with the table (otherwise the temporary data is destroyed when the table is no longer reference by any view). Common SQL statements such as “ALTER TABLE” also accept a new keyword “FREE.” The keyword “FREE” negates the effect of the “HOLD” keyword, and thus allows the release the temporary data from memory.

[0050] In an alternate embodiment, the temporary entry is created in response to an API call on a view. In one embodiment, temporary rows or columns are added via a view opened on a particular table. In an example embodiment, an API call “MsiViewModify” accepts a data record along with an enumeration value that denotes the operation to be performed on the data record. The enumeration value is an enumerated data type indicating the type of operation to be performed. For example, an “INSERT” operation inserts a persistent row or column. An “INSERT_TEMPORARY” operation inserts a non-persistent row or column.

[0051] In addition to temporary rows and temporary columns or attributes, the nonpersistent data management system of the present invention creates temporary tables and temporary databases. A temporary table is simply a table that has no persistent attributes; i.e. all columns are created with the “TEMPORARY” keyword specified. A temporary database is one that has no persistent location specified, thus all data is temporary by default.

[0052] As shown in block 304 of FIG. 3, the non-persistent data management system identifies the temporary entry as an entry containing non-persistent data. In an example embodiment shown in FIG. 4, a column 402 containing non-persistent data is identified by an attribute 404 (“Temporary Column”) in the description of the column. Likewise, a bit in the schema for the table is set to identify the column containing non-persistent data. In another embodiment, a row 406 containing non-persistent data is identified using a reserved column 408 in the table. The reserved column contains data for each row including a flag bit 410, or an attribute bit, used to identify a row containing nonpersistent data.

[0053] Referring back to block 306 of FIG. 3, the non-persistent data management system ignores the entry in the database when writing the persistent database to a computer readable medium so that an original state of the persistent database is preserved. When saving the persistent data (i.e. commit), the row attribute bits and the column attributes are used to identify rows and columns containing non-persistent data. In one embodiment, the non-persistent data is ignored when the database is saved. The database is saved using a call to an API function such as the API function “MsiDatabaseCommit.” Saving changes made to persistent data has no effect on the state of the temporary data or the persistent data loaded in memory. Both types of data remain integrated in memory. The lifetime of the temporary data is only as long as the table containing the temporary data is referenced by a view, unless the table is held in memory through the use of the keyword “HOLD.” The temporary is data deleted from memory, along with the table containing persistent data loaded in memory, when there are no longer views referencing the table and when the table is not held via use of the “HOLD” keyword.

[0054] The particular methods performed by a non-persistent data management system of an exemplary embodiment of the invention have been described by reference to a flowchart. The non-persistent temporary entries can be added to any relational database (including databases designated as “read/write” as well as “read only”) to manipulate data while maintaining the original state of the database. Using temporary entries is advantageous when a large amount of data already exists in a database and a user needs to enhance the data while still retaining the original state of the data.

[0055] In this section of the detailed description, a particular implementation of the invention is described that is part of a Microsoft Windows installer product available from Microsoft Corporation.

[0056] In the Microsoft Windows installer embodiment temporary entries are added to an installation database to manage a run-time state of a computer. The run-time state of the computer is a non-persistent state during the process of installing, upgrading or uninstalling software. Non-persistent temporary entries are added to data tables in the installation database. The installation database is used as a run-time data store. The temporary entries store the run-time state of a computer in rows and columns in the installation database, provide run-time properties, control logic flow of the installation process, and contain objects necessary for the installation process but which are not normally stored in the persistent database. The installation database collects and tracks information about the run-time state during the installation process and information about the progress of the installation. An example embodiment of such an installation database is further described in the co-filed and co-assigned U.S. patent application entitled “Use of Relational Databases for Software Installation”—Ser. No. 09/158,125 which is herein incorporated by reference.

[0057] In an example embodiment, each time an installation of a computer software product or component is preformed by a user, temporary columns are added to data tables in an installation database to represent a current state of a computer and a desired state of the computer after completion of the installation process. Data placed in the temporary columns is maintained only during the installation process. After the installation is complete, the data tables are released from memory and the temporary columns for the current state and the desired state that were added are not saved. All that remains in permanent storage of a user's computer is the permanent or persistent data contained in the data tables of the installation database. An example embodiment of a method for adding a temporary column to an installation database is described by the co-filed and co-assigned U.S. patent application entitled “Method for Optimizing the Installation of a Software Product onto a Target Computer System”—Ser. No. 09/157,853 which is herein incorporated by reference.

[0058] In previous systems, non-persistent data was not integrated with persistent data. Unlike previous systems, the non-persistent data management system of the present invention permits non-persistent data to be fully integrated with the persistent data. Interrelationships between the non-persistent data and the persistent data are allowed while the two types of data are integrated. The non-persistent data can be a temporary row or a temporary column, a temporary table or a temporary database with temporary tables. The lifetime of non-persistent data in a table is only as long as the table is referenced by any views associated with the table (unless the table is expressly held in memory beyond the lifetime of the views). The non-persistent data added to a table is lost when the table is no longer referenced by a view. Non-persistent data is ignored when a table loaded in memory is persisted (i.e. committed). Thus, the non-persistent data management system of the present invention permits new data to be added to a database in the form of temporary entries without requiring that the original state of the table be modified.

[0059] In one embodiment, an entire database containing persistent data is loaded into memory. Non-persistent data is integrated with the persistent data while the database is in memory. In an another embodiment, only the data tables that are in use are loaded into memory rather than the entire database of persistent data. The non-persistent data is a integrated with the persistent data while the tables exist in memory. In a further embodiment, the data tables that are in use are loaded on a separate computer readable medium (other than memory) that is never persisted. In each of these embodiments, the non-persistent data is integrated with the persistent data while the persistent data is in use; however, the non-persistent data is not preserve when persistent data is preserved.

[0060] A non-persistent data management system has been described. Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that any arrangement which is calculated to achieve the same purpose may be substituted for the specific embodiments shown. This application is intended to cover any adaptations or variations of the present invention. Therefore, it is manifestly intended that this invention be limited only by the following claims and equivalents thereof.