Software patch generator using compression techniques

[0001] This application is a continuation-in-part of U.S. application Ser. No. 09/144,666, filed Sep. 1, 1998 now U.S. Pat. No. 6,289,509.

[0002] The present invention relates to a method and system for creating revisions of data files, and more particularly, to a system and method for creating patch files and aggregating them into secure, portable compressed archives for distribution. These archives are in a form that is applied to an original copy of the file to revise it (or patch it) to a newer version. The method of the invention includes the ability for combining, compressing, encrypting, authenticating and signing patch files. The present invention covers any type of data or file that may require revisions.

[0003] Software vendors are continually fixing, modifying, and enhancing the computer programs supplied to their customers. Typically, such changes are in response to bugs found in the programs, to the need for improved or more features, or a combination of both. In the past and still today, the predominant method of updating software and providing fixes is to supply customers a disc (e.g., floppy or CD-ROM) containing a complete new version of the program. Upon receipt of the upgrade disc, the customer installs the new version of the software on his or her computer. The installation process generally results in the old version of the program being overwritten with the new version. The same problems arise with fixing or modifying the contents of files or folders.

[0004] There are several problems with this method of supplying upgrades. First, it generally takes a relatively large amount of time to produce sufficient quantities of discs for distribution to customers. Accordingly, such discs are released only once or twice a year. This reduces the speed at which customers can be supplied with fixes to their programs and may force them to operate the software with errors or other bugs for several months. Second, physical discs are expensive to create and deliver.

[0005] Thus, there have been some attempts to deliver upgrades via communication networks such as the Internet or by direct connection using modems. However, even with ever improving transmission capacity and reliability, transmission of large upgrade files can be difficult and time consuming to complete. In response to the difficulties of transmitting large complete files, patch technology has been developed that permits the transmission of smaller, partial programs. In many instances, only certain parts or files need to be repaired or updated in order to update a computer program. Therefore, only a partial or “patch” file needs to be transmitted to the end user. Generally, small files may be transmitted faster and more reliably than larger files. However, existing patch technology is unacceptable when anything more than minor changes need to be delivered to a customer. Accordingly, there is a need for an improved method and system of upgrading electronic data, files or folders using patches. More specifically, there is a need for an improved system and method of generating a patch file.

[0006] In addition, most types of computer data or files are to some degree redundant, in that they contain patterns of characters that occur over and over again throughout the file. File compression programs take advantage of this fact. Instead of listing a piece of information over and over again, a file compression program lists that information once, then refers back to it wherever it appears in the original file, thus creating a representation of the original file that is smaller than the original, i.e. the compressed file. An expansion program expands a compressed file back into the original file. The present invention allows one to compress patch files into a .ZIP file and to extract patch files from a .ZIP file. The .ZIP file provides a folder, or archive, of compressed patch files and contains instructions and information needed to direct the patch files to be applied to the specific files to be patched. The files to be patched may, or may not, be contained in the same .ZIP file. The common format of this file is a self-extracting executable .ZIP file.

[0007] Compression of computer files has been around for years. Compressing files can save significant amounts of disk space or memory, and transfer time when downloading files from the Internet or transferring files through email. Most files downloaded from the Internet are compressed in some way. Many compression formats have been developed over the years. The zip format, created by the assignee of the present invention, is the most common compressed file format, but there are others in use today. Files with a “.ZIP” extension are compressed files in the zip format. Zip files are indicated by a “.ZIP” filename extension. Zipping a file means compressing the file into the zip format so that the resulting .ZIP file occupies less disk space. Unzipping a file means uncompressing a compressed file in the zip format back into its original form. A .ZIP file is a file which contains one or more computer files that have been compressed with PKZIP®, a data compression program from PKWare, Inc., or another compatible compression program.

[0008] PKZIP® is a utility program that performs data compression and archiving. The file that PKZIP® creates is called a “.ZIP” file. PKZIP® can be used to exchange data files between different platforms or machines. PKSFX® is another data compression program from PKWare, Inc. The function of PKSFX® is to turn a .ZIP file into a self-extracting file with a .EXE file extension. A PKSFX® file is an executable file that automatically extracts the files it contains when executed.

[0009] A computer file is compressed through the use of one or more compression algorithms. A compression algorithm is essentially a mathematical formula that scans the data in the file for compressible information. For example, compressible information may be any repeating pattern or string that can be represented in a shorter length than the original compressible information. The compression algorithm will then store only the repeated patterns, along with a pointer system, in a file or folder to save space. For standard compression, most of the compression algorithms work in basically this way. Some are more efficient or faster than others.

[0010] Generally, the contents of a compressed file cannot be accessed unless the archive is uncompressed. In order to uncompress a file, a user needs to either use the same program used to compress the file, or use another program that is compatible with the particular compression format. That means that users are required to use standalone programs to compress and uncompress their files. The same problem occurs when trying to work with and manipulate compressed archived files. For example, a user wanting to open an existing compressed file, modify the file, or extract data from the file and transfer it to another file would have to command a standalone program to uncompress the original file and command the standalone program to compress the modified file. This process is often burdensome and inconvenient to the user. Therefore, it would be beneficial to create a product that would eliminate the need for separate standalone compression programs, and eliminate the need to separately command a file to be uncompressed or compressed each time the file is opened, modified, or saved.

[0011] However, all of the above products are implemented differently from the present invention, and do not include many of the features of the present invention. Many of the above programs have increased performance overhead in processing (compressing/uncompressing) files continuously in and out, and it is often difficult for a user to determine if he or she is working with files contained inside or outside a .ZIP file.

[0012] Accordingly, there is a need for a system and method for easy management and manipulation of archive files, especially patch archive files.

[0013] Therefore, it is an object of the present invention to provide an improved method and system of revising electronic data files.

[0014] It is another object of the present invention to provide a file patch generator that efficiently produces patches of relatively small size.

[0015] It is yet another object of the present invention to aggregate one or more patch files into a secure, portable compressed archive (a .ZIP file) to decrease the storage and transfer requirements of the patch files. The archive is preferably in the format of a self-extracting .ZIP file.

[0016] It is a further object of the present invention to encrypt and authenticate the compressed patch files using digital signatures to secure the contents of the patch file from unauthorized access and to validate the identity of the creator of the .ZIP file.

[0017] It is yet a further object of the present invention for the archive to include a rules-based form of intelligence to detect the presence of the appropriate files to be patched and to determine how the patching process should proceed.

[0018] These and other objects are achieved in a system for generating a patch file from an old version of electronic data, which consists of a series of elements, and a new version of electronic data, which also consists of a series of elements. Both the old and new versions of electronic data are stored in a memory of a computer, such as a server, in the system. The old and new versions of electronic data are accessible by a data processor of the computer.

[0019] An alphabet for processing the old and new versions of electronic data is first programmed into the computer. The alphabet consists of words of a desired size. Thus, for example, all sequences of three elements in each of the old and new versions of electronic data may be treated as a single word.

[0020] Once the alphabet is established, the old version of electronic data is sorted with the data processor alphabetically according to the established alphabet to create a first sorted list of data. A pointer is maintained in the first sorted list of data in order to indicate each element's original location in the old version of electronic data. Similarly, the new version of electronic data is also sorted alphabetically to create a second sorted list of data with a pointer of each element to indicate the element's original location in the new version of electronic data. Once the two sorted lists are created, they are recursively compared one word at a time to search for a match of data. Upon finding a match of data, the first and second sorted lists of data are searched to find the largest sequence of coinciding elements preceding and succeeding the match of data. Each sequence of coinciding words is then stored in a coincidences list. The coincidences list is then processed to remove duplicative information. Finally, a patch file is created from the processed coincidences list.

[0021] The process of creating a patch file from the processed coincidences list includes the steps of (a) finding a largest block of coinciding elements of the processed coincidences list that matches the second sorted list of data and recording the location of the largest found segment in memory; (b) in the area before the previously found segment, finding the next largest block of coinciding elements of the processed coincidences list that matches the second sorted list of data and recording the location of the next largest segment in memory; (c) repeating step (b) until (1) the first member of the processed list of coincidences is reached, or (2) there are no matches between the second sorted list of data and the processed coincidences list; (d) writing a “write from the old version of electronic data” command and offset and length information to the patch file if the first member of the processed list of coincidences is reached; and (e) writing a “write from patch file” command and length and patch information to the patch file if there are no matches between the second sorted list of data and the processed list of coincidences.

[0022] The present invention also includes a process for combining, compressing, and signing the patch files for decreasing the storage and transfer requirements of the patch data. The invention provides the ability for compressing patch files into a self-extracting .ZIP file with digital signatures, encryption, and authentication. The present invention covers any type of data or file that may require revisions. The compressed digitally signed patch files are incorporated into self-extracting executable files that are automatically extracted and decompressed upon execution.

[0023] In another aspect of the invention, multiple patch files are combined into a portable archive used to transfer a collection of patches more efficiently using compression, authentication and encryption. The portable archive includes features to detect the presence of the files to be patched on a target system and then applies the sequence of patches automatically. In other words, the invention provides a self-extracting .ZIP file with intelligence to determine if a patch is necessary and how the patch should be implemented.

[0024] The resulting deliverable of a portable compressed patch archive holds one or more patch files in a compressed form to decrease the storage and transfer requirements of the patch data. The one or more patch files created will be aggregated into a secure, portable, compressed archive for distribution. The self-extracting .ZIP file includes a rules-based form of intelligence to detect the presence of the appropriate files to be patched and to determine how the patching process should proceed. Additional functions include digital certificate based file authentication and encryption of the patch files. The patch archive will include encryption and authentication using digital signatures to secure the contents from unauthorized access and to validate the identity of the creator of the archive.

[0025] The invention provides the ability to digitally sign archives using standard digital certificates from VeriSign, Tawes, Digital IDs or other digital certificate companies. The invention also includes an authentication and encryption function, which allows a user to digitally sign and encrypt individual patch files archived in a .ZIP file and subsequently authenticate and decrypt those files upon extraction. Upon receiving a digitally signed .ZIP file, one can detect whether the integrity of the .ZIP file has been compromised. Encrypting a file denies access by unauthorized users to the file's contents.

[0026] Various other features, objects, and advantages of the invention will be made apparent to those skilled in the art from the following detailed description of the invention taken in combination with the accompanying drawings.

[0041] A conventional client-server computer system 15 is shown schematically in FIG. 1. The system 15 includes a server (or main computer) 17. The server 17 is coupled to a remote or client computer 19. The server 17 and client 19 are coupled to each other via a communications network 21, which can be any available network, from a LAN (local area network) to the Internet, it being understood that the present invention is intended to be implemented using presently existing and well-known computer hardware and communications technology. Of course, the inventor(s) envision(s) that the invention may also be implemented with equipment and technology not yet commercially available.

[0042] The general process of creating a patch file, in the broadest sense, is well known, and is shown in FIG. 2. An old version 23 of a computer program (FIG. 2) and a new version 25 of a computer program are fed to a patch generator 27. The patch generator 27 creates a patch file 29. The patch file 29 may be transmitted over a communications network such as the communications network 21 to a client such as the client 19 (FIG. 1). The client, on which a copy of the old version 23 of a computer program and a patch installer have been loaded, receives the patch file 29. Using the patch file 29, patch installer, and the copy of the old version 23 of a computer program, the client creates a copy of the new version 25 of a computer program.

[0043] As more readily seen by reference to FIG. 3, in the present invention the server 17 has a processing unit 32, input and output devices 34, a memory 36 storing an old version 38 of electronic data, a new version 39 of electronic data, and a patch generator 40 which is used to create a patch file (discussed below).

[0044] As best seen by reference to FIG. 4, the old version 38 of electronic data may be illustrated as a series of elements or symbols S (which, for the example shown, are English alphabetic symbols, but in actual files the elements would be bits of information, i.e., “1s and 0s”). Each symbol S has a position P in the electronic data 38 and 39 indicated by the numbers 1-19. In actual files, each position P is an offset (in bytes) based on a single byte (the very left byte in a file is the first position). Using the symbols S, an alphabet is developed where a series of symbols makes up a single word W. For purposes of explanation, three sequential symbols are considered to be a single word, although the number of symbols in a word can be changed. As will be better understood after further explanation below, the choice of word size affects the time it takes to generate a patch file as well as the size of the patch file. Using large words, patch files may be generated very quickly, but the resulting size of such files is relatively large. Using small words, patch files are generated relatively slowly, but are small in size.

[0045] It is presently thought that all sequences of 12 bytes following each other in a file should be treated as a single word in order to optimize time and size considerations. However, for purposes of discussion, the invention will be described with three-symbol words. By way of example, with three consecutive elements or symbols as a word, an initial sequence of “ABCDEF” yields four words W, namely: “ABC,” “BCD” (not “DEF”), “CDE,” and “DEF.” The words W are determined using a sliding window of length 3, moving it to the right, one symbol at a time, through the sequence of symbols.

[0046] FIG. 4 also illustrates a series of symbols that represent the new version of electronic data. (For the sake of simplicity, the old and new versions 38 and 39 of electronic data are the same length, but usually this is not the case, and it makes no difference whether it is or is not the case.) To create a patch file (discussed below), the patch generator 40 first processes the old and new versions 38 and 39 of electronic data into lists of three-symbol words as shown in FIG. 5; a first list 50 of words and a second list 52 of words. Next, the first list 50 of words (old version 38 of electronic data) is sorted alphabetically. Specifically, the first list 50 is sorted using the server 17 according to the established alphabet to create a first sorted list 55 of data with a pointer or offset P_1st (FIG. 5) indicating the original location of each sorted word W in the old version 38 of electronic data. The second list 52 of words (new version 29 of electronic data) is similarly sorted to create a second sorted list 57 of data with a pointer or offset P_2nd.

[0047] As best seen by reference to FIG. 7, once the first and second sorted lists 55 and 57 of data are generated, the patch generator 40 searches through each of the sorted lists recursively, comparing the first and second sorted lists of data one word at a time for a match of data. In particular, if the first word in the first sorted list 55 is less than (alphabetically) the first word in the second sorted list 57, then the next word in the first sorted list is compared to the first word in the second sorted list. However, if the selected word in the first sorted list 55 is greater than the selected word in the second sorted list 57, then the next word in the second sorted list is compared to the selected word in the first sorted list.

[0048] If a match or coincidence in the first and second sorted lists 55 and 57 of data is found, the coincidence is stored in a list of coincidences 60 (FIG. 8). Upon finding a coincidence, the patch generator 40 also searches the first and second sorted lists of data to find the largest sequence of coinciding symbols S preceding and succeeding the initial coincidence and this block of coinciding symbols is recorded in the list of coincidences 60. The list of coincidences 60 is then processed to remove duplicative coincidences or, more generally, duplicative information, indicated in the list by asterisks. The removal of duplicative information results in the creation of a refined list of coincidences 65 (FIG. 9). In short, if two equivalent words W are found (i.e., a coincidence) and the symbols preceding the coincidence in the first and second sorted lists of data 55 and 57 are the same, the coincidence is considered to contain duplicative information, and thus not included in the refined list of coincidences 65.

[0049] Once the refined list of coincidences 65 is generated, additional information is obtained by sorting the refined list of coincidences 65 by the offset or position in the new version of electronic data of each non-duplicative coincidence, resulting in a sorted list of coincidences 70 (FIG. 10). By adding the position or offset of each coincidence in the new version 39 of electronic data to the maximum coincidence length (measured in the number of elements or symbols S) an end block list 75 (FIG. 11) is obtained which provides a means of calculating the intersections between the elements or symbols of the new version of electronic data 39 and the refined list of coincidences 65.

[0050] Having generated the sorted list of coincidences 70 and end block list 75, the patch generator 40 can now generate a patch file 80 (FIG. 3). In the present invention the patch file 80 is generated recursively based on the contents of the new version 39 of electronic data. The patch generating algorithm is described below.

[0051] The patch generating algorithm may be incorporated into a procedure, which for purposes hereof may be called “BuildPatch.” The procedure call BuildPatch (m, n) is made where m and n are parameters representing the starting and the ending offsets in the new version 39 of electronic data, respectively. If m>n, then the BuildPatch procedure terminates. If m<=n, then the procedure searches for the largest coincidence or block of symbols of the maximum length within the segment range (m, n) using the sorted list of coincidences 70. More specifically, the BuildPatch procedure searches for a block of symbols in the new version of electronic data 39 having a starting position i and an ending position j such that m<=i<=j<=n. If such a block of symbols does not exist in the sorted list of coincidences 70, the BuildPatch procedure writes the contents of the (m, n) segment or block of symbols directly into the patch file 80 and subsequently terminates. If such a block is found, the BuildPatch procedure proceeds as follows:

[0052] (1) call BuildPatch (m, i−1);

[0053] (2) replace the (i, j) block with a corresponding reference to the old version 38 of electronic data. More specifically, the procedure writes a “write from the old file” (“WFOF”) command in the patch file 80 which indicates the data from the old version 38 of electronic data to be used, by means of its offset or location and length within the old version. Then,

[0054] (3) call BuildPatch (j+1, n).

[0055] Considering the specific example in FIGS. 4-11, the first step in the process is to call BuildPatch (1, 19). BuildPatch then searches for the block of symbols of maximum length by scanning the sorted list of coincidences 70, which for the exemplary files given herein is the block containing the word BCA with offsets in both the old and new versions 38 and 39 of data from the 2nd to the 7th position P. BuildPatch then calls itself: BuildPatch (1, 1). BuildPatch (1, 1) takes the 1st block and calculates its intersection with the parameters m and n. The length of this intersection is zero (2>1). Of course, there is also a zero length intersection when the (1, 1) block is intersected with the remaining blocks of symbols: (11>1, 13>1). Finally, BuildPatch (1, 1) writes a “write from the patch file” (“WFPF”) command along with the (1, 1) block of the new version 39 of electronic data into the patch file 80, since there are no common blocks with the old version 38 of electronic data within the range (1, 1) of the new version. BuildPatch (1, 1) then terminates.

[0056] Although the BuildPatch (1, 1) call has terminated, the BuildPatch (1, 19) call has not and continues the operation according to the basic process set out above. Since the (2, 7) block of symbols in the new version 39 of electronic data coincides with the (2, 7) block of symbols from the old version 38 of electronic data, the call results in a WFOF command with the offsets for the (2, 7) block of the old version being written into the patch file 80. Subsequently, BuildPatch (8, 19) is called.

[0057] BuildPatch (8, 19) projects the sorted list of coincidences 70 onto the block (8, 19) of the new version 39 of electronic data. This projection yields the following:

[0058]

	Max Coincidence
	Block Length	3(BCD)	4(DCBA)
	Old File Offset	17	13
	New File Offset	11	13

[0059] The (13, 16) block (which includes the symbols DCB) is the largest block, having a four-symbol length in the (8, 19) block. Following the process noted, the BuildPatch procedure then calls BuildPatch (8, 12). BuildPatch (8, 12) projects the sorted list of coincidences 70 onto the block (8, 12) of the new version 39 of electronic data, which yields the following:

[0060]

	Max Coincidence
	Block Length	2 (not 3!)
	Old File Offset	17
	New File Offset	11

[0061] Bear in mind the projection is limited to the (8, 12) block of the new version 39 and, thus, it is not possible to find the 3 symbol coincidence BBD which exists in the block (8, 13).

[0062] Since the last coincidence was found, BuildPatch calls BuildPatch (8, 10). BuildPatch (8, 10) writes the block of symbols (8, 10) into the patch file 80 and returns control of the program to the up-calling procedure, BuildPatch (8, 12).

[0063] The BuildPatch (8, 12) call results in a WFOF command with the offsets for the (17, 18) block of the old version 38 of electronic data being written into the patch file 80. The symbols in the (17, 18) block will be written into the (11, 12) block of the new copy of the new version 85 of electronic data generated in the client 19 (see FIG. 12). Then, BuildPatch (8, 12) calls BuildPatch (13, 12). BuildPatch (13, 12) does nothing and immediately terminates. BuildPatch (8, 19) then writes a WFOF command into the patch file 80 with directions to write the symbols in the (13, 16) block of the old version 38 of electronic data into the (13, 16) block of the new copy of the new version 85 of electronic data. BuildPatch (8, 19) then calls BuildPatch (17, 19). BuildPatch (17, 19) writes the (17, 19) block of data symbols in the patch file 80 and terminates. Then BuildPatch (8, 19) terminates. Finally, BuildPatch (1, 19) terminates too. Following through the above process, the file structure of the patch file 80 is as follows:

[WFPF “D”; WFOF block (2, 7); WFPF “DDB”; WFOF block (17, 18); WFOF block (13, 16); WFPF “DCD”; end-of-patch command].

[0064] The patch file 80 is combined with a copy of the old version 84 of the electronic data on the client 19 (FIG. 12) to create a new copy 85 of the new version 25 of the subject computer program using a patch installer 90. Since the patch file 80 is, in fact, the same as the new version of the computer program, but with all the coincidences replaced with corresponding references to the old version of a computer program, the patch installer 90 is a rather simple program and writing such a program would be within the ability of those skilled in the present art. For purposes of brevity, it is not discussed herein.

[0065] As shown in FIGS. 13 and 14, the present invention provides an improved method and system for creating a patch file. The resulting patch file 92 may be compressed using a compression program 94 into a .ZIP patch file 96 using PKZIP® or a self-extracting .ZIP patch file 98 using PKSFX® to yield a deliverable of a portable compressed patch file that allows for combining multiple patch files into a portable archive used to transfer the collection of patches more efficiently using compression, authentication and encryption. The one or more patch files created will be aggregated into a secure, portable, compressed archive for distribution to files to be patched 100. This portable archive of files 96, 98 also includes features to detect the presence of files to be patched on the target system and then applies the sequence of patches automatically using rules based intelligence 102. This archive may be in the format of a .ZIP file or a self-extracting .ZIP file, depending upon the compression algorithm used. The archive will hold the patch files in a compressed form to decrease the storage and transfer requirements of the patch data. The .ZIP and self-extracting .ZIP patch files archive may also include functionality for encryption and authentication 104 of the files and/or archive using digital signatures to secure the contents from unauthorized access and to validate the identity of the creator of the archive.

[0066] As mentioned above, the .ZIP patch file 96 and the self-extracting .ZIP patch file 98 may include a rules-based form of intelligence 102 to detect the presence of the appropriate files to be patched and to determine how the patching process should proceed.

[0067] Also as mentioned above, the present invention provides the capability of compressing 94 the patch files 92 into .ZIP patch files 96 or self-extracting .ZIP patch files 98 including encryption and authentication 104 using digital signatures for combining, compressing, signing, and transporting the patch data. The present invention also allows a user to digitally sign and encrypt individual patch files archived in a .ZIP file or a self-extracting .ZIP file, and subsequently to authenticate and decrypt those files upon extraction. Signing a .ZIP patch file allows a user to detect whether a .ZIP patch file's integrity has been compromised. Encrypting a file denies access to the file's contents by unauthorized users. Before a user can sign or encrypt files, the user must first have a digital certificate with which to sign or encrypt. A digital certificate may be obtained from VeriSign, Thawte or another certificate authority.

[0068] While the invention has been described with reference to preferred embodiments, it is to be understood that the invention is not confined to those embodiments or the particular examples and arrangement of the components herein illustrated and described, but embraces such modified forms thereof as come within the scope of the appended claims. In other words, those skilled in the art will appreciate that certain substitutions, alterations and omissions may be made without departing from the spirit of the invention. Accordingly, the foregoing description is meant to be exemplary only, and should not limit the scope of the invention set forth in the following claims.