US 8,060,476 B1Grant
Backup systems and methods for a virtual computing environment
Issue Date:2011-11-15
•23 Claims
•6 Drawing Sheets
Abstract
Improved backup and storage operations are disclosed for virtual computing environments using a backup proxy server to perform storage operations on one or more virtual machine disks. The proxy server can include a module that intercepts application programming interface (API) calls, for writing backup data to a first location, prior to the data arriving on the proxy disk. During the intercept process, the data can be compressed in memory pages of the proxy server and redirected to an alternative backup disk location. The proxy server can also include a differential engine that identifies changes to the virtual machine disk at the block level since the last full backup. The differential engine can advantageously leverage memory pages of the proxy server to compare differences between signatures of blocks of the last full backup with signatures of new blocks. Subsequently, only blocks with non-matching signatures are processed for backup.
Metadata
Assignee
- Quest Software, Inc.
Inventors
- Delano Xavier Afonso
- David Allen Feathergill
- Jason Mattox
- Jeremy Christopher Herman
Application Information
Application Number:US 12/502,052
Filing Date:2009-07-13
Priority Date:2008-07-14
Art Unit:2154
Classifications
IPC:
G06F17/30
Patent Drawings (6 sheets)
Description
Related Applications
[0001] This application claims the benefit of priority under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 61/080,531, filed Jul. 14, 2008, and of U.S. Provisional Patent Application No. 61/085,745, filed Aug. 1, 2008, each of which is hereby incorporated herein by reference in its entirety to be considered part of this specification.
Background
[0002] 1. Field
[0003] Embodiments of the invention relate to performing storage operations in a virtual environment and, in particular, to backing up data of one or more virtual machines.
[0004] 2. Description of the Related Art
[0005] Many companies take advantage of virtualization solutions to consolidate several specialized physical servers and workstations into fewer servers running virtual machines. Each virtual machine can be configured with its own set of virtual hardware (e.g., processor, memory, ports, and the like) such that specialized services that each of the previous physical machines performed can be run in their native operating system. In particular, a virtualization layer, or hypervisor, allocates the computing resources of one or more host servers to one or more virtual machines and further provides for isolation between such virtual machines. In such a manner, the virtual machine is a representation of a physical machine by software.
[0006] Associated with each virtual machine is at least one virtual machine disk that is located in one or more files on a datastore. The virtual machine disk can be copied, moved, archived or the like. For instance, certain vendors offer solutions that operate from inside the guest operating system of a virtual machine to back up the virtual machine disk(s). This approach, however, has significant drawbacks in that such backup copies, being performed from within the guest operating system, cannot capture a backup of the entire virtual machine. Moreover, other backup solutions require a full copy of the virtual machine disk to a backup proxy device each time a backup is to be performed.
Summary
[0007] Given the aforementioned issues and challenges, a need exists for systems and methods that perform backup operations in a virtual computing environment without operating through the server(s) hosting the virtual machines. Moreover, there is a need for data management solutions that back up virtual machine disks without consuming the resources and time required for a full copy of the virtual machine disks to be made to a backup proxy prior to being stored to a final destination on disk.
[0008] In view of the foregoing, certain systems and methods disclosed herein are directed to improved backup and storage operations for virtual computing environments. In certain embodiments, a backup proxy server is utilized to perform LAN-free storage operations by directly accessing virtual machine disk data stored on a storage attached network (SAN). The backup proxy server can further include an intercept engine executing thereon that intercepts a data stream from the SAN prior to the data stream arriving on the proxy server disk. During the intercept process, individual data blocks of the data stream can be optionally compressed in memory pages of the proxy server and redirected to a backup disk location of the administrator's choice, without occupying disk space on the proxy server.
[0009] As a result of this backup process, the final backup image size can be reduced via compression, and the overall storage process can be expedited significantly since the need is removed for the proxy server disk to serve as an intermediate location for the backup data prior to the final backup. The backup proxy can further utilize a differential engine to identify block-level changes made to the virtual machine disk since the time of the last full backup. The differential engine can advantageously leverage memory pages of the proxy server to compare differences between signatures of blocks of the last full backup with signatures of new blocks to reduce the amount of backup data written to disk.
[0010] In certain embodiments, a method is disclosed for performing backup of virtual machine data. The method includes initiating a backup process executing on a computing device to access one or more virtual machine disks stored on a datastore, the one or more virtual machine disks being comprised of a plurality of data blocks. The method also includes intercepting a plurality of calls made by the backup process to create a backup file in a first destination location that comprises a copy of the one or more virtual machine disks, the plurality of calls comprising at least one write call programmed to write a backup copy of each of the plurality of data blocks to the first destination location. For each intercepted write call, the method substitutes the intercepted write call with at least a second write call, wherein the at least the second write call is further programmed to: (i) transfer the data block associated with the particular intercepted write call to a buffer memory without writing the data block to a disk of the computing device, (ii) compute a signature of the data block, and (iii) compare the computed signature with a predetermined signature. For each data block having a computed signature that differs from the predetermined signature, the method compresses and stores the data block to a second destination location different than the first destination location. The method also disregards each data block having a computed signature that matches the predetermined signature.
[0011] In certain embodiments, a system is disclosed for performing backup of virtual machine data. The system includes a storage device comprising one or more virtual machine disks and an intercept module configured to redirect backup operations of a backup module executing on a computing device and accessing a plurality of data blocks of the one or more virtual machine disks. The intercept module further comprises (i) a proxy application configured to instruct the backup module to initiate a backup of the one or more virtual machine disks via a plurality of application programming interface (API) calls to create a backup file in a first destination location, wherein the backup file comprises a copy of the one or more virtual machine disks, and (ii) a library module configured to replace select API calls of the plurality of API calls by the backup module with alternative functions to transfer each data block associated with a write call of the select API calls to a buffer memory of the computing device without writing the data block to a disk of the computing device; compute a signature of the data block; compare the computed signature with a predetermined signature; and for each data block having a computed signature that differs from the predetermined signature and storing the data block to a second destination location different from the first destination location.
[0012] In certain embodiments, a method is disclosed for performing backup of virtual machine data. The method comprises intercepting a plurality of write calls for creating a backup copy of a plurality of data blocks of a virtual machine disk at a first destination location and substituting each intercepted write call with a second write call. The second write call is programmed to (i) transfer the data block associated with the particular write call to a buffer memory without first writing the data block to disk, (ii) compute a signature of the data block, and (iii) compare the computed signature with a predetermined signature. For each data block having a computed signature that differs from the predetermined signature, the method stores the data block to a second destination location different than the first destination location. The method also includes disregarding each data block having a computed signature that matches the predetermined signature.
[0013] In certain embodiments, a system for performing backup operations on virtual machine data is disclosed. The system includes: means for initiating a backup process executing on a computing device to access one or more virtual machine disks stored on a datastore, the one or more virtual machine disks comprising a plurality of data blocks; and means for intercepting a plurality of calls made by the backup process to create a backup file in a first destination location of a copy of the one or more virtual machine disks, the plurality of calls comprising write calls programmed to write a backup copy of each of the plurality of data blocks to the first destination location. The intercepting means is further configured to, for each intercepted write call, substitute the intercepted write call with a second write call, wherein the second write call is further programmed to: (i) transfer the data block associated with the particular intercepted write call to a buffer memory without writing the data block to a disk of the computing device, (ii) generate a signature of the data block, (iii) compare the signature with a predetermined signature, (iv) for each data block having a signature that differs from the predetermined signature, store the data block to a second destination location, and (v) disregard each data block having a signature that matches the predetermined signature.
[0014] For purposes of summarizing the disclosure, certain aspects, advantages and novel features of the inventions have been described herein. It is to be understood that not necessarily all such advantages may be achieved in accordance with any particular embodiment of the invention. Thus, the invention may be embodied or carried out in a manner that achieves or optimizes one advantage or group of advantages as taught herein without necessarily achieving other advantages as may be taught or suggested herein.
Brief Description of the Drawings
[0015] FIG. 1 illustrates an exemplary block diagram of a system for performing backup operations in a virtual computing environment, according to certain embodiments of the invention.
[0016] FIG. 2 illustrates a flowchart of an exemplary embodiment of an interception process usable by the backup proxy of FIG. 1 to create an alternative backup file.
[0017] FIG. 3 illustrates a flowchart of an exemplary embodiment of a differential backup process usable by the backup proxy of FIG. 1 .
[0018] FIG. 4 illustrates an exemplary embodiment of a signature file usable by the backup proxy during the backup process of FIG. 3 .
[0019] FIGS. 5A-5C illustrate exemplary embodiments of headers usable with a differential file created through the backup process of FIG. 3 .
Detailed Description of the Preferred Embodiments
[0020] Certain systems and methods disclosed herein are directed to improved backup and storage operations for virtual computing environments. In certain embodiments, a backup proxy server is utilized to perform LAN-free storage operations by directly accessing virtual machine disk data stored on a SAN. The backup proxy server can further include a module that intercepts a data stream from the SAN prior to the data stream arriving on the proxy server disk. During the intercept process, the data can be compressed in memory pages of the proxy server and redirected to a backup disk location of the administrator's choice, without consuming disk space on the proxy server for temporarily storing an intermediate backup copy. In other embodiments, backup systems and methods can perform similar interception and compression techniques over an internet protocol (IP) network with network attached storage (NAS) or the like.
[0021] Such backup methods can result in a smaller backup image on disk, due to compression, and can expedite the overall storage process significantly since the need is removed to first write the data to the proxy server disk and then to the backup disk. For example, in certain embodiments, the backup throughput can be increased up to forty percent (40%) or more by avoiding the writing of the backup data to disk prior to performing the actual backup of the data.
[0022] In addition, the backup proxy can further comprise a differential engine that identifies changes to the virtual machine disk at the block level since the last full backup. The differential engine can advantageously leverage memory pages of the proxy server to compare differences between signatures of blocks of the last full backup with signatures of new blocks. Subsequently, only blocks with non-matching signatures are processed for backup (e.g., a differential backup).
[0023] Certain embodiments of the invention advantageously include systems and methods for performing differential backup operations in combination with VMWARE CONSOLIDATED BACKUP (VCB) offered by VMware Inc. (Palo Alto, Calif.) or other hypervisor snapshot technology in a virtual computing environment.
[0024] The features of the inventive systems and methods will now be described with reference to the drawings summarized above. Throughout the drawings, reference numbers are re-used to indicate correspondence between referenced elements. The drawings, associated descriptions, and specific implementation are provided to illustrate embodiments of the invention and not to limit the scope of the disclosure.
[0025] In addition, methods and functions described herein are not limited to any particular sequence, and the blocks or states relating thereto can be performed in other sequences that are appropriate. For example, described blocks or states may be performed in an order other than that specifically disclosed, or multiple blocks or states may be combined in a single block or state.
[0026] For exemplary purposes, certain embodiments of the inventive systems and methods will be described with reference to VMWARE virtual infrastructures. However, it will be understood from the disclosure herein that the disclosed systems and methods can be utilized with other virtualization technologies, including, but not limited to, virtual environments using XEN and XENSERVER by Citrix Systems, Inc. (Fort Lauderdale, Fla.), ORACLE VM by Oracle Corporation (Redwood City, Calif.), HYPER-V by Microsoft Corporation (Redmond, Wash.), VIRTUOZZO by Parallels, Inc. (Switzerland), or the like.
[0027] FIG. 1 illustrates an exemplary block diagram of a system for performing backup operations in a virtual computing environment 100, according to certain embodiments of the invention. In general, the virtual computing environment 100 is advantageously configured for backing up virtual machine disk data. For example, the virtual computing environment 100 can perform LAN-free storage operations on data of one or more virtual machines. Moreover, certain embodiments of the invention are capable of generating on-the-fly compressed backup files (e.g., full, differential, or incremental backup files) from a memory of a backup proxy machine.
[0028] As illustrated, the virtual computing environment 100 comprises a plurality of host servers 102, 104, 106 having a plurality of virtual machines 108, 110, 112, 114 that communicate with a datastore 116 via a fiber switch 118. In particular, the host server A 102 hosts virtual machine A 108 and virtual machine B 110, which interact, respectively, with data stored in virtual machine file system (VMFS) A 120 and VMFS B 122. Host server B 104 hosts virtual machine C 112, which interacts with data stored in VMFS C 124, and host server C 106 hosts virtual machine D 114, which interacts with data stored in VMFS D 126.
[0029] In certain embodiments, the host servers 102, 104, 106 comprise one or more computing devices configured to host one or more virtual machines executing above a hypervisor layer. In certain embodiments, the hypervisor is configured to decouple the physical hardware of the host server from the operating system(s) of the virtual machine(s). For instance, one or more of the host servers 102, 104, 106 can comprise an ESX server or other like virtualization platform. Such abstraction allows, for example, for multiple virtual machines with heterogeneous operating systems and applications to run in isolation on resources of the same physical machine.
[0030] In yet other embodiments, one or more of the host servers 102, 104, 106 can include a hosted architecture in which the hypervisor runs within a host operating system environment. In such embodiments, the hypervisor can rely on the host operating system for device support and/or physical resource management. Examples of such hosted hypervisors can include, but are not limited to, VMWARE WORKSTATION and VMWARE SERVER by VMware, Inc., VIRTUAL SERVER by Microsoft Corporation, PARALLELS WORKSTATION by Parallels, Inc., or the like.
[0031] For illustrative purposes, the VMFS A 120 further comprises a VM_A.VMDK file 120a, which includes the virtual hard drive for the virtual machine A 108, and a VM_A.VMX file 120b, which includes configuration data for the virtual machine A 108. In certain embodiments, most of the .VMDK 120a file's content comprises the data of the virtual machine, while a small portion is allotted to overhead of the virtual machine.
[0032] In certain embodiments, the VM_A.VMDK file 120a can be a dynamic virtual disk in which the disk grows as the disk inside the guest operating system of the virtual machine A 108 grows. In yet other embodiments, the VM_A.VMDK file 120a can comprise a fixed size virtual disk. In certain embodiments of the invention, the virtual disk of a single virtual machine can comprise multiple .VMDK files. For instance, an administrator or other user can specify a maximum size of each .VMDK file (e.g., 2 GB chunks). In such embodiments, the number of .VMDK files depends on the size of the virtual disk.
[0033] As shown, the datastore 116 comprises a SAN or like shared storage network that includes a plurality of VMFSs for storing data for a plurality of virtual machines. In other embodiments, the datastore 116 can comprise any type of formatted logical container for holding virtual machine files and that can exist on a physical storage resource, including: local disks (e.g., local small computer system interface (SCSI) disks of the host server(s)), a disk array, an iSCSI disk array, NAS arrays, network file system (NFS), combinations of the same or the like.
[0034] As shown, each of the host servers 102, 104, 106 also communicates with a management server 128 through a network 130. In certain embodiments, management server 128 directs general operation of the host servers 102, 104, 106 and/or their associated virtual machines. For example, the management server 128 can comprise a VMWARE VirtualCenter management server that provides a centralized management module for the virtual environment, such as a VMWARE Infrastructure 3 (VI3) environment or the like.
[0035] In certain embodiments, the network 130 can comprise a local area network (LAN). In yet other embodiments, the network 130 can comprise one or more of the following communication means: internet, intranet, wide area network (WAN), public network, combinations of the same or the like. In addition, connectivity to the network 130 may be through, for example, remote modem, Ethernet, token ring, fiber distributed datalink interface (FDDI), asynchronous transfer mode (ATM), combinations of the same or the like.
[0036] The virtual computing environment 100 further comprises a backup proxy 132 usable to backup one or more virtual machine files. In certain embodiments, the backup proxy 132 is further capable of restoring backed-up virtual machines in the event of a disk failure or the like or if a user desires to revert to a previous version of a particular virtual machine.
[0037] In certain embodiments, the backup proxy 132 is configured to operate with a backup process, such as VMWARE Consolidated Backup (VCB), to perform storage operations on the virtual machine disks on the datastore 116. For example, the backup proxy 132 can advantageously, when used with SAN storage, enable offloaded and impact-free backups for virtual machines running on an ESX host server. Such an approach allows for the use of virtual machine snapshot technology and SAN-based data transfer in combination with file-based backup software. Moreover, VCB processes allow for the backing up of virtual machine contents from the backup proxy 132 rather than through one or more of the host servers 102, 104, 106. This approach can further allow for a reduction of the load on the host servers 102, 104 and 106 and allow for allocation of otherwise consumed resources to additional virtual machines.
[0038] As shown, the backup proxy 132 can advantageously access the datastore 116 through the fiber switch 118 without needing to communicate through the network 130 or any of the host servers 102, 104, 106. In yet other embodiments, the backup proxy 132 can operate in a LAN mode by communicating through the network 130 and at least one virtual machine of the host servers 102, 104, 106 to access data on the datastore 116.
[0039] In certain embodiments, the backup proxy 132 further communicates with the management server 128 through the network 130. For instance, the management server 128 can provide the backup proxy 132 with information regarding the infrastructure of the virtual computing environment 100, locations of certain virtual machine disks on the datastore 116, job scheduling, load or availability information, combinations of the same or the like.
[0040] In certain embodiments, the backup proxy 132 comprises a WINDOWS-based backup server. In yet other embodiments, the backup proxy 132 can comprise a LINUX-based server, an ESX server, combinations of the same or the like.
[0041] The backup proxy 132 is further illustrated with a plurality of modules and/or components executing thereon to perform one or more operations relating to the backing up of data. It will be understood, however, that this illustration is merely exemplary and that such modules or components can be executed on a plurality of computing devices, on one or more virtual machines, as stand-alone components, or the like.
[0042] The backup proxy 132 comprises a backup module 134 configured to obtain data from the datastore 116 for backup processing. In certain embodiments, the backup module 134 comprises the VCB utility that copies virtual machine disk data from the datastore 116 to the backup proxy 132 and then to an intended backup destination. For instance, the backup module 134 can provide a centralized management of agent-less backup of virtual machines.
[0043] In certain embodiments, the backup module 134 works in combination with a third-party backup agent that manages the backup schedule. Once instructed to begin a backup, the backup module 134 can run a set of pre-backup scripts to quiesce the virtual machine disks to take their snapshots (e.g., via a VMsnap command). The backup module 134 can then run post-thaw scripts to restore the virtual machine(s) back to normal operation. The backup module 134 can further mount the snapshot(s) to the backup proxy 132, from which the third-party backup agent backs up the files on the mounted snapshot to its backup targets. For example, the backup module 134 can utilize a virtual logic unit number (VLUN) that enables mounting of the virtual machine snapshot on the backup proxy 132 and makes the mounted drive available for backup.
[0044] In certain embodiments, the backup module 134 can perform various types of backups. For example, the backup module 134 can perform image-level backups to create a copy of all virtual disks and configuration files associated with a virtual machine. Such image-level backups can advantageously be operating-system neutral, as they involve copying the entire virtual machine disk data. In such embodiments, the backup module 134 can mount a snapshot of the virtual machine disk to a local directory of the backup proxy 132 to make the data accessible for being backed up.
[0045] In certain embodiments, the backup module 134 can perform file-level backups that include a copy of individual file(s) contained within one or more virtual machine disks. Moreover, the backups can comprise full backups, differential backups and/or incremental backups. In such embodiments, the backup module 134 can create a snapshot of the virtual machine disk and mount discovered volume(s) within the snapshot at predefined junction points.
[0046] The backup module 134 preferably stages data obtained from the datastore 116 in a memory 138 of the backup proxy 132 for being backed up. In certain embodiments, the memory 138 preferably comprises a buffer that serially receives the data in relatively small data blocks. In such embodiments, the buffer can have a memory capacity slightly more than the size of an individual data block. For example, in certain embodiments, the backup data is divided into 256 KB data blocks, wherein the memory 138 is slight larger (e.g., a number of bytes larger) than 256 KB in order to handle each individual data block and additional overhead associated therewith. In other embodiments, the data blocks and/or memory 138 can be a different size according to the requirements of the backup system. Moreover, in certain embodiments, the memory 138 can comprise multiple buffers for parallel processing of the data blocks.
[0047] An intercept module 136 is configured to intercept data obtained from the datastore 116 by the backup module 134 prior to storage on disk. For instance, once the backup module 134 has initiated a snapshot of the virtual machine disk to be backed up, the intercept module 136 can intercept the export of data from the snapshot and redirect the data to an alternative destination. During this redirecting, the data can be optionally compressed using the memory 138 and/or resources of the backup proxy 132. This redirection process can advantageously eliminate the need for additional disk space on the backup proxy 132 to temporarily house a copy of the backup data before copying the data to the final backup location.
[0048] In certain embodiments, the intercept module 136 comprises a plugin application installed on the backup proxy 132 that interacts with the backup module 134. For instance, the plugin can comprise a proxy application 137a that initiates one or more components of the backup module 134 responsible for general backup of the virtual machine disk(s) to a destination folder. The plugin can further comprise a library 137b, such as a dynamic link library (DLL), that is loaded in the address space of the backup module 134 to allow for the interception and/or replacement of select application programming interface (API) calls by the backup module 134 with customized functions of the DLL 137b. For instance, in certain embodiments, API calls CreateFile, WriteFile and CloseHandle are received and replaced with alternative methods for performing the backup functions disclosed in more detail herein.
[0049] In certain embodiments, the DLL 137b is configured to run a plurality of different backup procedures. For example, the DLL 137b can utilize a memory mapped file to set various arguments, wherein the name of the memory mapped file (or other shared memory) is created by the proxy application 137a and/or has the process identification (ID) of the proxy application 137a. Moreover, in a DIIMain function of the DLL 137b, the DLL 137b reads the memory mapped file and, knowing the ID of the parent process (i.e., the proxy application 137a), utilizes the data in the memory mapped file (e.g., command line arguments) to configure itself for the backup operations.
[0050] Appendix A, which is attached hereto to be considered part of this specification, provides one example of a code file usable by the intercept module 136 to replace particular API calls with customized functions to create an alternative backup file.
[0051] A compression module 140 comprises an engine that compresses the backup data to be stored to disk. In certain embodiments, the compression module 140 processes data received from the memory 138 prior to the data being backed up to disk. For instance, such compression can occur in the memory pages 138 of the backup proxy 132. In certain embodiments, the compression module 140 can utilize a ZLIB or LZO data compression algorithm. In yet other embodiments, the compression module 140 can perform other and/or additional types of compression. In yet further embodiments, the compression module 140 can further encrypt the data to be backed up.
[0052] In certain embodiments, the compression module 140 provides a compression ratio range of one through nine to compress the data. This compression module 140 can further erase “white space” (e.g., allocated, but not used, disk space) in an image prior to compressing the data to further reduce the size of the image on disk.
[0053] In certain embodiments, as the copying and compression is taking place, the compressed backup data is streamed (e.g., through a pipeline configuration) to a backup location. In certain embodiments, the backup location can comprise a WINDOWS or LINUX destination or can comprise a particular VMFS or logical unit number (LUN).
[0054] A differential engine 142 is configured to generate signatures for data blocks to be backed up and to compare signatures of a second set of data blocks to determine like blocks. In certain embodiments, the differential engine 142 computes and stores MD4 signatures for 256 KB data blocks in a signature file, as discussed in more detail below with respect to FIG. 4 . In yet other embodiments, the differential engine 142 can compute other types of signatures, digital fingerprints or the like.
[0055] The differential engine 142 can further store in a map 144 the signature file of one or more virtual machine disk files that have been backed up. For instance, the map 144 can store signatures of data blocks in virtual machine disk files that have been part of the last full backup. The differential engine 142 can then later access, during a differential backup process, the signatures stored in the map 144 to determine if corresponding data blocks have changed since the last full backup.
[0056] The backup proxy 132 further includes a user interface 146 for displaying to, and/or receiving from, a user information relating to storage operations of the backup proxy 132. In certain embodiments, the user interface 146 causes the display of one or more windows for obtaining user input and/or outputting status information with respect to the virtual environment.
[0057] The illustrated backup proxy 132 also includes a scheduler 148 that initiates one or more storage operations, such as full or differential backups, by the backup proxy 132. For instance, the scheduler 148 can indicate that a differential backup should be performed after a certain number of data modification operations have occurred and/or after a predetermined period of time since the last full backup. Moreover, in certain embodiments, the scheduler 148 can comprise one or more backup policies that dictate when a scheduled differential backup can trigger a full backup. For instance, if certain storage thresholds are exceeded by the differential backup (e.g., size difference between the full backup and the last differential backup, number of days since last full backup), a new full backup can be performed.
[0058] Although the backup proxy 132 has been described herein with respect to a physical machine, in other embodiments of the invention, the backup proxy 132 can be executed on one or more virtual machines. Moreover, other embodiments of the backup proxy 132 can function without one or more of the components illustrated in FIG. 1 . For example, in certain embodiments of the invention, the backup proxy 132 can function without the scheduler 148.
[0059] When backing up data, the backup proxy 132 can store data to a plurality of sources. For instance, in certain embodiments, the backup proxy 132 outputs backup data to a local storage device 152, such as a locally attached disk drive. In other embodiments, the backup proxy 132 can store backed up data on the datastore 116, such as in a new technology file system (NTFS).
[0060] In yet other embodiments of the virtual computing environment 100, backup tools described herein can be used with other types of storage and/or network configurations. For instance, the backup proxy 132 may access the virtual machine data over a network connection, such as an IP network, rather than through a fiber switch. In yet other embodiments, backup operations can utilize both a volume shadow copy service (VSS), to temporarily quiesce data operations on a virtual machine, and the VCB utility tool to backup a consistent virtual machine image, as described in more detail in U.S. patent application Ser. No. 12/182,364, filed Jul. 30, 2008, which is hereby incorporated herein by reference in its entirety and, in particular, paragraphs 0040-0089 and FIGS. 2-4B.
[0061] FIG. 2 illustrates a flowchart of an exemplary embodiment of an interception process 200 usable by the backup proxy 132 of FIG. 1 . For instance, the interception process 200 can be used to redirect writes in backing up data of one or more virtual machine disks. For illustrative purposes, the interception process 200 will be described herein with reference to the components of the virtual computing environment 100 in a VMWARE configuration and the exemplary code of Appendix A.
[0062] At Block 205, the proxy application 137a (e.g., vcblauncher.exe) causes the backup module 134 to begin the process of backing up a virtual disk to a destination folder. For instance, the proxy application 137a can initiate the vcbMounter.exe process of the VCB utility, which is responsible for creating a snapshot and mounting and/or copying virtual machine disks or files.
[0063] At Block 210, the intercept module 136 intercepts calls relating to the backing up of virtual machine disk data from the datastore 116. For instance, the intercept module 136 can intercept API calls made by the vcbMounter.exe process to back up the virtual machine disk or file. The intercept module 136 can then selectively replace certain API calls made by vcbMounter.exe with modified functions, as discussed in more detail below. For instance, the modified functions can be maintained in a detours library (e.g., vcbutility.dll) that is stored in the process space of vcbMounter.exe to perform improved backup of the virtual machine data. Such backups can include, but are not limited to: full compressed backups with signature collection, full compressed backups without signature collection, full non-compressed backups with signature collection, differential compressed backups, differential non-compressed backups, combinations of the same and the like.
[0064] At Block 215, the intercept module 136 determines if the API call intercepted from vcbMounter.exe comprises a CreateFile call. If so, the intercept module 136 replaces the call with an alternative function that opens an alternative compressed backup file (Block 220), and the process 200 returns to Block 210. For instance, the intercept module 136 can open the alternative compressed file at a location other than the default backup location for the backup module 134.
[0065] If at Block 225 the intercepted call comprises a WriteFile call, the intercept module 136 replaces the call with an alternative function that redirects the write command to the alternative compressed file (Block 230), and the process 200 returns to Block 210.
[0066] If at Block 235 the intercepted call comprises a CloseHandle call, the intercept module 136 replaces the call with an alternative function that closes the alternative compressed file (Block 240), and the process 200 returns to Block 210. Otherwise, the intercept module 136 ignores the call (Block 245), and the process 200 returns to Block 210.
[0067] Although the interception process 200 has been described with reference to a particular arrangement, other embodiments of the process 200 can include more or fewer blocks or states. For instance, the intercept module 136 can be configured to intercept only the CreateFile, WriteFile and CloseHandle calls, thereby removing Block 245 from the process 200.
[0068] In yet other embodiments, the intercept module 136 can be configured to identify other types of calls or functions other than those shown. For example, in certain embodiments, the intercept module 136 can redirect read calls to the alternative backup file. In yet other embodiments, the replacement functions can identify an alternative location for the backup file without compressing the data blocks of the backup file. In yet other embodiments, the intercept module 136 can be configured to compute signatures of the data blocks during a full backup and/or compare signatures of pairs of corresponding data blocks during a differential backup.
[0069] In embodiments of the invention wherein the backup module 134 comprises the VMware VCB utility, the interception process 200 can be further modified to ignore calls by the backup module 134 to create a new file wherein such creation comprises first reserving disk space for a backup file by writing placeholder data (e.g., digital zeros or ones) to the file location. For instance, in certain embodiments, when opening a new file, the VMware VCB utility will write to disk placeholder data to reserve the disk space and then close the newly written file. When preparing to write actual backup data, the VMware VCB utility will reopen the file to write the data.
[0070] In such embodiments of the invention, the interception process 200 can ignore the first call to open the placeholder file, but rather open an NTFS sparse file that makes it appear to the backup module 134 that the actual file was opened with the requested file size. Upon the second CreateFile request (i.e., to write actual backup data), the intercept module 136 can then proceed as in Blocks 215 and 220 to open and populate the alternative compressed file.
[0071] In certain embodiments, the proxy application 137a (e.g., vcblauncher.exe) that launches the backup process can be given a variety of parameters that define the scope of the backup. Such parameters can include a compressed backup instruction (“-c”), a differential backup feature disabled instruction (“-d0”), a full backup with data black signatures instruction (“-d1”) and/or a differential backup instruction (“-d2”).
[0072] FIG. 3 illustrates a flowchart of an exemplary embodiment of a differential backup process 300 usable in the virtual computing environment 100 of FIG. 1 . In general, the backup process 300 can be performed to back up virtual machine disk files on a datastore. For exemplary purposes, the backup process 300 will be described primarily with reference to the components of the backup proxy 132.
[0073] During Blocks 305, 310, 315 and 320, the backup proxy 132 performs a full backup of one or more virtual machine disk files resident on the datastore 116. In certain embodiments, the full backup can be performed in a manner described with reference to the process 200 of FIG. 2 . For instance, the full backup can be initiated at Block 305 by initiating the proxy application 137a (e.g., vcblauncher.exe) that instructs the backup module 134 to begin its process of backing up the virtual disk to a particular destination folder.
[0074] At Block 310, the intercept module 136 intercepts and selectively replaces API calls made by a component of the backup module 134 with customized functions to create and save a compressed backup file of the virtual machine disk file(s) without writing the backup data to a disk of the backup proxy 132 (Block 320). For instance, each of the data blocks associated with a write operation can be compressed and saved to an alternative destination on disk identified by the intercept module 136. In certain embodiments, ZLIB or LZO data compression is used, while in other embodiments, other types of compression can be performed. In yet other embodiments, the full backup can be performed without compression.
[0075] Prior to, concurrent with, or following the redirecting and saving of the compressed data to the alternative destination, the backup proxy 132 further creates signatures for each of the blocks of the backup file (Block 315). For instance, the differential engine 142 can compute or generate signatures for the data blocks of the backup file. In certain embodiments, each data block comprises a 256 KB data block, such as described in more detail below with respect to FIGS. 4-5C . In other embodiments, the data blocks can be of a different size, and/or other means for creating a digital signature for data can be used.
[0076] In yet other embodiments, the full backup can be performed without generating and storing signatures for each of the data blocks. For instance, a “dirty block” map can be maintained by the backup proxy 132, the management server 128 and/or the host servers to identify specific data blocks that are modified in the virtual machine disk(s) following a full backup of the disk(s).
[0077] In certain embodiments, the backup proxy 132 stores the signatures in the map 144 separate from the data of the compressed full backup.
[0078] At Block 325, the backup proxy 132 initiates a differential backup process. For instance, the differential backup can begin a predetermined time following the last full backup and/or after a certain amount of modifications to the virtual machine data has occurred. This initiating of the differential backup can be achieved, in certain embodiments, by initiating the proxy application 137a (e.g., vcblauncher.exe) that instructs the backup module 134 to begin the differential backup process.
[0079] Similar to Block 310, at Block 325, the intercept module 136 intercepts and redirects API calls received with respect to backing up virtual machine data. During Block 325, the backup proxy 132 can further generate a signature for every data block associated with a replaced WriteFile API call. For instance, in certain embodiments, the differential engine 142 computes an MD4 signature for each of the data blocks obtained from the virtual machine disk.
[0080] At Block 335, the signature of each of the data blocks in the differential backup operation is compared with the signature of the corresponding data block from the last full backup (e.g., signatures stored in the map 144). If the two signatures differ, it can be assumed that the particular data block has been modified since the time of the last full backup. Thus, if at Block 340 the signatures are different, the backup process 300 continues to write the compressed data block(s) to a differential backup file (Block 345). In yet other embodiments, the backup process 300 proceeds without compressing the data blocks of the differential backup.
[0081] If the signatures of the corresponding data blocks are the same, the backup process 300 disregards the specific block and loads a subsequent data block into the buffer memory 138. The process 300 then continues to Block 350 to determine if the differential backup is complete. For instance, the process 300 may determine if a CloseHandle API call was intercepted by the intercept module 136. If not, the backup process 300 continues to intercept additional API calls. Otherwise, the differential backup process 300 concludes at Block 355.
[0082] Although the process 300 has been described with reference to particular arrangements, other embodiments of the invention can include more or fewer blocks than those illustrated in FIG. 3 . For instance, in certain embodiments, the process 300 can allow the backup module 134 to write data to the backup proxy 132 and the compress the data before it is written to disk. In yet other embodiments, the process 300 can utilize customized drivers (e.g., IFS drivers) in place of, or in addition to, intercepting write calls for writing the backup data to an alternative file.
[0083] Moreover, in embodiments of the invention wherein incremental backups are used in combination with full backups, Block 335 can comprise comparing the signatures of each data block associated with the differential backup with the signatures of corresponding data blocks of the full backup and any subsequent incremental backups.
[0084] FIG. 4 illustrates an exemplary embodiment of a signature file 400 usable during the backup process 300 of FIG. 3 . In certain embodiments, the signature file 400 comprises an MD4 signature for each 256 KB data block that has been, or is to be, backed up as part of the backup process 300. In certain embodiments, the signature file 400 can be stored in the map 144.
[0085] As shown, the signature file 400 comprises a header 402 that lists the name of the disk file comprising the data blocks to which the plurality of signatures pertain. For instance, the name can comprise a fully qualified path of the virtual machine disk file. Following the header 402 is a file body 404 that comprises the signature of each data block of the virtual machine disk file. As shown, the file body includes the block numbers and corresponding MD4 signatures for data blocks 1-10.
[0086] In other embodiments, the signature file 400 can be generated using other types of message digest algorithms, cryptographic hash functions (e.g., collision-resistant, non-rolling hash functions), (digital) fingerprints, checksums, hash values, combinations of the same or the like. Moreover, the signatures can be calculated for block sizes other than 256 KB, such as smaller or larger data block sizes.
[0087] FIGS. 5A-5C illustrate exemplary embodiments of headers usable with a differential file created through the backup process 300 of FIG. 3 . In particular, the illustrated headers can be used in a differential file that stores data blocks that were modified since the last full backup of a virtual machine disk.
[0088] FIG. 5A illustrates an exemplary embodiment of a format of a file header 500 of 512 bytes. The file header 500 includes a field offset column 502, a field size column 504 and a description 506. Each row of the file header 500 includes metadata related to the differential file, including a file identifier, file version, file creation time, and compression type. It should be understood from this disclosure, however, that other and/or additional types of metadata can be used in the file header 500. For instance, the file header 500 can comprise information for a backup archive file, including block directory links and/or offsets, header links combinations of the same or the like.
[0089] FIG. 5B illustrates an exemplary embodiment of a format of a data block header 520 of 12 bytes that precedes differential data. As shown, the data block header 520 also includes a field offset column 522, a field size column 524 and a description 526. Each row of the data block header includes metadata corresponding to the particular data block of the differential file, including a differential data size and a differential data offset that corresponds to the main disk file. Thus, in certain embodiments, each differential data block saved to disk comprises the data block header 520 and the differential data.
[0090] As discussed herein, differential data blocks can advantageously be compressed (e.g., using ZLIB or LZO data compression techniques) prior to being stored to disk. FIG. 5C illustrates an exemplary embodiment of a format of a compression header 540 of 4 bytes that proceeds the compressed differential data block. As shown, the compression header 540 also includes a field offset column 542, a field size column 544 and a description 546, which indicates the compressed differential block size. This compression header 540 can be saved to disk along with the compressed differential data.
[0091] Furthermore, in certain embodiments, the systems and methods described herein can advantageously be implemented using computer software, hardware, firmware, or any combination of software, hardware, and firmware. In one embodiment, the system is implemented as a number of software modules that comprise computer executable code for performing the functions described herein. In certain embodiments, the computer-executable code is executed on one or more general purpose computers. However, a skilled artisan will appreciate, in light of this disclosure, that any module that can be implemented using software to be executed on a general purpose computer can also be implemented using a different combination of hardware, software or firmware. For example, such a module can be implemented completely in hardware using a combination of integrated circuits. Alternatively or additionally, such a module can be implemented completely or partially using specialized computers designed to perform the particular functions described herein rather than by general purpose computers.
[0092] Moreover, certain embodiments of the invention are described with reference to methods, apparatus (systems) and computer program products that can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the acts specified herein to transform data from a first state to a second state.
[0093] These computer program instructions can be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the acts specified herein.
[0094] The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions that execute on the computer or other programmable apparatus provide steps for implementing the acts specified herein.
[0095] While certain embodiments of the inventions have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the disclosure. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the disclosure. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the disclosure.
Claims
Certificate of Correction present
The claims shown below may not include correction changes. Use the corrected PDF for authoritative text.
What is claimed is:
1. A method for performing backup of virtual machine data to a target datastore, the method comprising:
initiating a backup process executing on a backup computing device to access one or more virtual machine disks stored on a datastore, the one or more virtual machine disks being comprised of a plurality of data blocks, the backup computing device comprising a volatile memory and nonvolatile storage that is different from the target datastore;
intercepting a plurality of calls made by the backup process to create a backup of the one or more virtual machine disks to the target datastore, the plurality of calls comprising:
(1) at least one open call programmed to open a proxy backup file at a first destination location on the nonvolatile storage of the backup computing device, the open call programmed to reserve space at the first destination location on the nonvolatile storage for the requested size of the proxy backup file, and
(2) at least one write call programmed to write a proxy backup copy of each of the one or more virtual machine disks to the proxy backup file at the first destination location on the nonvolatile storage of the backup computing device;
for each intercepted open call, substituting the open call with at least a second open call programmed to:
open a sparse file at the first destination location, the sparse file providing the appearance that the proxy backup file having the requested size was opened at the first destination location;
for each intercepted write call, substituting the intercepted write call with at least a second write call, wherein the at least the second write call is further programmed to:
transfer the data block associated with the particular intercepted write call to the volatile memory of the backup computing device without writing the data block to the nonvolatile storage of the backup computing device,
compute a signature of the data block while the data block is stored in the volatile memory of the backup computing device, and
compare the computed signature with a predetermined signature while the data block is stored in the volatile memory of the backup computing device;
for each data block having a computed signature that differs from the predetermined signature:
compressing the data block while the data block is stored in the volatile memory of the computing device; and
redirecting the compressed data block stored in the volatile memory to a second destination location on the target datastore that is different than the first destination location on the nonvolatile storage of the backup computing device,
wherein the redirecting occurs without writing the compressed data block to the nonvolatile storage of the computing device; and
for each data block having a computed signature that matches the predetermined signature:
disregarding the data block.
2. The method of claim 1, additionally comprising performing a full backup of the one or more virtual machine disks prior to said initiating the backup process.
3. The method of claim 2, wherein said comparing comprises comparing the computed signature of the data block with the predetermined signature of a corresponding data block in the full backup of the one or more virtual machine disks.
4. The method of claim 1, additionally comprising performing an incremental backup of the one or more virtual machine disks prior to said initiating the backup process.
5. The method of claim 4, wherein said comparing comprises comparing the computed signature of the data block with the predetermined signature of a corresponding data block in the incremental backup.
6. The method of claim 1, wherein the computed signature comprises an MD4 signature.
7. The method of claim 1, wherein said intercepting comprises loading a dynamic link library into a process space of the backup process.
8. The method of claim 1, further comprising intercepting one or more CreateFile application programming interface (API) calls of the plurality of calls.
9. The method of claim 8, further comprising, for each intercepted CreateFile API call, substituting an alternative function that opens an alternative file for receiving compressed backup data in the second destination location.
10. The method of claim 1, additionally comprising informing the backup process when each of the plurality of data blocks has been written to the second destination location.
11. The method of claim 1, wherein said initiating comprises initiating the backup process to access the one or more virtual machine disks via fiber channel.
12. A system for performing backup of virtual machine data, the system comprising:
a storage device comprising one or more virtual machine disks; and
an intercept module configured to redirect backup operations of a backup module executing on a proxy computing device, the intercept module configured to access a plurality of data blocks of the one or more virtual machine disks, the intercept module further comprising,
a proxy application configured to instruct the backup module to initiate a backup of the one or more virtual machine disks via a plurality of application programming interface (API) calls to create a proxy backup file in a first destination location on a disk of the proxy computing device, wherein the proxy backup file comprises a copy of the one or more virtual machine disks, and
a library module configured to replace select API calls of the plurality of API calls by the backup module with alternative functions to:
ignore a call to reserve space for the proxy backup file on the disk of the proxy computing device;
transfer each data block associated with a write call of the select API calls to a buffer memory of the proxy computing device without writing the data block to a disk of the proxy computing device,
compute a signature of the data block while the data block is stored in the buffer memory of the proxy computing device,
compare the computed signature with a predetermined signature while the data block is stored in the buffer memory of the proxy computing device, and
for each data block having a computed signature that differs from the predetermined signature:
redirecting the data block from the buffer memory of the proxy computing device to a second destination location on a target datastore, the second destination on the target datastore being different from the first destination location on the proxy computing device,
wherein the redirecting occurs without writing the data block to the disk of the proxy computing device.
13. The system of claim 12, where the select API calls comprise CreateFile, WriteFile and CloseHandle calls.
14. The system of claim 12, further comprising a differential module configured to compute the signature and compare the computed signature with the predetermined signature.
15. The system of claim 14, wherein the differential module is configured to compute the signature using a message digest algorithm.
16. The system of claim 14, further comprising a signature map configured to store predetermined signatures corresponding to each of a plurality of compressed data blocks of a most recent full backup of the one or more virtual machine disks.
17. The system of claim 12, wherein the buffer memory comprises random access memory (RAM).
18. The system of claim 12, wherein the plurality of data blocks are each 256 KB blocks.
19. The system of claim 12, wherein the library module comprises a dynamic link library (DLL).
20. The system of claim 12, further comprising a compression module configured to compress the data blocks being redirected to the second destination location.
21. A method for performing backup of virtual machine data, the method comprising:
intercepting an open call for opening a proxy backup file at a first destination location on a proxy disk, the open call programmed to reserve space on the proxy disk for a requested size of the proxy backup file;
substituting the open call with a second open call to open a target backup file at a second destination location on a backup datastore that is different than the proxy disk;
intercepting a plurality of write calls for creating a backup copy of a plurality of data blocks of a virtual machine disk at the first destination location on the proxy disk;
substituting each intercepted write call with a second write call, wherein the second write call is programmed to:
transfer the data block associated with the particular write call to a memory without first writing the data block to the proxy disk,
compute a signature of the data block, and
compare the computed signature with a predetermined signature;
for each data block having a computed signature that differs from the predetermined signature, storing the data block to the target backup file at the second destination location on the backup datastore, without storing the data block on the proxy disk; and
disregarding each data block having a computed signature that matches the predetermined signature.
22. The method of claim 1, further comprising:
opening a compressed file at the second destination location on the target datastore; and
storing the redirected compressed data block in the compressed file.
23. The system of claim 12, wherein the library module is further configured to open a sparse file at the first destination location, the sparse file providing the appearance that the proxy backup file having reserved space was opened at the first destination location.
Patent Citations (103)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US4130867(A) | 1978-12-01 | Bachman et al. | Applicant |
| US4648031(A) | 1987-03-01 | Jenner | Applicant |
| US4665520(A) | 1987-05-01 | Strom et al. | Applicant |
| US5222235(A) | 1993-06-01 | Hintz et al. | Applicant |
| US5297279(A) | 1994-03-01 | Bannon et al. | Applicant |
| US5325505(A) | 1994-06-01 | Hoffecker et al. | Applicant |
| US5333314(A) | 1994-07-01 | Masai et al. | Applicant |
| US5414650(A) | 1995-05-01 | Hekhuis | Applicant |
| US5422979(A) | 1995-06-01 | Eichfeld et al. | Applicant |
| US5423037(A) | 1995-06-01 | Hvasshovd | Applicant |
| US5455945(A) | 1995-10-01 | VanderDrift | Applicant |
| US5530855(A) | 1996-06-01 | Satoh et al. | Applicant |
| US5551020(A) | 1996-08-01 | Flax et al. | Applicant |
| US5553303(A) | 1996-09-01 | Hayashi et al. | Applicant |
| US5596747(A) | 1997-01-01 | Katabami et al. | Applicant |
| US5634052(A) | 1997-05-01 | Morris | Applicant |
| US5640561(A) | 1997-06-01 | Satoh et al. | Applicant |
| US5655081(A) | 1997-08-01 | Bonnell et al. | Applicant |
| US5721915(A) | 1998-02-01 | Sockut et al. | Applicant |
| US5758356(A) | 1998-05-01 | Hara et al. | Applicant |
| US5761667(A) | 1998-06-01 | Koeppen | Applicant |
| US5761677(A) | 1998-06-01 | Senator et al. | Applicant |
| US5774717(A) | 1998-06-01 | Porcaro | Applicant |
| US5778377(A) | 1998-07-01 | Marlin et al. | Applicant |
| US5778392(A) | 1998-07-01 | Stockman et al. | Applicant |
| US5796934(A) | 1998-08-01 | Bhanot et al. | Applicant |
| US5799322(A) | 1998-08-01 | Mosher, Jr. | Applicant |
| US5822780(A) | 1998-10-01 | Schutzman | Applicant |
| US5848416(A) | 1998-12-01 | Tikkanen | Applicant |
| US5893924(A) | 1999-04-01 | Vakkalagadda | Applicant |
| US5933818(A) | 1999-08-01 | Kasravi et al. | Applicant |
| US5933820(A) | 1999-08-01 | Beier et al. | Applicant |
| US5940832(A) | 1999-08-01 | Hamada et al. | Applicant |
| US5943677(A) | 1999-08-01 | Hicks | Applicant |
| US5948108(A) | 1999-09-01 | Lu et al. | Applicant |
| US5951694(A) | 1999-09-01 | Choquier et al. | Applicant |
| US5951695(A) | 1999-09-01 | Kolovson | Applicant |
| US5956489(A) | 1999-09-01 | San Andres et al. | Applicant |
| US5956504(A) | 1999-09-01 | Jagadish et al. | Applicant |
| US5978594(A) | 1999-11-01 | Bonnell et al. | Applicant |
| US5983239(A) | 1999-11-01 | Cannon | Applicant |
| US5991761(A) | 1999-11-01 | Mahoney et al. | Applicant |
| US5995958(A) | 1999-11-01 | Xu | Applicant |
| US6003022(A) | 1999-12-01 | Eberhard et al. | Applicant |
| US6016497(A) | 2000-01-01 | Suver | Applicant |
| US6026412(A) | 2000-02-01 | Sockut et al. | Applicant |
| US6029195(A) | 2000-02-01 | Herz | Applicant |
| US6067545(A) | 2000-05-01 | Wolff | Applicant |
| US6070170(A) | 2000-05-01 | Friske et al. | Applicant |
| US6119128(A) | 2000-09-01 | Courter et al. | Applicant |
| US6122640(A) | 2000-09-01 | Pereira | Applicant |
| US6151607(A) | 2000-11-01 | Lomet | Applicant |
| US6157932(A) | 2000-12-01 | Klein et al. | Applicant |
| US6185699(B1) | 2001-02-01 | Haderle et al. | Applicant |
| US6243715(B1) | 2001-06-01 | Bogantz et al. | Applicant |
| US6253212(B1) | 2001-06-01 | Loaiza et al. | Applicant |
| US6289357(B1) | 2001-09-01 | Parker | Applicant |
| US6314421(B1) | 2001-11-01 | Sharnoff et al. | Applicant |
| US6343296(B1) | 2002-01-01 | Lakhamraju et al. | Applicant |
| US6363387(B1) | 2002-03-01 | Ponnekanti et al. | Applicant |
| US6411964(B1) | 2002-06-01 | Iyer et al. | Applicant |
| US6460048(B1) | 2002-10-01 | Teng et al. | Applicant |
| US6470344(B1) | 2002-10-01 | Kothuri et al. | Applicant |
| US6477535(B1) | 2002-11-01 | Mirzadeh | Applicant |
| US6499039(B1) | 2002-12-01 | Venkatesh et al. | Applicant |
| US6519613(B1) | 2003-02-01 | Friske et al. | Applicant |
| US6523035(B1) | 2003-02-01 | Fleming et al. | Applicant |
| US6584474(B1) | 2003-06-01 | Pereira | Applicant |
| US6606626(B1) | 2003-08-01 | Ponnekanti | Applicant |
| US6631478(B1) | 2003-10-01 | Wang et al. | Applicant |
| US6671721(B1) | 2003-12-01 | Branson et al. | Applicant |
| US6691139(B2) | 2004-02-01 | Ganesh et al. | Applicant |
| US6721742(B1) | 2004-04-01 | Uceda-Sosa et al. | Applicant |
| US6728780(B1) | 2004-04-01 | Hebert | Applicant |
| US6834290(B1) | 2004-12-01 | Pugh et al. | Applicant |
| US6907512(B2) | 2005-06-01 | Hill et al. | Examiner |
| US6950834(B2) | 2005-09-01 | Huras et al. | Applicant |
| US6959441(B2) | 2005-10-01 | Moore | Examiner |
| US7065538(B2) | 2006-06-01 | Aronoff et al. | Applicant |
| US7085900(B2) | 2006-08-01 | Inagaki et al. | Examiner |
| US7370164(B1) | 2008-05-01 | Nagarkar et al. | Applicant |
| US7461103(B2) | 2008-12-01 | Aronoff et al. | Applicant |
| US7546325(B2) | 2009-06-01 | Kamei et al. | Examiner |
| US7610331(B1) | 2009-10-01 | Genske et al. | Applicant |
| US7752487(B1) | 2010-07-01 | Feeser et al. | Examiner |
| US7765400(B2) | 2010-07-01 | Costea et al. | Examiner |
| US7805423(B1) | 2010-09-01 | Romine et al. | Applicant |
| US7844577(B2) | 2010-11-01 | Becker et al. | Examiner |
| US7849267(B2) | 2010-12-01 | Lam et al. | Examiner |
| US2005/0114614(A1) | 2005-05-01 | Anderson et al. | Applicant |
| US2007/0208918(A1) | 2007-09-01 | Harbin et al. | Examiner |
| US2007/0244938(A1) | 2007-10-01 | Michael et al. | Applicant |
| US2008/0082593(A1) | 2008-04-01 | Komarov et al. | Applicant |
| US2008/0250406(A1) | 2008-10-01 | Carpenter et al. | Applicant |
| US2009/0007100(A1) | 2009-01-01 | Field et al. | Applicant |
| US2009/0089781(A1) | 2009-04-01 | Shingai et al. | Applicant |
| US2009/0216816(A1) | 2009-08-01 | Basler et al. | Applicant |
| US2009/0216970(A1) | 2009-08-01 | Basler et al. | Applicant |
| US2010/0070725(A1) | 2010-03-01 | Prahlad et al. | Applicant |
| US2010/0076934(A1) | 2010-03-01 | Pershin et al. | Applicant |
| US2010/0077165(A1) | 2010-03-01 | Lu et al. | Applicant |
| US2010/0262585(A1) | 2010-10-01 | Rosikiewicz et al. | Applicant |
| US2011/0047340(A1) | 2011-02-01 | Olson et al. | Applicant |
Non-Patent Literature (30)
- “Data Deduplication Deep Dive, How to Put Data Storage on a Diet”, InfoWorld, Mar. 2010, in 5 pages.Applicant
- “The What, How and Where of Deduplication”, Spectra nTier with FalconStor Deduplication, Spectra Logic Corporation, May 2008, in 12 pages.Applicant
- “Quest SharePlex for Oracle,” Brochure, Quest Software, Inc., Nov. 1999, 4 pages.Applicant
- Space Management and Reorganization: Challenges and Solutions, http://quest.com/whitepapers/space—manager—wp.doc, published on or around Dec. 21, 1999.Applicant
- “Top Five Tips for Space Management and Reorganization,” believed to be published after Jul. 21, 1998, in 2 pages.Applicant
- Computer Associates, “Platinum OnlineReorg Technical Overview, OnlineReorg”, http://platinum.com/products/custstor/tsreorg.htm, 5 pages downloaded on Nov. 30, 1999.Applicant
- Computer Associates, “Platinum Tsreorg Automates Tablespace Reorganizations, Customer Story”, http://platinum.com/products/custstor/tsreorg.htm, 2 pages downloaded on Nov. 30, 1999.Applicant
- Computer Associates, “ProVision Tsreorg for Oracle, Brochure, Database Utilities Tsreorg for Oracle”, http://platinum.com/products/custstor/tsreorg.htm, 4 pages downloaded on Nov. 30, 1999.Applicant
- Computer Associates, “Rapid Reorg for DB2 for OS/390, Brochure”, http://platinum.com/products/custstor/tsreorg.htm, 3 pages downloaded on Nov. 30, 1999.Applicant
- EMC Deduplication Frequently Asked Questions, http://www.datadomain.com/resources/faq.html, downloaded Jun. 7, 2011, 4 pages.Applicant
- Harley Stagner, “Aligning disk partitions to boost virtual machine performance”, Vmware Management, Migration and Performance, http://searchvmware.techtarget.com/tip/0,289483,sid179—gci1344730—mem1,00.html, Jan. 28, 2009, pp. 1-5.Applicant
- Jeff Graves, “Partition Alignment”, ORCS Web Team Blog, http://www.orcsweb.com/blog, Sep. 14, 2009, pp. 1-2.Applicant
- Jin, Keren et al.,“The Effectiveness of Deduplication on Virtual Machine Disk Images”, SYSTOR 2009, May 2009, in 12 pages.Applicant
- John Willemse, “VMware disk alignment VMDK settings and align at the 64k boundary blogSphere bug desktop enterprise microsoft server vist . . . ”, Planet Lotus, http://planetlotus.org/profiles/john-willemse—49586, Apr. 30, 2009, pp. 1-5 (of 44).Applicant
- Joseph Pagano, paper on Microsoft Exchange Disaster Recovery Planning , document version 3.00, 1996, in 39 pages.Applicant
- K. Loney, et al., “Oracle8i, DB Handbook,” Oracle Press, 2000, p. 20.Applicant
- L. Leverenz, et al., “Oracle8i Concepts,” Oracle Corp., vol. 2, Release 8.1.5, 1999, p. 20-3.Applicant
- Massiglia, Paul, “Block-Level Incremental Backup”, VERITAS Software Corporation, Feb. 2000, in 13 pages.Applicant
- Oracle: Introduction to PL/SQL, Power Point Presentation Regarding Triggers, slides 4, 6-7, 11, 14-17, 28, and 51, http://training.ntsource.com/dpec/COURSES/PL1/pIc011.htm, 10 pages downloaded on Oct. 20, 2000.Applicant
- Tom Hirt, “Importance of Disk Alignment in VMware”, VMware Disk Alignment—How-to Align VMware Partitions—Disk, Alignment, Vmfs, Vmdk, Esx, Apr. 9, 2009, pp. 1-15.Applicant
- VMware, “Recommendations for Aligning VMFS Partitions”, VMware Infrastructure 3, VMware Performance Study, Feb. 2009, pp. 1-10.Applicant
- VMware, Inc., “VMware Virtual Machine File System: Technical Overview and Best Practices”, A VMware Technical White Paper, http://www.vmware.com/support/, 2007, Issue Version 1.0, pp. 1-19.Applicant
- Laverick, Mike, “VMware ESX 3.x Server and VirtualCenter 2.x (GA Build Eval) Service Console Guide,” Document Ver. 1.2, RTFM Education, downloaded Dec. 17, 2008, in 73 pages.Applicant
- Kleo Bare Metal Backup, Wikipedia, retrieved from http://en.wikipedia.org/wiki/Kleo—Bare—Metal—Backup on Apr. 14, 2010, in 3 pages.Applicant
- Veritas NetBackup for VMware Adminstrator's Guide, UNIX, Windows, and Linux, Release 6.5.4, Symantec Corporation, 2009, in 66 pages.Applicant
- Data Sheet: Data Protection, “Symantec NetBackup 7, The Symantec NetBackup Platform: Complete protection for your information-driven enterprise,” Symantec Corporation, Dec. 2009, in 8 pages.Applicant
- Veeam Technology Overview, “The New Standard for Data Protection,” Veeam Software, Apr. 2010, in 2 pages.Applicant
- Backup Critic, “File Versus Image Backups,” retrieved from http://www.backupcritic.com/software-buyer/file-verus-image on May 4, 2010, in 3 pages.Applicant
- Microsoft TechNet, Windows Server 2003, retrieved from http://technet.microsoft.com/en-us/library/cc706993(WS.10,printer).aspx on Aug. 3, 2011, in 6 pages.Applicant
- MSDN, Overview of Processing a Backup Under VSS, retrieved from http://msdn.microsoft.com/en-us/library/aa384589(d=printer,v=VS.85).aspx on Aug. 3, 2011, in 5 pages.Applicant