Backup processing method

[0001] Not Applicable

[0002] Not Applicable

[0003] Not Applicable

[0004] The present invention relates generally to a backup processing system for data processing systems executing on-line processing and batch processing, and more particularly to backup processing technology capable of preventing backup processing delays when trouble occurs during a backup operation.

[0005] On-line processing and batch processing in data processing systems of banks, securities firms, etc., sometimes terminate abruptly due to bugs in the programs, trouble with storage devices, etc., leaving data in an inconsistent state. Moreover, data are sometimes erased by human errors made during data processing. Several means are known for correcting the inconsistencies in such data, restarting the data processing or redoing such data processing from scratch. One means restores a data processing system by backing up data from time to time and restoring the data if trouble has occurred.

[0006] With the means for backing up and restoring data, data of a database system, for example, are regularly backed up to a storage medium such as magnetic tape. If trouble occurs in the database system, the data are restored from the magnetic tape to the database system storage device. The backup system dates back to an appropriate point in time to reconstruct the data in the storage device of the database system. Thus the data of the database system are restored so that processing can recommence.

[0007] In the case of batch processing, the data in the system's storage device are backed up on magnetic tape prior to batch processing. If batch processing comes to an irregular end, the data are restored from the magnetic tape to the storage device, and then batch processing is started again from scratch.

[0008] JP-A-242437/2000 discloses a storage-device system which makes a copy of data to be backed up in its storage device so that backup data can be made not from the data, but from the copy; therefore access to the data in the storage device is not disrupted even while the data are being backed up.

[0009] Sometimes, data are being backed up on magnetic tape, as described above, backup processing comes to an irregular end due to trouble with the magnetic tape drive or the magnetic tape. In this case, another magnetic tape drive and another magnetic tape must be readied, the data-backup processing must be redone from scratch, and backup processing takes a long time.

[0010] Recently, the amount of data input to data processing systems has burgeoned, increasing the amount of data which need to be backed up. In contrast, the time allocated for data-backup processing has been decreasing in order to minimize the effects of data-backup processing on on-line business affairs. If data-backup processing of a system ends irregularly, data-backup processing has to be redone from scratch. Thus data-backup processing takes much longer to be completed than the time allocated for such processing, and may affect on-line business affairs.

[0011] With the storage-device system of JP-A-242437/2000, the effects of irregular termination of backup processing on online business affairs can be lessened. However, if data-backup processing terminates irregularly, the back-up has to be redone from scratch; accordingly the data backup takes a long time to complete and the process ties up resources such as magnetic tape drives and data transfer routes for a long time.

[0012] In accordance with the above, an object of the present invention is to provide a technology capable of preventing backup processing from being prolonged when trouble occurs during backup.

[0013] According to the present invention, resources and routes necessary for backup processing are dynamically secured to form a plurality of backup subsystems in a backup processing system for backing up data from a data processing computer system. Backup processing is executed by the subsystems.

[0014] In the backup processing system of the present invention, the states of a plurality of resources such as backup servers, library devices, etc., required for data-backup processing are managed; resources in a usable state are selected from the managed resources; and switches in a usable state are selected from a plurality of switches needed to form routes among the selected resources.

[0015] The system checks whether the resources and routes forming a plurality of backup processing subsystems are secured. If the resources and routes are secured, backup processing is executed using the secured resources and routes.

[0016] When backup processing has been successfully executed by at least one subsystem, the backup is considered successful. Alternatively, data may be backed up by at least one subsystem, and if trouble occurs during backup processing, the backup is continued using other resources and routes.

[0017] As described above, in the backup processing system of the present invention, resources and routes needed for backing up data to be used by a data processing computer system are dynamically secured to form a plurality of backup subsystems, and backup processing is executed; therefore, backup processing is prevented from being prolonged when trouble occurs during backup.

[0018] Other and further objects, features and advantages of the invention will appear more fully from the following description read in conjunction with the drawings.

[0031] A preferred embodiment of the backup processing system of the present invention is described below with reference to the drawings.

[0032] As shown in FIG. 1, a backup processing system is provided with a backup manager 400, which has a resource selection processor 401, a route selection processor 402, a backup processor 403, and a restore processor 404.

[0033] Resource selection processor 401 selects resources in a usable state from a plurality of resources such as backup servers 300, library devices 500, tapes 510, etc., required for backup of data to be used in data processing by a host computer 100.

[0034] Route selection processor 402 selects FC (Fibre Channel) switches in a usable state from a plurality of FC switches 600 to form routes among the selected resources. When the resources and routes required to back up data for use by host computer 100 are secured to form a plurality of backup subsystems, backup processor 403 performs a backup operation, using the selected resources and routes.

[0035] Restore processor 404 finds the storage areas of backup data by using information relating backup data to their storage areas and restores data into a storage device 200 of host computer 100.

[0036] A program which controls the backup manager 400 to function as the resource selection processor 401, the route selection processor 402, the backup processor 403, and the restore processor 404 is recorded in a storage medium such as a CD-ROM, stored in a magnetic disk or the like, and then loaded in memory and executed. The program may be recorded in storage media other than CD-ROM. The program may be loaded from the storage medium of the program into a data processing device, or the storage medium of the program may be accessed through a network to use the program.

[0037] The backup processing system comprises host computer 100, storage device 200, backup servers 300, backup manager 400, library devices 500, fibre-channel switching devices, or FC switches, 600, and copy devices 610 that make copies of data in the host computer 100 in accordance with backup instructions.

[0038] Host computer 100, backup servers 300, backup manager 400, and FC switches 600 are connected by a network 800. Host computer 100, storage device 200, backup servers 300, backup manager 400, library devices 500, and copy devices 610 consist of the FC switches 600 and are connected by a SAN (Storage Area Network) 700 for data transfer.

[0039] Host computer 100 has a backup agent 110 that controls the application software and database-management software of host computer 100 for backup processing. Storage device 200 records and reproduces data to be used in accordance with requirements of host computer 100. A single magnetic disk drive, a magnetic disk drive with a controller of a RAID (Redundant Array of Inexpensive Disks) type, or the like, may be used as storage device 200.

[0040] Each library device 500 has a plurality of tapes 510 and reads data from and writes data into a tape 510, which is selected by external control, in accordance with the read and write commands from a device connected to the library device 500. In the data backup processing described later, library devices 500 store copies (backup data) of the data that are stored in storage device 200 and used by host computer 100.

[0041] Host computer 100, backup servers 300, and backup manager 400 have components such as memories and CPUs that are necessary for computers, but their having such components is not important for the present embodiment; therefore the details of such components are not be described here.

[0042] In the data-backup processing described below, backup manager 400 backs up the data stored in storage device 200 within a given time, in accordance with a schedule, by securing multiple resources needed for backup processing and then instructing the backup servers 300 so secured to execute the backup.

[0043] An example of backup processing information 410 held by the backup manager 400 is now described with reference to FIG. 2. “Process Number” means numbers allotted to backup processes. “Time” means the time and date when each backup process is to start. The “Object” column lists information that identifies the data in storage device 200 to be backed up. The information may identify logical or physical volumes, file names (identifiers), database table names (identifiers), or the like.

[0044] Backup manager 400 contains various items of information shown in FIGS. 3 to 6 to manage the various resources mentioned above.

[0045] An example of backup server information 420 is described with reference to FIG. 3. The “Server Number” column contains numbers that identify the backup servers 300. The “Server Name” column contains the names (identifiers) of the backup servers 300. The “State” column shows the state of each backup server 300; i.e., usable, in use, or not usable. When a backup server 300 is executing a backup process in accordance with a data set in backup processing information 410, the process number of the data set is shown in the “Process Number” column. The numbers in the “Stream Number” column distinguish the multiple copies, to be made as described later, of data in a backup process.

[0046] An example of library device information 430 is now described with reference to FIG. 4. The numbers in the “Library Device Number” column identify library devices 500. The codes (identifiers) in the “Library Device Name” column identify library devices 500. The “State,” “Process Number,” and “Stream Number” columns contain information relating the library devices and backup processes, as in the case of the backup server information 420.

[0047] Backup manager 400 contains tape information 440 about tapes 510 in each library device 500. An example of that information is now described with reference to FIG. 5. The numbers in the “Tape Number” column of tape information 440 identify the tapes 510 of a library device 500. The “State,” “Process Number,” and “Stream Number” columns contain information relating the tapes and backup processes, as in the case of backup server information 420.

[0048] An example of FC switch information 450 is described with reference to FIG. 6. The numbers in the “FC Switch Number” column identify FC switches 600. The codes (identifiers) in the “FC Switch Name” column further identify FC switches 600. The “State,” “Process Number,” and “Stream Number” columns contain information relating the FC switches 600 and backup processes as in the case of the backup server information 420.

[0049] Backup processing by backup manager 400 is now described with reference to FIGS. 1, 7 and 8.

[0050] Backup manager 400 commences backup of the data specified by a backup data set in backup processing information 410 at the time and on the date given in the data set (Step 1000). Backup manager 400 instructs backup agent 110 of the host computer to prepare the backup (Step 1010).

[0051] Resource selection processor 401 of the backup manager 400 selects a backup server 300 from the usable backup servers by using backup server information 420. Resource selection processor 401 then changes the state information of the selected backup server 300 from “usable” to “in use”, sets the process number of the selected backup server to the process number in the backup data set of backup processing information 410, and sets the stream number of the selected backup server to “0” (Step 1020). The selected backup server 300 is hereinafter called backup server “0”.

[0052] In a similar manner, the resource selection processor 401 of the backup manager 400 uses library device information 430 and tape information 440, to select a library device 500 usable for the backup process and a tape 510 in the library device. Resource selection processor 401 then changes the state information of the selected library device 500 and tape 510 from “usable” to “in use,” sets the process numbers of the selected library device 500 and tape 510 to the process number in the backup data set of backup processing information 410, and sets the stream numbers of the selected library device 500 and tape 510 to “0” (Step 1030). The selected library device 500 and tape 510 are hereinafter called library device “0” and tape “0”, respectively.

[0053] Using FC switch information 450, route selection processor 402 of backup manager 400 selects an FC switch 600 to form routes among storage device 200, backup server “0”, and library device “0”. Then, route selection processor 402 changes the state information of the selected FC switch 600 from “usable” to “in use”, sets the process number of the selected FC switch 600 to the process number in the backup data set of backup processing information 410, and sets the stream number of the selected FC switch 600 to “0” (Step 1040).

[0054] Then resource selection processor 401 and route selection processor 402 of backup manager 400 select another backup server 300, another library device 500, another tape 510, and another FC switch 600 in the same way as described above, but all are given stream number “1”, to secure another backup route or subsystem (Steps 1050 to 1070). The backup server 300, library device 500, and tape 510 so selected are hereinafter called backup server “1”, library device “1”, and tape “1”, respectively.

[0055] If resource selection processor 401 and route selection processor 402 fail to secure two backup routes, or subsystems, as described above, the backup processor 403 of backup manager 400 regards the backup process as a failure, releases the secured resources, and records the failure in a log (Steps 1180 and 1190). In addition, backup processor 403 may notify the user of the failure.

[0056] If two backup routes, or subsystems, are secured, backup processor 403 of backup manager 400 controls library device “0” to prepare for recording the data onto the tape “0” (Step 1090).

[0057] Then backup processor 403 of backup manager 400 notifies backup server “0” of the data to be backed up, the library device “0”, and the tape “0”, and instructs backup server “0” to back up the data onto tape “0” (Step 1100).

[0058] Backup server “0” reads out the data to be backed up from storage device 200, transfers the data to library device “0”, and writes the data onto tape “0”. When the backup process has successfully completed, backup server “0” notifies backup processor 403 of the successful completion of the backup process. If the backup process ends in an irregular way, backup server “0” notifies backup processor 403 of the irregular termination (Step 1110).

[0059] While the above backup process is being executed, the backup processor 403 prepares library device “1” and instructs backup server “1” to back up the data onto tape “1”. As in the case of the backup process described above, backup server “1” executes the backup process and notifies backup processor 403 of the result of the backup process (Steps 1120 to 1140).

[0060] Backup processor 403 receives the information on the results of the backup processes from the backup servers “0” and “1” and checks the contents of the information to determine whether the backup processes were successes or failures (Step 1150). If both the backup processes fail, the backup of the data is regarded as failure (Steps 1180 and 1190). If either of the backup processes is successful, the backup of the data is regarded as a success and backup processor 403 finds a storage area for the backed-up data and updates the backup data save information 460 (Step 1160).

[0061] An example of backup data save information 460 is described with reference to FIG. 9. A field in the “Object” column identifies backed-up data and includes information to distinguish logical or physical volumes, file names (identifiers), database table names (identifiers), etc. “Start Time” means the time and date when a data backup process was started. “End Time” means the time and the date when the data backup process ended. “Data Time” means the time and the date of the data as backup data. “Library Device Number” and “Tape Number” are the numbers of a library device 500 and a tape 510 in which the backup data were stored, corresponding to “Library Device Number” in library device information 430 and “Tape Number” in tape information 440, respectively. The “Data Position” column contains information on the storage area of the backup data on tape 510; for example, block addresses or the number of bytes of an offset from the head. “Data Size” is the size of the backup data in, for example, numbers of blocks or bytes.

[0062] If one of the two backup processes described above is successful, backup processor 403 records, in backup data save information 460, the numbers of the library device and the tape on which the data have successfully been stored. If two or more backup processes are successful, the numbers of library device 500 and tape 510 of any of the backup processes, or the numbers of library devices 500 and tapes 510 of two or more backup processes, are recorded in the backup data save information 460. The storage areas of the backup data on some or all of the tapes 510 or the storage area of the backup data on either tape 510 is also recorded in the backup data save information 460. Thus, for example, backup results of only the first successful process can be selected.

[0063] Backup processor 403 of backup manager 400 stores all or part of the backup data save information 460 onto each tape 510 (Step 1170) and thus can collect the information from each tape 510 as the need arises.

[0064] Backup processor 403 changes the states of backup server information 420, library device information 430, tape information 440, and FC switch information 450 used for the backup processes from “in use” to “usable”, releasing the resources secured for the backup processes, and completes those processes (Step 1190).

[0065] The restore process performed by backup manager 400 is now described with reference to FIG. 10. If data stored in storage device 200 are lost due to operational trouble or trouble with some device, the user checks with restore processor 404 of backup manager 400 about the save condition of backup data (Step 2000).

[0066] Restore processor 404 provides information on the backup data to the user by using the backup data save information 460 (Step 2010).

[0067] The user chooses the data to be restored, assigns a storage area in storage device 200 for the data restoration, and instructs restore processor 404 to restore the data (Step 2020).

[0068] Using the backup data save information 460, restore processor 404 specifies the library device 500 and the tape 510 storing data to be restored and specifies the data storage area on the tape. Restore processor 404 then refers to library device information 430 and tape information 440, makes sure that the states of the indicated library device 500 and the indicated tape 510 are “usable” and changes the states of the indicated library device and the indicated tape to “in use” (Step 2030).

[0069] In addition, using backup server information 420, restore processor 404 selects a backup server 300 to be used for the restoration from the “usable” backup servers, and changes the state of backup server information 420 for the selected backup server from “usable” to “in use” (Step 2040). Further, restore processor 404 selects an FC switch 600 to form routes among the indicated library device, the selected backup server and storage device 200, and then changes the state information of the selected FC switch 600 to “in use” in FC switch information 450 (Step 2050).

[0070] Then restore processor 404 prepares library device 500 so that the data to be restored can be obtained from tape 510 (Step 2060).

[0071] Restore processor 404 then notifies the selected backup server 300 of the indicated library device, the indicated tape and the data to be restored, specifies the data storage area on the tape and the area to which the data will be restored, and instructs the backup server 300 to perform the data restoration (Step 2070).

[0072] Upon receiving the instruction, backup server 300 reads out the data to be restored from tape 510 of library device 500, and restores the data in the assigned storage area of storage device 200 (Step 2080).

[0073] When the requested restore process has successfully completed, backup server 300 notifies restore processor 404 of the successful completion. If the restore process ends in an irregular way, backup server 300 notifies restore processor 404 of the irregular termination (Step 2090).

[0074] Restore processor 404 records the results in a log and notifies the user of a successful completion, or of a failure if the restoration process ends irregularly (Step 2100).

[0075] Restore processor 404 changes the state of various information for the restore process from “in use” to “usable”, releasing the resources so secured, and completes the restore process (Step 2110).

[0076] As described above, in the backup processing system according to the present embodiment, resources and routes needed for backing up data to be used by host computer 100 are dynamically secured as required to form a plurality of backup subsystems, and backup processing is executed in parallel by the plurality of backup subsystems. Therefore, even when trouble occurs during any of the multiple backup operations, the backup process is not prolonged and can be completed within a given time.

[0077] In the backup processing described above, the backup is executed in parallel by a plurality of backup servers 300. In the backup processing described below with reference to FIGS. 11 and 12, however, a copy device 610 (see FIG. 1), which makes copies of data for the backup is switched when trouble occurs.

[0078] FIGS. 11 and 12 show a flowchart of backup processing by backup manager 400 in accordance with another embodiment of the present invention. As in the processing described above, resource selection processor 401 of backup manager 400 starts backup processing. Using copy device information 470, the resource selection processor selects a copy device 610 to be used for backup processing from the usable copy devices and sets copy device information 470 (Step 3000).

[0079] The selected copy device 610 is hereafter called copy device “0”. The selection of copy device “0” and the setting of the copy device information 470 by backup manager 400 are the same as was done with backup server 300 and backup server information 420 in previously described backup processing.

[0080] FIG. 13 is an example of copy device information 470 contained in backup manager 400 of the present embodiment. The numbers in the “Copy Device Number” column identify the copy devices 610. The “Copy Device Name” column lists the names (identifiers) of the copy devices 610. The state, process numbers and stream numbers are the same as those in backup server information 420.

[0081] Further, as in the backup process described above, backup manager 400 selects library device “0”, tape “0”, copy device “1”, library device “1”, tape “1” and an FC switch 600, and secures the selected equipment (resources) by setting the various information (Step 3010). If backup manager 400 fails to secure two or more backup routes or subsystems, then, as in the previously described backup process, the backup manager regards the backup process as a failure (Step 3160) and releases the resources secured for the backup process (Step 3170).

[0082] When two or more routes or subsystems are secured, backup processor 403 of backup manager 400 controls library device “0” and library device “1” to prepare for the recording of the data onto tape “0” and tape “1” (Steps 3030, 3040).

[0083] Then backup processor 403 instructs copy device “0” to backup (copy) the target data (i.e., the data to be backed up) into the onto tape “0” of library device “0” (Step 3050). An example of a backup command instructing the copy is an EXTENDED COPY command specified in the SCSI (Small Computer System Interface). When EXTENDED COPY commands are used, copying can be instructed by specifying a device from which data is copied, a device to which data is copied, an address of the area from which data is copied, an address of the area to which data is copied and copy length, etc., as parameters.

[0084] Backup processor 403 executes copying of the data to be backed up by dividing that data into multiple processes with multiple EXTENDED COPY commands. If the data to be copied, for example, is 100 Mbytes in size, copy length is set as 10 Mbytes using 10 commands, and the copying process is repeated 10 times. By dividing the copy process, fine-particle size by command during a trouble-shooting procedure can be realized. Further, prompt trouble-shooting is provided and the backup process can be continued.

[0085] Copy device “0” executes the instructed copy process, and informs backup processor 403 of successful completion when the copy process is successfully completed and of an irregular termination when the copy process comes to an irregular end (Step 3060).

[0086] Upon receiving a report of successful completion, backup processor 403 records in backup data save information 460, the library device “0”, tape “0”, and the storage area of data on the tape, with respect to the data whose copy process has been successfully completed (Step 3080). When there is data which has not yet been copied, backup processor 403 issues the next copy command to the copy device “0” (Step 3090). When the whole copying process of the data to be backed up has been completed, the backup process is regarded as successful (Step 3150) and the resources secured for the backup process are released (Step 3170).

[0087] When backup processor 403 receives a report of an irregular termination of the copy process from copy device “0”, or reaches a time-out without receiving any reports from copy device “0”, the backup processor indicates that the data whose copy process has not successfully completed will now be copied by copy device “1” to tape “1” of library device “1” (Step 3100).

[0088] The copy device “1” executes the instructed copy process and, as described above, informs backup processor 403 of the copy results (Step 3110).

[0089] When a report of successful completion is received, backup processor 403 stores in backup data save information 460, library device “1”, tape “1” and the storage area of data on the tape, with respect to the data whose copying has been successfully completed (Step 3130). If there is data which has not yet been copied, the backup processor issues the next copy instruction command to copy device “1” (Step 3140).

[0090] When the whole copying process of the data to be backed up has been completed, the backup process is regarded as successful (Step 3150) and the resources secured for the backup process are released (Step 3170). When backup processor 403 receives a report of an irregular termination of the copy process from copy device “1”, or reaches a time-out, the backup process is regarded as failure (Step 3160) and the resources secured for the backup process are released (Step 3170).

[0091] When switching of the backup processes occurs, as described above, the backup data is divided into multiple sections and stored in two or more library devices 500 and tapes 510. Such sections of the backup data and their storage area are respectively recorded in saved backup data information 460 and managed. Namely, the backup data save information 460 may have entries of multiple storage areas with respect to backup data of data that was selected for backup.

[0092] As described above in the restore process, when backup manager 400 restores data, it requests, using backup data save information 460, identification of the restorable data and the storage area of data to be restored. However, when the backup data (data to be restored) is divided and stored, as described immediately above, restore processor 404 of the backup manager 400 obtains, using backup data save information 460, the identification of each storage area (the tape 510 of the library device 500). Restore processor 404 then sequentially secures the library device/tape, gives a restore instruction to backup server 300 or to copy device 610 and then releases the library device/tape, eventually restoring all the data.

[0093] As previously described, in the backup processing system of the present embodiment, resources and routes needed for backing up data to be used by a host computer 100 are dynamically secured, according to the state of each resource, to form a plurality of backup subsystems. Therefore, when trouble occurs during any of the multiple backup processes, backup processing continues in another system and such processing, being free of delays, can be completed within a given time.

[0094] The backup process described above starts with an instruction of a user, according to a date and time set by backup process information 410. Alternatively, the user may give an instruction to start the backup immediately, in an on-demand manner.

[0095] Further, FC switch 600 may have a zoning function grouping multiple ports managed by the FC switch 600 and allowing access and transfer within each group. Accordingly, in selecting and securing resources (routes) described above for backup and restore processing, backup manager 400 sets FC switch 600 via a network 800, executes zoning the selected route as an independent route and carries out the processing so that the data transfer of the backup or restore processing does not influence a transfer in the processing being executed by another computer and is not influenced by such transfer.

[0096] In both of the above-described backup processes, two resources (routes) are secured and the processing is carried out. However, in order to improve the trouble-prevention function of the present invention, three or more routes may be used to carry out the processing.

[0097] In the backup and restore processing described above, when data to be backed up or restored are files or database tables, backup manager 400 and backup server 300 have means to translate file management and database management information to other file formats or database formats as needed or otherwise deemed appropriate.

[0098] Further, the backup processing method described above can be applied when creating a copy (snapshot) of data on the storage device 200 and acquiring the backup with respect to the copy.

[0099] In the above description, host computer 100, backup server 300 and backup manager 400 are shown as different computers. However, one or more computers may have the means and functions of the above computers, and may carry out backup processing in the same way as described above.

[0100] In the backup processing described above, backup manager 400 manages various information and carries out the backup processing using backup server 300. However, as an example of an alternative configuration, each backup server 300 may manage while synchronizing the information so that the contents will be the same on each backup server 300, and can achieve the backup processing by carrying out the processing previously done by the backup manager 400 in the above description.

[0101] Moreover, in the description of the backup process, the routes are switched with the occurrence of an irregular termination of the EXTENDED COPY command. However, routes may be switched by using other transfer instruction methods. For example, such as with the occurrence of an irregular termination of a data transfer based on a block, a track or a cylinder from storage device 200, transferred as a unit.

[0102] Further, in the backup process described above, the storage area of the backup data is on tape 510 of library device 500. However, other storage devices such as a single magnetic disk unit or a magnetic disk unit with a controller having a RAID configuration, etc., may be used.

[0103] As described above, according to the backup processing system of the present invention, resources and routes needed for backing up data to be used by a data-processing computer system are dynamically secured to form multiple backup subsystems, and backup processing is executed by the subsystems. Therefore, backup processing is prevented from being delayed when trouble occurs during backup processing.

[0104] The foregoing invention has been described in terms of the preferred embodiments. However, those skilled, in the art will recognize that many variations of such embodiments exist. Such variations are intended to be within the scope of the present invention and the appended claims.