Storage system and data relocation control device

[0001] This application is a Continuation-In-Part of U.S. application Ser. No. 10/975,645 filed Oct. 29, 2004, which relates to and claims priority from Japanese Patent Application No. 2004-250327 filed on Aug. 30, 2004, the entire disclosure of which is incorporated herein by reference.

[0002] The present invention relates to a storage system and a data relocation control device.

[0003] The storage system is constituted by comprising at least one or more storage device, known as a disk array sub-system, for example. This storage device provides a storage region based on a RAID (Redundant Arrays of Independent (Inexpensive) Disks), wherein disk drives, such as hard disk drives, semiconductor memory drives, or the like, are arranged in an array configuration, for example. A host computer (hereinafter, called “host”) accesses the logical storage region provided by the storage device and reads or writes data.

[0004] The amount of data managed by businesses and organizations such as regional authorities, educational institutions, financial institutions, government and municipal offices, and the like, is growing steadily year on year, and storage devices are added and replaced as this data volume increases. As the data volume increases and the composition of storage systems becomes more complicated in this way, techniques have been proposed for improving the efficiency of use of storage systems by locating the data relating to various application programs, such as main management software and database management software, in suitable locations according to the value of that data (Japanese Patent Laid-open No. 2003-345522, Japanese Patent Laid-open No. 2001-337790, Japanese Patent Laid-open No. 2001-67187, Japanese Patent Laid-open No. 2001-249853, and Japanese Patent Laid-open No. 2004-70403.)

[0005] The respective reference patents mentioned above disclose techniques for relocating data by copying data stored in one volume to another volume, on the basis of disk performance information and use information.

[0006] However, in the techniques described in these references, it is necessary to relocate data individually, in volume units, and the user is not able to move volumes between freely defined layers, and hence usability is poor. Moreover, in the techniques described in the aforementioned patent references, since data is relocated in volume units, it is difficult to relocate data in a group of related volumes, together, in one operation. Furthermore, the techniques described in the aforementioned patent references focus exclusively on the relocation of the data, and do not give consideration to the processing after relocation of the data. Therefore, usability is poor from this viewpoint also.

[0007] One object of the present invention is to provide a storage system and a data relocation control device capable of relocating data distributed over a plurality of storage devices, in a more simple fashion. Furthermore, one object of the present invention is to provide a storage system and a data relocation control device having improved usability, by allowing the data stored respectively in a plurality of mutually related volumes to be relocated together, in one operation. Moreover, one object of the present invention is to provide a storage system and a data relocation control device having improved usability, by causing the processing required after data relocation to be executed automatically. Other objects of the present invention will become apparent from the following description of the embodiments.

[0008] In order to achieve the aforementioned objects, the storage system according to the present invention comprises: a plurality of storage devices respectively having at least one or more volumes; a virtualization unit for managing the volumes belonging to the respective storage devices, virtually, in a unified fashion; a storage unit for storing volume attribute information for managing the attribute information of each of the volumes; and a relocating unit for relocating a designated movement source volume to a designated storage layer, with respect to a plurality of storage layers respectively generated on the basis of a plurality of predetermined policies and the volume attribute information.

[0009] Here, a “policy” can be set as desired by the user, and the same volume can belong to different storage layers. Moreover, the storage layers can be set in units corresponding to each storage device, or they can be set to span a plurality of storage devices.

[0010] For example, storage layer management information containing policy identification information for respectively identifying each of the policies, and layer composition conditions respectively associated with each of the policy identification information, is provided, and storage layers corresponding to each of the policies can be generated respectively by means of a group of volumes satisfying the respective layer composition conditions. The layer composition conditions may include at least one of RAID level, drive type, storage capacity, type of storage device, and use status.

[0011] More specifically, the storage layers are generated in accordance with policies defined by the user, such as a high-performance layer constituted by high-performance disks, a low-cost layer constituted by low-cost disks, and the like. One or a plurality of volumes belonging to the respective storage layers may be located in the same storage device, or they may be located in different storage devices.

[0012] The policies defining the respective layers are determined by layer composition conditions which can be set by the user. For example, when defining a high-performance layer, the user should establish conditions for selecting high-performance disks and high-performance storage devices, as the layer composition conditions. Moreover, for example, when defining a low-cost layer, the user should set conditions for selecting inexpensive disks, as the layer composition conditions. The storage layer is composed by means of volumes which satisfy the respective layer composition conditions.

[0013] When data in a volume belonging to a particular storage layer is to be relocated, then the source volume and the destination storage layer should be designated, respectively. Consequently, the data in the designated source volume is moved to a volume belonging to the designated destination storage layer.

[0014] The relocating unit is able to relocate the designated source volumes, in units of groups, each group made up of a plurality of mutually related volumes, for example. The plurality of mutually related volumes may be, for example, a group of volumes storing data used by the same application program, or a group of volumes storing data forming the same file system, or the like. It is still possible to group volumes together, even if there is little relation between the respective data.

[0015] The relocating unit can also execute prescribed processing that has been associated previously with the destination storage layer, with respect to the moved volume, when the designated source volume has been moved to the destination storage layer. The prescribed processing may be, for example, setting of access attributes, such as a read-only setting, or creation of redundant volumes, or the like.

[0016] The relocating unit includes a destination candidate selecting unit for selecting a destination candidate volume to which the storage contents of the designated source volume can be copied, and a presenting unit for presenting the destination candidate volume selected by the destination candidate selecting unit, to the user; and the destination candidate selecting unit can select a volume having matching essential attributes that are previously established from among the attributes of the source volume, as the destination candidate volume, by referring to the volume attribute information.

[0017] The volume attribute information may comprise static attributes and dynamic attributes, and prescribed attributes of the static attributes may be set as the essential attributes. The essential attributes may include at the least the storage capacity of the volume.

[0018] In this way, the relocating unit selects volumes which match the essential attributes of the source volume, as destination candidate volumes. If there are a plurality of destination candidate volumes having matching essential attributes, then the destination candidate selecting unit selects only one of the destination candidate volumes, on the basis of the degree of matching of other attributes apart from the essential attributes. Attributes other than the essential attributes may be, for example, the RAID level, the disk type, the model of storage device, and the like. In other words, if a plurality of volumes matching the essential attributes are extracted, then the volume of these volumes having a composition most closely resembling that of the source volume is selected as the destination candidate volume.

[0019] The relocating unit may further comprise a changing unit for changing the destination candidate volume selected by the destination candidate selecting unit. The changing unit can cause the destination candidate volume to be selected from among the destination candidate volumes having the matching essential attributes but not selected.

[0020] For example, the changing unit can change the provisionally selected destination candidate volumes, in such a manner that the destination candidate volumes do not become concentrated in a particular RAID group, or in such a manner that data groups having different use statuses, such as data that is accessed randomly and data that is accessed sequentially, is not located in the same RAID group. The changing unit may change the destination candidate volume on the basis of instructions from the user.

[0021] The data relocation control device according to another aspect of the present invention controls data relocation in a plurality of volumes located in a distributed fashion in a plurality of storage devices. The respective volumes are managed virtually in an integrated fashion, by a virtualization unit, and a storage unit and a control unit are provided. (A) The storage unit respectively stores: (a1) volume attribute information containing, at the least, identification information, RAID level, drive type, storage capacity, and use status, for each of the volumes; and (a2) storage layer management information containing policy identification information for respectively identifying a plurality of policies that can be defined by a user, and layer composition conditions respectively associated with each of the policy identification information. (B) The control unit may comprise a relocating unit for relocating a designated source volume to a designated storage layer, with respect to a plurality of storage layers generated respectively on the basis of the storage layer management information and the volume attribute information.

[0022] A further data relocation control device according to the present invention is a device for managing volumes belonging respectively to a plurality of storage devices, in a unified fashion, and controlling the relocation of data stored in each of the volumes; comprising: a virtualization unit for managing the volumes belonging to the respective storage devices, virtually, in a unified fashion; a storage unit for storing volume attribute information for managing the attribute information of each of the volumes; and a relocating unit for relocating a designated movement source volume to a designated storage layer, with respect to a plurality of storage layers respectively generated on the basis of a plurality of predetermined policies and the volume attribute information.

[0023] The present invention may also be interpreted as data relocation method as described below, for example. More specifically, it is a method for relocating data stored in a plurality of volumes distributed in a plurality of storage devices, to volumes in the same or different storage devices, comprising the steps of: virtually managing all the volumes belonging to the respective storage devices integrally; managing the attribute information of respective volumes as volume attribute information; previously establishing a plurality of policies; generating a plurality of storage layers on the basis of this plurality of policies and the volume attribute information; setting a source volume and a destination storage layer; and relocating a designated source volume to a designated storage layer among the storage layers.

[0024] At least a portion of the means, functions and steps according to the present invention may be constituted by computer programs which are read in and executed by a microcomputer. Computer programs of this kind may be distributed by copying them onto a storage medium, such as a hard disk, optical disk, or the like. Alternatively, computer programs may also be supplied via a communications network, such as the Internet.

[0025] FIG. 1 is an illustrative diagram showing the concept of an embodiment of the present invention;

[0026] FIG. 2 is a block diagram showing a general overview of a storage system;

[0027] FIG. 3 is an illustrative diagram showing a schematic view of a state where volumes distributed in an storage system are managed virtually;

[0028] FIG. 4 is a block diagram showing the hardware composition of a storage system;

[0029] FIG. 5 is an illustrative diagram showing the storage structure of the storage system;

[0030] FIG. 6 is a block diagram showing the composition of a storage management server;

[0031] FIG. 7 is an illustrative diagram showing the composition of a mapping table;

[0032] FIG. 8 is an illustrative diagram showing the composition of a volume attribute management table;

[0033] FIG. 9 is an illustrative diagram showing the composition of a storage layer management table;

[0034] FIG. 10 is an illustrative diagram showing the composition of a corresponding host management table;

[0035] FIG. 11 is an illustrative diagram showing the composition of a migration group management table;

[0036] FIG. 12 is an illustrative diagram showing the composition of an action management table;

[0037] FIG. 13 is an illustrative diagram showing a general view of the overall operation of data relocation;

[0038] FIG. 14 is a flowchart showing destination candidate selection processing;

[0039] FIG. 15 is a flowchart showing relocation implementation processing;

[0040] FIG. 16 is an illustrative diagram showing an example of a screen for presenting a proposal for data relocation;

[0041] FIG. 17 is an illustrative diagram showing an example of a screen for revising the presented plan;

[0042] FIG. 18 is a block diagram showing a simplified view of the general composition of a storage system relating to a second embodiment of the present invention;

[0043] FIG. 19 is an illustrative diagram showing the composition of a volume attribute management table used in an storage system relating to a third embodiment of the present invention;

[0044] FIG. 20 is a block diagram showing the general composition of a storage system according to a fourth embodiment of the present invention;

[0045] FIG. 21 is an illustrative diagram showing a schematic view of the relationship between a migration group management table and a storage layer management table;

[0046] FIG. 22 is a flowchart showing destination candidate selection processing relating to a fifth embodiment of the present invention;

[0047] FIG. 23 is a flowchart showing volume creation processing relating to a fifth embodiment of the present invention;

[0048] FIG. 24 is a further flowchart showing volume creation processing relating to a fifth embodiment of the present invention;

[0049] FIG. 25 is an illustrative diagram showing a schematic view of the relationship between a storage layer management table and an action management table relating to a sixth embodiment of the present invention;

[0050] FIG. 26 is an illustrative diagram showing the composition of a volume attribute management table relating to a sixth embodiment of the present invention;

[0051] FIG. 27 is a flowchart showing data relocation processing relating to a sixth embodiment of the present invention;

[0052] FIG. 28 is a flowchart showing replica volume reserve processing relating to a sixth embodiment of the present invention;

[0053] FIG. 29 is a flowchart showing action script execution processing relating to a sixth embodiment of the present invention; and

[0054] FIG. 30 is a diagram showing a schematic view of an example of state transitions in a volume attribute management table relating to a sixth embodiment of the present invention.

[0055] Below, embodiments of the present invention are described with respect to the drawings. FIG. 1 is an illustrative diagram showing a schematic view of the general concepts of the present embodiment. As described below, the storage system according to the present embodiment comprises a plurality of storage devices A-D.

[0056] The volumes belonging to the respective storage devices A-D are managed jointly in a virtual manner, and a host (see FIG. 2) recognizes the plurality of storage devices A-D together, as a single virtual storage device.

[0057] The respective storage devices A-D respectively comprise volumes A1-A4, B1-B4, C1-C4 and D1-D4. Each of these volumes is a logical storage region established on a physical storage region provided by a physical storage drive, such as a hard disk drive, semiconductor memory drive, optical disk drive, or the like, for example.

[0058] Here, the respective storage devices A-D may be provided with drives of the same type, or they may respectively combine drives of different types. Therefore, even in the case of volumes located within the same storage device, there may be differences in the volume attributes, such as performance, cost, and the like.

[0059] The user is able to group the respective volumes belonging to the storage system, as a plurality of storage layers 1-3. For example, any one storage layer 1 may be defined as a high-reliability layer. A high-reliability layer is constituted by a group of volumes comprising high-reliability drives, such as fiber channel disks (FC disks), forming a RAID1 array. Furthermore, another storage layer 2 may be defined as a low-cost layer, for example. The low-cost layer is constituted, for example, by a group of volumes comprising inexpensive drives, such as SATA (Serial AT Attachment) disks, forming a RAID5 array. Furthermore, yet another storage layer 3 may be defined as an archive layer, for example. The archive layer may be constituted by a group of volumes established on inexpensive disks of less than a prescribed capacity, for example.

[0060] As shown in FIG. 1, the respective storage layers 1-3 are constituted in a virtual fashion, spanning the respective storage devices A-D. More specifically, the user is able to define a plurality of the volumes constituting the storage system, as a desired storage layer, such as a high-reliability layer, a low-cost layer, a high-speed response layer, an archive layer, or the like, freely, on the basis of the business use standards (policy). The policy can be set independently of the composition of the storage system, and depending on the conditions for constituting each storage layer, a portion of the volumes may belong to a plurality of storage layers, or alternatively, another portion of the volumes may not belong to any of the storage layers.

[0061] The respective storage layers 1-3 may respectively comprise volume groups which form objects for data relocation. One example is indicated by the migration group consisting of two volumes V1, V2 in the storage layer 1. These volumes V1, V2 are mutually related volumes, for example, volumes storing data groups used by the same application program, or data groups constituting the same filing system, or the like.

[0062] The value of data declines progressively as time passes, for example. Data of high value is located in a high-reliability layer and is used frequently by application programs. Desirably, data whose value has dropped with the passage of time is moved to another storage layer. This is because there are limits on the storage resources available in the high-reliability layer.

[0063] Therefore, the user investigates relocation of the data stored in the plurality of mutually related volumes V1, V2, and decides, for example, to move the data from storage layer 1 to storage layer 3 (which is the archive layer in this case). The user issues a single instruction indicating relocation of the source volumes V1, V2, and instructs that they be moved to storage layer 3.

[0064] Thereby, in storage layer 3, which is the movement destination, volumes respectively capable of storing the volumes V1 and V2 constituting the migration group are selected, and the data is copied to these selected volumes. When copying has been completed, the data in the source volumes V1, V2 can be deleted, and these volumes become empty and can be reused.

[0065] Here, it is possible previously to associate prescribed actions with the respective storage layers 1-3, in accordance with the policies for the respective storage layers 1-3. An “action” indicates a prescribed information process or data operation carried out within the storage layer. For example, storage layer 1 which is defined as a high-reliability layer may be previously associated with a process for generating a replica of the relocated data. Moreover, storage layer 2 which is defined as a low-cost layer may not be associated previously with any action, for example. Furthermore, storage layer 3 which is defined as an archive layer may be previously associated with a plurality of processes, namely, a process for generating a replica of the relocated data, and a process for establishing a read-only access attribute, for example.

[0066] If the volumes V1, V2 constituting the migration group are copied to a volume belonging to storage layer 3, then the prescribed action associated with storage layer 3 is carried out automatically. A replica is generated of the data relocated to storage layer 3, and the data is set to a read-only status, thereby prohibiting modification of that data.

[0067] Here, when the data in the respective volumes V1, V2 is relocated, then the volumes to which that data can be copied are selected within the destination storage layer. Each volume has its own attribute information. Volume attribute information includes, for example, identification information for identifying each volume a RAID level, disk type, storage capacity, use status indicating whether or not the volume is in use, the model of storage device to which the volume belongs, and the like.

[0068] It is not necessary for all of these volume attributes to be matching in the source volumes (V1, V2) and the destination candidate volumes, and it is sufficient for only essential attributes to be matching. An example of an essential attribute is the storage capacity, for instance. More specifically, a volume which has a storage capacity equal to or exceeding the storage capacity of the source volume can be selected as a destination volume.

[0069] If more than the required number of volumes having the matching essential attributes are detected, then the degree of matching of other attributes apart from the essential attributes is taken into consideration, and the volumes having attributes closest to those of the source volumes can be selected as the destination volumes. In this example, the volume attributes are divided broadly into two types: essential attributes and other attributes, but the composition is not limited to this and it is also possible, for example, to determine the degree of matching between volumes by classifying attributes into three or more types, such as essential attributes, semi-essential attributes and other attributes, for instance, and applying suitable weightings to each respective type of attribute. For example, it is possible to use the volume capacity and the emulation type as essential attributes, and other attributes (such as the RAID level, disk type, and the like), as other attributes (non-essential attributes). Alternatively, a composition may be adopted in which the emulation type is taken to be an essential attribute, the volume capacity, to be a semi-essential attribute, and the other attributes, to be non-essential attributes. If the volume capacity is taken to be a semi-essential attribute, then although it is not absolutely necessary for the source volume and the destination volume to have the same capacity, the destination volume must have a capacity which is equal to or greater than the capacity of the source volume. Furthermore, of the volume attributes, the use status is an exceptional attribute which is not included in this classification; the use status of the destination volume must always be “empty”.

[0070] FIG. 2 is a block diagram showing an approximate view of the general composition of a storage system. As described hereinafter, this storage system may be constituted by comprising, for example, a plurality of hosts 10A and 10B (indicated as “host 10” in the diagram where no particular distinction is required), a volume virtualization device 20, a plurality of storage devices 30 and 40, a management client 50, and a storage management server 60. These elements are interconnected via a communications network CN1, such as a LAN (Local Area Network), or the like.

[0071] The hosts 10A and 10B are constituted by a computer system, such as a server, personal computer, workstation, mainframe computer, portable information terminal, or the like. A plurality of open type hosts and a plurality of mainframe type hosts may be combined in the same storage system, for example.

[0072] The hosts 10A and 10B may be provided with application programs (abbreviated to “App” in the drawings) 11A and 11B (described as “application program 11” where no particular distinction is required), and HBAs (Host Bus Adapters) 12A and 12B (described as “HBA 12” where no particular distinction is required). A plurality of application programs 11 and HBAs 12 may be provided respectively in each one of the hosts 10.

[0073] Examples of an application program 11A and 11B include, for example, an electronic mail management program, a database management program, a file system, or the like. The application programs 11A and 11B may be connected to a plurality of client terminals located outside the scope of the drawings, by means of a communications network separate to the plurality of client terminals illustrated, and they may provide information processing services in accordance with requests from the respective client terminals.

[0074] The HBA 12 is used for transmission and reception of data between the host and the storage system, and is connected to the volume virtualization device 20 via a communications network CN2. Here, the communications network CN2 is, for example, a LAN, a SAN (Storage Area Network), the Internet, or a dedicated circuit, or the like. In the case of an open type host, for example, then data transfer is conducted on the basis of a protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol), FCP (Fiber Channel Protocol), iSCSI (internet Small Computer System Interface), and the like. If the host computer is a mainframe type host, then data transfer is conducted in accordance with a communications protocol, such as FICON (Fiber Connection: registered trademark), ESCON (Enterprise System Connection: registered trademark), ACONARC (Advanced Connection Architecture registered trademark), FIBARC (Fiber Connection Architecture registered trademark), or the like.

[0075] Apart from this, the respective hosts 10A and 10B may also be respectively installed with a management program (not illustrated), such as a path control program, or the like. A management program of this kind carries out processing for distributing load between a plurality of HBAs 12 and switching the path when a fault occurs, for example.

[0076] The volume virtualization device (hereinafter, also referred to as “virtualization device”) 20 virtualizes the volumes 330, 430, and the like, present in the storage system, in such a manner that they appear as a single virtual storage device. As shown in FIG. 3(a), for example, the virtualization device 20 presents a plurality of logical volumes (LDEVs) indicated by the identification information LID001-LID 004, to the respective hosts 10. These logical volumes are respectively associated with other logical volumes indicated by the identification information PID01-PID 04. A logical volume having identification information PID is a physical volume which actually stores data, and a logical volume which can be recognized directly by the host 10 is a virtual volume.

[0077] By controlling mapping between the virtual volumes and the physical volumes, it is possible to move data in a manner that is transparent to the host 10. For example, as shown in FIG. 3(b), if data stored in a physical volume (PID01) is moved to another physical volume (PID02), then after copying the data between these physical volumes, the mapping between the physical volume and the virtual volume should be re-established. Alternatively, by exchanging the identification information between the virtual volume (LID001) and the virtual volume (LID002), it is possible to change the device forming the destination for data storage, without the host 10 being aware.

[0078] In this way, the virtualization device 20 virtualizes the plurality of physical volumes of different types located on the storage system, and it manages these volumes in a unified manner and presents the volumes to the host 10. As described below, the virtualization device 20 may be provided inside the storage device, or it may be provided in a high-performance intelligent switch. Moreover, as described below, the virtualization device 20 and the storage management server 60 may be provided in the same computer.

[0079] Returning to FIG. 2, the storage devices 30 and 40 respectively comprise logical volumes (physical volumes) 330, 430, and are connected respectively to the virtualization device 20, by means of a communications network CN3, such as a SAN. The storage devices 30 and 40 read and write data from and to the volumes, in response to requests from a host 10. An example of the composition of the storage device is described in further detail below.

[0080] The management client 50 is, for example, constituted by a computer system, such as a personal computer, a workstation, or a portable information terminal, and it comprises a web browser 51. The user may issue various types of instructions to the storage system, or acquire various types of information from the storage system, for example, by logging in to the storage management server 60 by means of the web browser 51.

[0081] The storage management server 60 is a computer system for managing relocation of volumes in the storage system, and the like. An example of the composition of the storage management server 60 is described below, but it may comprise, for example, a data relocation management unit 632 and a volume database (indicated as “DB” in the drawings) 640.

[0082] FIG. 4 is a block diagram showing an approximate view of the hardware composition of the storage system, in a case where the virtualization device 20 is constituted by a storage device.

[0083] In this embodiment, the virtualization device 20 may also be called the third storage device 20. The third storage device 20 can be constituted by comprising, for example, a plurality of channel adapters (hereinafter, “CHA”) 210, a plurality of disk adapters (hereinafter, “DKA”) 220, a cache memory 230, a shared memory 240, connection control units 250 and 260, a storage unit 270, and an SVP 280, which are respectively described hereafter.

[0084] The CHAs 210 serve to control transmission and reception of data between the host 10 and the external first storage device 30 and second storage device 40, and they may be constituted by a microcomputer system comprising a CPU, memory, input/output circuit, and the like, for example. Each of the CHAs 210 may be provided with a plurality of communications ports 211, and data may be exchanged independently and respectively via each of these communications ports 211. Each CHA 210 corresponds respectively one type of communications protocol, and is prepared in accordance with the type of host 10. However, it is also possible for each of the CHAs 210 to be composed so as to correspond respectively to a plurality of communications protocols.

[0085] The DKAs 220 control transmission and reception of data with the storage unit 270. Similarly to the CHAs 210, the DKAs 220 may be constituted by a microcomputer system comprising a CPU, memory and the like, for example. For example, each of the DKAs 220 accesses the respective disk drives 271 and performs data read out or data writing, by converting a logical block address (LBA) designated by the host 10 into an address on a physical disk. The functions of the CHAs 210 and the functions of the DKAs 220 may also be integrated into one or a plurality of controllers.

[0086] The cache memory 230 stores write data written from the host 10 and read data read out from the host 10. The cache memory 230 may be constituted by a volatile or a non-volatile memory, for example. If the cache memory 230 is constituted by a volatile memory, then desirably, a memory back-up is performed by means of a battery power source, or the like, which is not illustrated. Although not shown in the drawings, the cache memory 230 may be constituted by two regions, namely, a read cache region and a write cache region, and the data stored in the write cache region may be stored in multi-layered fashion. In other words, since read data is also present on the disk drive 271 in exactly the same form, then even if this read data happens to be lost, it simply needs to be read out again from the disk drive 271, and hence there is no need for multi-layered storage. On the other hand, write data is only present in the cache memory 230 of the storage device 20, and therefore, from the viewpoint of reliability it is desirable to store it in a multi-layered fashion. Ultimately, the decision whether or not to store the cache data in multiple layers depends on the specifications.

[0087] The shared memory (which may also be called the control memory) 240 may be constituted by a non-volatile memory, or it may be constituted by a volatile memory. Control information, management information, and the like, such as a mapping table T1, for example, is stored in the shared memory 240. Information, such as this control information, and the like, can be managed in a multi-layered fashion by means of a plurality of memories 240. An example of the composition of this mapping table T1 is described further below.

[0088] Here, the shared memory 240 and the cache memory 230 may be constituted respectively by separate memory packages, or the cache memory 230 and the shared memory 240 may be provided in the same memory package. Furthermore, one portion of the memory may be used as a cache region and another portion thereof may be used as a control region. In other words, the shared memory and the cache memory may also be constituted as the same memory.

[0089] The first connection control unit (switch unit) 250 respectively interconnects each of the CHAs 210, the DKAs 220, the cache memory 230, and the shared memory 240. Thereby, all of the CHAs 210 and the DKAs 220 may respectively access the cache memory 230 and the shared memory 240, in an independent fashion. The connection control unit 250 may be constituted as an ultra-high-speed cross-bar switch, or the like, for example. The second connection control unit 260 respectively connects each of the DKAs 220 with the storage unit 270.

[0090] The storage unit 270 is constituted by a plurality of disk drives 271. The storage unit 270 may be provided in the same frame as the controller units, such as the respective CHAs 210 and the respective DKAs 220, or it may be provided in a separate frame from the controller units.

[0091] A plurality of disk drives 270 may be provided in the storage unit 271. For the disk drives 271, it is possible to use an FC disk (fiber channel disk), a SCSI (Small Computer System Interface) disk, a SATA (Serial AT Attachment) disk, or the like. Moreover, the storage unit 270 does not have to be constituted by disk drives of the same type, and it is also possible to combine disk drives of a plurality of different types.

[0092] Here, in general, the performance declines in order, from an FC disk, to a SCSI disk to a SATA disk. It is possible, for example, to use different types of disk drive according to the state of use of the data, in such a manner that data which is accessed frequently (data of high value, or the like) is stored in a high-performance FC disk, and data which is accessed infrequently (data of low value, or the like) is stored in a low-performance SATA disk. A plurality of logical storage regions can be provided in a hierarchically layered fashion in the physical storage regions provided by the respective disk drives 271. The composition of these storage regions is described further below.

[0093] The SVP (Service Processor) 280 is connected respectively to each of the CHAs 210 and the DKAs 220, by means of an internal network CN11, such as a LAN. In the diagram the SVP 280 is only connected to the CHAs 210, but the SVP 280 can also be connected respectively to each of the DKAs 220. The SVP 280 gathers the various statuses within the storage device 20 and supplies them to the storage management server 60, either directly or after processing.

[0094] The third storage device 20, which virtualizes the volumes, is an access point for processing data input and output requests from the host 10, and it is connected respectively to the first storage device 30 and the second storage device 40, via the communications network CN3. The drawing shows a state where two storage devices 30 and 40 are connected to the storage device 20, but the composition is not limited to this, and one storage device may be connected to the storage device 20, or three or more storage devices may be connected to the storage device 20.

[0095] The first storage device 30 may be constituted by comprising, for example, a controller 310, a communications port 311 for connecting to the third storage device 20, and a disk drive 320. The controller 310 performs the function of the CHA 210 and DKA 220 described above, and controls the transmission and reception of data between the third storage device 20 and the disk drive 320, respectively.

[0096] The first storage device 30 may have the same or substantially the same composition as the third storage device 20, or it may have a different composition to that of the third storage device 20. The first storage device 30 is able to perform data communications with the third storage device 20, based on a prescribed communications protocol (for example, FC, iSCSI, or the like), and it should comprise a storage drive (storage device), such as a disk drive 320. As described hereinafter, the logical volumes belonging to the first storage device 30 are mapped to a prescribed layer of the third storage device 20, and are used exactly as if there where internal volumes of the third storage device 20.

[0097] In the present embodiment, an example is illustrated wherein a hard disk is used as a physical storage drive, but the present invention is not limited to this. Apart from a hard disk, it may also be possible to use a semiconductor memory drive, a magnetic tape drive, an optical disk drive, a magneto-optical disk drive, or the like, as a storage drive.

[0098] Similarly to the first storage device 30, the second storage device 40 may be constituted by comprising a controller 410, a disk drive 420, and a port 411, for example. The second storage device 40 may have the same composition as the first storage device 30, or it may have a different composition.

[0099] FIG. 5 is a compositional diagram focusing on the logical storage structure of the storage system. Firstly, the composition of the third storage device 20 will be described. The storage structure of the third storage device 20 can be divided broadly into the physical storage layer and the logical storage layer, for example. The physical storage layer is constituted by PDEVs (Physical Devices) 271, which are physical disks. The PDEVs correspond to disk drives.

[0100] The logical storage layer can be constituted by a plurality of layers (for example, layers of two types). One logical layer may be constituted by VDEVs (Virtual Devices) 272. The other logical layer may be constituted by LDEVs (Logical Device) 273.

[0101] A VDEV 272 may be constituted by grouping together a prescribed number of PDEVs 271, in order to form, for instance, one group of four (3D+1P), or one group of eight (7D+1P). One RAID storage region is formed by the collection of storage regions provided respectively by the PDEVs 271 belonging to a group. This RAID storage region forms a VDEV 272.

[0102] Here, all of the VDEVs 272 are not actually provided directly on PDEVs 271, but rather, some of the VDEVs 272 can be generated in the form of a virtual intermediate device. A virtual VDEV 272 of this kind forms a recipient for mapping the LUs (Logical Units) belonging to the external storage devices 30 and 40.

[0103] At least one or more LDEVs 273 may be provided on a VDEV 272. LDEVs 273 may be formed by dividing up a VDEV 272, into fixed lengths. If the host 10 is an open type host, then since the LDEVs 273 are mapped to a LU 274, the host 10 recognizes the LDEV 273 as a single physical disk volume. The open type host 10 accesses a desired LDEV 273 by specifying a LUN (Logical Unit Number) and a logical block address.

[0104] The LU 274 is a device that can be recognized as a logical SCSI unit. Each LU 274 is connected to the host 10 via the port 211A. Each of the LUs 274 can be associated respectively with at least one or more LDEV 273. By associating a plurality of LDEVs 273 with one LU 274, it is also possible to expand the LU size, in a virtual fashion.

[0105] The CMD (Command Device) 275 is a special LU used in order to exchange command and status information between a program running on the host 10 and the controller of the storage device (CHA 210 and DKA 220). Commands from the host 10 are written to the CMD 275. The controller of the storage device executes processing corresponding to the command written to the CMD 275 and writes execution results as status information to the CMD 275. The host 10 reads out and confirms the status written to the CMD 275 and then writes the contents of the processing that is to be executed next, to the CMD 275. In this way, the host 10 is able to issue various types of instructions to the storage device, via the CMD 275.

[0106] The first storage device 30 and the second storage device 40 are connected respectively via a communications network CN3 to initiator ports (External Port) 211B used for connecting external devices to the third storage device 20. The first storage device 30 comprises a plurality of PDEVs 320, and an LDEV 330 established on the storage region provided by the PDEVs 320. Each LDEV 330 is associated with an LU 340. Similarly, the second storage device 40 is constituted by a plurality of PDEVs 420 and an LDEV 430, and the LDEV 430 is associated with an LU 440.

[0107] The LDEV 330 belonging to the first storage device 30 is mapped via the LU 340 to a VDEV 272 of the third storage device 20 (“VDEV2”). The LDEV 430 belonging to the second storage device 40 is mapped via the LU 440 to a VDEV 272 of the third storage device 20 (“VDEV3”).

[0108] By mapping the physical volumes (LDEVs) belonging to the first and second storage devices 30 and 40 to a prescribed logical level of the third storage device 20 in this way, the third storage device 20 is able to make the volumes 330 and 430, which are located outside it, appear to the host 10 exactly as if there were volumes belonging to itself. The method for incorporating volumes situated outside the third storage device 20, into the third storage device 30, is not limited to example described above.

[0109] Next, FIG. 6 is a block diagram showing an approximate view of the hardware composition of the storage management server 60. The storage management server 60 may be constituted, for example, by comprising a communication unit 610, a control unit 620, a memory 630, and a volume database 640.

[0110] The communication unit 610 performs data communications via the communications network CN1. The control unit 620 performs overall control of the storage management server 60. The memory 630 stores, for example, a web server program 631, a data relocation management program 632, and a database management program 633.

[0111] The volume database 640 stores, for example, a volume attribute management table T2, a storage layer management table T3, a corresponding host management table T4, a migration group management table T5, and an action management table T6. An example of the composition of each of these tables is described in further detail below.

[0112] The web server program 631 provides web server functions in the storage management server 60 by being read in and executed by the control unit 620. The data relocation management program 632 provides a data relocation management unit in the storage management server 60, by being read in by the control unit 620. The database management system 633 manages the volume database 640. The web server functions, data relocation management functions, and database management functions may be executed respectively in a parallel fashion.

[0113] FIG. 7 is an illustrative diagram showing the composition of a mapping table T1. The mapping table T1 is used to map the volumes respectively belonging to the first storage device 30 and the second storage device 40, to the third storage device 20. The mapping table T1 may also be stored in the shared memory 240 of the third storage device 20.

[0114] The mapping table T1 is constituted by associating information, such as the LUN, LDEV number, maximum slot number (capacity) for LDEV, VDEV number, maximum slot number (capacity) for VDEV, device type and path information, for example. The path information can be divided broadly into internal path information indicating a path to an internal storage region of the third storage device 20 (PDEV 271) and external path information indicating a path to a volume belonging to the first storage device 30 or the second storage device 40. The external path information may include a WWN (World Wide Name) and a LUN, for example.

[0115] FIG. 8 shows one example of a volume attribute management table T2. The volume attribute management table T2 is used to manage the attribute information for the respective volumes distributed in the storage system.

[0116] The volume attribute management table T2 can be constituted by, for example, associating each virtual volume with a logical ID for identifying that virtual volume, a physical ID for the physical volume associated with that virtual volume, a RAID level, an emulation type, a disk type, a storage capacity, a use status, and a model of storage device.

[0117] Here, the RAID level is information that indicates the composition of the RAID, such as RAID0, RAID1, RAID5, or the like, for example. The emulation type is information indicating the structure of the volume; for instance, the emulation type will be different for a volume presented to an open type host and a volume presented to a mainframe type host. The use status is information indicating whether or not that volume is in use. The device model is information indicating the model of storage device in which that volume is located.

[0118] Moreover, the logical ID is a logical volume ID presented to the host 10 by the volume virtualization device 20, and the physical ID is an ID indicating the location of the physical volume corresponding to that logical volume. The physical ID consists of a device number of the storage device where the physical volume is stored, and a volume number within that device.

[0119] FIG. 9 shows one example of a storage layer management table T3. The storage layer management table T3 may be constituted by associating, for example, a storage layer number, a storage layer name, a condition formula for defining that storage layer, and an action that is executed automatically. The action is not an essential setting and it is possible to define a storage layer without associating an action with it.

[0120] The user (system administrator, or the like) may set any desired name as the storage layer name. For example, he or she may use names, such as high-reliability layer, low-cost layer, high-speed response layer, archive layer, or the like, as the storage layer name. The search conditions for extracting the volumes that are to belong to that storage layer are set in the condition formula. The search conditions are set by the user, in accordance with the policy for that storage layer.

[0121] Depending on the search conditions, volumes formed by disks of a prescribed type in a prescribed RAID level may be detected (for instance, “RAID level=RAID1 and disk type=FC”), or volumes located in a particular storage device may be detected (for instance, “device model=SS1”). For example, in the high-reliability layer (#1), volumes formed by redundant highly reliable FC disks in a RAID1 configuration are selected. Accordingly, it is possible to compose a high-reliability layer by means of highly reliable volumes only. In the low-cost layer (#2), volumes formed by redundant inexpensive SATA disks in a RAID5 configuration are selected. Accordingly, it is possible to compose a low-cost layer by means inexpensive volumes of relatively small capacity, only. In the high-speed response layer (#3), volumes created by striping disks (RAID0) located in a device model capable of high-speed response are selected. Accordingly, it is possible to compose a high-speed response layer by means of volumes capable of fast I/O processing, without the need for parity calculations, or the like, only. In the archive layer (#4), volumes formed by inexpensive SATA disks having less than a prescribed capacity are selected. Accordingly, it is possible to compose an archive layer by means of low-cost volumes.

[0122] As shown in FIG. 9, by searching the volume attribute management table T2 on the basis of the condition formula set in the storage layer management table T3, a group of volumes that should belong to a particular storage layer are detected. It should be noted here that the storage layer and the group of volumes are not related directly in an explicit fashion, but rather, they are related indirectly by means of the condition formula. Accordingly, even if the physical composition of the storage system has changed in various ways, it is still possible to determine the correspondence between layers and volumes, easily.

[0123] FIG. 10 is an illustrative diagram showing one example of a corresponding host management table T4. The corresponding host management table T4 may be constituted by associating, for example, a logical ID for identifying a virtual volume, information for identifying the host accessing that virtual volume (for example, a domain name), and the name of the application program using that virtual volume.

[0124] FIG. 11 is an illustrative diagram showing one example of a migration group management table TS. A migration group is a unit used when relocating data, and in the present embodiment, a migration group is constituted by a plurality of mutually related volumes, in such a manner that data can be relocated with respect to a group unit, in a single operation. It is possible to extract a group of mutually related volumes, by searching the corresponding host management table T4 illustrated in FIG. 10.

[0125] The migration group management table T5 may associate, for example, a group number, a group name, the logical ID identifying the volume belonging to that group, and the name of the storage layer to which that group currently belongs. The name of the migration group can be specified freely by the user. In this way, each migration group may be constituted by grouping together volumes storing data groups used by the same application program, or volumes storing data groups forming the same file system. Furthermore, when data relocation has not yet been performed, for instance, immediately after a new migration group has been established, then there may be cases where a storage layer name belonging to the group has not been set.

[0126] FIG. 12 is an illustrative diagram showing one example of an action management table T6. The action management table T6 defines the specific contents of the prescribed information processing or data operation previously established for a storage layer. The action management table T6 may be constituted by associating, for example, an ID for identifying an action, the name of that action, and the script (program) that is to be executed by that action. Therefore, if an action ID is previously set in the storage layer management table T3, then it is possible to execute a required action by searching the action management table T6, using that action ID as a search key.

[0127] For example, in the high-reliability layer, an action ID of “A1” is set. The action ID “A1” refers to a mirroring action, and is related with script for generating a replica of the volume. Consequently, if a migration group is relocated to the high-reliability layer, then a replica of that volume group is generated. Furthermore, in the archive layer, an action ID of “A3” is set. The action ID “A3” refers to data archive processing, and is related with a plurality of scripts required for an archiving process. One of the scripts sets the access attribute to read-only, and the other script creates a replica of the volume group. An ID of “A2” in the action management table T6 permits a once-only write operation, which is known as a WORM (Write Once Read Many). This action ID is related with script for setting the access attribute to read-only.

[0128] FIG. 13 is an illustrative diagram showing a simplified view of the overall operation of data relocation. When data relocation is carried out, the user logs in to the storage management server 60 by means of the management client 50, and specifies the migration group to be relocated, and the storage layer forming the destination, respectively (S1).

[0129] The storage management server 60 selects candidate destination volumes for each of the volumes forming the designated migration group (S2). As described in more detail below, in the process of selecting candidate destination volumes, one volume to which the data in the source volume can be copied is selected from all of the volumes belonging to the storage layer specified as the movement destination.

[0130] The results of the selection of candidate destination volumes by the storage management server 60 are presented to the user, in the form of a volume correspondence table T7, for example (S3). The volume correspondence table T7 may be constituted by associating, for example, a logical ID of a source volume, and a logical ID of a destination volume.

[0131] The user confirms the relocation proposal presented by the storage management server 60 (the volume correspondence table T7), by means of the web browser 51. If the user approves the proposal from storage management server 60, in its presented form, then relocation is executed at a prescribed timing (S5). If the proposal from the storage management server 60 is to be revised, then the user changes the logical ID of the destination volume by means of the web browser 51 (S4).

[0132] FIG. 14 is a flowchart showing processing for selecting destination candidate volumes. This process is initiated, for example, by means of the user explicitly designating a migration group that is to be relocated, and a storage layer forming the relocation destination (movement destination).

[0133] The storage management server 60 (the data relocation management program 632) judges whether or not selection of the destination candidate volumes has been completed, for all of the source volumes (S11). Here, if the judgment result is “NO”, then the procedure advances to S12. By referring to the volume attribute management table T2, the storage management server 60 extracts volumes which have an “empty” use status and which match the essential attributes of the source volumes, from the group of volumes belonging to the storage layer designated as the destination layer (S12).

[0134] An “essential attribute” is an attribute that is required in order to copy data between volumes. If any one essential attribute is not matching, then data cannot be copied between the volumes. In the present embodiment, examples of essential attributes are the storage capacity, and the emulation type, for instance. In other words, in the present embodiment, at the very least, the storage capacity and the emulation type must be matching in the source volume and the destination volume.

[0135] Next, the storage management server 60 judges the number of volumes detected to be empty volumes having the matching essential attributes (S13). If there is only one empty volume having the matching essential attributes, then that volume is selected as the destination candidate volume (S14). If no empty volume matching the essential attributes is discovered at all, then this means that data cannot be relocated, and error processing is executed and a report is sent to the user (S16).

[0136] If a plurality of empty volumes having the matching essential attributes have been detected, then the storage management server 60 selects the volume having the highest degree of matching of the other attributes apart from the essential attributes (non-essential attributes), as the movement candidate volume, (S15). For example, the volume having the highest number of other attributes which are matching, such as the RAID level, disk type, model of storage device, or the like, is selected as a destination candidate volume. It is also possible to calculate the degree of matching by assigning priority rankings to the respective non-essential attributes. Furthermore, if there are a plurality of volumes having the same degree of matching in respect of the non-essential attributes, then the volume having the smallest logical ID may be selected, for example.

[0137] The processing described above is carried out respectively for all of the volumes constituting the migration group that is to be moved. If corresponding destination candidate volumes have been selected respectively for each one of the source volumes (S1: YES); then the storage management server 60 generates a volume correspondence table T7 and presents it to the user (S17).

[0138] The user checks the volume correspondence table T7 presented by the storage management server 60 and decides whether to approve it or to revise it. If the user approves the proposal (S18: YES), then this processing sequence terminates. If the user wishes to make changes (S18: NO), then the user can reset the destination candidate volumes manually, by means of the web browser 51 (S19). When the user has finished revising the settings, the processing sequence terminates.

[0139] FIG. 15 is a flowchart showing an overview of relocation implementation processing. The storage management server 60 (data relocation management program 632) detects the action associated with the storage layer designated as the movement destination, by referring to the storage layer management table T3 (S21).

[0140] Thereupon, the storage management server 60 judges whether or not relocation has been completed for all of the source volumes (S22). In the first processing sequence, the judgment result is “NO” and the process advances to the next step S23. The data stored in the source volume is copied to the destination volume corresponding to that source volume (S23), and the access path is switched from the source volume to the destination volume (S24). This switching of the path follows a similar procedure to the path switching shown in FIG. 3(b). By this means, the host 10 is able to access prescribed data without altering its settings, and without being aware of the fact that the data has been relocated.

[0141] The storage management server 60 judges whether or not the movement of data from the source volume to the destination volume has been completed correctly (S25), and if movement of the data has not been completed correctly (S25: NO), then error processing is carried out and the process terminates.

[0142] If the movement of data has been completed correctly (S25: YES), then the storage management server 60 checks whether or not there exists an action that has been associated with the destination storage layer (S27). If an action has been established for the destination storage layer (S27: YES), then the storage management server 60 refers to the action management table T6, executes the prescribed script (S28), and then returns to S22. If no action has been established for the destination storage layer (S27: NO), then no action is carried out and the sequence returns to S22.

[0143] In this way, the data stored respectively in each of the volumes belonging to the migration group that is to be moved is copied respectively to destination volumes, and the access paths are changed. When data movement has been completed for all of the source volumes (S22: YES), this processing sequence terminates.

[0144] FIG. 16 is an illustrative diagram showing a concrete example of the volume correspondence table T7. The results of the selection of destination candidate volumes by the storage management server 60 can be displayed by arranging the source volumes and the destination volumes in upper and lower rows, as illustrated in FIG. 16, for example. For each of the source volumes and the destination volumes, for example, it is possible to display the corresponding logical ID, the RAID group number to which the volume belongs, the RAID level, the emulation type, and the attributes, such as the storage capacity, and the like.

[0145] The user can determine whether or not data relocation is to be executed by checking the screen illustrated in FIG. 16. In order to change the destination volumes individually, the user operates the modify button B1. When this button B1 is operated, the display changes to the individual revision screen illustrated in FIG. 17.

[0146] In the revision screen illustrated in FIG. 17, the logical ID of the source volume and the emulation type and storage capacity of the source volume can be displayed in the upper portion of the screen.

[0147] The logical ID of the currently selected destination volume, and its RAID group, RAID level, physical ID, the number of the storage device to which it belongs, and the physical ID of the physical volume, and the like, can be displayed in the central portion of the screen.

[0148] In the lower portion of the screen, a list of all of the candidate volumes in the designated layer which match the essential attributes of the source volume can be displayed. The user is able to select any one of the volumes from the volumes displayed in the volume list in the lower portion of the screen. For example, if the results of the initial selections made by the storage management server 60 are concentrated in volumes belonging to a particular RAID group, or if sequentially accessed data and randomly accessed data are located in the same RAID group, then the response characteristics of that RAID group will decline. Therefore, the user is able to revise the destination volumes, individually, in such a manner that the data does not become concentrated in a particular RAID group.

[0149] By adopting the composition described above, the present embodiment has the following beneficial effects. In the present embodiment, a composition is adopted wherein a designated source volume is relocated to a designated storage layer, between a plurality of storage layers respectively generated on the basis of a plurality of previously determined policies and volume attribute information. Therefore, the user can define the storage layers freely, in accordance with a desired policy, and can relocate volumes between the storage layers, thereby improving the usability of the storage system. In particular, in a complex storage system wherein a plurality of storage devices are combined, the user is able to relocate data directly in accordance with policies set by the user himself or herself, without having to consider the detailed characteristics of each policy, or the like.

[0150] In the present embodiment, it is possible to relocate data in units of groups consisting of a plurality of volumes. Therefore, in conjunction with a composition wherein data can be relocated between the aforementioned storage layers, it is possible to improve operability for the user yet further.

[0151] In the present embodiment, it is possible previously to associate prescribed actions with a destination storage layer, and therefore prescribed actions can be implemented after data relocation has been completed. Therefore, it is possible automatically to implement additional services in association with data relocation, and hence situations where the user forgets to carry out certain operations, or the like, can be prevented, and usability can be improved.

[0152] In the present embodiment, the matching of essential attributes is taken as a prerequisite condition for destination volumes, and the volume having the highest degree of matching of attributes other than the essential attributes is selected as the destination candidate volume. Therefore, it is possible to select appropriate volumes for relocating the data.

[0153] A second embodiment of the present invention is now described on the basis of FIG. 18. The following embodiments, including the present embodiment, correspond to modifications of the first embodiment. The characteristic feature of the present embodiment lies in the fact that the volume virtualization device 20 and the storage management server 60 mentioned in the first embodiment are concentrated in a single volume virtualization device 70.

[0154] The volume virtualization device 70 according to the present embodiment comprises a volume virtualization unit 71, a data relocating unit 72 and a volume database 73, for example. The volume virtualization unit 71 realizes similar functions to those of the volume virtualization device 20 according to the first embodiment. The data relocating unit 72 realizes similar functions to those of the data relocation management program 632 of the storage management server 60 in the first embodiment. The volume database 73 stores various tables similar to the volume database 640 of the first embodiment.

[0155] A third embodiment of the present invention is now described on the basis of FIG. 19. The characteristic feature of the present embodiment lies in the fact that dynamic attributes are added to the volume attribute management table T2 and the storage layers can be defined by taking these dynamic attributes into consideration.

[0156] As shown on the right hand side, the response time for data input and output (the I/O response time) can also be managed in the volume attribute management table T2 of the present embodiment. The I/O response time can be updated by means of the storage management server 60 gathering the response time from each of the storage devices 20, 30, 40, at regular intervals or irregular intervals, for example. In FIG. 19, for the sake of space, the I/O response time is shown instead of the storage device type, but the model of the storage device can also be managed as one of the volume attributes. Here, the I/O response time is found by measuring the time period from the issuing of a test I/O until a response to the issued I/O. Furthermore, this I/O response time can be included in the condition formula shown in FIG. 9.

[0157] In this way, in the present embodiment, since dynamic attributes are also managed, in addition to static attributes, such as the RAID level, storage capacity, or the like, it is possible to take both static attributes and dynamic attributes into account when defining the storage layers. For example, a storage layer where it is sought to achieve faster response time can be constituted from volumes established on high-speed disks (FC disks), which are located in a storage device which has the smallest value for I/O response time.

[0158] A fourth embodiment of the present invention is now described on the basis of FIG. 20 and FIG. 21. The characteristic feature of the present embodiment lies in the fact that if there is a change in the composition of the storage system (if a storage device is removed), then the data stored in a storage device relating to that compositional change is automatically relocated to a suitable empty volume.

[0159] FIG. 20 is an illustrative diagram showing a general overview of a storage system according to the present embodiment. In this storage system, a fourth storage device 80 is added to the composition of the first embodiment. The fourth storage device 80 can be composed in the same manner as the storage devices 30 and 40, for example. The fourth storage device 80 is added here in order to simplify the description, and therefore it is not an essential element in the composition of the present invention. The present invention can be implemented satisfactorily, as long as a plurality of storage devices are provided.

[0160] In the present embodiment, an example is described wherein the first storage device 30 is removed. For example, if the usable life of the first storage device 30 has expired, or the like, then the first storage device 30 is scheduled for removal. Here, a case where the data group stored in a storage device 30 scheduled for removal is moved to other storage devices 40, 80 (or to the volume virtualization device 20 forming a third storage device; same applies hereinafter), will be described on the basis of the illustrative diagram in FIG. 21.

[0161] As shown in FIG. 21, firstly, the user supplies a condition formula, whereby the volume attribute management table T2 is searched, a group of volumes having a status of “in use”, which are located on the storage device 30 that is to be removed, are detected, and the user defines a migration group made up of these volumes. In FIG. 21, it is supposed that “device number 1” has been set up in the storage device 30 that is to be removed. In the drawings, a migration group name such as “withdrawn data volumes” is assigned to the volumes having an “in use” status that are located in the storage device 30 to be removed.

[0162] Next, a storage layer is defined based on the condition of “device number is different from device number of storage device to be removed (device number≠1)”. In the diagram, the storage layer name “destination layer” is assigned to the storage layer constituted by the other storage devices 40, 80 apart from the storage device 30 that is to be removed. The user then instructs relocation of the aforementioned migration group “withdrawn data volumes”, taking the storage layer assigned with the name “destination layer” as the destination.

[0163] Thereupon, similarly to the method described in the first embodiment, the data relocation management program 632 respectively selects appropriate volumes from the storage layer designated as the destination, namely “destination layer”, for each of the volumes contained in the migration group “withdrawn data volumes” designated as the source, and it presents the selected volumes to the user.

[0164] In this way, volumes having a value of “empty” for the volume attribute “use status” and matching the essential attributes, or volumes having a value of “empty” for the “use status”, matching the essential attributes and having the highest degree of matching in respect of the non-essential attributes, are selected as suitable destination candidate volumes and presented to the user. If the user approves the assignment of volumes proposed by the data relocation management program 632, then a relocation process is carried out, and all of the data located in the storage device 30 that is to be removed is relocated to suitable volumes in the other storage devices 40 and 80.

[0165] Moreover, in cases where a new storage device is introduced, or where a portion of existing data is moved to a newly added storage device, in order to improve performance balance, the storage layer “new layer” should be defined on the basis of the condition “device number =device number of newly added storage device”, and data relocation should be carried out by specifying this storage layer as a destination. Furthermore, as can be seen in the other embodiments also, in the present embodiment, it is possible for the user to define storage layers himself or herself, to specify a group of related volumes as a migration group, in one operation, and to carry out data relocation in group units.

[0166] The present invention is not limited to the embodiments described above. It is possible for a person skilled in the art to make various additions, modifications, or the like, without departing from the scope of the present invention. For example, the migration group does not have to be constituted by mutually related volumes, and indeed, any volumes may be grouped together to form a group for movement. Furthermore, the storage layers may also be established by using the storage devices as units, namely, a first storage device layer, a second storage device layer, a first storage device and second storage device layer, and the like.

[0167] A fifth embodiment of the present invention is now described on the basis of FIG. 22, FIG. 23 and FIG. 24. The characteristic feature of the present embodiment lies in the fact that if the storage layer designated as the location destination does not have a suitable empty volume to form a destination volume for a particular volume, then a volume satisfying the conditions of the destination volume is automatically created and the particular volume is relocated by using the newly created volume as a destination candidate.

[0168] FIG. 22 is a flowchart showing processing for selecting a destination candidate volume according to the present embodiment. Many of the steps in FIG. 22 are the same as the steps in the destination candidate selection processing illustrated in FIG. 14 relating to the first embodiment. However, different processing is carried out when no empty volume has been discovered as a result of the storage management server 60 executing step (S13) for judging the number of volumes detected to be empty volumes matching the essential attributes. In this case, in the present embodiment, volume creation processing (S31) is implemented and it is attempted to create a volume which belongs to the storage layer indicated as the relocation destination and which has essential attributes matching those of the source volume.

[0169] Next, the storage management server 60 judges whether or not a volume matching the essential attributes has been created successfully (S32), and if it has been created successfully, then the volume thus created is selected as a destination candidate volume (S33). Furthermore, the created volume is registered in the volume attribute management table T2 (S34). If the volume cannot be created, then relocation of the data is not possible, and therefore error processing is implemented and a report is sent to the user (S16).

[0170] FIG. 23 is a flowchart showing a detailed view of the volume creation processing (S31) in FIG. 22.

[0171] In the volume creation processing in FIG. 23, firstly, the storage management server 60 selects one storage device from the volume virtualization device 20 and the group of storage devices connected to the volume virtualization device 20 (S41). Thereupon, it judges whether or not the selected storage device satisfies the storage device requirements relating to the volume that is to be created (S42).

[0172] Here, the storage device requirements indicate conditions, amongst the various conditions that define the storage layer designated as the destination layer, which relate to the attributes of the storage device, such as the model name, serial number, and the like, of the storage device (if specified).

[0173] If the selected storage device satisfies the storage device requirements, then the storage management server 60 determines a set S of VDEVs which satisfy the essential attributes, from amongst all of the VDEVs in the selected storage device (S43). Therefore, one VDEV is selected from the set S (S44).

[0174] Here, the VDEV requirements indicate conditions, of the conditions which define the storage layer designated as the destination layer, which relate to the attributes of the VDEVs, such as disk type, RAID level, or the like, (if specified), and the emulation type of the source volume.

[0175] Next, the storage management server 60 judges whether or not the free unassigned capacity in the selected VDEV is of a size equal to or greater than the capacity (Q1) of the source volume (S45).

[0176] If the free capacity is equal to or greater than the capacity of the source volume, then a new volume (LDEV) having the same capacity as the source volume is created within that VDEV (S46), and the successful creation of the volume is reported back to the calling device.

[0177] In step S45, if it is judged that free capacity equal to or greater than the capacity of the source volume is not available in the selected VDEV, then it is not possible to create a volume forming a destination candidate in that VDEV, and therefore the storage management server 60 judges whether or not there is another VDEV in the set S which has not yet been investigated (S47).

[0178] If there is another VDEV, then the next VDEV is selected (S48), and the procedure returns to step S44. If there is no uninvestigated VDEV left in the set S, and/or it is judged at step S42 that the selected storage device does not satisfy the storage device requirements, then it is not possible to create a volume forming a destination candidate inside that storage device, and therefore, the storage management server 60 judges whether or not there is another storage device that has not yet been investigated (S49).

[0179] If there is another storage device, then the next storage device is selected (S50) and the procedure returns to step S42. If there is no uninvestigated storage device left, then the failure to create a volume is reported to the calling device.

[0180] In this way, in the present embodiment, in addition to selecting a suitable volume as a destination volume from a group of empty volumes present at the time that a data relocation instruction is issued, it is also possible to create a suitable volume forming a destination volume, from unassigned storage capacity, in cases where no suitable empty volume is present. Therefore, more flexible data relocation processing becomes possible.

[0181] When the relocation processing has completed, the source volume which was holding the data before movement may be returned to a reusable state by changing its use status in the volume management table to “empty”, or alternatively, the volume itself may be deleted and returned to form a part of the free capacity of the storage device.

[0182] FIG. 24 is a flowchart showing a further example of the volume creation processing (S31) in FIG. 22. This processing makes it possible to create a destination volume (LDEV) from the empty regions of a plurality of VDEVs.

[0183] In the volume creation processing shown in FIG. 24, firstly, the storage management server 60 selects one storage device from the volume virtualization device 20 and the group of storage devices connected to the volume virtualization device 20 (S41). Thereupon, it judges whether or not the selected storage device satisfies the storage device requirements relating to the volume to be created (S42).

[0184] Here, the storage device requirements indicate conditions, of the conditions that define the storage layer designated as a relocation destination layer, which relate to the attributes of the storage device, such as the model name and serial number of the storage device, and the like (if specified).

[0185] If the selected storage device satisfies the storage device requirements, then the storage management server 60 determines a set S of VDEVs which satisfy the VDEV requirements, from amongst all of the VDEVs in the selected storage device (S43). Thereupon, one VDEV is selected from the set S (S44).

[0186] Here, the VDEV requirements indicate conditions, of the conditions that define the storage layer designated as the destination layer, which relate to the attributes of the VDEVs, such as disk type, RAID level, or the like, (if specified), and the emulation type of the source volume.

[0187] Next, the storage management server 60 judges whether or not the free unassigned capacity in the selected VDEV is of a size equal to or greater than the capacity (Q1) of the source volume (S45).

[0188] If the free capacity is equal to or greater than the capacity of the source volume, then a new volume (LDEV) having the same capacity as the source volume is created within that VDEV (S46), and the successful creation of the volume is reported back to the calling device.

[0189] If, at step S45, there is not free capacity equal to or greater than the capacity of the source volume, then the free capacity (Q2) in that VDEV is secured (S81), and the differential capacity (Q3) between the capacity (Q1) of the source volume and the secured free capacity (Q2) is found (S82). At this point, a capacity equal to or greater than the capacity of the source volume has not yet been secured, and therefore the storage management server 60 judges whether or not there is another VDEV in the set S (S83), and if there is, then the server 60 selects that VDEV and judges whether or not the free unassigned capacity in that VDEV has a size equal to or greater than the differential capacity (Q3) (S84). If the free capacity has a size equal to or greater than the differential capacity (Q3), then a new volume (LDEV) having the same capacity as the source volume is created, using the free capacity in this VDEV and the free capacity secured in the previous VDEV (S85), and the successful creation of a volume is reported to the calling device.

[0190] On the other hand, if the free capacity of the VDEV is not equal to or greater than the differential capacity Q3 at step S84, then the free capacity (Q2) of the VDEV is secured (S86), the remaining differential capacity (Q3) is found (S87), and the procedure then returns to step S83.

[0191] At step S83, if there is no other VDEV in the set S, then it is not possible to ensure the required free capacity in that storage device, and therefore the storage management server 60 releases the free capacity secured up to that point (S88), and then judges whether or not there is another storage device that has not yet been investigated (S49). At step S42, if it is judged that the selected storage device does not satisfy the storage device requirements, then the procedure also moves to step S49.

[0192] At step S49, if there is another storage device, then the next storage device is selected (S50), and the procedure returns to step S42. If there is no uninvestigated storage device left, then the failure to create a volume is reported back to the calling device.

[0193] In this way, if it is not possible to secure the capacity of the source volume in one VDEV, then a volume (LDEV) forming a destination candidate is generated from a plurality of VDEVs having free capacity.

[0194] In step S41 in FIG. 23 and FIG. 24, the storage device is selected, but it is also possible to adopt a composition in which the volume virtualization device manages all of the VDEVs inside the connected storage devices, and hence the selection of the storage device in step S41 is omitted and the VDEVs managed by the volume virtualization device are selected in turn.

[0195] A sixth embodiment of the present invention is now described on the basis of FIG. 25, FIG. 26, FIG. 27, FIG. 28, FIG. 29 and FIG. 30. The characteristic feature of the present invention lies in the fact that, if creation of a replica is included in the actions associated with the storage layer designed as a relocation destination layer, then it is possible to designate any storage layer, including the relocation destination layer, as a destination for creating the replica.

[0196] FIG. 25 is a diagram showing the association between storage layers and actions in the present embodiment. In the present embodiment, if creation of a replica is specified in the script, then the storage layer forming the replica creation destination is designated explicitly, by name. As shown in FIG. 25, the storage layer forming the replica creation destination may be the same as the storage layer designated as the relocation destination layer, or it may be a different storage layer.

[0197] FIG. 26 is a diagram showing the composition of a volume attribute management table T2 in the present embodiment. In the volume attribute management table according to the present embodiment, the use status of a volume may take one of four states: “source”, “replica”, “reserved” and “empty”, rather than just two states: “in use” or “empty”. Furthermore, a new attribute, “pair”, is added.

[0198] The use status “source” indicates that the volume holds user data which is referred to by the volume host. The use status “replica” indicates that the volume holds a replica, which is a duplicate copy of user data. The use status “reserved” indicates that the volume is reserved for future use as a replica. The use status “empty” indicates that the volume is not in either of the three states described above and is available to be allocated as a data movement destination or copy destination.

[0199] If the use status of the volume is any one of “source”, “replica” or “reserved”, then the “pair” attribute of that volume may have a value. If the use status of the volume is “source” and that volume has a replica, then the value of the “pair” attribute indicates the logical ID of the replica volume paired with that volume. (If the volume does not have a replica, then the value of the “pair” attribute is blank.) If the use status of the volume is “replica”, then the value of the “pair” attribute is the logical ID of the source volume paired with that volume. If the use status of the volume is “reserved”, then the “pair” attribute is set to the logical ID of the source volume with which that volume is to be paired in the future.

[0200] FIG. 27 is a flowchart showing a general view of data relocation processing in the present embodiment. In the data relocation processing according to the present embodiment, the user instructs relocation of a migration group to a prescribed layer (S1), movement destination candidate selection processing is performed (S2), a volume correspondence table is presented (S3), and the destination candidates are revised (S4), whereupon, before carrying out relocation execution processing (S5), replica volume reserve processing (S6) is carried out.

[0201] FIG. 28 is a flowchart showing the details of replica volume reservation processing (S6). In the replica volume reservation processing according to the present embodiment, firstly, the storage management server 60 refers to the storage layer management table T3 and the action management table T6, and acquires the actions associated with the storage layer designated as the relocation destination (S61).

[0202] Thereupon, it is judged whether or not creation of a replica is indicated in the acquired actions (S62). If creation of a replica is not indicated, or if there is no action associated with the storage layer forming the relocation destination, then it is not necessary to reserve a replica volume, and hence the process ends.

[0203] If creation of a replica is indicated in the actions, then the storage management server 60 judges whether or not a replica volume has already been reserved, in respect of all of the source volumes (S63).

[0204] Initially, no volume has been reserved, and therefore the procedure advances to the next step, and one replica volume is selected to correspond to one source volume (S64). Here, it is possible to select, as a replica volume, any volume which belongs to the storage layer designated as the replica creation target, which has an “empty” use status, which has not been selected as a movement destination candidate, and which has essential attributes matching those of the source volume.

[0205] Next, the storage management server 60 judges whether or not it has been possible to select a volume of this kind (S65). If it was not possible to select a volume, then this means that it was not possible to secure the volume required for creating a replica, and therefore, error processing is carried out (S67), and a report is sent to the user, Here, it is also possible to create the volume required for creating a replica, by implementing the processing from S31 to S34 in FIG. 22.

[0206] If it was possible to select a volume, then that volume is reserved (S66), the procedure then returns to step S63, and similar processing is carried out until reservation of a replica volume has been completed for all of the source volumes. Here, when a particular volume is reserved, then the use status of that volume is changed to “reserved”, and the logical ID of the corresponding source volume is set in the “pair” attribute of that volume.

[0207] FIG. 29 is a flowchart showing the details of action script execution processing according to the present embodiment. This processing corresponds to step S28 of the relocation execution processing shown in FIG. 15, and it involves copying the storage contents of one source volume to a corresponding destination volume, switching the corresponding access path (logical ID), and then executing the action associated with the relocation destination storage layer, with respect to the destination volume.

[0208] In the action script execution processing shown in FIG. 29, firstly, the storage management server 60 judges whether or not there is an action that has not yet been implemented in respect of the destination volume in question (S71). If there is an unimplemented action, then one unimplemented action is extracted (S72), and the type of action of is identified (S73).

[0209] If the type of action is creation of a replica, then the storage management server 60 refers to the volume management table T2, and acquires a reserved volume that has been reserved in relation to the destination volume (S74). Here, the reserve volume that has been reserved in relation to the destination volume is a volume holding the logical ID of the destination volume as the value of its “pair” attribute.

[0210] Thereupon, the storage management server 60 sets up a pair relationship in the volume virtualization device 20, taking the destination volume to be a primary volume and the reserved volume to be a secondary volume (S75). At the same time, the logical ID of the reserved volume corresponding to the “pair” attribute of the destination volume is set in the volume attribute management table T2, and the use status of the reserved volume is changed to “replica”.

[0211] Next, the storage management server 60 instructs the volume virtualization device 20 to synchronize the volumes set to have a paired relationship in step S75 (S76). By this means, data is copied from the destination volume (primary) to the reserved volume (secondary), and the contents of the two volumes become identical. Furthermore, thereafter, whenever the contents of the primary volume are rewritten, the rewritten portion of data is copied to the secondary volume, and hence the contents of the respective volumes are kept the same at all times.

[0212] After carrying the processing described above, the storage management server 60 returns to step S71 and again judges whether or not there exists an unimplemented action. Furthermore, if it is judged at step S73 that the type of action is an action other than creation of a replica, then the prescribed processing corresponding to the type of action is executed (S77), whereupon the procedure returns, similarly, to step S71.

[0213] At step S71, it is judged that there is no unimplemented action left, then the storage management server 60 terminates the action script execution processing.

[0214] FIG. 30 is a diagram showing one example of the state of the volume attribute management table T2 in the respective layers during the course of the data relocation processing according to the present embodiment. FIG. 30(a) shows an initial state, in which three volumes matching the essential attributes (capacity and emulation type) are registered. Of these, the volume having a logical ID of “001” holds user data, and the volumes having logical IDs of “006” and “007” have an empty state. In this state, the volume having a logical ID of “001” is taken as the movement source and the volume having the logical ID of “006” is taken as the movement destination, and data relocation accompanied by creation of a replica is instructed.

[0215] FIG. 30(b) shows a state where the volume having the logical ID “007” is selected as a reserved volume for a replica, in the replica volume reserve processing (S6). The use status of the volume “007” is “reserved”, and the value “001”, which is the logical ID of the source volume, is set at the “pair” attribute of volume “007”.

[0216] FIG. 30(c) shows a state where the data relocation processing has terminated. After copying data from the source volume to the destination volume, the access paths (logical IDs) of the two volumes are switched, and at this point, the logical ID of the destination volume becomes “001”. The volume having a logical ID of “007” holds a replica of this volume, and the source and replica volumes are referenced to each other by their “pair” attributes.

[0217] In this way, in the present embodiment, if a desired storage layer is previously specified as a replica creation destination in the actions associated with a storage layer, and a data relocation process is then implemented, then in the sequence of data relocation processing, it is possible to create a replica of the moved data, automatically, in another storage layer (or in the same storage layer as the relocation destination layer). Thereby, it is possible to define storage layers in a flexible and highly efficient way, by, for instance, indicating the creation of a replica to a low-cost layer, as part of the definition of a high-reliability layer.