Top
ServerView Resource Orchestrator Cloud Edition V3.4.0 DR Option Instruction
FUJITSU Software

4.1 Normal Operation

This section explains operations that need to be performed in order to be able to perform disaster recovery switchover.

Notes on Setting of Resources

When creating resources, there are restrictions on the setting of resource names, etc.

For details, refer to the following:

Advisory Notes when Modifying System Configurations

When performing the operations described in the following table, update the definition information by checking the references.

When not limiting switchover scope, all resources on the site are the targets of switchover.

Table 4.1 Operations Requiring Definition Information Update
Operation Reference
  • Creating and deleting L-Platforms
  • Creating and deleting L-Servers
  • Creating and deleting tenants
  • Creating, deleting, and migrating VM pools
  • Modifying VM pool names
  • Adding and deleting VM hosts

    If the switchover destination site is one on which VM hosts have been added or deleted, it is necessary to update the definition information on the switchover source site when performing virtual L-Server switchover (VM guest).

  • "4. Create a VM pool definition file [Virtual L-Server switchover (VM guest)]" in "1. Create the mapping definitions of physical servers [Physical L-Server switchover (physical OS), Physical/Virtual L-Server switchover (VM host/VM guest)]" in "3.6 Creating Files Used for Switchover".
  • Creating, deleting, and migrating storage pools
  • Modifying storage pool names
  • Updating the management information of VM management software

Modifying IP addresses or login passwords, etc.

  • Modifying DR switchover targets (L-Servers, storage)
  • Modifying replication target LUNs
  • Modifying the replication configuration

Modification of IP addresses of the storage used or the replication software, etc.

  • "Required Option Setting Information for the rcxrepdef Command" in "B.1 rcxmgrexport"

Collecting Switchover Information

If updating is performed, such as resource configuration information to do with an L-Platform deployment, or patches are applied to ROR managers, perform the following to collect the information for Disaster Recovery switchover. Collect information either automatically or periodically to ensure the latest configuration information is available.

  1. Export the Required Information from the Switchover Source Site
    1. Export the Required Information

      As a backup in case of failure of the switchover source site, and where an environment that can be used for recovery has been constructed, export the information as explained below. The information can be automatically collected by configuring the settings. For how to configure the automatic collection settings, refer to "3.7 Configuring Automatic Collection of Switchover Information".

      • L-Platform Templates
      • L-Platform Configuration Information
      • Resource Information
      • Role Information
      • Execution Information of Sample Scripts
      • Accounting information
      • Metering Logs
      • Usage Charges
      • Configuration File Information

      One of the following operations is recommended.

      • When changing the configurations of managed servers, export the information first, and maintain the latest system information
      • Export regularly, and update the data

      Execute the command shown below to collect the information.

      [Windows Manager]

      >Installation_folder\SVROR\Manager\bin\rcxmgrexport<RETURN>

      [Linux Manager]

      # /opt/FJSVrcvmr/bin/rcxmgrexport <RETURN>

      Information

      The following configuration files are collected by executing the rcxmgrexport command. These configuration files can be referred to when making the content of the configuration file for the switchover destination file the same as the one for the switchover source site, during switchover.

      These configuration files are output to the following switchover information storage folder:

      [Windows Manager]

      Switchover information storage folder\ManagerExport\CONFIG_FILEDate Exported

      [Linux Manager]

      Switchover information storage directory/ManagerExport/CONFIG_FILEDate Exported

      For details on the switchover information storage folder, refer to "3.2 Creating Switchover Information Storage Folders".

      For details on the rcxmgrexport command, refer to "B.1 rcxmgrexport".

    2. Export Network Configuration Information

      When you change the target network device configuration, keep the latest system configuration by exporting the information.

      Execute the command shown below to collect the information.

      [Windows Manager]

      >Installation_folder\SVROR\Manager\bin\rcxadm netconfig export -file switchover_information_storage_folder\OtherBackupfiles\networkconfiginfo.xml <RETURN>

      [Linux Manager]

      # /opt/FJSVrcvmr/bin/rcxadm netconfig export -file Switchover_installation_folder/OtherBackupfiles/networkconfiginfo.xml <RETURN>

      Specify the XML file of the output destination used as the -file option argument so that it will be stored in switchover_information_storage_folder\OtherBackupFiles.

      For details on the rcxadm netconfig command, refer to "3.7 rcxadm netconfig" in the "Reference Guide (Command/XML) CE".

      Note

      • Operations such as L-Platform deployment, cancellation, or configuration modifications that change various information must not be performed during the export of information.
      • If the accounting setting is on, it is recommended to export switchover information every day.

      This ensures the exported information of the switchover source site will be updated with the newest information.

      • When using VMware as the server virtualization software, note the following regarding execution of rcxmgrexport:
        • Do not execute rcxmgrexport immediately after performing any operations that move the files of the virtual machines (e.g. VM migration involving changes of datastores, storage vMotion). Be sure to execute rcxmgrexport after the information is reflected on ROR by a regular update.
        • When a virtual machine is moving a VM host (e.g. vMotion), do not execute rcxmgrexport. Execute rcxmgrexport after such operations are completed.
  2. Confirm Switchover Scope

    Perform this procedure when configuring the limitations of switchover scopes.

    After executing rcxmgrexport, execute the following commands to confirm that the switchover scope is correct.

    rcxmgrexport -drlist : Displays the list of the resources that are switchover targets.

    rcxmgrexport -drlist -error : Displays the list of resources which use both targeted storage and non-targeted storage for Disaster Recovery, and therefore cannot be switched over.

    Example

    > rcxmgrexport -drlist
    TYPE NAME
    ---- ----
    L-Server /tenant_1/l-server_1
    Image /image_1
    Image /image_2
    > rcxmgrexport -drlist -error
    TYPE NAME
    ---- ----
    L-Server /tenant_1/l-server_1

    For details on the rcxmgrexport command refer to "B.1 rcxmgrexport".

    If the displayed switchover targets are not appropriate, check if the limitation of switchover scope is correctly configured. For details on how to configure limitation of switchover scope, refer to "3.5 Configuring for Limiting Switchover Scope".

  3. Obtain the Storage Replication Information

    Create a replication definition file describing the relationship of LUNs in the switchover source and destination sites when replicating storage units.

    When "3.7 Configuring Automatic Collection of Switchover Information" is performed, this operation is not necessary, because the information is collected automatically.

    Create a replication definition file that describes LUN relations.

    When using dynamic LUN mirroring storage of ETERNUS, as the target LUNs to be replicated are changed by the deployment or cancellation of L-Platforms, and the addition or removal of disks, create the replication definition file using the rcxrepdef command.

    When using a LUN that was created in advance, if the replication definition is created, modified, or deleted by the storage management software, create a replication definition file using the rcxrepdef command.

    For configurations where LUNs connected with L-Servers are not replicated (Configuration example: The LUN connected with an L-Server is copied to another LUN using One Point Copy for replication), the rcxrepdef command cannot be used. Create replication definition files manually.

    For details on replication definition files, refer to "Replication Definition Files" in "18.1.3 High Availability for Storage Chassis" in the "Operation Guide CE".

    Example

    [Windows Manager]

    >Installation_folder\SVROR\Manager\bin\rcxrepdef ccm -local 192.168.0.X -remote 192.168.0.Y -file file1 <RETURN>

    [Linux Manager]

    # /opt/FJSVrcvmr/bin/rcxrepdef ccm -local 192.168.0.X -remote 192.168.0.Y -file file1 <RETURN>

    After creating the replication definition file, specify it and create the file to perform mapping of LUNs in the switchover destination site resources from the relation lists during import.

    To create this file, execute the rcxstorage command with the -recovery, -mode, and -outfile options specified. Specify "prepare" for the -mode option, and switchover_information_storage_folder\storage_file for the -outfile option.

    For details on the switchover information storage folder, refer to "3.2 Creating Switchover Information Storage Folders".

    Example

    [Windows Manager]

    >Installation_folder\SVROR\Manager\bin\rcxstorage -recovery -mode prepare -file file1 -outfile D:\Export\storage_file <RETURN>

    [Linux Manager]

    # /opt/FJSVrcvmr/bin/rcxstorage -recovery -mode prepare -file file1 -outfile /DRExport/Export/storage_file <RETURN>

    For details on replication definition files, refer to "Replication Definition Files" in "18.1.3 High Availability for Storage Chassis" in the "Operation Guide CE".

    For details on the rcxrepdef command, refer to "5.22 rcxrepdef" in the "Reference Guide (Command/XML) CE".

    For details on the rcxstorage command, refer to "5.23 rcxstorage" in the "Reference Guide (Command/XML) CE".

  4. Back Up Directory Service Information (When Using Single Sign-On Authentication)

    When using Single Sign-On authentication, back up the directory service information. Back up the information, after performing operations such as registration, modification, or deletion of a user. For the backup procedure, refer to the manual for the directory service product being used.

  5. Back Up VM Management Software Information

    When not configuring VM management software on a physical L-Server using the physical/virtual L-Server switchover (VM host/VM guest) method, it is necessary to restore the VM management software information during switchover. Therefore, back up the VM management software information as well. For details on how to back up and restore VM management software information, refer to the manual of each VM management software. It is necessary to collect the VM management software information when registering, modifying, or deleting an L-Platform on which a virtual L-Server is deployed.

  6. Back Up Firewall Configurations

    When configuring a firewall automatically using the auto-configuration function for network devices, it is recommended to use the network device configuration backup command or the management software configuration backup function, and operate as follows:

    1. After configuring auto-configuration of the firewall, back up the configuration automatically and collect the newest configuration.

      To enable this function, refer to "9.4.8.2 When Using the Network Device File Management Function" in the "Design Guide CE" for required settings.

      For details on auto-configuration function of the network devices, refer to "2.2.7.4 Network Device Automatic Configuration" in the "Design Guide CE".

    2. Back up firewall configurations regularly.

      When backing up a firewall configuration regularly, the -event option of the rcxmgrexport command must be disabled.

      Collect the firewall configuration immediately after executing the rcxmgrexport command, which exports configuration information of Resource Orchestrator, to synchronize the timing of backup of network device configuration files.

      Use the rcxadm netdevice cfbackup command for the backup of network device configuration files.

      For details on the rcxadm netdevice command, refer to "3.8 rcxadm netdevice" in the "Reference Guide (Command/XML) CE".

      When not using the auto-configuration function of network devices, it is recommended to perform the operation in step b.

  7. Customize Roles

    Do not create a role using the same name as that of a role copied from the basic role, on different sites.

    If the basic role or a role restored by DR switchover is modified on one site, perform the same modification on the other site as well.

    For details on how to customize roles, refer to "5.1.3 Customizing Roles" in the "Design Guide CE".

  8. Transfer the Switchover Information Storage Folder

    When manually copying the switchover information storage folder, transfer the switchover information storage folder to the Resource Orchestrator manager on the switchover destination site.

    Transfer the folder regularly, or when the configuration is changed.

    The transfer destination is the folder specified in #rcxrecovery_define in the DR definition file (fa_dr.rcxprop) in "3.3 Manager Installation and Configuration".

    Example

    [Windows Manager]

    Transfer the folder in D:\Export of the Resource Orchestrator manager on the switchover source site to the E:\Export folder of the Resource Orchestrator manager on the switchover destination site.

    [Linux Manager]

    Transfer the directory in /DRExport/Export of the Resource Orchestrator manager on the switchover source site to the /DRImport/Export directory of the Resource Orchestrator manager on the switchover destination site.

Checking Using the DR Configuration Check Tool

Check whether the settings of the created Disaster Recovery environment are complete using the DR configuration check tool through the procedure below.

Information

After setting up the DR environment or when the resource configuration is changed for reasons such as addition of network resources or L-Platform deployment, execute the DR configuration check tool again.

  1. Execute the following commands on the switchover destination site to collect information for the DR configuration check tool of the switchover destination site.

    [Windows Manager]

    >Installation_folder\SVROR\Manager\bin\rcxdrcheck -mode prepare <RETURN>

    [Linux Manager]

    # /opt/FJSVrcvmr/bin/rcxdrcheck -mode prepare <RETURN>

    The command execution results are stored in the folder specified using "rcxdrcheck_prepare_define" in the DR configuration check tool definition file.

    For details, refer to "B.6 rcxdrcheck".

    Note

    Check that the folder specified using "rcxdrcheck_prepare_define" in the DR configuration check tool definition file is empty before executing the command for collecting information for the DR configuration check tool.

  2. Copy the collected information for the DR configuration check tool on the switchover destination site to the switchover source site. Store the copy in the folder specified using "rcxdrcheck_check_define" in the DR configuration check tool definition file.

    For details, refer to "B.6 rcxdrcheck".

  3. Execute the following commands on the switchover source site to run the DR configuration check tool.
    • For Site Switchover

      [Windows Manager]

      >Installation_folder\SVROR\Manager\bin\rcxdrcheck -mode check <RETURN>

      [Linux Manager]

      # /opt/FJSVrcvmr/bin/rcxdrcheck -mode check <RETURN>
    • For Tenant Switchover (tenant1, tenant2)

      [Windows Manager]

      >Installation_folder\SVROR\Manager\bin\rcxdrcheck -mode check -tenant tenant1,tenant2 <RETURN>

      [Linux Manager]

      # /opt/FJSVrcvmr/bin/rcxdrcheck -mode check -tenant tenant1,tenant2 <RETURN>

    For details, refer to "B.6 rcxdrcheck".

    When DR_switchover_method has not been set in the definition file for the DR configuration check tool, the following message is displayed.

    Please select the DR switchover method.

    <DR Switchover Method>

    1:Physical L-Server switchover

    2:Physical/Virtual L-Server switchover

    3:Virtual L-Server switchover

    4:both Physical L-Server switchover and Physical/Virtual L-Server switchover

    5:both Physical L-Server switchover and Virtual L-Server switchover

    =>

    Enter the number of the desired switchover method to continue the command.

    When DR_operation_method has not been set in the definition file for the DR configuration check tool, the following message is displayed.

    Please select the type of DR operation method.

    <DR Operation Method>

    1:Active-Active

    2:Active-Standby

    =>

    Enter the number of the desired DR switchover operation method to continue the command.

  4. After execution of the DR configuration check tool is completed, the result is output as follows.

    [Windows Manager]

    Stored in the %temp%drcheckresult-YYYY-MM-DD-hhmmss.txt file. YYYY-MM-DD-hhmmss indicates the check completion time.

    Check results are automatically displayed using a text editor.

    [Linux Manager]

  5. Check results are written to the standard output.
    • Confirm that the check results are neither "WARNING" nor "ERROR".

    If an item determined to be an "ERROR" exists, remove the cause of the error. Then execute the DR configuration check tool again to confirm the item does not appear again. Repeat these steps until all "ERROR" items no longer appear.

    If an item determined to be a "WARNING" exists, check the content and remove the cause of the "WARNING" as necessary.

    For details, refer to "C.3 Error Messages Regarding rcxdrcheck".

Collecting Additional Recovery Information

When additional recovery is planned, copy all information in the switchover information storage folder into the additional recovery information storage folder. However, it is not necessary to copy the Image folder under the switchover information storage folder or the images of physical servers stored in the Image folder.

For the VM pool definition file (vm_pool.csv) and the mapping definition file of the physical server name or the VM management software name in the MAP folder, modify the section in which the switchover destination site information is described to the information of the switchover source site.

Place the configuration information that includes resources that will be recovered through additional recovery (i.e. resources removed by the function of switchover scope limitation) in the additional recovery information folder.

For details on the switchover information storage folder, refer to "3.2 Creating Switchover Information Storage Folders".

For additional recovery, refer to "2.4 Limitation of switchover scope and additional recovery".

For details on how to specify additional recovery information folders, refer to "3.3 Manager Installation and Configuration".