Top
PRIMECLUSTERGlobal Link Services Configuration and AdministrationGuide 4.3Redundant Line Control Function
FUJITSU Software

6.4.2 Active maintenance of NIC

This section describes the PCI Hot Plug for redundant NIC by Redundant line control function.

The target devices for PCI Hot Plug provided by PRIMEQUEST are as follows. The procedures vary depending on the target to be swapped:

For details, see the following manual:

Note that this section describes the operation when swapping IOU using the Dynamic Reconfiguration utility as an example.

Note

Make sure to check the procedure for the PCI Hot Plug in the latest manual before performing active maintenance for NIC.

For what active operation is enabled through PCI Hot Plug in the redundant line control function, see "6.3.2 Active maintenance of NIC."

6.4.2.1 Addition procedure

This section describes the procedure for adding NICs and creating a virtual interface to make the added NICs redundant.

Figure 6.4 Addition of a virtual interface for making the added NICs (ethX, ethY) redundant

For Fast switching mode

  1. Make sure that power to the target device is off.

    Example: When checking the power status of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr stat IOU
    IOU"<slot-number>": online
    IOU"<slot-number>": offline
    IOU"<slot-number>": empty
  2. Add the target device.

    The device needs to be added by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  3. Turn on power to the added device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  4. If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  5. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address (link/ether) of the created interface. To add more NICs, repeat steps 1 to 5.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  6. Perform post-addition processing.

    1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 5 for "HWADDR". In addition, specify "HOTPLUG=no" and "ONBOOT=yes" in the interface setting files of NICs for redundancy.

    ifcfg-ethX

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet

    ifcfg-ethY

    DEVICE=ethY
    BOOTPROTO=static
    HWADDR=YY:YY:YY:YY:YY:YY
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet

    2) Activate the interface of the added NICs.

    # /sbin/ifup ethX
    # /sbin/ifup ethY

    3) If necessary, specify subnet mask information for the virtual interface.

    # /opt/FJSVhanet/usr/sbin/hanetmask create -i network_address -m netmask

    4) Make the virtual interface settings to make the NICs redundant.

    # /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m t -i ipaddress -t ethX,ethY

    5) Activate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/strhanet -n shaX

For NIC switching mode

  1. Make sure that power to the target device is off.

    Example: When checking the power status of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr stat IOU
    IOU"<slot-number>": online
    IOU"<slot-number>": offline
    IOU"<slot-number>": empty 
  2. Add the target device.

    The device needs to be added by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  3. Turn on power to the added device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  4. If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  5. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address (link/ether) of the created interface. To add more NICs, repeat steps 1 to 5.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  6. Perform post-addition processing.

    1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 5 for "HWADDR". In addition, specify " HOTPLUG=no" and "ONBOOT=yes" in the interface setting files of NICs for redundancy.

    ifcfg-ethX (Active interface)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet

    ifcfg-ethY (Standby interface)

    DEVICE=ethY
    BOOTPROTO=static
    HWADDR=YY:YY:YY:YY:YY:YY
    HOTPLUG=no
    ONBOOT=yes
    TYPE=Ethernet 

    2) Activate the interface of the added NICs.

    # /sbin/ifup ethX
    # /sbin/ifup ethY

    3) If necessary, specify subnet mask information for the virtual interface.

    # /opt/FJSVhanet/usr/sbin/hanetmask create -i network_address -m netmask

    4) Make the virtual interface settings to make the NICs redundant.

    # /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m d -i ipaddress1 -e ipaddress2 -t ethX,ethY

    5) Specify HUB monitoring destination information.

    # /opt/FJSVhanet/usr/sbin/hanetpoll create -n shaX -p ipaddr1,ipaddr2

    6) If necessary, set the standby patrol function.

    # /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaY -m p -t shaX

    7) Activate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/strhanet -n shaX

    8) Start HUB monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpoll on

For Virtual NIC mode

  1. Make sure that the power to the target device is off.

    Example: When checking the power status of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr stat IOU
    IOU"<slot-number>": online
    IOU"<slot-number>": offline
    IOU"<slot-number>": empty
  2. Add the target device.

    The device needs to be added by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  3. Turn on power to the added device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  4. If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  5. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address (link/ether) of the created interface. To add more NICs, repeat steps 1 to 5.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  6. Perform post-addition processing.

    1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 5 for "HWADDR". In addition, specify " HOTPLUG=no", "ONBOOT=yes", and "DEVICETYPE=hanet" in the interface setting files of NICs for redundancy.

    ifcfg-ethX (Active interface)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    ONBOOT=yes
    DEVICETYPE=hanet

    ifcfg-ethY (Standby interface)

    DEVICE=ethY
    BOOTPROTO=static
    HWADDR=YY:YY:YY:YY:YY:YY
    HOTPLUG=no
    ONBOOT=yes
    DEVICETYPE=hanet

    2) Activate the interface of the added NICs.

    # /sbin/ifup ethX
    # /sbin/ifup ethY

    3) Make the virtual interface settings to make the NICs redundant.

    # /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m v -t ethX,ethY

    4) Set the IP address or the netmask and so on.

    To make the virtual interface of GLS available, edit the network configuration file for the virtual interface (/etc/sysconfig/network-scripts/ifcfg-shaX) and configure IP addresses and so on.

    ifcfg-shaX

    DEVICE=shaX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    BOOTPROTO=static
    ONBOOT=yes
    DEVICETYPE=sha
    HOTPLUG=no

    5) If necessary, specify HUB monitoring destination information.

    # /opt/FJSVhanet/usr/sbin/hanetpathmon target -n shaX -p ipaddr1,ipaddr2

    6) Activate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/strhanet -n shaX

6.4.2.2 Removal procedure

This section describes the procedure for removing NICs whose virtual interface makes them redundant.

Figure 6.5 Removing NICs whose virtual interface makes them redundant (ethX, ethY)

For Fast switching mode

  1. Prepare for removing a card.

    1) Deactivate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/stphanet -n shaX

    2) Delete the virtual interface configuration information.

    # /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX

    3) If necessary, delete the subnet mask information about the virtual interface.

    # /opt/FJSVhanet/usr/sbin/hanetmask delete -i network_address

    4) Check the slot number on which the target device to be removed is installed.

    5) Deactivate the interface of the NIC to be removed.

    # /sbin/ifdown ethX
    # /sbin/ifdown ethY
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Remove the target device.

    The device needs to be removed by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

    To remove more NICs, repeat steps 2 to 3.

  4. Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).

    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX
    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY

For NIC switching mode

  1. Prepare for removing a card.

    1) Deactivate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/stphanet -n shaX

    2) Stop interface status monitoring.

    # /bin/touch /var/opt/FJSVhanet/tmp/disable_watchif

    3) Stop HUB monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpoll off

    4) Delete the HUB monitoring destination information.

    # /opt/FJSVhanet/usr/sbin/hanetpoll delete -n shaX

    5) Delete the standby patrol function. If the standby patrol function is not used, skip this step.

    # /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaY

    6) Delete the virtual interface configuration information.

    # /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX

    7) If necessary, delete the subnet mask information about the virtual interface.

    # /opt/FJSVhanet/usr/sbin/hanetmask delete -i network_address

    8) Restart HUB monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpoll on

    Information

    If the above commands are executed with no monitoring target has been set, the following error is output.

    In this case, ignore the error and go to the next step.

    hanet: 20802: operation error: configuration is not defined.

    9) Restart interface status monitoring.

    # /bin/rm /var/opt/FJSVhanet/tmp/disable_watchif

    10) Check the slot number on which the target device to be removed is installed.

    11) Deactivate the interface of the NIC to be removed.

    # /sbin/ifdown ethX
    # /sbin/ifdown ethY
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Remove the target device.

    The device needs to be removed by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

    To remove more NICs, repeat steps 2 to 3.

  4. Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).

    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX
    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY

For Virtual NIC mode

  1. Prepare for swapping a card.

    1) Deactivate the virtual interface.

    # /opt/FJSVhanet/usr/sbin/stphanet -n shaX

    Stop monitoring by stphanet if it is running.

    2) Delete the virtual interface configuration information.

    # /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX

    3) Check the slot number on which the target device to be removed is installed.

    4) Deactivate the interface of the NIC to be removed.

    # /sbin/ifdown ethX
    # /sbin/ifdown ethY
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Remove the target device.

    The device needs to be removed by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

    To remove more NICs, repeat steps 2 to 3.

  4. Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).

    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX
    # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY

6.4.2.3 Swapping procedure

This section describes the procedure for swapping a NIC whose virtual interface makes it redundant.

Figure 6.6 Swapping a NIC whose virtual interface makes it redundant (ethX)

For Fast switching mode

  1. Prepare for swapping a card.

    1) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).

    # /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX

    2) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    t   OFF  ethX(CUT),ethY(ON)

    3) Deactivate the interface of the target NIC.

    # /sbin/ifdown ethX

    4) Back up the network configuration file of the interface.

    # cd /etc/sysconfig/network-scripts
    # mkdir temp
    # mv ifcfg-ethX temp
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Swap the target device.

    The device needs to be swapped by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  4. Turn on power to the target device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  5. If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  6. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address (link/ether) of the created interface.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  7. Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 6.

    # cd /etc/sysconfig/network-scripts
    # mv temp/ifcfg-ethX .
    # rmdir temp

    ifcfg-ethX (Swapped NIC)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet
  8. If interface names are switched before and after swapping NICs, turn on the power of the target device again.

    For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  9. Perform post-swap processing.

    1) Activate the interface of the swapped NIC.

    # /sbin/ifup ethX

    2) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.

    # /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX

    3) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "ON".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    t   OFF  ethY(ON),ethX(ON)

For NIC switching mode

  1. Prepare for swapping a card.

    1) Stop HUB monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpoll off

    2) Stop standby patrol monitoring. If the standby patrol function is not used, skip this step.

    # /opt/FJSVhanet/usr/sbin/stpptl -n shaY

    3) Enter the dsphanet command to check the status of the NIC (Interface name: ethX) to be swapped. The NIC must be in a different state from that of an active NIC (the NIC must be in the "OFF" or "STOP" state). If the NIC is active, follow step 4) to switch its state to standby.

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    d   OFF   ethX(ON),ethY(OFF)

    4) If the NIC is an active NIC, switch its state to standby. After the switch, enter the dsphanet command to confirm that the NIC is a standby NIC(OFF).

    # /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX
    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    d   OFF   ethX(OFF),ethY(ON)

    5) Stop interface status monitoring.

    # /bin/touch /var/opt/FJSVhanet/tmp/disable_watchif

    6) Deactivate the interface of the target NIC.

    # /sbin/ifdown ethX

    7) Back up the network configuration file of the interface.

    # cd /etc/sysconfig/network-scripts
    # mkdir temp
    # mv ifcfg-ethX temp
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Swap the target device.

    The device needs to be swapped by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  4. Turn on power to the target device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  5. If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  6. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address(link/ether) of the created interface.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  7. Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 6.

    # cd /etc/sysconfig/network-scripts
    # mv temp/ifcfg-ethX .
    # rmdir temp

    ifcfg-ethX (Swapped NIC)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet
  8. If interface names are switched before and after swapping NICs, turn on the power of the target device again.

    For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  9. Perform post-swap processing.

    1) Set the state of the swapped NIC to that of a standby NIC of GLS.

    The procedure varies depending on whether or not the IP address set to the virtual interface is only an IPv6 address.

    • If an IPv4 address is set to the virtual interface

      Confirm that an IPv4 address is not assigned and the "UP" and "NOARP" flags are set.

      # /usr/sbin/ip link set dev ethX arp off
      # /usr/sbin/ip link set dev ethX up
      # /usr/sbin/ip addr show ethX
      N: ethX: <BROADCAST,MULTICAST, NOARP,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
          link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
          inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
              valid_lft forever preferred_lft forever
    • If an only IPv6 address is set the virtual interface

      Confirm that the "UP" flag is set.

      # /usr/sbin/ip link set dev ethX up
      # /usr/sbin/ip addr show ethX
      N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
          link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
          inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
              valid_lft forever preferred_lft forever

    Information

    If an only IPv6 address is set, when executing the dsphanet command right after executing the above commands, the available state "ON" is displayed for the both devices. This is a temporary state and it does not affect the system because the state will become a proper state by performing the following steps.

    2) If necessary, fail-back the NIC.

    # /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX

    3) Start standby patrol monitoring. If the standby patrol function is not used, skip this step.

    # /opt/FJSVhanet/usr/sbin/strptl -n shaY

    4) Restart HUB monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpoll on

    5) Restart interface status monitoring.

    # /bin/rm /var/opt/FJSVhanet/tmp/disable_watchif

For Virtual NIC mode

  1. Prepare for swapping a card.

    1) Stop network monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpathmon off

    2) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).

    # /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX

    3) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    v   OFF  ethX(CUT),ethY(ON)

    4) Deactivate the interface of the target NIC.

    # /sbin/ifdown ethX

    5) Back up the network configuration file of the interface.

    # cd /etc/sysconfig/network-scripts
    # mkdir temp
    # mv ifcfg-ethX temp
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Swap the target device.

    The device needs to be swapped by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  4. Turn on power to the target device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  5. If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  6. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address(link/ether) of the created interface.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  7. Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 6.

    # cd /etc/sysconfig/network-scripts
    # mv temp/ifcfg-ethX .
    # rmdir temp

    ifcfg-ethX (Swapped NIC)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    ONBOOT=yes
    DEVICETYPE=hanet
  8. If interface names are switched before and after swapping NICs, turn on the power of the target device again.

    For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  9. Perform post-swap processing.

    1) Activate the interface of the swapped NIC.

    # /sbin/ifup ethX

    2) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.

    # /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX

    3) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "OFF".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    v   OFF  ethX(OFF),ethY(ON)

    4) If necessary, fail-back the NIC.

    # /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX -i ethX

    5) Restart network monitoring.

    # /opt/FJSVhanet/usr/sbin/hanetpathmon on 

For GS linkage mode

  1. Prepare for swapping a card.

    1) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).

    # /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX

    2) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    c   OFF  ethX(CUT),ethY(ON)

    3) Deactivate the interface of the target NIC.

    # /sbin/ifdown ethX

    4) Back up the network configuration file of the interface.

    # cd /etc/sysconfig/network-scripts
    # mkdir temp
    # mv ifcfg-ethX temp
  2. Turn off power to the target device.

    The interface (ethX) is deleted when power is turned off.

    Example: When turning off the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr rm IOU"<slot-number>"
  3. Swap the target device.

    The device needs to be swapped by MMB. For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  4. Turn on power to the target device.

    Example: When turning on the power of IOU using the Dynamic Reconfiguration utility

    # /opt/FJSVdr-util/sbin/dr add IOU"<slot-number>"
  5. If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.

    # /usr/sbin/ip link set dev ethX down
  6. Check the hardware address.

    The interface (ethX) is created for the added NIC when power is turned on. Execute the ip(8) command to check the hardware address (link/ether) of the created interface.

    # /usr/sbin/ip addr show
    N: ethX: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
        link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
        inet XXX.XXX.XXX.XXX/24 brd XXX.XXX.XXX.XXX scope global ethX
            valid_lft forever preferred_lft forever
        inet6 fe80::XXXXXXXXXXXXXXXX/64 scope link
            valid_lft forever preferred_lft forever
  7. Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 6.

    # cd /etc/sysconfig/network-scripts
    # mv temp/ifcfg-ethX .
    # rmdir temp

    ifcfg-ethX (Swapped NIC)

    DEVICE=ethX
    BOOTPROTO=static
    HWADDR=XX:XX:XX:XX:XX:XX
    HOTPLUG=no
    BROADCAST=XXX.XXX.XXX.XXX
    IPADDR=XXX.XXX.XXX.XXX
    NETMASK=XXX.XXX.XXX.XXX
    NETWORK=XXX.XXX.XXX.XXX
    ONBOOT=yes
    TYPE=Ethernet
  8. If interface names are switched before and after swapping NICs, turn on the power of the target device again.

    For details, see the following manual:

    • PRIMEQUEST 2000 Series

      "PCI Card Hot Maintenance in Red Hat Enterprise Linux 7" in "PRIMEQUEST 2000 Series Administration Manual"

  9. Perform post-swap processing.

    1) Activate the interface of the swapped NIC.

    # /sbin/ifup ethX

    2) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.

    # /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX

    3) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "ON".

    # /opt/FJSVhanet/usr/sbin/dsphanet
    [IPv4,Patrol / Virtual NIC]
     Name       Status   Mode CL  Device
    +----------+--------+----+----+------------------------------------------------+
     shaX       Active    c   OFF  ethY(ON),ethX(ON)