This section describes the PCI Hot Plug for redundant NIC by Redundant line control function.
For the outline and the procedure for setting up PCI Hot Plug provided by PRIMEQUEST, see the following manuals:
PRIMEQUEST 1000 Series
PRIMEQUEST 1000 Series Administration Manual
PRIMEQUEST 2000 Series
PRIMEQUEST 2000 Series Administration Manual
Note
Make sure to check the procedure for the PCI Hot Plug in the latest manual before performing active maintenance for NIC.
The following table shows what active operation is enabled through PCI Hot Plug.
Mode | System configuration | PCI Hot Plug | ||
|---|---|---|---|---|
Add | Remove | Swap | ||
Fast switching mode | Single system | A | A | A |
Cluster system | B (*1) | B (*2) | A | |
NIC switching mode | Single system | A | A | A |
Cluster system | B (*1) | B (*2) | A | |
Virtual NIC mode | Single system | A | A | A |
Cluster system | B (*1) | B (*2) | A | |
GS linkage mode | Single system | N | N | A |
Cluster system | N | N | A | |
[Meaning of the symbols]
A: Active maintenance is enabled when GLS is running
B: Active maintenance is enabled when GLS is stopped
N: Not supported
Add NIC.
For details, see the following manuals.
PRIMEQUEST 1000 Series
PRIMEQUEST 1000 Series Administration Manual
PRIMEQUEST 2000 Series
PRIMEQUEST 2000 Series Administration Manual
Add the configuration for virtual interfaces.
For details, see "5.2.1 Adding configuration".
Delete virtual interfaces.
For details, see "5.2.3 Deleting configuration".
Delete NIC.
For details, see the following manuals.
PRIMEQUEST 1000 Series
PRIMEQUEST 1000 Series Administration Manual
PRIMEQUEST 2000 Series
PRIMEQUEST 2000 Series Administration Manual
This section describes the procedure for adding NICs and creating a virtual interface to make the added NICs redundant.
Figure 6.1 Addition of a virtual interface for making the added NICs (ethX,ethY) redundant
For Fast switching mode
Make sure that power to the target PCI slot is off.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# cat /sys/bus/pci/slots/"<slot-number>"/power 0
Add a NIC to the PCI slot.
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
Check that the entry information related to the NIC after addition is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check the hardware address.
The interface (ethX) is created for the added NIC when power is turned on. Execute the ifconfig (8) command to check the hardware address (HWaddr) of the created interface. To add more NICs, repeat steps 1 to 6.
Perform post-addition processing.
1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 6 for "HWADDR". In addition, specify "HOTPLUG=no" and "ONBOOT=yes" in the interface setting files of NICs for redundancy.
ifcfg-ethX
DEVICE=ethX BOOTPROTO=static HWADDR=XX:XX:XX:XX:XX:XX HOTPLUG=no BROADCAST=XXX.XXX.XXX.XXX IPADDR=XXX.XXX.XXX.XXX NETMASK=XXX.XXX.XXX.XXX NETWORK=XXX.XXX.XXX.XXX ONBOOT=yes TYPE=Ethernet
ifcfg-ethY
DEVICE=ethY BOOTPROTO=static HWADDR=YY:YY:YY:YY:YY:YY HOTPLUG=no BROADCAST=XXX.XXX.XXX.XXX IPADDR=XXX.XXX.XXX.XXX NETMASK=XXX.XXX.XXX.XXX NETWORK=XXX.XXX.XXX.XXX ONBOOT=yes TYPE=Ethernet
2) Activate the interface of the added NICs.
# /sbin/ifup ethX # /sbin/ifup ethY
3) If necessary, specify subnet mask information for the virtual interface.
# /opt/FJSVhanet/usr/sbin/hanetmask create -i network_address -m netmask
4) Make the virtual interface settings to make the NICs redundant.
# /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m t -i ipaddress -t ethX,ethY
5) Activate the virtual interface.
# /opt/FJSVhanet/usr/sbin/strhanet -n shaX
For NIC switching mode
Make sure that power to the target PCI slot is off.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# cat /sys/bus/pci/slots/"<slot-number>"/power 0
Add a NIC to the PCI slot.
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
Check that the entry information related to the NIC after addition is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check the hardware address.
The interface (ethX) is created for the added NIC when power is turned on. Execute the ifconfig (8) command to check the hardware address (HWaddr) of the created interface. To add more NICs, repeat steps 1 to 6.
Perform post-addition processing.
1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 6 for "HWADDR". In addition, specify "HOTPLUG=no" and "ONBOOT=yes" in the interface setting files of NICs for redundancy.
ifcfg-ethX (Active interface)
DEVICE=ethX BOOTPROTO=static HWADDR=XX:XX:XX:XX:XX:XX HOTPLUG=no BROADCAST=XXX.XXX.XXX.XXX IPADDR=XXX.XXX.XXX.XXX NETMASK=XXX.XXX.XXX.XXX NETWORK=XXX.XXX.XXX.XXX ONBOOT=yes TYPE=Ethernet
ifcfg-ethY (Standby interface)
DEVICE=ethY BOOTPROTO=static HWADDR=YY:YY:YY:YY:YY:YY HOTPLUG=no ONBOOT=yes TYPE=Ethernet
2) Activate the interface of the added NICs.
# /sbin/ifup ethX # /sbin/ifup ethY
3) If necessary, specify subnet mask information for the virtual interface.
# /opt/FJSVhanet/usr/sbin/hanetmask create -i network_address -m netmask
4) Make the virtual interface settings to make the NICs redundant.
# /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m d -i ipaddress1 -e ipaddress2 -t ethX,ethY
5) Specify HUB monitoring destination information.
# /opt/FJSVhanet/usr/sbin/hanetpoll create -n shaX -p ipaddr1,ipaddr2
6) If necessary, set the standby patrol function.
# /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaY -m p -t shaX
7) Activate the virtual interface.
# /opt/FJSVhanet/usr/sbin/strhanet -n shaX
8) Start HUB monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpoll on
For Virtual NIC mode
Make sure that power to the target PCI slot is off.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# cat /sys/bus/pci/slots/"<slot-number>"/power 0
Add a NIC to the PCI slot.
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
Check that the entry information related to the NIC after addition is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If the interface (ethX) for the added NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check the hardware address.
The interface (ethX) is created for the added NIC when power is turned on. Execute the ifconfig (8) command to check the hardware address (HWaddr) of the created interface. To add more NICs, repeat steps 1 to 6.
Perform post-addition processing.
1) The added NICs must be activated at system startup. For this purpose, make the settings shown below in each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>). Specify the hardware address that was checked in step 6 for "HWADDR". In addition, specify "HOTPLUG=no", "ONBOOT=yes", and "DEVICETYPE=hanet" in the interface setting files of NICs for redundancy.
ifcfg-ethX (Active interface)
DEVICE=ethX BOOTPROTO=static HWADDR=XX:XX:XX:XX:XX:XX HOTPLUG=no ONBOOT=yes DEVICETYPE=hanet
ifcfg-ethY (Standby interface)
DEVICE=ethY BOOTPROTO=static HWADDR=YY:YY:YY:YY:YY:YY HOTPLUG=no ONBOOT=yes DEVICETYPE=hanet
2) Activate the interface of the added NICs.
# /sbin/ifup ethX # /sbin/ifup ethY
3) Make the virtual interface settings to make the NICs redundant.
# /opt/FJSVhanet/usr/sbin/hanetconfig create -n shaX -m v -t ethX,ethY
4) Set the IP address or the netmask and so on.
To make the virtual interface of GLS available, edit the network configuration file for the virtual interface (/etc/sysconfig/network-scripts/ifcfg-shaX) and configure IP addresses and so on.
ifcfg-shaX
DEVICE=shaX IPADDR=XXX.XXX.XXX.XXX NETMASK=XXX.XXX.XXX.XXX BOOTPROTO=static ONBOOT=yes DEVICETYPE=sha HOTPLUG=no
5) If necessary, specify HUB monitoring destination information.
# /opt/FJSVhanet/usr/sbin/hanetpathmon target -n shaX -p ipaddr1,ipaddr2
6) Activate the virtual interface.
# /opt/FJSVhanet/usr/sbin/strhanet -n shaX
This section describes the procedure for removing NICs whose virtual interface makes them redundant.
Figure 6.2 Removing NICs whose virtual interface makes them redundant (ethX, ethY)
For Fast switching mode
Prepare for removing a card.
1) Deactivate the virtual interface.
# /opt/FJSVhanet/usr/sbin/stphanet -n shaX
2) Delete the virtual interface configuration information.
# /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX
3) If necessary, delete the subnet mask information about the virtual interface.
# /opt/FJSVhanet/usr/sbin/hanetmask delete -i network_address
4) Check the slot number of the PCI slot on which the NIC to be removed is installed.
5) Deactivate the interface of the NIC to be removed.
# /sbin/ifdown ethX # /sbin/ifdown ethY
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Remove the NIC from the PCI slot.
To remove more NICs, repeat steps 2 to 3.
Perform post-removal processing.
1) Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).
# /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY
2) Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX" # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="YY:YY:YY:YY:YY:YY", ATTR{type}=="1", KERNEL=="eth*", NAME="ethY
3) Update udev with the edited rule.
When loading the rule defined in the rule file at startup, udevd holds it in the memory and the rule is not updated by only changing the rule file. Then update udev with the new rule.
# udevadm control --reload-rules
For NIC switching mode
Prepare for removing a card.
1) Deactivate the virtual interface
# /opt/FJSVhanet/usr/sbin/stphanet -n shaX
2) Stop interface status monitoring.
# /bin/touch /var/opt/FJSVhanet/tmp/disable_watchif
3) Stop HUB monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpoll off
4) Delete the HUB monitoring destination information.
# /opt/FJSVhanet/usr/sbin/hanetpoll delete -n shaX
5) Delete the standby patrol function. If the standby patrol function is not used, skip this step.
# /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaY
6) Delete the virtual interface configuration information.
# /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX
7) If necessary, delete the subnet mask information about the virtual interface.
# /opt/FJSVhanet/usr/sbin/hanetmask delete -i network_address
8) Restart HUB monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpoll on
Information
If the above commands are executed with no monitoring target has been set, the following error is output.
In this case, ignore the error and go to the next step.
hanet: 20802: operation error: configuration is not defined.
9) Restart interface status monitoring.
# /bin/rm /var/opt/FJSVhanet/tmp/disable_watchif
10) Check the slot number of the PCI slot on which the NIC to be removed is installed.
11) Deactivate the interface of the NIC to be removed.
# /sbin/ifdown ethX # /sbin/ifdown ethY
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Remove the NIC from the PCI slot.
To remove more NICs, repeat steps 2 to 3.
Perform post-removal processing.
1) Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).
# /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY
2) Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX" # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="YY:YY:YY:YY:YY:YY", ATTR{type}=="1", KERNEL=="eth*", NAME="ethY"
3) Update udev with the edited rule.
When loading the rule defined in the rule file at startup, udevd holds it in the memory and the rule is not updated by only changing the rule file. Then update udev with the new rule.
# udevadm control --reload-rules
For Virtual NIC mode
Prepare for removing a card.
1) Deactivate the virtual interface.
# /opt/FJSVhanet/usr/sbin/stphanet -n shaX
Stop monitoring by stphanet if it is running.
2) Delete the virtual interface configuration information.
# /opt/FJSVhanet/usr/sbin/hanetconfig delete -n shaX
3) Check the slot number of the PCI slot on which the NIC to be removed is installed.
4) Deactivate the interface of the NIC to be removed.
# /sbin/ifdown ethX # /sbin/ifdown ethY
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Remove the NIC from the PCI slot.
To remove more NICs, repeat steps 2 to 3.
Perform post-removal processing.
1) Delete each interface setting file (/etc/sysconfig/network-scripts/ifcfg-eth<x>).
# /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethX # /bin/rm /etc/sysconfig/network-scripts/ifcfg-ethY
2) Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX" # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="YY:YY:YY:YY:YY:YY", ATTR{type}=="1", KERNEL=="eth*", NAME="ethY"
3) Update udev with the edited rule.
When loading the rule defined in the rule file at startup, udevd holds it in the memory and the rule is not updated by only changing the rule file. Then update udev with the new rule.
# udevadm control --reload-rules
This section describes the procedure for swapping a NIC whose virtual interface makes it redundant.
Figure 6.3 Swapping a NIC whose virtual interface makes it redundant (ethX)
For Fast switching mode
Prepare for swapping a card.
1) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).
# /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX
2) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active t OFF ethX(CUT),ethY(ON)3) Deactivate the interface of the target NIC.
# /sbin/ifdown ethX
4) Back up the network configuration file of the interface.
# cd /etc/sysconfig/network-scripts # mkdir temp # mv ifcfg-ethX temp
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Swap the NIC in the PCI slot.
Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check that the entry information related to the NIC after swap is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="ZZ:ZZ:ZZ:ZZ:ZZ:ZZ", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If interface names are switched before and after swapping NICs, turn off the power of the PCI slot. Then edit the interface name in the rule file for udev function and turn on the power of the PCI slot again. For details, see the following manuals:
PRIMEQUEST 1000 Series
"Network card replacement procedure" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"Network card replacement procedure" in "PRIMEQUEST 2000 Series Administration Manual"
Check the hardware address.
Check that the hardware address (HWaddr) of the created interface on the swapped NIC from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
Perform post-swap processing.
1) Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 9.
# cd /etc/sysconfig/network-scripts # mv temp/ifcfg-ethX . # rmdir temp
ifcfg-ethX (Swapped NIC)
DEVICE=ethX
BOOTPROTO=static
HWADDR=ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
HOTPLUG=no
BROADCAST=XXX.XXX.XXX.XXX
IPADDR=XXX.XXX.XXX.XXX
NETMASK=XXX.XXX.XXX.XXX
NETWORK=XXX.XXX.XXX.XXX
ONBOOT=yes
TYPE=Ethernet2) Activate the interface of the swapped NIC.
# /sbin/ifup ethX
3) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.
# /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX
4) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "ON".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active t OFF ethY(ON),ethX(ON)For NIC switching mode
Prepare for swapping a card.
1) Stop HUB monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpoll off
2) Stop standby patrol monitoring. If the standby patrol function is not used, skip this step.
# /opt/FJSVhanet/usr/sbin/stpptl -n shaY
3) Enter the dsphanet command to check the status of the NIC (Interface name: ethX) to be swapped. The NIC must be in a different state from that of an active NIC (the NIC must be in the "OFF" or "STOP" state). If the NIC is active, follow step 4) to switch its state to standby.
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active d OFF ethX(ON),ethY(OFF)4) If the NIC is an active NIC, switch its state to standby. After the switch, enter the dsphanet command to confirm that the NIC is a standby NIC(OFF).
# /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active d OFF ethX(OFF),ethY(ON)5) Stop interface status monitoring.
# /bin/touch /var/opt/FJSVhanet/tmp/disable_watchif
6) Deactivate the interface of the target NIC.
# /sbin/ifdown ethX
7) Back up the network configuration file of the interface.
# cd /etc/sysconfig/network-scripts # mkdir temp # mv ifcfg-ethX temp
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Swap the NIC in the PCI slot.
Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series.
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check that the entry information related to the NIC after swap is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="ZZ:ZZ:ZZ:ZZ:ZZ:ZZ", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If interface names are switched before and after swapping NICs, turn off the power of the PCI slot. Then edit the interface name in the rule file for udev function and turn on the power of the PCI slot again. For details, see the following manuals:
PRIMEQUEST 1000 Series
"Network card replacement procedure" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"Network card replacement procedure" in "PRIMEQUEST 2000 Series Administration Manual"
Check the hardware address.
Check that the hardware address (HWaddr) of the created interface on the swapped NIC from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
Perform post-swap processing.
1) Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 9.
# cd /etc/sysconfig/network-scripts # mv temp/ifcfg-ethX . # rmdir temp
ifcfg-ethX (Swapped NIC)
DEVICE=ethX
BOOTPROTO=static
HWADDR=ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
HOTPLUG=no
BROADCAST=XXX.XXX.XXX.XXX
IPADDR=XXX.XXX.XXX.XXX
NETMASK=XXX.XXX.XXX.XXX
NETWORK=XXX.XXX.XXX.XXX
ONBOOT=yes
TYPE=Ethernet2) Set the state of the swapped NIC to that of a standby NIC of GLS.
The procedure varies depending on whether or not the IP address set to the virtual interface is only an IPv6 address:
If an IPv4 address is set to the virtual interface
Confirm that an IPv4 address is not assigned and the "UP" and "NOARP" flags are set.
# /sbin/ifconfig ethX 0 -arp up
# /sbin/ifconfig ethX
ethX Link encap:Ethernet HWaddr ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
inet6 addr: fe80::XXXXXXXXXXXXXXXX/64 Scope:Link
UP BROADCAST NOARP MULTICAST MTU:1500 Metric:1If an only IPv6 address is set the virtual interface
Confirm that the "UP" flag is set.
# /sbin/ifconfig ethX up
# /sbin/ifconfig ethX
ethX Link encap:Ethernet HWaddr ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
inet6 addr: fe80::XXXXXXXXXXXXXXXX/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1Information
If an only IPv6 address is set, when executing the dsphanet command right after executing the above commands, the available state "ON" is displayed for the both devices. This is a temporary state and it does not affect the system because the state will become a proper state by performing the following steps.
3) If necessary, fail-back the NIC.
# /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX
4) Start standby patrol monitoring. If the standby patrol function is not used, skip this step.
# /opt/FJSVhanet/usr/sbin/strptl -n shaY
5) Restart HUB monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpoll on
6) Restart interface status monitoring.
# /bin/rm /var/opt/FJSVhanet/tmp/disable_watchif
For Virtual NIC mode
Prepare for swapping a card.
1) Stop network monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpathmon off
2) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).
# /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX
3) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active v OFF ethX(CUT),ethY(ON)4) Deactivate the interface of the target NIC.
# /sbin/ifdown ethX
5) Back up the network configuration file of the interface.
# cd /etc/sysconfig/network-scripts # mkdir temp # mv ifcfg-ethX temp
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Swap the NIC in the PCI slot.
Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check that the entry information related to the NIC after swap is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="ZZ:ZZ:ZZ:ZZ:ZZ:ZZ", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If interface names are switched before and after swapping NICs, turn off the power of the PCI slot. Then edit the interface name in the rule file for udev function and turn on the power of the PCI slot again. For details, see the following manuals:
PRIMEQUEST 1000 Series
"Network card replacement procedure" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"Network card replacement procedure" in "PRIMEQUEST 2000 Series Administration Manual"
Check the hardware address.
Check that the hardware address (HWaddr) of the created interface on the swapped NIC from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
Perform post-swap processing.
1) Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 9.
# cd /etc/sysconfig/network-scripts
# mv temp/ifcfg-ethX .
# rmdir tempifcfg-ethX (Swapped NIC)
DEVICE=ethX
BOOTPROTO=static
HWADDR=ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
HOTPLUG=no
ONBOOT=yes
DEVICETYPE=hanet2) Activate the swapped NIC.
# /sbin/ifup ethX
3) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.
# /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX
4) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "OFF".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active v OFF ethX(OFF),ethY(ON)5) If necessary, fail-back the NIC.
# /opt/FJSVhanet/usr/sbin/hanetnic change -n shaX -i ethX
6) Restart network monitoring.
# /opt/FJSVhanet/usr/sbin/hanetpathmon on
For GS linkage mode
Prepare for swapping a card.
1) From the virtual interface definition, temporarily delete the definition information about the NIC to be swapped (The interface name of the target NIC is ethX).
# /opt/FJSVhanet/usr/sbin/hanetnic delete -n shaX -i ethX
2) Enter the dsphanet command to confirm that the device status of the target NIC (interface name: ethX) is "CUT".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active c OFF ethX(CUT),ethY(ON)3) Deactivate the interface of the target NIC.
# /sbin/ifdown ethX
4) Back up the network configuration file of the interface.
# cd /etc/sysconfig/network-scripts # mkdir temp # mv ifcfg-ethX temp
Turn off power to the target PCI slot.
The interface (ethX) is deleted when power is turned off. For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 0 > /sys/bus/pci/slots/"<slot-number>"/power
Swap the NIC in the PCI slot.
Delete the entry information of the deleted interface from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# vi /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000)
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \
ATTR{address}=="XX:XX:XX:XX:XX:XX", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
Turn on power to the PCI slot.
For details, see the following manuals:
PRIMEQUEST 1000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"PCI Card Hot Maintenance in Red Hat Enterprise Linux 6" in "PRIMEQUEST 2000 Series Administration Manual"
For example: PRIMEQUEST 1000 Series
# echo 1 > /sys/bus/pci/slots/"<slot-number>"/power
If the interface (ethX) for the swapped NIC, which was newly generated by turning on power, has been activated, deactivate it.
# /sbin/ifconfig ethX down
Check that the entry information related to the NIC after swap is added into the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
# cat /etc/udev/rules.d/70-persistent-net.rules # This file was automatically generated by the /lib/udev/write_net_rules # program, run by the persistent-net-generator.rules rules file. ... ... # PCI device 0xXXXX:0xXXXX (e1000) SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", \ ATTR{address}=="ZZ:ZZ:ZZ:ZZ:ZZ:ZZ", ATTR{type}=="1", KERNEL=="eth*", NAME="ethX"
If interface names are switched before and after swapping NICs, turn off the power of the PCI slot. Then edit the interface name in the rule file for udev function and turn on the power of the PCI slot again. For details, see the following manuals:
PRIMEQUEST 1000 Series
"Network card replacement procedure" in "PRIMEQUEST 1000 Series Administration Manual"
PRIMEQUEST 2000 Series
"Network card replacement procedure" in "PRIMEQUEST 2000 Series Administration Manual"
Check the hardware address.
Check that the hardware address (HWaddr) of the created interface on the swapped NIC from the rule file /etc/udev/rules.d/70-persistent-net.rules for the udev function of the operating system.
Perform post-swap processing.
1) Change the HWADDR in the backed up interface setting file to the hardware address of the swapped NIC that was checked in step 9.
# cd /etc/sysconfig/network-scripts # mv temp/ifcfg-ethX . # rmdir temp
ifcfg-ethX (Swapped NIC)
DEVICE=ethX
BOOTPROTO=static
HWADDR=ZZ:ZZ:ZZ:ZZ:ZZ:ZZ
HOTPLUG=no
BROADCAST=XXX.XXX.XXX.XXX
IPADDR=XXX.XXX.XXX.XXX
NETMASK=XXX.XXX.XXX.XXX
NETWORK=XXX.XXX.XXX.XXX
ONBOOT=yes
TYPE=Ethernet2) Activate the interface of the swapped NIC.
# /sbin/ifup ethX
3) Restore the NIC (interface name: ethX) that was temporarily deleted prior to swapping in 1) of step 1.
# /opt/FJSVhanet/usr/sbin/hanetnic add -n shaX -i ethX
4) Enter the dsphanet command to confirm that the device status of the swapped NIC (interface name: ethX) is "ON".
# /opt/FJSVhanet/usr/sbin/dsphanet
[IPv4,Patrol / Virtual NIC]
Name Status Mode CL Device
+----------+--------+----+----+------------------------------------------------+
shaX Active c OFF ethY(ON),ethX(ON)