This section explains a procedure of replacing or adding a PCI card for GLS in a PCI Hot Plug (PHP) environment.
Compatibility of PHP with each mode is shown in the table below.
[PHP Support] A: Supported X: Not supported
PHP(PCI Hot Plug) operation | Fast switching mode | RIP mode | NIC switching mode | GS/SURE linkage mode |
|---|---|---|---|---|
Replacement (Redundant system) | A | X | A | A |
Extension (Non-redundant system) | A | X | A | A |
Extension (Redundant system) | A | X | X | A |
Note
Replacement and expansion of PHP (PCI Hot Plug) is allowed only when the system is running in a multiple user mode.
In Fast Switching and NIC Switching mode, it is possible to replace the redundant NIC without stopping network communication.
Note
For NIC Switching mode, it is required to stop the transfer path monitoring function and standby patrol function.
For GS/SURE linkage mode, it is required to deactivate the virtual interface.
The following is a procedure of replacing redundant system.
Perform the following procedure when using PRIMEPOWER.
For replacing procedure of deactivated configuration, refer to "PCI Hot Plug User's guide for I/O device".
1) Stop the hardware monitoring of the Machine Administration
The hardware monitoring of the Machine Administration is stopped by using the following command.
# /usr/sbin/FJSVmadm/prephp <Return> |
2) Specify the replacing PCI card
An interface on the PCI card to be replaced can be identified from the warning messages output to the console (eg. hme1).
3) Disconnect from redundant system
In order to remove the PCI card from the redundant system for replacement, please execute the following command with the interface name obtained in the procedure "2) Specify the replacing PCI card". On the redundant system of standby mode, when an online communication path is disconnected, a standby communication path will be online communication path automatically.
Fast switching mode
# /opt/FJSVhanet/usr/sbin/hanetnic delete -n sha0 -i hme1 <Return> # /usr/sbin/ifconfig hme1 unplumb <Return> |
NIC switching mode
# /opt/FJSVhanet/usr/sbin/hanetpoll off <Return> # /opt/FJSVhanet/usr/sbin/stpptl -n sha1 <Return> # /opt/FJSVhanet/usr/sbin/hanetnic change -n sha0 <Return> |
GS/SURE linkage mode
# /opt/FJSVhanet/usr/sbin/stphanet -n sha0 <Return> |
4) Disconnect the PCI card
Specify the interface name identified in the procedure "2) Specify the replacing PCI card." to "inst2comp" command to obtain the PCI bus slot "Ap_Id".
# /usr/sbin/FJSVmadm/inst2comp hme1 <Return> pcipsy21:R0B01-PCI#slot03 |
Specify the "Ap_Id" obtained above as an argument to "cfgadm"(1M) command, and confirm that the slot status of the PCI card to be disconnected is "connected configured".
# cfgadm pcipsy21:R0B01-PCI#slot03 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy21:R0B01-PCI#slot03 pci-pci/hp connected configured ok |
Please disconnect the PCI card by executing the cfgadn (1M) command with "Ap_Id," and confirm that the slot status is "disconnected unconfigured."
# cfgadm -c disconnect pcipsy21:R0B01-PCI#slot03 <Return> # cfgadm pcipsy21:R0B01-PCI#slot03 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy21:R0B01-PCI#slot03 unknown disconnected unconfigured unknown |
To indicate the slot position for replacement, specify the obtained "Ap_Id" to "cfgadm" command and blink the ALARM LED.
# cfgadm -x led=fault,mode=blink pcipsy21:R0B01-PCI#slot03 <Return> |
5) Replace the PCI card
The PCI card disconnected in the procedure "4) Disconnect the PCI card" is replaced with a new one. Our customer support staff does this for you.
6) Connect the PCI card
In order to connect a new PCI card, execute "cfgadm" command with "configure" option and the "Ap_Id", or push the push button of the PCI bus slot.
Note
In addition, a push button is valid only in multiple user mode.
Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.
# cfgadm -c configure pcipsy21:R0B01-PCI#slot03 <Return> # cfgadm pcipsy21:R0B01-PCI#slot03 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy21:R0B01-PCI#slot03 pci-pci/hp connected configured ok |
7) Connect to redundant system
In order to connect the new PCI card to a redundant system, please execute the following commands with the interface name identified in the procedure "2) Specify the replacing PCI card".
Fast switching mode
# /opt/FJSVhanet/usr/sbin/hanetnic add -n sha0 -i hme1 <Return> |
NIC switching mode
# /opt/FJSVhanet/usr/sbin/hanetnic change -n sha0 <Return> # /opt/FJSVhanet/usr/sbin/strptl -n sha1 <Return> # /opt/FJSVhanet/usr/sbin/hanetpoll on <Return> |
GS/SURE linkage mode
# /opt/FJSVhanet/usr/sbin/strhanet -n sha0 <Return> |
8) Switch back the redundant path
Please switch back an online communication path if needed.
9) Start the hardware monitoring of the Machine Administration
Please execute the following commands in order to update configuration information, and restart the hardware monitoring of the Machine Administration.
# /usr/sbin/FJSVmadm/postphp <Return> |
By adding a new PCI card to a non-redundant system, it is possible to create a redundant system.
The following is the procedure of adding a new PCI card to a non-redundant system.
Perform the following procedure when using PRIMEPOWER.
1) Stop the hardware monitoring of the Machine Administration
The hardware monitoring of the Machine Administration is stopped by using the following command.
# /usr/sbin/FJSVmadm/prephp <Return> |
2) Add PCI cards
a.
Before adding a PCI card, please save the output of "prtpicl"(1M) command.
# prtpicl -v > /tmp/prtpicl.pre <Return> |
b.
Check the status of the slot.
An example of adding a PCI card to a slot "R0B01-PCI#slot02" is shown in this section. "R0" in "R0B01-PCI#slot02" indicates the I/O cabinet number: 0, "B01" the PCI/Disk Box number: 1, and "slot02" the physical slot number: 02.
If you are adding more PCI cards, please repeat the procedures 2) b and 3).
The relationship of the position of a PCI card and format of "Ap_Id" is shown below. (N: an integral number)
Location of PCI slot | Element | Format of "Ap_Id" |
|---|---|---|
Cabinet of PRIMEPOWER 900/1500/2500 | Cabinet Number: X | pcipsyN:CXM0Y-PCI#slotZZ |
PCI / Disk BOX | I/O Cabinet Number: X | pcipsyN:RXB0Y-PCI#slotZZ |
other than those above | Physical Slot Number: ZZ | pcipsyN:PCI#slotZZ |
Please confirm that the status of the PCI slot where a PCI card is added is "empty unconfigured" by using "cfgadm" (1M) command.
# cfgadm R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 unknown empty unconfigured unknown |
c.
To indicate the slot position for expansion, specify the "Ap_Id" identified in the procedure 2)b to "cfgadm" command and blink the ALARM LED.
# cfgadm -x led=fault,mode=blink pcipsy18:R0B01-PCI#slot02 <Return> |
d.
Add a PCI card after the READY LED of the target PCI bus slot has turned off.
This operation is performed by our customer support.
e.
Please confirm that the PCI slot status which extended PCI cards is "disconnected unconfigured" by using cfgadm (1M) command.
# cfgadm pcipsy18:R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 unknown disconnected unconfigured unknown |
3) Connect PCI cards
An added PCI card is connected to the system by executing "cfgadm" command with "configure" option and "Ap_Id", or by pushing the push button of the PCI bus slot.
Note
In addition, a push button is valid only in multiple user mode.
Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.
# cfgadm -c configure pcipsy18:R0B01-PCI#slot02 <Return> # cfgadm pcipsy18:R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 pci-pci/hp connected configured ok |
4) Start the hardware monitoring of the Machine Administration
Please execute the following command in order to update configuration information, and restart the hardware monitoring of the Machine Administration.
# /usr/sbin/FJSVmadm/postphp <Return> |
5) Connect equipment to PCI cards
The extended PCI card is connected with network equipment by the cable.
6) Setup driver
The driver configuration is added by following operations.
a.
The interface name is investigated in order to configure drivers and high layer products.
Please save the result of the prtcicl (1M) command, and obtain the difference information between current result and the result taken at "2.a." Then, the driver instance number for the extended PCI card is obtained.
In the following example, since the instance number is 1, it can be determined that the interface name of the extended PCI card is "hme1."
# prtpicl -v > /tmp/prtpicl.post <Return>
# diff /tmp/prtpicl.pre /tmp/prtpicl.post | more <Return>
:
> :status okay
> :devfs-path /pci@8d,2000/network@1
> :driver-name hme
> :binding-name SUNW,hme
> :bus-addr 1
> :instance 1
> :_class obp-device
> :name network
: |
b.
Confirm that the interface name that is obtained from the above operation matches the one that has been added to the PCI bus slot.
# /usr/sbin/FJSVmadm/inst2comp hme1 <Return> pcipsy18:R0B01-PCI#slot02 |
c.
The configuration of each driver is added.
Please refer to each driver manual for details.
7) Setup redundant system
Activate the virtual interface after configuring Fast Switching, NIC Switching, or GS/SURE linkage mode. System reboot is not required after configuring each mode.
When configuring Fast Switching mode, the added interface "hme1" must be activated preliminary by the following command.
For IPv4 address
# /usr/sbin/ifconfig hme1 plumb <Return>
# /usr/sbin/ifconfig hme1 IP address netmask + broadcast + -trailers up <Return> |
For IPv6 address
# /usr/sbin/ifconfig lo0 inet6 plumb up <Return> # /usr/sbin/ifconfig hme1 inet6 plumb up <Return> |
Note
For Fast switching mode (IPv4), the IP address specified in this section must also be defined in /etc/inet/hosts and /etc/hostname.hme1.
For Fast switching mode (IPv6), create /etc/hostname6.hme1 as an empty file.
Unless these are configured, when the system reboots, the virtual interface for Fast Switching mode cannot be activated.
It is possible to extend a PCI card to the redundant system.
Note
In NIC Switching mode, it is not possible to add a new interface to a redundant system.
Also, when adding a new interface in GS/SURE linkage mode, it is first required to deactivate the virtual interface for GS/SURE linkage mode and then add a new interface.
The following is the procedure of extending PCI card to the redundant system.
Perform the following procedure when using PRIMEPOWER.
1) Stop the hardware monitoring of the Machine Administration
The hardware monitoring of the Machine Administration is stopped by using the following command.
# /usr/sbin/FJSVmadm/prephp <Return> |
2) Add PCI cards
a.
Before extending the PCI card, please save the result (current configuration information) of the prtpicl (1M) command.
# prtpicl -v > /tmp/prtpicl.pre <Return> |
b.
Check the status of the slot.
An example of adding a PCI card to a slot "R0B01-PCI#slot02" is shown in this section. "R0" in "R0B01-PCI#slot02" indicates the I/O cabinet number: 0, "B01" the PCI/Disk Box number: 1, and "slot02" the physical slot number: 02.
If you are adding more PCI cards, please repeat the procedures 2) b and 3).
The relationship of the position of a PCI card and format of "Ap_Id" is shown below. (N: an integral number)
Location of PCI slot | Element | Format of "Ap_Id" |
|---|---|---|
Cabinet of PRIMEPOWER 900/1500/2500 | Cabinet Number: X | pcipsyN:CXM0Y-PCI#slotZZ |
PCI / Disk BOX | I/O Cabinet Number: X | pcipsyN:RXB0Y-PCI#slotZZ |
other than those above | Physical Slot Number: ZZ | pcipsyN:PCI#slotZZ |
Please confirm that the status of the PCI slot where a PCI card is added is "empty unconfigured" by using "cfgadm" (1M) command.
# cfgadm R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 unknown empty unconfigured unknown |
c.
To indicate the slot position for expansion, specify the "Ap_Id" identified in the procedure 2)b to "cfgadm" command and blink the ALARM LED.
# cfgadm -x led=fault,mode=blink pcipsy18:R0B01-PCI#slot02 <Return> |
d.
Add a PCI card after the READY LED of the target PCI bus slot has turned off. This operation is performed by our customer support.
e.
Please confirm that the PCI slot status which extended PCI cards is "disconnected unconfigured" by using cfgadm (1M) command.
# cfgadm pcipsy18:R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 unknown disconnected unconfigured unknown |
3) Connect PCI cards
An added PCI card is connected to the system by executing "cfgadm" command with "configure" option and "Ap_Id", or by pushing the push button of the PCI bus slot.
Note
In addition, a push button is valid only in multiple user mode.
Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.
# cfgadm -c configure pcipsy18:R0B01-PCI#slot02 <Return> # cfgadm pcipsy18:R0B01-PCI#slot02 <Return> Ap_Id Type Receptacle Occupant Condition pcipsy18:R0B01-PCI#slot02 pci-pci/hp connected configured ok |
4) Connect equipment to PCI cards
The extended PCI card is connected with network equipment by the cable.
5) Setup driver
The driver configuration is added by following operations.
a.
The interface name is investigated in order to configure drivers and high layer products.
Please save the result of the prtcicl (1M) command, and obtain the difference information between current result and the result taken at "2.a." Then, the driver instance number for the extended PCI card is obtained.
In the following example, since the instance number is 1, it can be determined that the interface name of the extended PCI card is "hme2."
# prtpicl -v > /tmp/prtpicl.post <Return>
# diff /tmp/prtpicl.pre /tmp/prtpicl.post | more <Return>
:
> :status okay
> :devfs-path /pci@8d,2000/network@2
> :driver-name hme
> :binding-name SUNW,hme
> :bus-addr 2
> :instance 2
> :_class obp-device
> :name network
: |
b.
Confirm that the interface name that is obtained from the above operation matches the one that has been added to the PCI bus slot.
# /usr/sbin/FJSVmadm/inst2comp hme2 <Return> pcipsy18:R0B01-PCI#slot02 |
c.
The configuration of each driver is added.
Please refer to each driver manual for details.
6) Connect to redundant system
Please execute following commands in order to connect the extended PCI card to the existing redundant configuration system.
Fast switching mode
# /usr/sbin/ifconfig hme2 plumb <Return> # /usr/sbin/ifconfig hme2 IP_address netmask + broadcast + -trailers up <Return> # /usr/bin/echo IP_address > /etc/hostname.hme2 # /opt/FJSVhanet/usr/sbin/hanetnic add -n sha0 -i hme2 -f <Return> |
GS/SURE linkage mode
# /opt/FJSVhanet/usr/sbin/stphanet -n sha0 <Return> # /opt/FJSVhanet/usr/sbin/hanetconfig create -n sha2 -m n -i IP_address -t hme2 <Return> # /opt/FJSVhanet/usr/sbin/hanetconfig modify -n sha0 -t sha2,sha3,sha4 <Return> # /opt/FJSVhanet/usr/sbin/strhanet -n sha0 <Return> |
7) Switch the redundant path
Please switch an online communication path for extended communication path if needed.
8) Start the hardware monitoring of the Machine Administration
Please execute the following command in order to update configuration information, and restart the hardware monitoring of the Machine Administration.
# /usr/sbin/FJSVmadm/postphp <Return> |
