PRIMECLUSTER Global Link Services Configuration and Administration Guide: Redundant Line Control Function 4.1 (for Solaris(TM) Operating System)

4.5.2.3 Extension of PCI cards to redundant system

It is possible to extend a PCI card to the redundant system.

In NIC Switching mode, it is not possible to add a new interface to a redundant system.
Also, when adding a new interface in GS/SURE linkage mode, it is first required to deactivate the virtual interface for GS/SURE linkage mode and then add a new interface.

The following is the procedure of extending PCI card to the redundant system.

1) Stop the hardware monitoring of the Machine Administration

The hardware monitoring of the Machine Administration is stopped by using the following command.

# /usr/sbin/FJSVmadm/prephp <Return>

2) Add PCI cards

a.
Before extending the PCI card, please save the result (current configuration information) of the prtpicl (1M) command.

# prtpicl -v > /tmp/prtpicl.pre <Return>

b.
Check the status of the slot.
An example of adding a PCI card to a slot "R0B01-PCI#slot02" is shown in this section. "R0" in "R0B01-PCI#slot02" indicates the I/O cabinet number: 0, "B01" the PCI/Disk Box number: 1, and "slot02" the physical slot number: 02.
If you are adding more PCI cards, please repeat the procedures 2) b and 3).
The relationship of the position of a PCI card and format of "Ap_Id" is shown below. (N: an integral number)

Location of PCI slot	Element	Format of "Ap_Id"
Cabinet of PRIMEPOWER 900/1500/2500	Cabinet Number: X System Board Number: Y Physical Slot Number: ZZ	pcipsyN:CXM0Y-PCI#slotZZ
PCI / Disk BOX	I/O Cabinet Number: X PCI/Disk BOX Number: Y Physical Slot Number: ZZ	pcipsyN:RXB0Y-PCI#slotZZ
other than those above	Physical Slot Number: ZZ	pcipsyN:PCI#slotZZ

Please confirm that the status of the PCI slot where a PCI card is added is "empty unconfigured" by using "cfgadm" (1M) command.

# cfgadm R0B01-PCI#slot02 <Return>
Ap_Id                          Type        Receptacle    Occupant      Condition
pcipsy18:R0B01-PCI#slot02      unknown     empty         unconfigured  unknown

c.
To indicate the slot position for expansion, specify the "Ap_Id" identified in the procedure 2)b to "cfgadm" command and blink the ALARM LED.

# cfgadm -x led=fault,mode=blink pcipsy18:R0B01-PCI#slot02 <Return>

d.
Add a PCI card after the READY LED of the target PCI bus slot has turned off. This operation is performed by our customer support.

e.
Please confirm that the PCI slot status which extended PCI cards is "disconnected unconfigured" by using cfgadm (1M) command.

# cfgadm pcipsy18:R0B01-PCI#slot02 <Return>
Ap_Id                          Type        Receptacle    Occupant      Condition
pcipsy18:R0B01-PCI#slot02      unknown     disconnected  unconfigured  unknown

3) Connect PCI cards

An added PCI card is connected to the system by executing "cfgadm" command with "configure" option and "Ap_Id", or by pushing the push button of the PCI bus slot.

In addition, a push button is valid only in multiple user mode.

Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.

# cfgadm -c configure pcipsy18:R0B01-PCI#slot02 <Return>
# cfgadm pcipsy18:R0B01-PCI#slot02 <Return>
Ap_Id                          Type        Receptacle    Occupant      Condition
pcipsy18:R0B01-PCI#slot02      pci-pci/hp  connected     configured    ok

4) Connect equipment to PCI cards

The extended PCI card is connected with network equipment by the cable.

5) Setup driver

The driver configuration is added by following operations.

a.
The interface name is investigated in order to configure drivers and high layer products.
Please save the result of the prtcicl (1M) command, and obtain the difference information between current result and the result taken at "2.a." Then, the driver instance number for the extended PCI card is obtained.
In the following example, since the instance number is 1, it can be determined that the interface name of the extended PCI card is "hme2."

# prtpicl -v > /tmp/prtpicl.post <Return>
# diff /tmp/prtpicl.pre /tmp/prtpicl.post | more <Return>
            :
>    :status    okay
>    :devfs-path    /pci@8d,2000/network@2
>    :driver-name   hme
>    :binding-name  SUNW,hme
>    :bus-addr  2
>    :instance  2
>    :_class    obp-device
>    :name  network
            :

b.
Confirm that the interface name that is obtained from the above operation matches the one that has been added to the PCI bus slot.

# /usr/sbin/FJSVmadm/inst2comp hme2 <Return>
pcipsy18:R0B01-PCI#slot02

c.
The configuration of each driver is added.
Please refer to each driver manual for details.

6) Connect to redundant system

Please execute following commands in order to connect the extended PCI card to the existing redundant configuration system.

Fast switching mode

# /usr/sbin/ifconfig hme2 plumb <Return>
# /usr/sbin/ifconfig hme2 IP_address netmask + broadcast + -trailers up <Return>
# /opt/FJSVhanet/usr/sbin/hanetnic add -n sha0 -i hme2 -f <Return>

GS/SURE linkage mode

# /opt/FJSVhanet/usr/sbin/stphanet -n sha0 <Return>
# /opt/FJSVhanet/usr/sbin/hanetconfig create -n sha2 -m n -i IP_address -t hme2 <Return>
# /opt/FJSVhanet/usr/sbin/hanetnic modify -n sha0 -t sha2,sha3,sha4 <Return>
# /opt/FJSVhanet/usr/sbin/strhanet -n sha0 <Return>

7) Switch the redundant path

Please switch an online communication path for extended communication path if needed.

8) Start the hardware monitoring of the Machine Administration

Please execute the following command in order to update configuration information, and restart the hardware monitoring of the Machine Administration.

# /usr/sbin/FJSVmadm/postphp <Return>