PCI Hot Plug User's Guide I/O device edition - for Solaris (TM) Operating Environment -
Contents PreviousNext

Chapter 4 Network Devices

4.1 Replacement of PCI card

This section describes replacement procedure of the PCI card by using PCI Hot Plug on non-redundant system and redundant system.

4.1.1 Replacement of PCI cards on non-redundant system 

When exchanging PCI cards without redundant configuration software, you must stop applications which using PCI cards. The replacement procedure of PCI cards is as follows.
  1. Stop the hardware monitoring of the Machine Administration

    The hardware monitoring of the Machine Administration is stopped by using the following command.

    Please refer to "PCI Hot Plug User's Guide" about the details of prephp (1M) command.

    # /usr/sbin/FJSVmadm/prephp <Return>
  2. Specify the replacing PCI card

    The interfaces (e.g. hme1) which stop applications for replacement of PCI cards are specified from warning messages outputted the console.

  3. Stop applications

    By following operations, the high layer product (e.g. service, application) which uses PCI cards for exchange is stopped.

    1. When using TCP/IP interface

      The example in the case of using TCP/IP interface is shown below. Please refer to the online manual etc. about the details of the ifconfig (1M) command.

      Moreover, when high layer programs which using the TCP/IP interface needs to be stopped, please stop each high layer program. Please refer to each manual about the stop procedure of high layer programs.

      1. When using Ethernet devices
        # /usr/sbin/ifconfig hme1 down <Return>
        # /usr/sbin/ifconfig hme1 unplumb
        <Return>
      2. When using ATM devices
        # /opt/FJSVatm/bin/atmunlink adapter_number <Return>
    2. When using FNA/SNA communication protocol over Ethernet

      When not using the redundant configuration software, it is necessary to stop all high layer applications that are using Netcompo FNA-LAN, and all interfaces of Netcompo FNA-LAN.

      For details, please refer to the manual of Netcompo FNA-LAN and high layer applications.

  4. Disconnect the PCI card
    1. The "Ap_Id" is displayed using the following command, based on the interface (e.g.: hme1) specified in Procedure "2. Specify the replacing PCI card." The attachment pint identifier "Ap_Id" is a value for the cfgadm (1M) command specifying the slot position of the PCI card. Please refer to "PCI Hot Plug user's guide" about the details of cfgadm (1M) and "Ap_Id."
      # /usr/sbin/FJSVmadm/inst2comp hme1 <Return>
      pcipsy3:COM00-PCI#slot02
    2. Obtained "Ap_Id" is specified as an argument of the cfgadm (1M) command, and it confirms that the slot status of the PCI card that disconnects is "connected configured."
      # cfgadm pcipsy3:COM00-PCI#slot02 <Return>
      Ap_Id Type Receptacle Occupant Condition
      pcipsy3:COM00-PCI#slot02 pci-pci/hp connected configured ok
    3. Please disconnect the PCI card by executing the cfgadn (1M) command with "Ap_Id," and confirm that the slot status is "disconnected unconfigured."
      # cfgadm -c disconnect pcipsy3:COM00-PCI#slot02 <Return>
      # cfgadm pcipsy3:COM00-PCI#slot02 <Return>
      Ap_Id Type Receptacle Occupant Condition
      pcipsy3:COM00-PCI#slot02 pci-pci/hp disconnected unconfigured unknown
    4. To confirm the slot position at replacement operation, blink the ALARM LED of Ap_Id displayed in procedure 4.a.
      # cfgadm -x led=fault,mode=blink pcipsy3:COM00-PCI#slot02 <Return>
  5. Replace the PCI card

    The PCI card disconnected in procedure "4. Disconnect the PCI card" is exchanged for a new PCI card. Our customer service works about this procedure.

  6. Connect the PCI card

    The cfgadm command is executed with the "configure" option to "Ap_Id," or the push button of the PCI bus slot is pushed. Then a new PCI card is connected.

    In addition, a push button is valid only in multiple user mode.

    Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.

    Notes:

    If the setup of driver.conf(4) file exist, please refer to "5.1.1 Network driver configuration changing."

    # cfgadm -c configure pcipsy3:COM00-PCI#slot02 <Return>
    # cfgadm pcipsy3:COM00-PCI#slot02 <Return>
    Ap_Id Type Receptacle Occupant Condition
    pcipsy3:COM00-PCI#slot02 pci-pci/hp connected configured ok
  7. Start applications

    Please restart the stopped high layer product (service, application) by the following operations.

    1. When using TCP/IP interface

      The example in the case of using TCP/IP interface is shown below.

      Furthermore, when the high layer program which is using the PCI card needs to restart, please refer to the manual of each high layer program.

      1. When using Ethernet devices
        # /usr/sbin/ifconfig hme1 plumb <Return>
        # /usr/sbin/ifconfig hme1 inet 192.168.10.10 netmask + broadcast + -trailers up <Return>
      2. When using ATM devices
        # /opt/FJSVatm/bin/atmlink adapter_number <Return>
    2. When using FNA/SNA communication protocol over Ethernet

      When not using the redundant configuration software, it is necessary to start all interfaces of Netcompo FNA-LAN, and all high layer applications that are using Netcompo FNA-LAN.

      For details, please refer to the manual of Netcompo FNA-LAN and high layer applications.

  8. Start the hardware monitoring of the Machine Administration

    Please execute the following commands in order to update configuration information, and restart the hardware monitoring of the Machine Administration.

    Please refer to "PCI Hot Plug User's Guide" about details of postphp (1M) command.

    # /usr/sbin/FJSVmadm/postphp <Return>

4.1.2 Replacement of PCI cards on redundant system 

When exchanging PCI cards with redundant configuration software, it can exchange PCI cards without stopping applications.

This subsection describes replacement procedure of PCI cards with the following redundant configuration software.

The replacement and extension of PCI cards are supported only on Redundant Line Control Function of SynfinityLink.

Notes:
Because of the dynamic replacement, if the environment of SynfinityLink or PRIMECLUSTER GLS has been modified, system reboot is not required.

When using other redundant software, please refer to manuals of each product.

  1. Stop the hardware monitoring of the Machine Administration

    The hardware monitoring of the Machine Administration is stopped by using the following command.

    # /usr/sbin/FJSVmadm/prephp <Return>
  2. Specify the replacing PCI card

    The interfaces (e.g. hme1) which stop applications for replacement of PCI cards are specified from warning messages outputted the console.

  3. Disconnect from redundant system

    In order to disconnect the PCI card for exchange from a redundant system, please execute the following command with the interface name specified by procedure "2. Specify the replacing PCI card."

    On the redundant system of standby mode, when an online communication path is disconnected, a standby communication path will be online communication path automatically.

    When using the GS/SURE linkage mode in Redundant Line Control Function of SynfinityLink or PRIMECLUSTER GLS, it is necessary to deactivate virtual interfaces (e.g. sha0) used by GS/SURE linkage mode.

    Fast switching mode in Redundant Line Control Function
    # /opt/FJSVhanet/usr/sbin/hanetnic delete -n sha0 -i hme1 <Return>
    # /usr/sbin/ifconfig hme1 unplumb <Return>

    NIC switching mode in Redundant Line Control Function
    # /opt/FJSVhanet/usr/sbin/hanetpoll off <Return>
    # /opt/FJSVhanet/usr/sbin/stpptl -n sha1 <Return>
    # /opt/FJSVhanet/usr/sbin/hanetnic change -n sha0 <Return>

    GS/SURE linkage mode in Redundant Line Control Function
    # /opt/FJSVhanet/usr/sbin/stphanet -n sha0 <Return>

    Multipath Function
    # /usr/opt/FJSViomp/bin/iompadm -c mpnet stop mpnet0 hme1 <Return>
    # /usr/opt/FJSViomp/bin/iompadm -c mpnet disconnect mpnet0 hme1 <Return>
  4. Disconnect the PCI card
    1. Please specify the PCI bus slot position by the interface (e.g. hme1) in procedure "2. Specify the replacing PCI card."
      # /usr/sbin/FJSVmadm/inst2comp hme1 <Return>
      pcipsy21:R0B01-PCI#slot03
    2. Obtained "Ap_Id" is specified as an argument of the cfgadm (1M) command, and it confirms that the slot status of the PCI card that disconnects is "connected configured."
      # cfgadm pcipsy21:R0B01-PCI#slot03 <Return>
      Ap_Id Type Receptacle Occupant Condition
      pcipsy21:R0B01-PCI#slot03 pci-pci/hp connected configured ok
    3. Please disconnect the PCI card by executing the cfgadn (1M) command with "Ap_Id," and confirm that the slot status is "disconnected unconfigured."
      # cfgadm -c disconnect pcipsy21:R0B01-PCI#slot03 <Return>
      # cfgadm pcipsy21:R0B01-PCI#slot03 <Return>
      Ap_Id Type Receptacle Occupant Condition
      pcipsy21:R0B01-PCI#slot03 pci-pci/hp disconnected unconfigured unknown
    4. To confirm the slot position at replacement operation, blink the ALARM LED of Ap_Id displayed in procedure 4.a.
      # cfgadm -x led=fault,mode=blink pcipsy21:R0B01-PCI#slot03 <Return>
  5. Replace the PCI card

    The PCI card disconnected in procedure "4. Disconnect the PCI card" is exchanged for a new PCI card. Out customer support works about this procedure.

    Notes:

    When using the PRIMECLUSTER GLS Multipath Function, please exchange the PCI card after waiting 10 seconds or more, after Procedure "4. Disconnect the PCI card."

  6. Connect the PCI card

    The cfgadm command is executed with the "configure" option to "Ap_Id," or the push button of the PCI bus slot is pushed. Then a new PCI card is connected.

    In addition, a push button is valid only in multiple user mode.

    Please confirm that the slot status is "connected configured" by using the cfgadm (1M) command after the above-mentioned procedure.

    Notes:

    If the setup of driver.conf(4) file exist, please refer to "5.1.1 Network driver configuration changing."

    # cfgadm -c configure pcipsy21:R0B01-PCI#slot03 <Return>
    # cfgadm pcipsy21:R0B01-PCI#slot03 <Return>
    Ap_Id Type Receptacle Occupant Condition
    pcipsy21:R0B01-PCI#slot03 pci-pci/hp connected configured ok
  7. Connect to redundant system

    In order to connect the exchanged PCI card into a redundant system, please execute the following command with interface name specified at procedure "2. Specify the replacing PCI card."

    Fast switching mode in Redundant Line Control Function
    # /usr/sbin/ifconfig hme1 plumb <Return>
    # /usr/sbin/ifconfig hme1 IP_address netmask + broadcast + -trailers up <Return>
    # /opt/FJSVhanet/usr/sbin/hanetnic add -n sha0 -i hme1 <Return>

    NIC switching mode in Redundant Line Control Function
    # /opt/FJSVhanet/usr/sbin/hanetnic change -n sha0 <Return>
    # /opt/FJSVhanet/usr/sbin/strptl -n sha1 <Return>

    GS/SURE linkage mode in Redundant Line Control Function
    # /opt/FJSVhanet/usr/sbin/strhanet -n sha0 <Return>
    # /opt/FJSVhanet/usr/sbin/hanetpoll on <Return>

    Multipath Function
    # /usr/opt/FJSViomp/bin/iompadm -c mpnet connect mpnet0 hme1 <Return>
    # /usr/opt/FJSViomp/bin/iompadm -c mpnet start mpnet0 hme1 <Return>

    Notes

    It is necessary to configure the IP address specified by ifconfig(1M) command in /etc/inet/hosts and /etc/hostname.hme1. Unless these are configured, the virtual interface for fast switching mode can not be activated after rebooting the system. In addition, in order to use IPv6 address, please refer to the PRIMECLUSTER GLS (4.1A20 or later) manual.

  8. Switch back the redundant path

    Please switch back an online communication path if needed.

  9. Start the hardware monitoring of the Machine Administration

    Please execute the following commands in order to update configuration information, and restart the hardware monitoring of the Machine Administration.

    # /usr/sbin/FJSVmadm/postphp <Return>

Contents PreviousNext

All Rights Reserved, Copyright(C) FUJITSU LIMITED 2005