Top
PRIMECLUSTER Global Link Services Configuration and AdministrationGuide 4.6Redundant Line Control Function
FUJITSU Software

3.2.2 Network configuration

3.2.2.1 Setup common to modes

(1) Physical interface settings

Set up physical interfaces to be used for the Redundant Line Control Function.

The physical interface settings vary depending on redundant network methods and configurations. For details on the differences of each setting, see the following Table 3.8 Physical interface settings (RHEL7) and Table 3.9 Physical interface settings (RHEL8 or later).

Point

  • For RHEL 7 or later, the naming conventions for NIC names are changed to generate device names based on the hardware locations of NICs (Predictable Network Interface Names).
    In an environment where Predictable Network Interface Names are enabled, interface names are displayed as enXXXXX. In an environment where Predictable Network Interface Names are disabled, interface names are displayed as ethX.
    Replace the interface name (ethX) described in this manual with the interface name suitable for your environment. Replace the ifcfg-ethX file name with the file name suitable for your environment as well.

  • Only the required parameters in the Redundant Line Control Function are described for the configuration file (ifcfg-ethX) of the network interface in this manual. Set other parameters according to your environment.

For RHEL7

Table 3.8 Physical interface settings (RHEL7)

Redundant network methods

Tagged VLAN disabled

Tagged VLAN enabled

Fast switching mode (IPv4)

Setup 1

Setup 3

Fast switching mode (IPv6)

Setup 2

Setup 4

Fast switching mode (Dual)

Setup 1

Setup 3

NIC switching mode (IPv4)

Primary interface

Setup 1

Setup 3

Secondary interface

Setup 2

Setup 4

NIC switching mode (IPv6)

Primary interface

Setup 2

Setup 4

Secondary interface

Setup 2

Setup 4

NIC switching mode (Dual)

Primary interface

Setup 1

Setup 3

Secondary interface

Setup 2

Setup 4

Virtual NIC mode

Setup 5

Setup 5

GS linkage mode

Setup 1

Not supported

Note

  • For RHEL 7 or later, the naming conventions for NIC names are changed to generate device names based on the hardware locations of NICs (Predictable Network Interface Names).
    If you need to prevent device names of physical NICs from changing to unexpected names in an environment where traditional interface names (ethX) for RHEL6 or earlier are used, describe the definition of "HWADDR=<MAC address>" in the settings for the physical interfaces (the /etc/sysconfig/network-scripts/ifcfg-ethX file). For details, see "Linux documentation."

  • Add "HOTPLUG=no" to the settings for the physical interfaces bundled by GLS (the /etc/sysconfig/network-scripts/ifcfg-ethX file). This setting is not required for RHEL8 or later or when bundling the tagged VLAN interfaces.

  • The tagged VLAN interface name is available only by "interface name.VLAN-ID" format, such as eth0.1.

  • In the cluster environment of physical IP takeover II, do not set the IPADDR (IP address) to ifcfg-ethX.

Information

Setting "HOTPLUG=no" will not disable the PCI Hot Plug. The hot maintenance of NIC (PCI cards) can be performed for the physical interface where "HOTPLUG=no" is set.

Setup 1

/etc/sysconfig/network-scripts/ifcfg-ethX

DEVICE=ethX
BOOTPROTO=static
HOTPLUG=no
IPADDR=XXX.XXX.XXX.XXX
NETMASK=XXX.XXX.XXX.XXX
ONBOOT=yes
TYPE=Ethernet
Setup 2

/etc/sysconfig/network-scripts/ifcfg-ethX

DEVICE=ethX
BOOTPROTO=static
HOTPLUG=no
ONBOOT=yes
TYPE=Ethernet
Setup 3

/etc/sysconfig/network-scripts/ifcfg-ethX

DEVICE=ethX
BOOTPROTO=static
HOTPLUG=no
ONBOOT=yes
TYPE=Ethernet

/etc/sysconfig/network-scripts/ifcfg-ethX.Y

DEVICE=ethX.Y
BOOTPROTO=static
IPADDR=XXX.XXX.XXX.XXX
NETMASK=XXX.XXX.XXX.XXX
ONBOOT=yes
VLAN=yes

Information

If you want to use the NIC switching mode to share the same physical connection between two virtual interfaces (one that bundles physical interfaces and the other that bundles tagged VLAN interfaces), you need to set up ifcfg-ethX the same as Setup 1 using the same IP address (IPADDR=) and other values. For example, if sha0 bundles eth0 and eth1, and sha1 bundles eth0.2 and eth1.2, configure ifcfg-eth0 according to ifcfg-ethX in Setup 1, not according to that shown in Setup 3.

Setup 4

/etc/sysconfig/network-scripts/ifcfg-ethX

DEVICE=ethX
BOOTPROTO=static
HOTPLUG=no
ONBOOT=yes
TYPE=Ethernet

/etc/sysconfig/network-scripts/ifcfg-ethX.Y

DEVICE=ethX.Y
BOOTPROTO=static
ONBOOT=yes
VLAN=yes
Setup 5

/etc/sysconfig/network-scripts/ifcfg-ethX

DEVICE=ethX
BOOTPROTO=static
HOTPLUG=no
ONBOOT=yes
DEVICETYPE=hanet

For RHEL8 or later

Table 3.9 Physical interface settings (RHEL8 or later)

Redundant network methods

Tagged VLAN disabled

Tagged VLAN enabled

Fast switching mode (IPv4)

Setup 1

Setup 3

NIC switching mode (IPv4)

Primary interface

Setup 1

Setup 3

Secondary interface

Setup 2

Setup 4

Virtual NIC mode

Setup 5

Setup 5

GS linkage mode

Setup 1

Not supported

Note

  • For RHEL 7 or later, the naming conventions for NIC names are changed to generate device names based on the hardware locations of NICs (Predictable Network Interface Names).
    If you need to prevent device names of physical NICs from changing to unexpected names in an environment where traditional interface names (ethX) for RHEL6 or earlier are used, describe the definition of "HWADDR=<MAC address>" in the settings for the physical interfaces (the /etc/sysconfig/network-scripts/ifcfg-ethX file). For details, see "Linux documentation."
    The setting "HOTPLUG=no" is not required.

  • The tagged VLAN interface name is available only by "interface name.VLAN-ID" format, such as eth0.1.

  • In the cluster environment of physical IP takeover II, set ONBOOT=no to ifcfg-ethX.

Setup 1

/etc/sysconfig/network-scripts/ifcfg-ethX

TYPE=Ethernet
BOOTPROTO=none
IPADDR=XXX.XXX.XXX.XXX
PREFIX=XX
DEVICE=ethX
ONBOOT=yes
Setup 2

/etc/sysconfig/network-scripts/ifcfg-ethX

TYPE=Ethernet
BOOTPROTO=none
IPADDR=XXX.XXX.XXX.XXX
PREFIX=XX
DEVICE=ethX
ONBOOT=no
Setup 3

/etc/sysconfig/network-scripts/ifcfg-ethX

TYPE=Ethernet
DEVICE=ethX
ONBOOT=yes

/etc/sysconfig/network-scripts/ifcfg-ethX.Y

VLAN=yes
TYPE=Vlan
PHYSDEV=ethX
VLAN_ID=Y
BOOTPROTO=none
IPADDR=XXX.XXX.XXX.XXX
PREFIX=XX
ONBOOT=yes
Setup 4

/etc/sysconfig/network-scripts/ifcfg-ethX

TYPE=Ethernet
DEVICE=ethX
ONBOOT=yes

/etc/sysconfig/network-scripts/ifcfg-ethX.Y

VLAN=yes
TYPE=Vlan
PHYSDEV=ethX
VLAN_ID=Y
BOOTPROTO=none
IPADDR=XXX.XXX.XXX.XXX
PREFIX=XX
ONBOOT=no
Setup 5

/etc/sysconfig/network-scripts/ifcfg-ethX

TYPE=Ethernet
BOOTPROTO=none
DEVICE=ethX
ONBOOT=yes

Information

If you want to use the NIC switching mode to share the same physical connection between two virtual interfaces (one that bundles physical interfaces and the other that bundles tagged VLAN interfaces), you need to set up ifcfg-ethX the same as Setup 1 using the same IP address (IPADDR=) and other values. For example, if sha0 bundles eth0 and eth1, and sha1 bundles eth0.2 and eth1.2, configure ifcfg-eth0 according to ifcfg-ethX in Setup 1, not according to that shown in Setup 3.

(2) Verification of the physical interface

Verify if the physical interface is inserted into the system using the ip command.
Also, if the physical interface is UP, check whether "LOWER_UP" is displayed. If "LOWER_UP" is not displayed, the links might be down on the interface. Check the cable switch and HUB speed settings. Use the ethtool command to check the link state.

# ip addr show
eth0      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
          link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
          inet 192.168.70.2/24 brd 192.168.70.255 scope global eth0
          valid_lft forever preferred_lft forever
          inet6 fe80::xxx:xxxx:xxxx:xxxx/64 scope link
          valid_lft forever preferred_lft forever
eth1      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
          link/ether XX:XX:XX:XX:XX:XX brd ff:ff:ff:ff:ff:ff
          inet 192.168.71.2/24 brd 192.168.71.255 scope global eth1
          valid_lft forever preferred_lft forever
          inet6 fe80::xxx:xxxx:xxxx:xxxx/64 scope link
          valid_lft forever preferred_lft forever

In the above example, it is possible to use eth0 and eth1. For details on the ip command, refer to the Linux manual.

Information

When using Tagged VLAN, ensure that the NIC supports tagged VLAN functionality (IEEE 802.1Q). In addition, in a Redundant Line Control function, the effective range of VLAN-ID which can be specified is from 1 to 4094.

(3) Checking the name service

When using name services such as DNS or NIS, define keywords such as hosts in /etc/nsswitch.conf file to first refer to the local file. This allows to solve the address even if the DNS, NIS or LDAP sever is unreachable. The following is an example of /etc/nsswitch.conf.

#
# /etc/nsswitch.conf
#
# An example Name Service Switch config file. This file should be
# sorted with the most-used services at the beginning.
#
# The entry '[NOTFOUND=return]' means that the search for an
# entry should stop if the search in the previous entry turned
# up nothing. Note that if the search failed due to some other reason
# (like no NIS server responding) then the search continues with the
# next entry.
#
# Legal entries are:
#
#       nisplus or nis+         Use NIS+ (NIS version 3)
#       nis or yp               Use NIS (NIS version 2), also called YP
#       dns                     Use DNS (Domain Name Service)
#       files                   Use the local files
#       db                      Use the local database (.db) files
#       compat                  Use NIS on compat mode
#       hesiod                  Use Hesiod for user lookups
#       [NOTFOUND=return]       Stop searching if not found so far
#

# To use db, put the "db" in front of "files" for entries you want to be
# looked up first in the databases
#
# Example:
#passwd:    db files nisplus nis
#shadow:    db files nisplus nis
#group:     db files nisplus nis

passwd:     files
shadow:     files
group:      files

#hosts:     db files nisplus nis dns
hosts:      files dns
.....

Information

If the host name rather than the IP address is used in setting GLS, enable the hostname resolution function (set by hanetparam -h), which allows you to change the host name to the IP address using only the /etc/hosts file without depending on the /etc/nsswitch.conf file setting.

(4) IPv6 RA daemon configuration

GLS supports radvd(router advertisement daemon for IPv6) for RA (router advertisement) daemon. To use IPv6(dual) on Fast switching mode, you must start RA daemon on the host running GLS in order to transmit RA from virtual interfaces. Other than this purpose, RA daemon is not necessary. The following describes configuration procedure.


radvd configuration

  1. Define the configuration in /etc/radvd.conf.

    When transmitting network information (network fec0:1::, prefix length 64) from sha0 with RA(router advertisement), define the configuration description as shown below.
    In addition, the difference in the version of radvd needs to define the following kernel parameters (net.ipv6.conf.all.forwarding=1) in /etc/sysctl.conf.
    For details on radvd configuration, refer to radvd manual.

    interface sha0
    {
            AdvSendAdvert on;        # Sending router advertisements
            MinRtrAdvInterval 3;
            MaxRtrAdvInterval 10;       
            prefix fec0:1::0/64      # Sending Prefix fec0:1::0/64 from sha0
            {
                    AdvOnLink on;
                    AdvAutonomous on;
                    AdvRouterAddr on;
            };
    };
  2. Configure radvd to startup during system startup.

    Enable the radvd service.

    # systemctl enable radvd.service 
  3. Verify the radvd configuration.

    Check whether the radvd service is enabled.

    # systemctl is-enabled radvd.service
    enabled

(5) Route configuration

Route configuration is described below.


Default gateway configuration

Define the default gateway address (GATEWAY) in the "/etc/sysconfig/network-scripts/ifcfg-ethX" file.

/etc/sysconfig/network-scripts/ifcfg-ethX
DEVICE=ethX
(omitted)
GATEWAY=192.168.1.254

For RHEL 7, the default gateway can be also configured in the following procedure.

Define the default gateway address (GATEWAY) in the "/etc/sysconfig/network" file.

/etc/sysconfig/network
GATEWAY=192.168.1.254

For IPv6 and NIC switching mode in the RHEL7 environment, configure the setting by using the user command execution function instead of the network configuration file for the operating system. In the configuration file of the user command execution function, define the operating system command assigning the route of IPv6 to be executed after activation of the IP address. For details, refer to the Linux manual (ip(8), route(8) and so on).

Information

  • The default gateway device (GATEWAYDEV) can not be configured for a physical interface bound with NIC switching mode.

  • When defining the default gateway (GATEWAY) in the "/etc/sysconfig/network-scripts/ifcfg-ethX" file in the NIC switching mode, add the same configuration of GATEWAY in the configuration files of all NICs bound by GLS. Note that if different configurations of GATEWAY are defined in the "/etc/sysconfig/network" file and the "/etc/sysconfig/network-scripts/ifcfg-ethX" file, the configuration in the "/etc/sysconfig/network-scripts/ifcfg-ethX" file has a priority.

    # /opt/FJSVhanet/usr/sbin/hanetconfig print
    [IPv4,Patrol / Virtual NIC]
    
     Name        Hostname        Mode Physical ipaddr   Interface List
    +-----------+---------------+----+-----------------+--------------
     sha0        192.168.1.10     e                     eth1,eth2
    
    # cat /etc/sysconfig/network-scripts/ifcfg-eth1
    DEVICE=eth1
    (omitted)
    GATEWAY=192.168.1.254
    
    # cat /etc/sysconfig/network-scripts/ifcfg-eth2
    DEVICE=eth2
    (omitted)
    GATEWAY=192.168.1.254
  • If you do not use the "/etc/sysconfig/network" file in the environment where Virtual NIC mode is used, configure the route in the "/etc/sysconfig/network-scripts/ifcfg-shaX" file. You do not need to configure it in the "/etc/sysconfig/network-scripts/ifcfg-ethX" file in the same way as NIC switching mode. For details, see "3.3.3 Virtual NIC mode".


Static route configuration

For RHEL7

For RHEL8

3.2.2.2 System setup in Fast switching mode

Common settings between IPv4 and IPv6

When using an IPv4 address

When using an IPv6 address

3.2.2.3 System setup in NIC switching mode

Common settings between IPv4 and IPv6

When using an IPv4 address

When using an IPv6 address

3.2.2.4 System setup in Virtual NIC mode

Edit the setting (/etc/sysconfig/network-scripts/ifcfg-ethX file) for the physical interfaces that the GLS bundles as follows:

The descriptions vary depending the OS. See "Table 3.10 Configuration of physical interface (RHEL7)" and "Table 3.11 Configuration of physical interface (RHEL8 or later)" for the differences in descriptions.

For RHEL7

Table 3.10 Configuration of physical interface (RHEL7)

Item

Value (Example)

Description

DEVICE

ethX

Specify the device name. Set "ethX".

BOOTPROTO

static

Specify the protocol when getting the IP address. Set "static" or "none".

HOTPLUG

no

Specify the use of hotplug. Set "no".

ONBOOT

yes

Select whether to start the physical interface on startup of the OS. Set "yes".

DEVICETYPE

hanet

Specify the type of the device. Set "hanet".

MTU

9000

Specify the length of MTU.

When specifying the length of MTU, set the same value for the configuration file (ifcfg-ethX) of the primary interface and the secondary interface, and for the virtual interface configuration file (ifcfg-shaX).

An example is shown below.

For RHEL8 or later

Table 3.11 Configuration of physical interface (RHEL8 or later)

Item

Value (Example)

Description

TYPE

Ethernet

Specify the device type. Set "Ethernet".

BOOTPROTO

none

Specify the protocol when getting the IP address. Set "none" or "static".

DEVICE

ethX

Specify the device name. Set "ethX".

ONBOOT

yes

Select whether to start the physical interface on startup of the OS. Set "yes".

MTU

9000

Specify the length of MTU.

When specifying the length of MTU, set the same value for the configuration file (ifcfg-ethX) of the primary interface and the secondary interface, and for the virtual interface configuration file (ifcfg-shaX).

An example is shown below.

To create backup of the physical interface settings (the "/etc/sysconfig/network-scripts/ifcfg-ethX" file), the file name must begin with names other than "ifcfg-".
(e.g. bak_ifcfg-ethX)
If the file name begins with "ifcfg-", OS might recognize the interface as an interface to be activated during system startup.

Point

  • In RHEL7, add "HOTPLUG=no" to the settings of the physical interfaces bundled by GLS (the "/etc/sysconfig/network-scripts/ifcfg-ethX" file).
    This setting is not necessary in RHEL 8 or later. Do not set it.

  • In RHEL7, for the physical interfaces bundled by GLS, do not set "TYPE=Ethernet". Otherwise, GLS will not work properly.
    In RHEL 8 or later, set "TYPE=Ethernet" for the physical interfaces bundled by GLS.

  • An address such as IPADDR is not necessary. Do not set it.

  • In RHEL7, for the ifcfg-ethX configuration of the physical interfaces bundled by the GLS virtual interface, add the item "DEVICETYPE=hanet".
    This setting is not necessary in RHEL 8 or later. Do not set it.

  • If you need to prevent device names of physical NICs from changing to unexpected names in an environment where traditional interface names (ethX) for RHEL6 or earlier are used, describe the definition of "HWADDR=<MAC address>" in the settings for the physical interfaces (the /etc/sysconfig/network-scripts/ifcfg-ethX file).

  • When modifying MTU, make sure to set 1280 or more.

3.2.2.5 System setup in GS linkage mode