Top
Interstage Big DataParallel Processing ServerV1.0.1 User's Guide
FUJITSU Software

B.1 bdpp.conf

This section explains the settings in bdpp.conf.

File storage location

/etc/opt/FJSVbdpp/conf/bdpp.conf

File content

This file defines the information required for the installation and setup of this product.

A separate file must be created for each server functionality.

Format

Configure using the format shown below.

parameter=specifiedValue

Refer to the following for information on the parameters defined in each server:

Note

Parameters with "select" as the specified value

Enter up to "parameter=" but omit the value.

BDPP_PCL_PRIMARY_CONNECT2=

Parameters with "optional" as the specified value

The parameter line itself can be omitted.

Point

Separate "bdpp.conf" templates for each server type are stored under "/DISK1/config_template" on the distribution media (DVDROM) of this product. Copy the relevant template to the system work directory, and then edit the parameters to create the configuration file.

Note

When installing this product, create the configuration file in any directory. The storage directory of the created configuration file must be specified as the "BDPP_CONF_PATH" environment variable before installation.


[Master server]

Parameters set in the master server configuration file are shown below.

Item
No.

Parameter

Mandatory/
Optional

Value to be specified
(settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Specify the virtual host name to be set for the cluster.

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Specify the virtual IP address to be set for the cluster

3

BDPP_PRIMARY_NAME

Mandatory

master1

Specify the representative host name of the primary master server (the host name corresponding to the NIC that connects to the public LAN).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

4

BDPP_PRIMARY_IP

Mandatory

10.10.10.11

Specify the representative IP address that will be used to connect to the primary master server public LAN.

(The IP address that will be used to connect to public LAN1 in the figure)

5

BDPP_PRIMARY_ADM_IP

Mandatory

192.168.1.1

Specify the IP address that will be used to connect to the primary master server admin LAN.

(The IP address that will be used to connect to the admin LAN in the figure)

6

BDPP_SECONDARY_NAME

Optional

master2

Specify the representative host name of the secondary master server (the host name corresponding to the NIC that connects to the public LAN).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

If not replicating the master server, this value should be omitted.

7

BDPP_SECONDARY_IP

Optional

10.10.10.12

Specify the representative IP address that will be used to connect to the secondary master server public LAN.

(The IP address that will be used to connect to public LAN1 in the figure)

If not replicating the master server, this value should be omitted.

8

BDPP_SECONDARY_ADM_IP

Optional

192.168.1.2

Specify the IP address that will be used to connect to the secondary master server admin LAN.

(The IP address that will be used to connect to the admin LAN in the figure)

If not replicating the master server, this value should be omitted.

9

BDPP_PCL_CLUSTER_GROUP

Mandatory

bdppcluster

Specify the cluster group name to be set for the cluster.

For the cluster group name, the first character must be a letter, and it must consist of 31 or fewer alphanumeric characters.

10

BDPP_PCL_PRIMARY_iRMC_IP

Optional

192.168.1.11

Specify the IP address of the primary master server remote management controller.

If building a master server in a virtual environment, this value should be omitted.

11

BDPP_PCL_PRIMARY_iRMC_ACCOUNT

Optional

root

Specify the account of the primary master server remote management controller.

If building a master server in a virtual environment, this value should be omitted.

12

BDPP_PCL_PRIMARY_iRMC_PASS

Optional

password

Specify the password of the primary master server remote management controller.

If building a master server in a virtual environment, this value should be omitted.

13

BDPP_PCL_SECONDARY_iRMC_IP

Optional

192.168.1.12

Specify the IP address of the secondary master server remote management controller.

If not replicating the master server, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

14

BDPP_PCL_SECONDARY_iRMC_ACCOUNT

Optional

root

Specify the account of the secondary master server remote management controller.

If not replicating the master server, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

15

BDPP_PCL_SECONDARY_iRMC_PASS

Optional

password

Specify the password of the secondary master server remote management controller.

If not replicating the master server, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

16

BDPP_PCL_PRIMARY_CIP

Mandatory

192.168.2.11

Specify the IP address (*1) used for the primary master server CIP (Cluster Interconnect Protocol).

17

BDPP_PCL_SECONDARY_CIP

Optional

192.168.2.12

Specify the IP address (*1) used for the secondary master server CIP (Cluster Interconnect Protocol).

If not replicating the master server, this value should be omitted.

18

BDPP_PCL_PRIMARY_CONNECT1

Mandatory

eth5

Specify the primary master server side NIC name (NIC5) used for connections between clusters.

Configure the network interface used in the cluster interconnect so that it is activated when the system is started. Note, however, that no IP address must be assigned.

19

BDPP_PCL_PRIMARY_CONNECT2

Optional

eth6

Specify the primary master server side NIC name (NIC6) used for connections between clusters.

Note, however, that no IP address must be assigned.

When the cluster interconnect is a single configuration, this value should be omitted.

20

BDPP_PCL_SECONDARY_CONNECT1

Optional

eth5

Specify the secondary master server side NIC name (NIC5) used for connections between clusters.

If not replicating the master server, this value should be omitted.

21

BDPP_PCL_SECONDARY_CONNECT2

Optional

eth6

Specify the secondary master server side NIC name (NIC6) used for connections between clusters.

When the cluster interconnect is a single configuration, this value should be omitted.

If not replicating the master server, this value should be omitted.

22

BDPP_GLS_PRIMARY_CONNECT1

Mandatory

eth1

Specify the primary master server NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the figure)

23

BDPP_GLS_PRIMARY_CONNECT2

Optional

eth2

Specify the primary master server NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the figure)

When the public LAN is a single configuration, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

24

BDPP_GLS_SECONDARY_CONNECT1

Optional

eth1

Specify the secondary master server NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the figure)

If not replicating the master server, this value should be omitted.

25

BDPP_GLS_SECONDARY_CONNECT2

Optional

eth2

Specify the secondary master server NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the figure)

When the public LAN is a single configuration, this value should be omitted.

If not replicating the master server, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

26

BDPP_GLS_POLLING1_IP

Mandatory

10.10.10.100

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN1 in the figure)

27

BDPP_GLS_POLLING2_IP

Optional

10.10.10.101

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN2 in the figure)

When the public LAN is a single configuration, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

28

BDPP_GLS_NETMASK

Optional

255.255.0.0

Specify the net mask for the public LAN IP address.

The default net mask is "255.255.255.0".

29

BDPP_DISKARRAY_iSCSI1_IP

Optional

10.10.11.11

Specify the IP address of the ETERNUS DX disk array iSCSI-CA port that is part of the DFS management partition.

This parameter is mandatory if YES is specified for BDPP_PDFS_FILESYSTEM.

30

BDPP_DISKARRAY_iSCSI2_IP

Optional

10.10.12.11

If the connection to the ETERNUS DX disk array is redundant, specify the other IP address of the ETERNUS DX disk array iSCSI-CA port to which the connection will be made.

When the iSCSI LAN is a single configuration, this value should be omitted.

If building a master server in a virtual environment, this value should be omitted.

31

BDPP_ROR_ADMIN_IP

Optional

192.168.1.1

Specify the primary master server admin LAN IP address to be specified when installing ROR.

If building a master server in a virtual environment, this value should be omitted.

32

BDPP_ROR_ADMIN_ACCOUNT

Optional

root

Specify the account of the local server used when installing ROR.

If building a master server in a virtual environment, this value should be omitted.

33

BDPP_ROR_ADMIN_PASS

Optional

password

Specify the password of the local server used when installing ROR.

If building a master server in a virtual environment, this value should be omitted.

34

BDPP_PDFS_FILESYSTEM

Mandatory

YES

If DFS is to be used as the file system, specify YES (or yes).

35

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Specify the PDFS mount point.

This parameter is mandatory if YES is specified for BDPP_PDFS_FILESYSTEM.

36

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

To register a user ID with permissions for the execution of MapReduce and access to the file system (DFS), specify the user name and UID.

Multiple user IDs can be registered (*2).

37

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Specify this to register a user group name and GID for the execution of MapReduce and to access the file system (DFS).

38

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Specify the name of the top directory that stores the data used in Hadoop on the file system (DFS).

The data used in Hadoop and the results data processed in Hadoop will be stored under the directory that is specified here.

39

BDPP_KVMHOST_IP

192.168.1.100

Specify the IP address of the admin LAN for the KVM host machine used in the shutdown agent settings (*3).

Specify this only when building a master server in a virtual environment (KVM).

40

BDPP_KVMHOST_ACCOUNT

pcluser

Specify the user account for the KVM host machine used in the shutdown agent settings.

Specify this only when building a master server in a virtual environment (KVM).

41

BDPP_KVMHOST_PASS

password

Specify the user password for the KVM host machine used in the shutdown agent settings.

Specify this only when building a master server in a virtual environment (KVM).

*1: An interconnect private IP interface can be built by using an IP address provided for a private network.

*2: When registering multiple user IDs, specify multiple user names and user IDs by delimiting with a space (" ") as shown below.

bdppuser1,1500 bdppuser2,1501 bdppuser3,1502

*3: If replicated configuration is used for master servers and the primary master server and the secondary master server are installed on virtual machines that are on different host machines, specify the IP addresses for the two host machines by delimiting with a comma (",").

192.168.1.100,192.168.1.101

Figure B.1 Network configuration of the master server and bdpp.conf parameters

*1: CIP (Cluster Interconnect Protocol)

*2: HUB host used for the HUB monitoring feature.

The HUB monitoring feature executes a ping to neighboring hubs at fixed intervals, and if it detects a fault in the transfer route, it switches the interface being used.


[Slave server]

Parameters set in the slave server configuration file are shown below.

Item
No.

Parameter

Mandatory/
Optional

Value to be specified
(settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Set the same value as the master server.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Set the same value as the master server.

3

BDPP_PRIMARY_NAME

Mandatory

master1

Set the same value as the master server.

4

BDPP_SECONDARY_NAME

Optional

master2

Set the same value as the master server.

5

BDPP_SERVER_NAME

Mandatory

slave1

Specify the representative host name of the slave server (the host name corresponding to the NIC that connects to the public LAN).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

6

BDPP_SERVER_IP

Mandatory

10.10.10.21

Specify the representative IP address that will be used to connect to the slave server public LAN.

7

BDPP_GLS_SERVER_CONNECT1

Mandatory

eth1

Specify the slave server NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the figure)

8

BDPP_GLS_SERVER_CONNECT2

Optional

eth2

Specify the slave server NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the figure)

When the public LAN is a single configuration, this value should be omitted.

If building a slave server in a virtual environment, this value should be omitted.

9

BDPP_GLS_SERVER_POLLING1_IP

Mandatory

10.10.10.100

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN1 in the figure)

10

BDPP_GLS_SERVER_POLLING2_IP

Optional

10.10.10.101

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN2 in the figure)

When the public LAN is a single configuration, this value should be omitted.

If building a slave server in a virtual environment, this value should be omitted.

11

BDPP_GLS_NETMASK

Optional

255.255.0.0

Specify the net mask for the public LAN IP address.

The default net mask is "255.255.255.0".

12

BDPP_ROR_ADMIN_IP

Optional

192.168.1.1

Set the same value as the master server.

13

BDPP_PDFS_FILESYSTEM

Mandatory

YES

Set the same value as the master server.

14

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Set the same value as the master server.

15

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Set the same value as the master server.

16

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Set the same value as the master server.

17

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Set the same value as the master server.


Figure B.2 Slave server network configuration and bdpp.conf parameter


[Development server]

Parameters set in the development server configuration file are shown below.

Item
No.

Parameter

Mandatory/
Optional

Value to be specified
(settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Set the same value as the master server.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Set the same value as the master server.

3

BDPP_PRIMARY_NAME

Mandatory

master1

Set the same value as the master server.

4

BDPP_SECONDARY_NAME

Optional

master2

Set the same value as the master server.

5

BDPP_SERVER_NAME

Mandatory

develop

Specify the representative host name of the development server (the host name corresponding to the NIC that connects to the public LAN).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

6

BDPP_SERVER_IP

Mandatory

10.10.10.30

Specify the representative IP address of the development server.

7

BDPP_PDFS_FILESYSTEM

Mandatory

YES

Set the same value as the master server.

8

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Set the same value as the master server.

9

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Set the same value as the master server.

10

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Set the same value as the master server.

11

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Set the same value as the master server.


Figure B.3 Development server network configuration and bdpp.conf parameter


[Collaboration server]

Parameters set in the collaboration server configuration file are shown below.

Item
No.

Parameter

Mandatory/

Optional

Value to be specified
(settings example)

Explanation

1

BDPP_SERVER_NAME

Mandatory

collaborate

Specify the representative host name of the collaboration server (the host name corresponding to the NIC that connects to the public LAN).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

2

BDPP_SERVER_IP

Mandatory

10.10.10.31

Specify the representative IP address of the collaboration server.

3

BDPP_PDFS_FILESYSTEM

Mandatory

YES

Set the same value as the master server.

4

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Set the same value as the master server.

5

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Set the same value as the master server.

6

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Set the same value as the master server.

7

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Set the same value as the master server.


Figure B.4 Collaboration server network configuration and bdpp.conf parameter


Definition examples

Definition examples for bdpp.conf are shown below.

These definition examples are provided for various servers for the following system configurations:

[Master server]
BDPP_CLUSTER_NAME=cluster
BDPP_CLUSTER_IP=10.10.10.1
BDPP_PRIMARY_NAME=master1
BDPP_PRIMARY_IP=10.10.10.11
BDPP_PRIMARY_ADM_IP=192.168.1.1
BDPP_SECONDARY_NAME=master2
BDPP_SECONDARY_IP=10.10.10.12
BDPP_SECONDARY_ADM_IP=192.168.1.2
BDPP_PCL_CLUSTER_GROUP=bdppcluster
BDPP_PCL_PRIMARY_iRMC_IP=192.168.1.11
BDPP_PCL_PRIMARY_iRMC_ACCOUNT=irmc
BDPP_PCL_PRIMARY_iRMC_PASS=password
BDPP_PCL_SECONDARY_iRMC_IP=192.168.1.12
BDPP_PCL_SECONDARY_iRMC_ACCOUNT=irmc 
BDPP_PCL_SECONDARY_iRMC_PASS=password
BDPP_PCL_PRIMARY_CIP=192.168.2.11
BDPP_PCL_SECONDARY_CIP=192.168.2.12
BDPP_PCL_PRIMARY_CONNECT1=eth5
BDPP_PCL_PRIMARY_CONNECT2=eth6
BDPP_PCL_SECONDARY_CONNECT1=eth5
BDPP_PCL_SECONDARY_CONNECT2=eth6
BDPP_GLS_PRIMARY_CONNECT1=eth1
BDPP_GLS_PRIMARY_CONNECT2=eth2
BDPP_GLS_SECONDARY_CONNECT1=eth1
BDPP_GLS_SECONDARY_CONNECT2=eth2
BDPP_GLS_POLLING1_IP=10.10.10.100
BDPP_GLS_POLLING2_IP=10.10.10.101
BDPP_DISKARRAY_iSCSI1_IP=10.10.11.11
BDPP_DISKARRAY_iSCSI2_IP=10.10.12.11
BDPP_ROR_ADMIN_IP=192.168.1.1
BDPP_ROR_ADMIN_ACCOUNT=admin
BDPP_ROR_ADMIN_PASS=password
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop

[Slave server]
BDPP_CLUSTER_NAME=cluster
BDPP_CLUSTER_IP=10.10.10.1
BDPP_PRIMARY_NAME=master1
BDPP_SECONDARY_NAME=master2
BDPP_SERVER_NAME=slave1
BDPP_SERVER_IP=10.10.10.21
BDPP_GLS_SERVER_CONNECT1=eth1
BDPP_GLS_SERVER_CONNECT2=eth2
BDPP_GLS_SERVER_POLLING1_IP=10.10.10.100
BDPP_GLS_SERVER_POLLING2_IP=10.10.10.101
BDPP_ROR_ADMIN_IP=192.168.1.1
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop

[Development server]
BDPP_CLUSTER_NAME=cluster
BDPP_CLUSTER_IP=10.10.10.1
BDPP_PRIMARY_NAME=master1
BDPP_SECONDARY_NAME=master2
BDPP_SERVER_NAME=develop
BDPP_SERVER_IP=10.10.10.30
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop

[Collaboration server]
BDPP_SERVER_NAME=collaborate
BDPP_SERVER_IP=10.10.10.31
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop