Top
Interstage Big DataParallel Processing ServerV1.0.0 User's Guide
Interstage

A.2.1 bdpp.conf

This section describes the configuration file (bdpp.conf) used by this product.

File storage location

Point

Separate "bdpp.conf" file templates for each server type are stored under "/DISK1/config_template" on the distribution media (DVD-ROM) of this product. Copy the relevant template to the system work directory and then edit the parameters to create the configuration file.

Note

When installing this product, create the configuration file in any directory. The storage directory of the created configuration file must be specified as the "BDPP_CONF_PATH" environment variable before installation.

File content

The file content defines the information required for installation and setup of this product.
A separate file must be created for each of the server functions.

Note

For parameters for which specifying a value is optional, enter up to "parameter=" but omit the value.

Example when value is omitted:

BDPP_PCL_ PRIMARY_CONNECT2=

[Master server]

Item No.

Parameter

Mandatory/Optional

Value to be specified (settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Specify the virtual host name to be set for the cluster.

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Specify the virtual IP address to be set for the cluster

3

BDPP_PRIMARY_NAME

Mandatory

master1

Specify the representative host name of the master server (primary).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

4

BDPP_PRIMARY_IP

Mandatory

10.10.10.11

Specify the representative IP address that will be used to connect to the master server (primary) public LAN.

(The IP address that will be used to connect to public LAN1 in the graphic)

5

BDPP_PRIMARY_ADM_IP

Mandatory

192.168.1.1

Specify the IP address that will be used to connect to the master server (primary) admin LAN.

(The IP address that will be used to connect to the admin LAN in the graphic)

6

BDPP_SECONDARY_NAME

Mandatory

master2

Specify the representative host name of the master server (secondary).

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

7

BDPP_SECONDARY_IP

Mandatory

10.10.10.12

Specify the representative IP address that will be used to connect to the master server (secondary) public LAN.

(The IP address that will be used to connect to public LAN1 in the graphic)

8

BDPP_ SECONDARY_ADM_IP

Mandatory

192.168.1.2

Specify the IP address that will be used to connect to the master server (secondary) admin LAN.

(The IP address that will be used to connect to the admin LAN in the graphic)

9

BDPP_PCL_CLUSTER_GROUP

Mandatory

bdppcluster

Specify the cluster group name to be set for the cluster.

10

BDPP_PCL_PRIMARY_iRMC_IP

Mandatory

192.168.1.11

Specify the IP address of the master server (primary) remote management controller.

11

BDPP_PCL_PRIMARY_iRMC_ACCOUNT

Mandatory

root

Specify the account of the master server (primary) remote management controller.

12

BDPP_PCL_PRIMARY_iRMC_PASS

Mandatory

password

Specify the password of the master server (primary) remote management controller.

13

BDPP_PCL_SECONDARY_iRMC_IP

Mandatory

192.168.1.12

Specify the IP address of the master server (secondary) remote management controller.

14

BDPP_PCL_SECONDARY_iRMC_ACCOUNT

Mandatory

root

Specify the account of the master server (secondary) remote management controller.

15

BDPP_PCL_SECONDARY_iRMC_PASS

Mandatory

password

Specify the password of the master server (secondary) remote management controller.

16

BDPP_PCL_PRIMARY_CIP

Mandatory

192.168.2.11

Specify the IP address (*1) used for the master server (primary) CIP (cluster interconnect protocol).

17

BDPP_PCL_SECONDARY_CIP

Mandatory

192.168.2.12

Specify the IP address (*1) used for the master server (secondary) CIP (cluster interconnect protocol).

18

BDPP_PCL_ PRIMARY_CONNECT1

Mandatory

eth5

Specify the master server (primary) side NIC name (NIC5) used for connections between clusters.

19

BDPP_PCL_ PRIMARY_CONNECT2

Optional

eth6

Specify the master server (primary) side NIC name (NIC6) used for connections between clusters.

20

BDPP_PCL_ SECONDARY_CONNECT1

Mandatory

eth5

Specify the master server (secondary) side NIC name (NIC5) used for connections between clusters.

21

BDPP_PCL_ SECONDARY_CONNECT2

Optional

eth6

Specify the master server (secondary) side NIC name (NIC6) used for connections between clusters.

22

BDPP_GLS_ PRIMARY_CONNECT1

Mandatory

eth1

Specify the master server (primary) NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the graphic)

23

BDPP_GLS_ PRIMARY_CONNECT2

Optional

eth2

Specify the master server (primary) NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the graphic)

24

BDPP_GLS_ SECONDARY_CONNECT1

Mandatory

eth1

Specify the master server (secondary) NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the graphic)

25

BDPP_GLS_ SECONDARY_CONNECT2

Optional

eth2

Specify the master server (secondary) NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the graphic)

26

BDPP_GLS_POLLING1_IP

Mandatory

10.10.10.100

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN1 in the graphic)

27

BDPP_GLS_POLLING2_IP

Optional

10.10.10.101

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN2 in the graphic)

28

BDPP_DISKARRAY_iSCSI1_IP

Mandatory

10.10.11.11

Specify the IP address of the storage system disk array iSCSI-CA port to which the connection will be made

29

BDPP_DISKARRAY_iSCSI2_IP

Optional

10.10.12.11

If the storage system connection has been duplicated, specify the other IP address of the storage system disk array iSCSI-CA port to which the connection will be made.

30

BDPP_ROR_ADMIN_IP

Mandatory

192.168.1.1

Specify the master server (primary) admin LAN IP address to be specified when installing ROR.

31

BDPP_ROR_ADMIN_ACCOUNT

Mandatory

root

Specify the account of the local server used when installing ROR.

32

BDPP_ROR_ADMIN_PASS

Mandatory

password

Specify the password of the local server used when installing ROR.

33

BDPP_PDFS_FILESYSTEM

Mandatory

YES

If DFS is to be used as the file system, specify YES (or yes).

34

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Specify the DFS mount point.

This parameter is mandatory if YES is specified for BDPP_PDFS_FILESYSTEM.

35

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

To register a user ID with permissions for the execution of MapReduce and access to the file system (DFS), specify the user name and UID.

When registering multiple user IDs, use a space ( ) to separate each user name and UID.

Example

bdppuser1,1500 bdppuser2,1501 bdppuser2,1502

36

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Specify this to register a user group name and GID for the execution of MapReduce and to access the file system (DFS).

37

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Specify the name of the top directory that stores the data used in Hadoop on the file system (DFS).

The data used in Hadoop and the results data processed in Hadoop will be stored under the directory that is specified here.

*1: An interconnect private IP interface can be built by using an IP address provided for a private network.

Figure A.1 Network configuration of the master server and bdpp.conf parameters

[Slave server]

Item No.

Parameter

Mandatory/Optional

Value to be specified (settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Specify the value that was specified for the master server bdpp.conf BDPP_CLUSTER_NAME parameter.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Specify the value that was specified for the master server bdpp.conf BDPP_CLUSTER_IP parameter.

3

BDPP_PRIMARY_NAME

Mandatory

master1

Specify the value that was specified for the master server bdpp.conf BDPP_PRIMARY_NAME parameter.

4

BDPP_SECONDARY_NAME

Mandatory

master2

Specify the value that was specified for the master server bdpp.conf BDPP_SECONDARY_NAME parameter.

5

BDPP_SERVER_NAME

Mandatory

slave1

Specify the representative host name of the slave server.

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

6

BDPP_SERVER_IP

Mandatory

10.10.10.21

Specify the representative IP address that will be used to connect to the slave server public LAN

7

BDPP_GLS_ SERVER_CONNECT1

Optional

eth1

Specify the slave server NIC name (NIC1) used for connections between slave servers.

(The NIC that will be used to connect to public LAN1 in the graphic)

8

BDPP_GLS_ SERVER_CONNECT2

Optional

eth2

Specify the slave server NIC name (NIC2) used for connections between slave servers.

(The NIC that will be used to connect to public LAN2 in the graphic)

9

BDPP_GLS_SERVER_POLLING1_IP

Optional

10.10.10.100

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN1 in the graphic)

10

BDPP_GLS_SERVER_POLLING2_IP

Optional

10.10.10.101

Specify the IP address of the monitoring target HUB host.

(Monitoring target HUB host on public LAN2 in the graphic)

11

BDPP_ROR_ADMIN_IP

Mandatory

192.168.1.1

Specify the value that was specified for the master server bdpp.conf BDPP_ROR_ADMIN parameter.

12

BDPP_PDFS_FILESYSTEM

Mandatory

YES

Specify the value that was specified for the master server bdpp.conf BDPP_PDFS_FILESYSTEM parameter.

13

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Specify the value that was specified for the master server bdpp.conf BDPP_PDFS_MOUNTPOINT parameter.

14

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_USERS parameter.

15

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_GROUP parameter.

16

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_TOP_DIR parameter.

Figure A.2 Slave server network configuration and bdpp.conf parameter

[Development server]

Item No.

Parameter

Mandatory/Optional

Value to be specified (settings example)

Explanation

1

BDPP_CLUSTER_NAME

Mandatory

cluster

Specify the value that was specified for the master server bdpp.conf BDPP_CLUSTER_NAME parameter.

2

BDPP_CLUSTER_IP

Mandatory

10.10.10.1

Specify the value that was specified for the master server bdpp.conf BDPP_CLUSTER_IP parameter.

3

BDPP_PRIMARY_NAME

Mandatory

master1

Specify the value that was specified for the master server bdpp.conf BDPP_PRIMARY_NAME parameter.

4

BDPP_SECONDARY_NAME

Mandatory

master2

Specify the value that was specified for the master server bdpp.conf BDPP_SECONDARY_NAME parameter.

5

BDPP_SERVER_NAME

Mandatory

develop

Specify the representative host name of the development server.

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

6

BDPP_SERVER_IP

Mandatory

10.10.10.30

Specify the representative IP address of the development server.

7

BDPP_PDFS_FILESYSTEM

Mandatory

YES

If PDFS is to be used as the file system, specify YES (or yes).

This parameter must match the master server settings.

8

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Specify the PDFS mount point.

This parameter is mandatory if YES is specified for BDPP_PDFS_FILESYSTEM.
This parameter must match the master server settings.

9

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_USERS parameter.

10

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_GROUP parameter.

11

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_TOP_DIR parameter.

Figure A.3 Development server network configuration and bdpp.conf parameter

[Collaboration server]

Item No.

Parameter

Mandatory/Optional

Value to be specified (settings example)

Explanation

1

BDPP_SERVER_NAME

Mandatory

collaborate

Specify the representative host name of the collaboration server.

For the host name, the first character must be a letter, and it must consist of 11 or fewer alphanumeric characters.

2

BDPP_SERVER_IP

Mandatory

10.10.10.31

Specify the representative IP address of the collaboration server.

3

BDPP_PDFS_FILESYSTEM

Mandatory

YES

If PDFS is to be used as the file system, specify YES (or yes).

This parameter must match the master server settings.

4

BDPP_PDFS_MOUNTPOINT

Optional

/mnt/pdfs

Specify the PDFS mount point.

This parameter is mandatory if YES is specified for BDPP_PDFS_FILESYSTEM.
This parameter must match the master server settings.

5

BDPP_HADOOP_DEFAULT_USERS

Optional

bdppuser1,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_USERS parameter.

6

BDPP_HADOOP_DEFAULT_GROUP

Optional

bdppgroup,1500

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_DEFAULT_GROUP parameter.

7

BDPP_HADOOP_TOP_DIR

Optional

/hadoop

Specify the value that was specified for the master server bdpp.conf BDPP_HADOOP_TOP_DIR parameter.

Figure A.4 Collaboration server network configuration and bdpp.conf parameter

Definition examples
[Master server]
BDPP_CLUSTER_NAME=cluster
BDPP_CLUSTER_IP=10.10.10.1
BDPP_PRIMARY_NAME=master1
BDPP_PRIMARY_IP=10.10.10.11 
BDPP_PRIMARY_ADM=192.168.1.1
BDPP_SECONDARY_NAME=master2
BDPP_SECONDARY_IP=10.10.10.12
BDPP_SECONDARY _ADM=192.168.1.2
BDPP_PCL_CLUSTER_GROUP=bdppcluster
BDPP_PCL_PRIMARY_iRMC_IP=192.168.1.11
BDPP_PCL_PRIMARY_iRMC_ACCOUNT=irmc
BDPP_PCL_PRIMARY_iRMC_PASS=password
BDPP_PCL_SECONDARY_iRMC_IP=192.168.1.12
BDPP_PCL_SECONDARY_iRMC_ACCOUNT=irmc 
BDPP_PCL_SECONDARY_iRMC_PASS=password
BDPP_PCL_PRIMARY_CIP=192.168.2.11
BDPP_PCL_SECONDARY_CIP=192.168.2.12
BDPP_PCL_PRIMARY_CONNECT1=eth5
BDPP_PCL_PRIMARY_CONNECT2=eth6
BDPP_PCL_SECONDARY_CONNECT1=eth5
BDPP_PCL_SECONDARY_CONNECT2=eth6
BDPP_GLS_PRIMARY_CONNECT1=eth1
BDPP_GLS_PRIMARY_CONNECT2=eth2
BDPP_GLS_SECONDARY_CONNECT1=eth1
BDPP_GLS_SECONDARY_CONNECT2=eth2
BDPP_GLS_POLLING1_IP=10.10.10.100
BDPP_GLS_POLLING2_IP=10.10.10.101
BDPP_DISKARRAY_iSCSI1_IP=10.10.11.11
BDPP_DISKARRAY_iSCSI2_IP=10.10.12.11
BDPP_ROR_ADMIN_IP=192.168.1.1
BDPP_ROR_ADMIN_ACCOUNT=admin
BDPP_ROR_ADMIN_PASS=password
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop
[Slave server]
BDPP_CLUSTER_IP=10.10.10.1
BDPP_CLUSTER_NAME=cluster
BDPP_PRIMARY_NAME=master1
BDPP_SECONDARY_NAME=master2
BDPP_SERVER_NAME=slave1
BDPP_SERVER_IP=10.10.10.21
BDPP_GLS_SERVER_CONNECT1=eth1
BDPP_GLS_SERVER_CONNECT2=eth2
BDPP_GLS_POLLING1_IP=10.10.10.100
BDPP_GLS_POLLING2_IP=10.10.10.101
BDPP_ROR_ADMIN_IP=192.168.1.1
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop
[Development server]
BDPP_CLUSTER_IP=10.10.10.1
BDPP_CLUSTER_NAME=cluster
BDPP_PRIMARY_NAME=master1
BDPP_SECONDARY_NAME=master2
BDPP_SERVER_NAME=develop
BDPP_SERVER_IP=10.10.10.30
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop
[Collaboration server]
BDPP_SERVER_NAME=collaborate
BDPP_SERVER_IP=10.10.10.31
BDPP_PDFS_FILESYSTEM=YES
BDPP_PDFS_MOUNTPOINT=/mnt/pdfs
BDPP_HADOOP_DEFAULT_USERS=bdppuser1,1500
BDPP_HADOOP_DEFAULT_GROUP=bdppgroup,1500
BDPP_HADOOP_TOP_DIR=/hadoop