Interstage Big DataParallel Processing ServerV1.0.1 User's Guide

Appendix D Port List

This appendix describes the ports used by this product.

Note

Port numbers listed in the Port column are fixed and cannot be changed.

Ports used with Hadoop (MapReduce)

The following ports are used for MapReduce processes.

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
Public LAN	Slave server	Hadoop (TaskTracker)	Not fixed	Master server	Hadoop (JobTracker)	9000	tcp
	Development server	Hadoop (Client)	Not fixed	Master server
	Development server	Hadoop (Client)	Not fixed	Master server	Hadoop (JobTracker)	50030	tcp
	Slave server	Hadoop (TaskTracker)	Not fixed	Slave server	Hadoop (TaskTracker)	50060	tcp

Ports used with Fujitsu distributed file system (DFS)

The following ports are used for iSCSI connections to the ETERNUS DX disk array.

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
iSCSI LAN	Master server	-	Not fixed	ETERNUS DX disk array	iscsi-target	3260	tcp
	Slave server	-	Not fixed
	Development server	-	Not fixed
	Collaboration server	-	Not fixed

Ports used for master server replication

The following ports are used for the master server replication feature.

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
Admin LAN	Master server	-	Not fixed	Master server (*1)	-	2316	udp
		-	Not fixed		-	623	udp
CIP LAN	Master server	-	Not fixed	Master server (*2)	-	9331	tcp
	Master server	-	Not fixed	Master server (*1 ) (*2)	-	9379	tcp
	Master server	-	Not fixed	Master server (*2)	-	9378	tcp
	Master server	-	Not fixed	Master server (*1) (*2)	-	9377	tcp
	Master server	-	Not fixed	Master server (*2)	-	9376	tcp
		-	Not fixed		-	9375	tcp
	Master server	-	Not fixed	Master server (*1)	-	9383	tcp
		-	Not fixed		-	9384	tcp
		-	9786		-	9786	tcp
		-	8000		-	8000	udp
		-	11111		-	11111	udp

*1: Used for communication between the primary master server and the secondary master server if replicated configuration is used for master servers.

*2: Used for communication between processes within master servers. Can also be used if replicated configuration is not used for master servers.

Ports used for Smart Setup

The following ports are used when adding (cloning) slave servers to a physical environment.

They are not used for adding slave servers to virtual environments.

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
Admin LAN	Primary master server	-	4972	Slave server	-	4973	udp
	Slave server	-	4973	Primary master server	-	4972	udp
		bootpc	68		bootpc	67	udp
		-	Not fixed		pxc	4011	udp
		-	Not fixed		tftp	69	udp
	Primary master server	-	Not fixed	Primary master server	-	4971	tcp
	Slave server	-	4974~ 4989	Primary master server	-	4974~ 4989	udp
		-	Not fixed		-	4974~ 4989	tcp udp

Point

The method for adding slave servers differs depending on the server configuration. Refer to "6.3 Adding Second and Subsequent Slave Servers" for details.

Ports used for Hadoop (HBase, ZooKeeper) (reference information)

The following ports are used for HBase and ZooKeeper processes.

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
Public LAN	Slave server	HBbase (RegionServer)	Not fixed	Master server	HBase (Hmaster) (BackupHmaster)	60000	tcp
	Development server	HBase (Client)	Not fixed
	Development server	HBase (Client)	Not fixed	Master server	HBase (Hmaster) (BackupHmaster)	60010	tcp
	Master server	HBase (Hmaster) (BackupHmaster)	Not fixed	Slave server	HBase (RegionServer)	60020	tcp
	Slave server	HBase (RegionServer)	Not fixed
	Development server	HBase (Client)	Not fixed
	Development server	HBase (Client)	Not fixed	Slave server	HBase (RegionServer)	60030	tcp
	Master server	HBase (Hmaster) (BackupHmaster)	Not fixed	Slave server	ZooKeeper	2081	tcp
	Slave server	HBase (RegionServer)	Not fixed
	Development server	HBase (Client)	Not fixed
	Slave server	ZooKeeper	Not fixed	Slave server	ZooKeeper	2888	tcp
	Slave server	ZooKeeper	Not fixed	Slave server	ZooKeeper	3888	tcp

Ports used for HDFS (reference information)

The following ports are used with the HDFS file system.

They cannot be used when using DFS file systems (when YES is specified in the BDPP_PDFS_FILESYSTEM parameter of bdpp.conf).

LAN type	Send source			Send destination			Protocol
	Server	Service	Port	Server	Service	Port
Public LAN	Slave server	Hadoop (DataNode)	Not fixed	Master server	Hadoop (NameNode)	8020	tcp
	Development server	Hadoop (Client)	Not fixed
	Development server	Hadoop (Client)	Not fixed	Slave server	Hadoop (DataNode)	50010	tcp
	Slave server	Hadoop (DataNode)	Not fixed	Slave server	Hadoop (DataNode)	50020	tcp
	Development server	Hadoop (Client)	Not fixed
	Master server	Hadoop (Secondary NameNode)	Not fixed	Master server	Hadoop (NameNode)	50070	tcp
	Development server	Hadoop (Client)	Not fixed
	Slave server	Hadoop (DataNode)	Not fixed	Slave server	Hadoop (DataNode)	50075	tcp
	Development server	Hadoop (Client)	Not fixed
	Master server	Hadoop (NameNode)	Not fixed	Master server	Hadoop (Secondary NameNode)	50090	tcp
	Master server	Hadoop (Secondary NameNode)	Not fixed	Master server	Hadoop (NameNode)	50470	tcp
	Development server	Hadoop (Client)	Not fixed
	Slave server	Hadoop (DataNode)	Not fixed	Slave server	Hadoop (DataNode)	50475	tcp
	Development server	Hadoop (Client)	Not fixed

See

Refer to "B.1 bdpp.conf" for information on this configuration file.