Top
Interstage Big DataParallel Processing ServerV1.0.1 User's Guide
FUJITSU Software

C.1 hadoop-env.sh

This section explains the environment variables set in hadoop-env.sh.

Environment variable

Default value/Value to be set

HADOOP_CLASSPATH

CLASSPATH of the JVM that operates Hadoop

Default value

None

Value to be set

$HADOOP_CLASSPATH:/opt/FJSVpdfs/lib/pdfs.jar

HADOOP_JOBTRACKER_OPTS

Launch option specifically for the JVM that operates the JobTracker

Default value

-Dcom.sun.management.jmxremote $HADOOP_JOBTRACKER_OPTS

Value to be set

-Xmx$$m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=60001 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=localhost -Dhadoop.security.logger=INFO,DRFAS -Dmapred.audit.logger=INFO,MRAUDIT -Dhadoop.mapreduce.jobsummary.logger=INFO,JSA $HADOOP_JOBTRACKER_OPTS


$$ = physicalMemorySizeInMb / 3

HADOOP_OPTS

Launch option for the JVM that operates Hadoop

Default value

None

Value to be set

-Djava.net.preferIPv4Stack=true $HADOOP_OPTS

HADOOP_SSH_OPTS

Option specified in ssh when Hadoop uses ssh

Default value

None

Value to be set

-o StrictHostKeyChecking=no -o BatchMode=yes

HADOOP_TASKTRACKER_OPTS

Launch option specifically for the JVM that operates the TaskTracker

Default value

None

Value to be set

-Xmx$$m -Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.port=60002 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=localhost -Dhadoop.security.logger=ERROR,console -Dmapred.audit.logger=ERROR,console $HADOOP_TASKTRACKER_OPTS


$$ = The lesser of the following values:

  • 512

  • physicalMemorySizeInMb / 6

HADOOP_USER_CLASSPATH_FIRST

Add HADOOP_CLASSPATH specification to the beginning of the existing CLASSPATH

Default value

None

Value to be set

true

JAVA_HOME

Path of the JVM used by Hadoop

Default value

None

Value to be set

JVM installation directory

Note

In some cases, values to be set for some parameters (JVM-specific launch options) may be displayed across several lines, even though the specified value does not actually include a newline.