Top
Interstage Big DataParallel Processing ServerV1.0.0 User's Guide
Interstage

3.1.5 Distributing the DFS File System Configuration Information

Distribute the DFS file system configuration file generated on the master server to the slave server development server, and collaboration server. Refer to "4.1.3.7 Generating and Distributing the DFS File System Configuration Information" for information on generating DFS file systems.


The procedure for distributing file system configuration information is described below using the following environment as an example:

  • File system ID:

1

  • Logical file system name:

pdfs1

  • Slave servers, development server, collaboration server:

slave1, slave2, slave3, slave4, slave5, develop, collaborate

  1. Log in to the master server with root permissions.

  2. Confirm that the user ID for executing MapReduce is set in the configuration file created in "4.1.3.7 Generating and Distributing the DFS File System Configuration Information".
    If the user ID for executing MapReduce is not set, set the user ID for executing MapReduce by checking in "4.1.3.3 Setting the User ID for Executing MapReduce".

    # cat <directory where configuration file was created>/client.conf.pdfs1
    FSID 1
    MDS kawa4 29000
    MDS kawa5 29000
    DEV /dev/disk/by-id/scsi-1FUJITSU_300000370107 0 7341778
    DEV /dev/disk/by-id/scsi-1FUJITSU_300000370108 0 6578704
    MAPRED mapred              <-- Check that the user ID for executing MapReduce is set
  3. Distribute the configuration information file to the slave servers, development server and the collaboration server.

    # cd {directory where configuration file was created} <Enter>
    # scp -p ./client.conf.pdfs1 root@slave1:/etc/pdfs/client.conf.pdfs1 <Enter>
    # scp -p ./client.conf.pdfs1 root@develop:/etc/pdfs/client.conf.pdfs1 <Enter>
    # scp -p ./client.conf.pdfs1 root@collaborate:/etc/pdfs/client.conf.pdfs1 <Enter>

    Note

    Place the configuration information file under "/etc/pdfs" at each server.