Interstage Big DataParallel Processing ServerV1.0.1 User's Guide

6.2.2 DFS Setup

The DFS setup sequence is as follows:

1. Create the Mount Point and Configure fstab Settings

2. Mounting

   
   

6.2.2.1 Creating the Mount Point and Configuring fstab Settings

Create the mount point and add the DFS entry to /etc/fstab.

Creating the mount point

Create the mount point for mounting the disk partitions on the storage system used as the DFS.

Make the mount point the same as that specified at the master server.

Example

Create the mount point "pdfs" under "/mnt".

# mkdir /mnt/pdfs <Enter>

fstab settings

Add the DFS entry to /etc/fstab.

The parameters specified in the fields for the added entry are as follows:

• Field 1 (fs_spec)
  Specify the logical file system name of the DFS to be mounted.

  Information

  The logical file system name is used to identify the DFS file system. Use the name defined when generating the configuration information of the file system on the master server.

  The configuration information file is used to manage the file system structure at slave servers, development servers and collaboration servers. Use a logical file system name to identify the DFS configuration information file.

• Field 2 (fs_file)
  Specify the mount point you created above.

• Field 3 (fs_vfstype)
  Specify the pdfs.

• Field 4 (fs_mntops)
  Specify the mount options to be used when mount is performed.

  Ensure that the _netdev option is specified.

  Determine other option specifications as shown below.

  Item to be checked	Option to be specified
  If not updating the time when a file was last referenced or when a DFS is shared by five or more servers	noatime
  If not mounting when starting the DFS client	noauto
  If mounting DFS as read only	ro

  See

  Refer to the mount command page in the online manual for details of the noauto option.

  Refer to "mount.pdfs" under "Appendix A Command Reference" in the "Primesoft Distributed File System for Hadoop V1 User's Guide" for details of other mount options.

• Field 5 (fs_freq)
  Specify 0.

• Field 6 (fs_passno)
  Specify 0.

Example

This example shows the mount point "/mnt/pdfs" and the logical file system name "pdfs1" defined at "/etc/fstab".

LABEL=/                 /                       ext3    defaults        1 1
LABEL=/home             /home                   ext3    defaults        1 2
LABEL=/boot             /boot                   ext3    defaults        1 2
tmpfs                   /dev/shm                tmpfs   defaults        0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
LABEL=SWAP-sda3         swap                    swap    defaults        0 0

pdfs1                   /mnt/pdfs               pdfs    _netdev         0 0

6.2.2.2 Mounting

Distribute the DFS configuration information file generated on the master server to the slave server to mount the DFS file system.

1. Copy the DFS configuration information file generated in "6.1.3.11 Generating the DFS File System Configuration Information" for the master server to /etc/pdfs.

   # scp -p root@master1:dfsConfigurationFileDirectory/client.conf.pdfs1 /etc/pdfs <Enter>

2. Mount the DFS file system.

   Example

   Mount the DFS file system at the slave server.

   # mount pdfs1 <Enter>

Note

• The DFS configuration information file must be distributed to the slave server before the DFS file system is mounted.

• Ensure that the DFS mount sequence is: master servers, slave servers, development servers and collaboration servers. If the slave servers, development servers or collaboration servers are mounted first, then mount will fail, because the master server (MDS) does not exist.

See

Refer to the "mount.pdfs" under "Appendix A Command Reference" in the "Primesoft Distributed File System for Hadoop V1 User's Guide" for details of mounting.