Top
Interstage Big DataParallel Processing ServerV1.0.0 User's Guide
Interstage

D.1.4 Selecting the Data Block Size

The blocksz option of the pdfsmkfs command can be used to specify the data block size during DFS creation. Specification of the data block size enables contiguous allocation of shared disk device area, which enables efficient input-output processing.

A data block size of 8 MB is recommended if the DFS is used by Hadoop.

Note

If 8 MB is specified as the data block size, an 8 MB area is used on the shared disk even if the file size is less than 8 MB.
If a large quantity of small-sized files are stored, give priority to space efficiency and do not specify a data block size.

See

Refer to "D.1.5 Relationship between File System Size, Data Block Size and Maximum File Size" for the relationship between the data block size the maximum file system size, and maximum file size.