The Hadoop system design considerations, when using Hadoop collaboration to perform logging, are listed below.
Based on this information, design storage areas for the required event logs in the Hadoop system. Refer to the Interstage Big Data Parallel Processing Server manuals for information on the design of the Hadoop system.
Number of data type to be logged (events or processing results of complex event processing rules)
Details of data to be logged
Number of occurrences (per unit of time)
Average data size
Accumulation period