B.2.2 Setting the MaxConnection Parameter and the MultiMax Parameter

Interstage Shunsaku Data Manager Operator's Guide - Microsoft(R) Windows(R) 2000/ Microsoft(R) Windows Server(TM) 2003 - - UNIX -

Contents Index

Appendix B Consideration on Setting Values of Execution Parameters in Environment files

> B.2 The Approach for Parameters that Have to be Considered with Other Environment Files' Parameters

B.2.2 Setting the MaxConnection Parameter and the MultiMax Parameter

Set the value of MaxConnection parameter in the conductor environment file and the value of MultiMax parameter in the director and sorter environment files by considering the following table:

Parameter name	Consideration point
MultiMax (Director environment file)	Specifies the number of multiple requests from search and sort or aggregation process that can be processed at once. If the director receives search requests more than the value specified in this parameter, the exceeded search requests have to be queued and waited until the next process. It is necessary to consider the number of access at a peak time for the value of this parameter. When the number of requests the conductor receives is more than the parameter value while the director is executing the search process at the value specified in the MultiMax parameter (maximum number of executions that can be executed at once), this means that requests during the peak time cannot be processed. In this case, It is necessary to improve the search performance or to control the number of access by reducing the value of MaxConnection parameter. It is necessary to take into account the condition where normal search requests and requests for sort or aggregation are occurred at the same time, and calculate the value of (normal search requests + requests for sort or aggregation) as the maximum value of this parameter.
MultiMax (Sorter environment file)	Specifies the maximum number of sort or aggregation processes that can be processed at once when process the sort or aggregation in parallel. One Sorter Configuration For one sorter configuration, the maximum number of records that the sort and aggregation processes can be processed at once in Shunsaku system is the value of the MultiMax parameter in a sorter. If conductor receives sort or aggregation requests more than the value of MultiMax parameter in sorter, the error is notified to the source invoking the function. The target data have to be searched when process the sort and aggregation. Therefore, the value of MultiMax parameter in director including the execution numbers of search process for sort and aggregation must be set. As a result, the value of both MultiMax parameter must satisfy the following conditions: The value of MultiMax parameter in director the value of MultiMax parameter in sorer To avoid the error of the exceeding maximum value of executions at once in sort process, the following condition must be satisfied: The value of MaxConnection parameter the value of MultiMax parameter in sorter Multiple Sorters Configuration For multiple sorters configuration, the maximum number of records that the sort and aggregation processes can be processed at once in Shunsaku system is the total value of MultiMax parameter in all sorters. If conductor executes a sort process at the value of MultiMax in all sorters (the number of sort and aggregation processes that are executing is equal to the total number of MultiMax parameter in all sorters), the conductor does not execute the new receiving process, and the error is notified to the source invoking the function. Because the value of MultiMax parameter in director includes the search process to identify data for sorting and aggregating, it must be set more than the total value of MultiMax parameter in all sorters. Therefore, the value of both MultiMax parameter must satisfy the following conditions: The value of MultiMax parameter in director the total value of MultiMax parameter in all sorters To avoid the error of the exceeding maximum value of executions at once in sort process, the following condition must be satisfied: The value of MaxConnection parameter the total value of MultiMax parameter in all sorters
MaxConnection	This parameter must be set more than the value of MultiMax parameter in director and the total value of MultiMax parameter in all sorters. This parameter is the maximum value of requests that Shunsaku can receive. It is not the number of process that director can execute at once. This means that the conductor receives search requests and issues the search to the director regardless of whether or not the director is processing the search during [the value of MaxConnection parameter > the value of MultiMax parameter]. If the director is not executing the search process, the director will execute the search process received from the conductor using the value specified at the MultiMax parameter in director as the maximum number of processes to be executed at once. For other conditions, the search requests will be in waiting status. If Shunsaku File is used, set the parameter with the same approach. The value of the MaxConnection parameter is the maximum number of the connections that can be connected at once in Shunsaku system. Even if Shunsaku system is configured with multiple Shunsaku Files and the values of MultiMax parameter in each director are different, the MaxConnection parameter is considered for the whole Shunsaku system. Therefore, the approach will be the same as the case where Shunsaku file not used. The MaxConnection parameter is for specifying the maximum number of connections that can be connected in Shunsaku system. It is necessary to consider the volume of an access to Shunsaku system, but the MaxConnection parameter does not have any relationship with the existence of Shunsaku File. For example, there are 3 configurations as follows: Shunsaku File A: director (MultiMax: 5) Shunsaku File B: director (MultiMax: 10) Shunsaku File C: director (MultiMax: 20) In this case, if the application that is using Shunsaku File A to C is executed at the same time, the maximum number of executions that can be executed at once in each director is 5 + 10 + 20 = 35. Because the value of MaxConnection parameter has to be more than the total number of executions that can be executed at once in each director, it has to be more than 35.

Parameter name

Consideration point

MultiMax
(Director environment file)

Specifies the number of multiple requests from search and sort or aggregation process that can be processed at once.
If the director receives search requests more than the value specified in this parameter, the exceeded search requests have to be queued and waited until the next process.

It is necessary to consider the number of access at a peak time for the value of this parameter. When the number of requests the conductor receives is more than the parameter value while the director is executing the search process at the value specified in the MultiMax parameter (maximum number of executions that can be executed at once), this means that requests during the peak time cannot be processed.
In this case, It is necessary to improve the search performance or to control the number of access by reducing the value of MaxConnection parameter.

It is necessary to take into account the condition where normal search requests and requests for sort or aggregation are occurred at the same time, and calculate the value of (normal search requests + requests for sort or aggregation) as the maximum value of this parameter.

MultiMax
(Sorter environment file)

Specifies the maximum number of sort or aggregation processes that can be processed at once when process the sort or aggregation in parallel.

One Sorter Configuration

For one sorter configuration, the maximum number of records that the sort and aggregation processes can be processed at once in Shunsaku system is the value of the MultiMax parameter in a sorter.
If conductor receives sort or aggregation requests more than the value of MultiMax parameter in sorter, the error is notified to the source invoking the function.
The target data have to be searched when process the sort and aggregation. Therefore, the value of MultiMax parameter in director including the execution numbers of search process for sort and aggregation must be set. As a result, the value of both MultiMax parameter must satisfy the following conditions:

The value of MultiMax parameter in director the value of MultiMax parameter in sorer

To avoid the error of the exceeding maximum value of executions at once in sort process, the following condition must be satisfied:

The value of MaxConnection parameter the value of MultiMax parameter in sorter

Multiple Sorters Configuration

For multiple sorters configuration, the maximum number of records that the sort and aggregation processes can be processed at once in Shunsaku system is the total value of MultiMax parameter in all sorters.
If conductor executes a sort process at the value of MultiMax in all sorters (the number of sort and aggregation processes that are executing is equal to the total number of MultiMax parameter in all sorters), the conductor does not execute the new receiving process, and the error is notified to the source invoking the function.
Because the value of MultiMax parameter in director includes the search process to identify data for sorting and aggregating, it must be set more than the total value of MultiMax parameter in all sorters. Therefore, the value of both MultiMax parameter must satisfy the following conditions:

The value of MultiMax parameter in director the total value of MultiMax parameter in all sorters

To avoid the error of the exceeding maximum value of executions at once in sort process, the following condition must be satisfied:

The value of MaxConnection parameter the total value of MultiMax parameter in all sorters

MaxConnection

This parameter must be set more than the value of MultiMax parameter in director and the total value of MultiMax parameter in all sorters.
This parameter is the maximum value of requests that Shunsaku can receive. It is not the number of process that director can execute at once. This means that the conductor receives search requests and issues the search to the director regardless of whether or not the director is processing the search during [the value of MaxConnection parameter > the value of MultiMax parameter]. If the director is not executing the search process, the director will execute the search process received from the conductor using the value specified at the MultiMax parameter in director as the maximum number of processes to be executed at once. For other conditions, the search requests will be in waiting status.

If Shunsaku File is used, set the parameter with the same approach.
The value of the MaxConnection parameter is the maximum number of the connections that can be connected at once in Shunsaku system. Even if Shunsaku system is configured with multiple Shunsaku Files and the values of MultiMax parameter in each director are different, the MaxConnection parameter is considered for the whole Shunsaku system. Therefore, the approach will be the same as the case where Shunsaku file not used.
The MaxConnection parameter is for specifying the maximum number of connections that can be connected in Shunsaku system. It is necessary to consider the volume of an access to Shunsaku system, but the MaxConnection parameter does not have any relationship with the existence of Shunsaku File.
For example, there are 3 configurations as follows:

Shunsaku File A: director (MultiMax: 5)
Shunsaku File B: director (MultiMax: 10)
Shunsaku File C: director (MultiMax: 20)

In this case, if the application that is using Shunsaku File A to C is executed at the same time, the maximum number of executions that can be executed at once in each director is 5 + 10 + 20 = 35.
Because the value of MaxConnection parameter has to be more than the total number of executions that can be executed at once in each director, it has to be more than 35.

The relationship of the value of MaxConnection parameter in the conductor environment file and the value of MultiMax parameter in the director and sorter environment files are as follows:

MaxConnection MultiMax (Director environment file)
The request that exceed the value of director MultiMax parameter is not queued and the error is notified to the invoking source.

MaxConnection MultiMax (Director environment file) x 2
If concurrent processes are assumed to be executed, it is necessary to consider on the peak time accesses.
The value of the MaxConnection parameter is considered as the maximum number of requests that conductor receives when director is executing the search process (including the search process for sort or aggregation) with the maximum number of executions that can be executed at once (the value of MultiMax parameter).
However, maximum value of MaxConnection parameter must not be set more than the double value of MultiMax parameter in director (the value of MultiMax parameter in director x 2).

MaxConnection > MultiMax (Director environment file) x 2
This condition must be set when director is executing the search process (including the search process for sort or aggregation) with the maximum number of executions that can be executed at once (the value of MultiMax parameter) and there is any possibility to receive requests more than the number of processes that is executing.
This case is known as the status where requests cannot be processed in a peak time.
In this case, it is necessary to improve the search performance or to control the number of access by using the value of MaxConnection parameter. The requests received from conductor will be in the status that is waiting for search requests until the number of requests is more than the value of MaxConnection parameter.
The following calculation is the maximum time for the search request that is in a waiting status to wait for the execution:

Maximum wait time for the request = (the value of MaxConnection parameter / the value of MultiMax parameter for director) x the time of search process by the MultiMax parameter

Example

The value of MaxConnection parameter for conductor = the value of MultiMax parameter for director x 2 > the value of MultiMax parameter for sorter
(the value of MultiMax parameter for the director is including the number of search process when requesting for sorting)

Entry example for conductor environment file

#---Character code of the lookup data---#
MaxConnection     60

Entry example for director environment file

#---The maximum number of search requests that can be received at once ---#
MultiMax          30

Entry example for sorter environment file

#---The maximum number of sort or aggregation requests that can be received at once---#
MultiMax          10

Contents Index