2.3.2 Error during Data Updating

Interstage Shunsaku Data Manager Troubleshooting - Microsoft(R) Windows(R) 2000/ Microsoft(R) Windows Server(TM) 2003 - - UNIX -

Contents Index

Chapter 2 Examples of Troubleshooting

> 2.3 Operation Errors

2.3.2 Error during Data Updating

shn30351u: Insufficient space in the director data file.
shn30353u: Insufficient space in the operation log file.
shn30393u: The number of records has reached the maximum value.
shn30396u: The size of the director data file has reached the maximum value.
shn30398u: The size of the operation log file has reached the maximum value.

Insufficient space in director data file

Error Event

After the command or the application is executed, the following message is output:

shn30351u:There is not enough space in the data file folder. [shund1]

Several recovery methods are available depending on whether the OperationLogFolder has been set in the director environment file or in operation during the error. Select the recovery method that corresponds to the error event.

Corrective Action

[Recovery Method]

Operation during the error	Has the OperationLogFolder been set in the director environment file?	Recovery Method (*1)
Shunsaku API Execution shundimport command shundbackup command	No	1 (*2)
	Yes	1 or 2 (*2)
Shundcds command	No	1 or 3
Shundcds command	Yes	1 ~ 3

*1The following recovery methods can be used:

Recovery Method 1
Stop the Shunsaku system and change the director data file storage directory.
Recovery Method 2
Execute the shundrecover command to restore the data. This method can be used to restore data without stopping the Shunsaku system.
Recovery Method 3
Stop the Shunsaku system. Then use shundimport command to import the file exported by the shundexport command. This method is can be used if the fragmentation rate is high.

*2Recovery Method 3 can be used if the fragmentation rate is high even if the Shunsaku API execution error occurs.

Refer to the Operator's Guide or the Command Reference for more information on using the above commands.

Recovery Method 1

Stop the Shunsaku system. Copy the director data file to a larger space disk then restart Shunsaku.

Confirm Status:

Execute the shundstate command to confirm that the DataFileStatus is "FULL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 10:09:53

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

10:09:53 ACTIVE               FULL                 40.0GB               2
         ----/--/-- --:--:--  NORMAL               10.0KB
         100000               12000                5.020                2.00MB

Stop Shunsaku system: Execute the shunsysstop command to stop Shunsaku system:
shunsysstop -n shunsaku
Copy the director data: Copy all the director data under the directory specified by the DataFileFolder parameter in the director environment file to a larger space disk.
: cp command, etc.
cp -rp /Shunsaku/data /Shunsaku2/data
: xcopy command, etc.
xcopy /r /e D:\Shunsaku E:\Shunsaku
Edit the DataFileFolder:
Specify the same directory the director data was copied to in Step 3 for the DataFileFolder parameter in the director environment file.
DataFileFolder /Shunsaku2/data/
DataFileFolder E:\Shunsaku\
Start Shunsaku system: Execute the shunsysstart command to start Shunsaku system:
shunsysstart -n shunsaku

Confirm Status: Execute the shundstate command to confirm that the DataFileStatus is "NORMAL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 10:14:06

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

10:14:06 ACTIVE               NORMAL               40.0GB               2
         ----/--/-- --:--:--  NORMAL               10.0KB
         100000               12000                5.020                2.00MB

If the DataFileStatus is "NORMAL", the recovery was successful and operations can be recommenced.

Recovery Method 2

This section explains the recovery method in which the Shunsaku system does not need to be stopped with the shundrecover command.

This method can be used for systems that meet the following conditions:

The OperationLogFolder parameter is set in the director environment file.
The director data is backed up.
It is not necessary to restart the operating system when exchanging disks.

If several directors are used in one operation and the shundrecover command is executed to recover data to the point when the backup was performed or to the specified point, execute the shundrecover command to recover all other directors to the same recovery point.

Confirm status:

Execute the shundstate command to confirm that the DataFileStatus is "FULL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 11:32:14

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

11:32:14 ACTIVE               FULL                 40.0GB               2
         2006/05/10 11:28:07  NORMAL               10.0KB
         100000               12000                5.020                2.00MB

Start the recovery:
Execute the shundrecover command with the -b option to declare the start recovery.
shundrecover -s shund1 -b
Replace the disk:
Replace the disk in which the director data is stored with a large space disk.
Create the directory for storing director data:
Create the directory specified by the DataFileFolder in the director environment file on the disk.
Restore the backup data:
Use the copy function of operating system command or disk device to restore the backup data in the director data file:
: cp command, etc.
Cp -rp /Backup/data/shund1 /Shunsaku/data/shund1
: xcopy command, etc.
xcopy /r /k E:\Backup\shund1 D:\Shunsaku\shund1
End the recovery:
Execute the shundrecover command with the -e option to restore the data to the latest status. Then recommence operations.
shundrecover -s shund1 -e
Confirm status:

Execute the shundstate command to confirm that the DataFileStatus is "NORMAL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 11:38:22

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

11:38:22 ACTIVE               NORMAL               40.0GB               2
         2006/05/10 11:28:07  NORMAL               10.0KB
         100000               12000                5.020                2.00MB

If the DataFileStatus is "NORMAL", recovery was successful and operation can be recommenced.

Recovery Method 3

This section explains how to recover using the shundimport command to import the data extracted by the shundexport command to Shunsaku.

Confirm status:

Execute the shundstate command to confirm that the DataFileStatus is "FULL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 13:21:02

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

13:21:02 ACTIVE               FULL                 40.0GB               50
         ----/--/-- --:--:--  NORMAL               10.0KB
         100000               12000                5.020                2.00MB

Stop all the transactions:
Stop all the applications. Do not search or update data.
Extract the director data:
Execute the shundexport command to extract the director data to a text file:
shundexport -s shund1 -o /shundata/exp_data.txt
Stop Shunsaku system:
Execute the shunsysstop command to stop Shunsaku system.
shunsysstop -n shunsaku
Delete the director data:
Delete the directory storing the director identifier specified by the DataFileFolder parameter in the director environment file.
Start Shunsaku system:
Execute the shunsysstart command to start the Shunsaku system.
shunsysstart -n shunsaku
Import director data:
Execute the shundimport command to import the text data extracted in Step 3.
shundimport -s shund1 -f /shundata/exp_data.txt
Confirm status:

Execute the shundstate command to confirm that the DataFileStatus is "NORMAL".

shundstate -s shund1
Shunsaku shundstate 2006/05/10 13:25:05

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

13:25:05 ACTIVE               NORMAL               40.0GB               0
         ----/--/-- --:--:--  NORMAL               10.0KB
         100000               0                    0.000                0.00MB

If the DataFileStatus is "NORMAL", the recovery was successful and operations can be recommenced.

Note: Make sure that the disk to store the extracted file has enough available disk space when extracting the director data.
Refer to Estimating Resources in the Operator's Guide for more information on how to estimate the extracted file size.

How to avoid the error

If the director data file directory does not have enough available space, jobs cannot continue until the action is completed.

To avoid this situation, precautions in design and operations are necessary. Refer to Managing the Director Data File in 2.3.4 Managing Disk Capacity for more information on such precautions.

Insufficient space in operation log file

Error Event

After the command or the application is executed, the following message is output:

shn30353u:There is not enough space in the operation log folder. [shund1]

The operation log file accumulates Shunsaku update operations as update log data. If the disk that stores this log file does not have enough space, a command error or application error may occur during Shunsaku operations.

Corrective Action

Back up the director data file. If this is done, the operation log file before the backup will be automatically terminated and the operation can be recommenced.

To back up the director data file and recommence the operation, follow the procedure below. If there are several directors using in one operation, back up all the directors to the same backup point.

Confirm status:
Execute the shundstate command to confirm that the OperationLogStatus is "FULL".

shundstate -s shund1
Shunsaku shundstate 2006/05/10 09:24:47

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

09:24:47 ACTIVE               NORMAL               40.0GB               2
         ----/--/-- --:--:--  FULL                 10.0KB
         100000               12000                5.020                2.00MB

Backup start declaration:
Execute the shundbackup command with the -b option to declare the start of the backup.
shundbackup -s shund1 -b
Note: If there are several directors used in one operation, execute the shundbackup command to all directors.
Back up the director data file:
The directory specified by the DataFileFolder parameter in the director environment file contains a directory with the same name as the director identifier. Back up all the files from that directory.

Use the following operating system commands or disk device copy function to perform the backup.

: cp command, etc.
cp -rp /Shunsaku/data/shund1 /Backup/data/shund1
: xcopy command, etc.
xcopy /r /k D:\Shunsaku\shund1 E:\Backup\shund1
Backup end declaration
Execute the shundbackup command with the -e option to declare the end of the backup.
shundbackup -s shund1 -e
Note: If there are several directors used in one operation, execute the shundbackup command for all directors.
Confirm status:

Execute the shundstate command to confirm that the OperationLogStatus is "NORMAL":

shundstate -s shund1
Shunsaku shundstate 2006/05/10 09:33:55

Time     State                DataFileStatus       DataSize             Fragments(%)
         LastBackedUp         OperationLogStatus   OperationLogSize
         Records              ReadRecords          ReadTime(sec)        ReadSize

09:33:55 ACTIVE               NORMAL               40.0GB               2
         2006/05/10 09:31:50  NORMAL              0.08KB
         100000               12000                5.020                2.00MB

The OperationLogStatus will be changed from "FULL" to "NORMAL" and operations can be recommenced.

Refer to the Operator's Guide and the Command Reference for more information on using the above commands.

How to avoid the error

If the operation log file storage directory does not have enough available space, jobs cannot be continued until the action is completed. To avoid this situation, precautions in design and operations are necessary. Refer to Managing the Director Data File in the 2.3.4 Managing Disk Capacity for more information on such precautions.

The number of records has reached the maximum value

Error Event

After the command or the application to add data is executed, the following message is output to the system log (syslog) or event log and to the command or application:

Message output to the system Log (syslog) or event log:

shn30393u The addition processing has been stopped because the maximum record number will be exceeded if data is added. add=d* remain=e* maximum=f* (director) [shund1] Shunsaku System Name=shunsaku

Message output to the Command or Application:

shn30394u The addition processing has been stopped because the maximum record number will be exceeded if data is added. add=d* remain=e* maximum=f* [shund1]

d*: Number of records to be added.

e*: Number of records that can be added.

f*: Maximum number of stored records.

Cause

The addition processing has been stopped because the total of the number of stored records and the number of records to be added exceed the maximum record number. In this case, the transaction is rolled back.

Corrective Action

The record cannot be added more than the maximum record number. Delete any unnecessary records or add more directors and change the directory specified by the InsertPoint parameter in the conductor environment file.

The size of the director data file to be used has reached the maximum

Error Event

After the shundimport command or the application to add, delete, or update data is executed, the following message is output to the system log (syslog) or event log and to the command or application:

Message output to the system Log (syslog) or event log:

shn30396u The size of the director data file to be used has reached the maximum. Max file size=Maximum size of director data file (MB) (director) [shund1] Shunsaku System Name=shunsaku

Message output to the Command or Application:

shn30351u:There is not enough space in the data file folder. [shund1]

Cause

An addition process, deletion process, or update process was terminated because the size of the director file exceeded the maximum size for executing the shundimport command to add, delete, or update data. In this case, the transaction is rolled back.

In addition, the DataFileStatus displayed by the shundstate command is "LIMIT" and an error occurs if the shundimport command or the application to add, delete, or update the data is executed.

Corrective Action

To recover the system, execute one of the following procedures

If the shundcds command can be executed:
Execute the shundcds command to optimize the director data file. Also increase the capacity of the disk where the director data file is stored.
If the shundcds command cannot be executed:
Execute one of the following procedures:
- Stop the Shunsaku system and change the director data file storage directory.
- Executed the shundrecover command to recover.
- Executed the shundexport command to recover.
Refer to Corrective Action in the Insufficient Space in director Data File for more information on how to recover the system.

The following director commands can be executed:

The shundbackup command for backing up the director data file.
The shundcds command for optimizing data.
The shundclear command for deleting data.
The shundexport command for extracting data.
The shundresend command for reallocating data.
The shundrecover command for restoring data.
The shunsysstop command for stopping the director.
The shunsyscfgedit command for dynamic changes.

The size of the operation log file to be used has reached the maximum.

Error Event

After the shundimport command or the application to add, delete, or update the data is executed, the following message is output in the system log (syslog) event log and to the command or application:

Message output to the system Log (syslog) event log:

shn30398u The size of the operation log file to be used has reached the maximum. Max file size=Maximum size of operation log file(MB) (director) [shund] Shunsaku System Name=shunsaku

Message output to the Command or Application:

shn30353u:There is not enough space in the operation log folder. [shund1]

Cause

The addition process, deletion process, or update process was terminated because the size of the operation log file exceeded the maximum size for the shundimport command to add, delete, or update data. In this case, the transaction will be rolled back.
In addition, the OperationLogStatus displayed by the shundstate command will become "LIMIT" and an error occurs if the shundimport command or the application to add, delete, or update the data is executed.

Corrective Action

Execute the shundbackup command to back up the director data file. Then review the backup cycle of the director data file and reduce the size of the log in the operation log file.

Refer to Corrective Action in the Insufficient Space in the operation log file for more information on how to recover the system.

The following director commands can be executed:

The shundimport command with the -n option for adding and deleting data.
The shundbackup command for backing up the director data file.
The shundcds command for optimizing data.
The shundclear command for deleting data.
The shundexport command for extracting data.
The shundresend command for reallocating data.
The shundrecover command for recovering data.
The shunsysstop command for stopping the director.
The shunsyscfgedit command for the dynamic changes.

Contents Index