Routine and Periodic Maintenance of the Job Log Directory - Parallel Transporter

Teradata Parallel Transporter User Guide

Product
Parallel Transporter
Release Number
15.00
Language
English (United States)
Last Update
2018-09-27
dita:id
B035-2445
lifecycle
previous
Product Category
Teradata Tools and Utilities

Routine and Periodic Maintenance of the Job Log Directory

The job log directory (TPT_install_directory/logs) is the destination of job logs and temporary files that are created as part of executing Teradata PT jobs. While Teradata PT deletes all the temporary files automatically at job termination time, only you can delete job logs.

Because each job log contains valuable detailed status and statistical information, you must decide how long the job logs should be kept and when to remove them from the job log directory. Regular, periodic cleaning of the job log directory is required to ensure you have enough disk space available for your daily loading activities.

As part of executing a Teradata PT job, Teradata PT also needs to acquire inter-process communication (IPC) resources such as shared memory and semaphores for the synchronization and communication between operators. At job initialization, Teradata PT creates a script file in the job log directory with a name of the form twbclean.nnn that contains IPC commands for releasing the IPC resources back to the system. In normal job termination, Teradata PT executes the commands in the twbclean file before deleting it. However, if a job fails in such a way that Teradata PT cannot remove its IPC resources, the twbclean file remains in the job log directory and you must remove it manually.

Before removing the twbclean files, you need to find out if these files were created recently based on the date and timestamps associated them. For example, if the files are old and the system has been rebooted after the creation of these files, they can be deleted because the IPC resources described in them are no longer valid. However, if the files are new, then the IPC resources described in them are still held by the jobs that have been terminated. To clean up these IPC resources, you need to run these files as shell scripts before deleting them.