15.10 - Job Example 8: Batch Directory Scan - Parallel Transporter

Teradata Parallel Transporter User Guide

prodname
Parallel Transporter
vrm_release
15.10
category
User Guide
featnum
B035-2445-035K

Job Example 8: Batch Directory Scan

Job Objective

Scan a directory for one or more flat files and then do high speed loading of the data into to a Teradata Database table.

Note: If the Teradata Database table is populated, use the Update operator for the load operation.

For strategies on using this method, see “Batch Directory Scan” on page 223 and the DataConnector Operator chapter in Teradata Parallel Transporter Reference.

Data Flow Diagrams

Figure 32 shows a flow diagram of the elements in Job Example 8.

Figure 32: Job Example PTS00014 -- Batch Directory Scan

Sample Script

For the sample script that corresponds to this job, ee the following script in the sample/userguide directory:

PTS00014: Batch Directory Scan.

Rationale

This job uses:

  • DDL operator because it can DROP/CREATE staging tables and target tables prior to loading and DROP unneeded tables at the conclusion of the job.
  • DataConnector operator because it is the only producer operator that reads data from external flat files.
  • Load operator because it is the consumer operator that offers the best performance for high speed writing of a large number of rows into an empty Teradata Database table.