Job Example 8: Batch Directory Scan - Parallel Transporter

Job Objective

Scan a directory for one or more flat files and then do high speed loading of the data into to a Teradata Database table.

For strategies on using this method, see Batch Directory Scan and the DataConnector Operator chapter in Teradata Parallel Transporter Reference (B035-2436).

Data Flow Diagram

The following figure shows a flow diagram of the elements in Job Example 8.

Job Example PTS00014 – Batch Directory Scan

Sample Script

For the sample script that corresponds to this job, see the following script in the sample/userguide directory:

PTS00014: Batch Directory Scan.

Rationale

This job uses:

• DDL operator because it can DROP/CREATE staging tables and target tables prior to loading and DROP unneeded tables at the conclusion of the job.
• DataConnector operator because it is the only producer operator that reads data from external flat files.
• Load operator because it is the consumer operator that offers the best performance for high speed writing of a large number of rows into an empty Teradata Database table.