Job Example 8: Batch Directory Scan - Parallel Transporter

Teradata® Parallel Transporter User Guide - 17.20

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
Lake
VMware
Product
Parallel Transporter
Release Number
17.20
Published
June 2022
Language
English (United States)
Last Update
2023-08-25
dita:mapPath
uzp1645128359760.ditamap
dita:ditavalPath
tvt1507315030722.ditaval
dita:id
B035-2445
Product Category
Teradata Tools and Utilities

Job Objective

Scan a directory for one or more flat files and then do high speed loading of the data into to a database table.

If the database table is populated, use the Update operator for the load operation.

For strategies on using this method, see Batch Directory Scan and "DataConnector Operator" in Teradata® Parallel Transporter Reference, B035-2436.

Data Flow Diagram

The following figure shows a flow diagram of the elements in Job Example 8.

Job Example PTS00014 – Batch Directory Scan

Sample Script

For the sample script that corresponds to this job, see the following script in the sample/userguide directory:

PTS00014: Batch Directory Scan

Rationale

This job uses:
  • DDL operator because it can DROP/CREATE staging tables and target tables prior to loading and DROP unneeded tables at the conclusion of the job.
  • DataConnector operator because it is the only producer operator that reads data from external flat files.
  • Load operator because it is the consumer operator that offers the best performance for high-speed writing of a large number of rows into an empty database table.