Job Objective
Read large amounts of data directly from an external flat file, or from an access module, and write it to an empty Teradata Database table. If the source data is an external flat file, this job is equivalent to using the Teradata FastLoad utility. If the data source is a named pipe, the job is equivalent to using the Teradata standalone DataConnector utility to access data from a named pipe, through an access module, and write it to a temporary flat file, and then running a separate FastLoad job to load the data from the temporary file.
Data Flow Diagrams
The following figures show flow diagrams of the elements in each of the three variations of Job Example 1.
Sample Scripts
For the sample scripts that correspond to the three variations of this job, see the following scripts in the sample/userguide directory:
- PTS00001: High Speed Bulk Loading from Flat Files into an Empty Teradata Database Table.
- PTS0002A, PTS0002B: High Speed Bulk Loading from a Named Pipe into an Empty Teradata Database Table.
- PTS00003A: High Speed Loading from Two Flat Files into an Empty Teradata Database Table.
- PTS00003B: High Speed Loading from a Flat File into an Empty Teradata Database Table.
Rationale
This job uses:
- DDL operator because it can DROP/CREATE tables needed for the job prior to loading and DROP unneeded tables at the conclusion of the job.
- DataConnector operator because it is the only producer operator that reads data from external flat files and from the Named Pipes access module.
- Load operator because it is the consumer operator that offers the best performance for high speed writing of a large number of rows into an empty Teradata Database table.