15.10 - Consumer Operators - Parallel Transporter

Teradata Parallel Transporter User Guide

prodname
Parallel Transporter
vrm_release
15.10
category
User Guide
featnum
B035-2445-035K

Consumer Operators

The Teradata PT consumer operators in this section read data from the data stream and write it to a Teradata Database.

The Teradata PT job script invokes a consumer operator using an APPLY statement. For further information on using APPLY to specify a consumer operator, see “Coding the APPLY Statement” on page 64 and the section on APPLY in Teradata Parallel Transporter Reference.

The following table briefly describes and compares the function of each Teradata PT operator that can be used as a consumer when loading data into a Teradata Database:

 

Operator

Description

Load Operator

Inserts data at high speed into a single empty Teradata Database table. Function is similar to the standalone FastLoad utility.

Features:

  • Best used for the initial data loads into Teradata Database tables.
  • Limitations:

  • Does not support UPDATE, SELECT, or DELETE operations.
  • The target table must be empty, with no defined secondary indexes.
  • Multiple parallel instances of the Load operator can be used in a job, but they must all insert data into the same table.
  • For details, see Teradata Parallel Transporter Reference.

    SQL Inserter Operator

    Uses a single SQL session to insert data into a Teradata Database in either an empty or populated table.

    Features:

  • Protects data integrity. If an error is encountered during the INSERT operation, SQL Operator backs out all rows it has inserted for the job since the last checkpoint.
  • Use of multiple instances of SQL Inserter allows parallel loading of LOBs, XML, and JSON.
  • Limitations:

  • Is slower than other operators capable of writing to Teradata Database.
  • Will terminate the job if an attempted insert would duplicate an existing row in the target table.
  • For details, see Teradata Parallel Transporter Reference.

    Stream Operator

    Performs high-speed, low-steady volume SQL DML transactions, INSERT, UPDATE, DELETE, or UPSERT on Teradata Database tables. Function is similar to the standalone Teradata Tpump utility.

    Stream operator or Update operator can be used for many similar tasks. For comparison of function to help you choose the best operator for the job, see “Comparing Update and Stream Operators” on page 97.

    For details, see Teradata Parallel Transporter Reference.

    Update Operator

    Performs high-speed, high-volume SQL DML transactions, INSERT, UPDATE, DELETE, or UPSERT on Teradata Database tables. Function is similar to the standalone Teradata MultiLoad utility.

    Update operator or Stream operator can be used for many similar tasks. For comparison of function to help you choose the best operator for the job, see “Comparing Update and Stream Operators” on page 97.

    For details, see Teradata Parallel Transporter Reference.

    Note: Consumer operators have a limit on the number of tables they can load simultaneously, as shown in the following:

     

    Teradata PT Operator

    Maximum Target Tables

    Load

    1

    Update

    5

    Stream

    127

    SQL Inserter

    1