Defining Producer Operators - Parallel Transporter

Teradata Parallel Transporter User Guide
Product
Parallel Transporter
Release Number
15.10
Language
English (United States)
Last Update
2018-10-07
dita:id
B035-2445
lifecycle
previous
Product Category
Teradata Tools and Utilities

Defining Producer Operators

Producer operators “produce” a data stream after reading data from a Teradata Database or an external data store. Then they write the data into the data stream for further processing by consumer or filter operators.

Figure 11: Defining Producer Operators

A Teradata PT job script allows as many producer operators as data sources, as long as the output schema is the same; or you can use a single producer. The producer extracts data from the source and places it into the data stream, where other operators can use it.

Following is a list of Teradata PT producer operators:

 

Table 3: Producer Operators 

Operator

Description

Produces Data from Teradata Database

Export

The Export operator extracts data from Teradata tables and writes it to the data stream. The Export operator functions in a way similar to the standalone FastExport utility protocol.

SQL Selector

Selects data from Teradata tables using SQL sessions. The only producer operator that can handle LOB, JSON, and XML data.

Produces Data from a Non-Teradata Data Source

DataConnector (producer)

The DataConnector operator accesses files either directly or through an access module, and then writes it to the data stream.

The DataConnector operator can also read data from files and tables in Hadoop.

ODBC

The ODBC operator extracts data from any ODBC provider, such as Oracle or SQL Server on Windows, UNIX, and z/OS platforms, and then writes it to the data stream.

Produces and Processes Data from a Non-Teradata Data Source

FastLoad INMOD Adapter

The FastLoad INMOD adapter uses FastLoad INMOD routines to read and preprocess input data from flat files, and then places it in the data stream.

MultiLoad INMOD Adapter

The MultiLoad INMOD adapter uses MultiLoad INMOD routines to read and preprocess input data from flat files, and then places it in the data stream.

Script Requirements

When you define a producer operator in a Teradata PT script, required specifications include:

  • In the operator definition
  • A name for the operator (maximum of 255 characters, with no spaces).
  • The operator type.
  • The name of the input schema. A deferred schema, specified as SCHEMA *, is not supported for producer operators.
  • Declarations for all required attributes.
  • In the APPLY statement
  • A SELECT . . . FROM clause that names the producer operator

    • Example: Producer Operator Definition

    Following is a simplified example of an Export operator definition in a job script:

    Figure 12: Export Operator Definition