Data Streams - Parallel Transporter

In Teradata PT, data streams (or buffers in memory that temporarily hold data) enable the passing of data between operators without intermediate storage. Data streams allow Teradata PT to automate parallelism and scalability.

A Teradata PT job moves data from the sources to the targets through data streams. Data moves from producer operator(s) through the data streams to consumer operator(s):

Producer operators take data from the source, moving the data into data streams.

At that point, filter operators can access the data, perform updates, and return updated data to the data streams for further processing by consumer operator(s).

In the absence of a filter operator, data passes from the producer operator(s), straight through the data streams, to the consumer operator(s).

In all cases, the data flows through the data streams as shown in Figure 7.

Figure 7: Data Streams