16.10 - About Importing Data - Access Module

Teradata Tools and Utilities Access Module Reference

prodname
Access Module
vrm_release
16.10
created_date
July 2017
category
Programming Reference
featnum
B035-2425-077K

The following figure shows how the Teradata Access Module for Kafka imports data to a Teradata Database through Teradata Parallel Transporter loading operators. Although the figure shows the data producer, Kafka Server, and the Teradata Parallel Transporter loading operators on separate systems, these entities can be on the same system.

Importing Data

  1. The Data Producer writes input data to partitions of a specified Topic of the Kafka Server.
  2. At the software code level, the Teradata Access Module for Kafka uses APIs of librdkafka, a third party open source shared library, to fetch messages from Kafka Server.
  3. The Teradata Parallel Transporter DataConnector operator initiates a sequence of instructions to fetch the messages from the Teradata Access Module for Kafka.

    This sequence of instructions includes the access module Initialize, File Open, File Read, File Get Position, File Close and Shutdown.

  4. The Teradata Parallel Transporter DataConnector operator transfers the data to Teradata Parallel Transporter loading operators.
  5. The Teradata Parallel Transporter loading operators process and load the data into a table in the Teradata Database.