17.10 - About Importing Data - Access Module

Teradata® Tools and Utilities Access Module Reference

Product
Access Module
Release Number
17.10
Published
October 2021
Language
English (United States)
Last Update
2021-11-02
dita:mapPath
uur1608578381725.ditamap
dita:ditavalPath
obe1474387269547.ditaval

The following figure shows how the Teradata Access Module for Kafka imports data to the database through Teradata Parallel Transporter loading operators. Although the figure shows the data producer, Kafka Server, and the Teradata Parallel Transporter loading operators on separate systems, these entities can be on the same system.



  1. The Data Producer writes input data to partitions of a specified Topic of the Kafka Server.
  2. At the software code level, the Teradata Access Module for Kafka uses APIs of librdkafka, a third-party open source shared library, to fetch messages from Kafka Server.
  3. The Teradata Parallel Transporter DataConnector operator initiates a sequence of instructions to fetch the messages from the Teradata Access Module for Kafka.

    This sequence of instructions includes the access module Initialize, File Open, File Read, File Get Position, File Close and Shutdown.

  4. The Teradata Parallel Transporter DataConnector operator transfers the data to Teradata Parallel Transporter loading operators.
  5. The Teradata Parallel Transporter loading operators process and load the data into a table in the database.