About Importing Data - Access Module

The following figure shows how the Teradata Access Module for Kafka imports data to the database through Teradata Parallel Transporter loading operators. Although the figure shows the data producer, Kafka Server, and the Teradata Parallel Transporter loading operators on separate systems, these entities can be on the same system.

1. The Data Producer writes input data to partitions of a specified Topic of the Kafka Server.
2. At the software code level, the Teradata Access Module for Kafka uses APIs of librdkafka, a third-party open source shared library, to fetch messages from Kafka Server.
3. The Teradata Parallel Transporter DataConnector operator initiates a sequence of instructions to fetch the messages from the Teradata Access Module for Kafka.

   This sequence of instructions includes the access module Initialize, File Open, File Read, File Get Position, File Close and Shutdown.

4. The Teradata Parallel Transporter DataConnector operator transfers the data to Teradata Parallel Transporter loading operators.
5. The Teradata Parallel Transporter loading operators process and load the data into a table in the database.