16.10 - Importing Data - Access Module

Teradata Tools and Utilities Access Module Reference

prodname
Access Module
vrm_release
16.10
created_date
July 2017
category
Programming Reference
featnum
B035-2425-077K

The following figure shows how the Teradata Access Module for Azure imports data to a Teradata Database through Teradata Parallel Transporter Consumer operators.



  1. The Teradata Parallel Transporter DataConnector operator dynamically loads the Teradata Access Module for Azure.
  2. The Teradata Access Module for Azure supports the Teradata Parallel Transporter DataConnector API by providing implementation for the required generic instructions such as File Open, File Read, File Get Position, File Set Position, File Close and Shutdown.
  3. The Teradata Parallel Transporter DataConnector operator uses the Init and File Open instructions to have the Teradata Access Module for Azure establish a number, specified by the user through the initialization string,of encrypted TCP connections to Microsoft Azure Blob Storage.
  4. The Teradata Access Module for Azure retrieves data asynchronously from Microsoft Azure Blob Storage using the number of connections as specified in Init instruction.
  5. As File Read instructions are received by the Teradata Access Module for Azure from the Teradata Parallel Transporter DataConnector Operator, the reads are matched up with the appropriate Microsoft Azure Blob Storage buffer.

    Since data is read from Azure asynchronously using multiple connections and buffers, read operations may be completed immediately.

  6. In response to the Teradata Parallel Transporter DataConnector operator instructions mentioned in step 1 above, the Teradata Access Module for Azure establishes connection(s) to Microsoft Azure Blob Storage and fetches data from file object stored at Microsoft Azure Blob Storage.
  7. The Teradata Parallel Transporter DataConnector operator transfers the data to a Teradata Parallel Transporter Consumer operator.
  8. The Teradata Parallel Transporter Consumer operators process and load the data into a table in the Teradata Database.
  9. Once an end-of-file has been received and communicated via the response to the last read instruction, Close and Shutdown instructions are sent by the Teradata Parallel Transporter DataConnector so that the Teradata Access Module for Azure can close the encrypted TCP connections to Azure.