Transfer of Data From GCS to a Database - Access Module

The following figure shows how the Teradata Access Module for GCS imports data to the database through Teradata Parallel Transporter loading operators.

1. The Teradata Parallel Transporter DataConnector operator dynamically loads the Teradata Access Module for GCS.
2. The Teradata Access Module for GCS supports the Teradata Parallel Transporter DataConnector API by providing implementation for the required generic instructions such as File Open, File Read, File Get Position, File Set Position, File Close and Shutdown.
3. The Teradata Parallel Transporter DataConnector operator uses the Init and File Open instructions to have the Teradata Access Module for GCS establish a number, specified by the user through the initialization string of encrypted TCP connections to GCS.
4. The Teradata Access Module for GCS retrieves data asynchronously from GCS using the number of connections specified in the Init instruction.
5. As File Read instructions are received by the Teradata Access Module for GCS from the Teradata Parallel Transporter DataConnector Operator, the reads are matched up with the appropriate GCS buffer. Since data is read from GCS asynchronously using multiple connections and buffers, read operations may be completed immediately.
6. In response to the Teradata Parallel Transporter DataConnector operator instructions mentioned in step 1 above, the Teradata Access Module for GCS establishes connections to Google Cloud Storage and fetches data from file object stored at GCS.
7. The Teradata Parallel Transporter DataConnector operator transfers the data to a Teradata Parallel Transporter loading operator.
8. The Teradata Parallel Transporter loading operators process and load the data into a table in the database.
9. Once an end-of-file has been received and communicated through the response to the last read instruction, Close and Shutdown instructions are sent by the Teradata Parallel Transporter DataConnector so that the Teradata Access Module for GCS can close the encrypt TCP connections to GCS.