The following figure shows how the Teradata Access Module for S3 imports data to the database through Teradata Parallel Transporter loading operators.
- The Teradata Parallel Transporter DataConnector operator dynamically loads the Teradata Access Module for S3.
- The Teradata Access Module for S3 supports the Teradata Parallel Transporter DataConnector API by providing implementation for the required generic instructions such as File Open, File Read, File Get Position, File Set Position, File Close and Shutdown.
- The Teradata Parallel Transporter DataConnector operator uses the Init and File Open instructions to have the Teradata Access Module for S3 establish a number, specified by the user through the initialization string of encrypted TCP connections to S3.
- The Teradata Access Module for S3 retrieves data asynchronously from S3 using the number of connections specified in the Init instruction.
- As File Read instructions are received by the Teradata Access Module for S3 from the Teradata Parallel Transporter DataConnector Operator, the reads are matched up with the appropriate S3 buffer. Since data is read from S3 asynchronously using multiple connections and buffers, read operations may be completed immediately.
- In response to the Teradata Parallel Transporter DataConnector operator instructions mentioned in step 1 above, the Teradata Access Module for S3 establishes connections to S3 and fetches data from file object stored at S3.
- The Teradata Parallel Transporter DataConnector operator transfers the data to a Teradata Parallel Transporter loading operator.
- The Teradata Parallel Transporter loading operators process and load the data into a table in the database.
- Once an end-of-file has been received and communicated through the response to the last read instruction, Close and Shutdown instructions are sent by the Teradata Parallel Transporter DataConnector so that the Teradata Access Module for S3 can close the encrypted TCP connections to S3.