Importing Data - Access Module

The following figure shows how the Teradata Access Module for Amazon S3 imports data to a Teradata Database through Teradata Parallel Transporter loading operators.

The Teradata Parallel Transporter operators and the Teradata Access Module for Amazon S3 run on an EC2 instance.

1. The Teradata Parallel Transporter DataConnector operator dynamically loads the Teradata Access Module for Amazon S3.
2. The Teradata Access Module for Amazon S3 supports the Teradata Parallel Transporter DataConnector API by providing implementation for the required generic instructions such as File Open, File Read, File Get Position, File Set Position, File Close and Shutdown.
3. The Teradata Parallel Transporter DataConnector operator uses the Init and File Open instructions to have the Teradata Access Module for Amazon S3 establish a number, specified by the user through the initialization string of encrypted TCP connections to Amazon S3.
4. The Teradata Access Module for Amazon S3 retrieves data asynchronously from Amazon S3 using the number of connections specified in the Init instruction.
5. As File Read instructions are received by the Teradata Access Module for Amazon S3 from the Teradata Parallel Transporter DataConnector Operator, the reads are matched up with the appropriate Amazon S3 buffer. Since data is read from Amazon S3 asynchronously using multiple connections and buffers, read operations may be completed immediately.
6. In response to the Teradata Parallel Transporter DataConnector operator instructions mentioned in step 1 above, the Teradata Access Module for Amazon S3 establishes connection(s) to Amazon S3 and fetches data from file object stored at Amazon S3.
7. The Teradata Parallel Transporter DataConnector operator transfers the data to a Teradata Parallel Transporter loading operator.
8. The Teradata Parallel Transporter loading operators process and load the data into a table in the Teradata Database.
9. Once an end-of-file has been received and communicated via the response to the last read instruction, Close and Shutdown instructions are sent by the Teradata Parallel Transporter DataConnector so that the Teradata Access Module for Amazon S3 can close the encrypt TCP connections to Amazon S3.