17.10 - Scenario 3: Publishing Data to the Avro Format - Advanced SQL Engine - Teradata Database

Teradata Vantageā„¢ - DATASET Data Type

Product
Advanced SQL Engine
Teradata Database
Release Number
17.10
Release Date
July 2021
Content Type
Programming Reference
Publication ID
B035-1198-171K
Language
English (United States)
Data not stored as Avro, whether stored in a table, a constant value, the result of some other operation, may be published to the Avro format and used to construct an object container file. Follow these steps to gather the data and construct the object container file:
  1. Formulate a query to publish data in the desired Avro format using the DATASET_PUBLISH table operator.
  2. Obtain the schema for the object container file by executing the getSchema method of the DATASET type on the data output column of DATASET_PUBLISH. This provides an Avro instance that contains the schema and binary-encoded Avro value created.
This operation only needs to be executed once because the schema produced by DATASET_PUBLISH applies to all output instances (and therefore applies to an object container file).