17.10 - AvroContainerSplit Syntax - Advanced SQL Engine - Teradata Database

Teradata Vantageā„¢ - DATASET Data Type

Product
Advanced SQL Engine
Teradata Database
Release Number
17.10
Release Date
July 2021
Content Type
Programming Reference
Publication ID
B035-1198-171K
Language
English (United States)
AvroContainerSplit ( ON
  ( SELECT ( container_id, container )
           ( select_stmt_options )
  )
)

Syntax Elements

container_id
Uniquely identifies the Avro Object Container File, useful when processing multiple container files.
container_id includes the following types:
  • BYTEINT
  • SMALLINT
  • INTEGER
  • BIGINT
  • DOUBLE PRECISION
  • DECIMAL
  • NUMBER
  • CHAR
  • VARCHAR
container
A BLOB in the Avro Object Container File format.
An error is returned if the input data is not one of these data types, or if the input rows contain more or less than two columns. If the container value is a null value, a row with an avro_object_id and avro_value set to null is returned. The result of AvroContainerSplit is one or more output rows, where each row represents an individual Avro value from the Object Container File. Three output columns are returned as follows:
  • out_container_id: The same type and value as the container_id input column. out_container_id identifies the Object Container File that the Avro value came from.
  • avro_object_id: Each Avro value from a container is numbered from 0 to n-1, where n is the number of Avro values within the Object Container File. The output column is type INTEGER.
  • avro_val: The Avro Dataset value.
The Object Container File can be uncompressed (null codec) or compressed (deflate codec). The schema within the Object Container File is limited to 16 MB, and the uncompressed size of any file data block within the Object Container file is also limited to 16 MB.
select_stmt_options
The allowable or necessary options in Vantage for a SQL SELECT statement.