Using Algorithmic Compression on DATASET Columns | VantageCloud Lake - Using Algorithmic Compression on DATASET Columns - Teradata Vantage

Teradata® VantageCloud Lake

Deployment
VantageCloud
Edition
Lake
Product
Teradata Vantage
Published
January 2023
ft:locale
en-US
ft:lastEdition
2024-12-11
dita:mapPath
phg1621910019905.ditamap
dita:ditavalPath
pny1626732985837.ditaval
dita:id
phg1621910019905

The storage format specification defines a file format that transmits and stores the values with a common schema and defines processes for operating on and compressing the storage format data.

You can perform algorithmic compression on DATASET data using the SNAPPY_COMPRESS and SNAPPY_DECOMPRESS routines.

You can only use SNAPPY_COMPRESS and SNAPPY_DECOMPRESS to compress DATASET data. If you use any other algorithmic compression routines, you get an error.

For storage format AVRO:

CREATE TABLE avroCompressTable(
	id INTEGER,
	compressibleAvroFile DATASET STORAGE FORMAT AVRO
		COMPRESS USING SNAPPY_COMPRESS
		DECOMPRESS USING SNAPPY_DECOMPRESS);
For storage format CSV:
CREATE TABLE csvCompressTable(
	id INTEGER,
	compressibleCSVFile DATASET STORAGE FORMAT CSV
		COMPRESS USING SNAPPY_COMPRESS
		DECOMPRESS USING SNAPPY_DECOMPRESS);

For more information about algorithmic compression, see Algorithmic Compression (ALC).