Iceberg
TD_MANIFESTS function returns manifest information for an OTF Iceberg table.
Columns Returned
- snapshotId
- snapshotTimestamp
- manifestList
- manifestFile
- manifestFileLength
- datafilecount
- totalrowcount
Syntax
[TD_SYSFNLIB.]TD_MANIFESTS( ON ( <datalake_name>.<database_name>.<table_name> ) ) <alias_name>;
Example:
SELECT * FROM TD_MANIFESTS(ON (datalake_iceberg_glue.vim.cdata)) D; *** Query completed. 3 rows found. 7 columns returned. *** Total elapsed time was 2 seconds. snapshotId 6373759902296319074 snapshotTimestamp 2023-06-15 00:07:47 manifestList s3://vim-iceberg-v1/glue/metadata/snap-6373759902296319074-1-28a1d854-5be4-45c2-92fe-66f0dc75e7bc.avro manifestFile s3://vim-iceberg-v1/glue/metadata/28a1d854-5be4-45c2-92fe-66f0dc75e7bc-m0.avro manifestFileLength 7233 datafilecount 1 totalrowcount 5 snapshotId 4768076782814510171 snapshotTimestamp 2023-06-15 00:09:01 manifestList s3://vim-iceberg-v1/glue/metadata/snap-4768076782814510171-1-85485f8a-ebb4-4595-9a3e-42f314dafbe1.avro manifestFile s3://vim-iceberg-v1/glue/metadata/85485f8a-ebb4-4595-9a3e-42f314dafbe1-m0.avro manifestFileLength 7222 datafilecount 1 totalrowcount 2 snapshotId 4768076782814510171 snapshotTimestamp 2023-06-15 00:09:01 manifestList s3://vim-iceberg-v1/glue/metadata/snap-4768076782814510171-1-85485f8a-ebb4-4595-9a3e-42f314dafbe1.avro manifestFile s3://vim-iceberg-v1/glue/metadata/28a1d854-5be4-45c2-92fe-66f0dc75e7bc-m0.avro manifestFileLength 7233 datafilecount 1 totalrowcount 5
Delta Lake
TD_MANIFESTS function is not supported for Delta Lake tables and will return an appropriate error is invoked on a Delta Lake table.
SELECT * FROM TD_MANIFESTS(ON (deltalake_glue.db1.table1)) D; $ *** Failure 3706 Syntax error: TD_MANIFESTS is not supported for Deltalake.