Example: Datalake Definition for Iceberg Gravitino with StorageGrid as a Storage - Teradata Vantage

This section shows how to use OTF with the Iceberg format, using Apache Gravitino as the catalog and StorageGrid (on-prem S3-compatible storage) for data. The example includes required authorizations and datalake setup.

Other S3-compatible on-prem solutions like MinIO and Dell ECS are also supported.

CREATE AUTHORIZATION storagegrid_gravitino_catalog_auth  
USER '<catalog_oauth_service_user>'  
PASSWORD '<catalog_oauth_service_user >'; 

CREATE AUTHORIZATION storagegrid_storage_auth  
USER '<storage_access_key_id'  
PASSWORD '<storage_secret_key'; 

CREATE DATALAKE iceberg_gravitino_storagegrid_rest  
EXTERNAL SECURITY CATALOG storagegrid_gravitino_catalog_auth ,  
EXTERNAL SECURITY STORAGE storagegrid_storage_auth  
USING  
catalog_type ('rest')  
catalog_location ('http://hostname:port/iceberg')  
idp_location ('http://hostname:port/oauth2/token')  
storage_region ('us-east-1')  
storage_endpoint ('https://hostname:10443')  
storage_location ('s3://gravitino-otf/')  
TABLE FORMAT iceberg ;