Teradata Open Table Format integrates with Polaris and Databricks Iceberg REST Catalogs to improve data lake management across VantageCloud Lake on AWS, Azure, and Google Cloud Platform (GCP).
This integration enables users to read and write Iceberg tables in data lakes through a REST-based catalog interface, simplifying access and management of Iceberg metadata across cloud platforms.
Key benefits of this feature are:
- Provides RESTful access to Apache Iceberg catalogs
- Enables seamless read and write operations on Iceberg tables
- Improves data lake interoperability for Teradata customers across multiple cloud platforms
This feature adds support for Apache Iceberg REST Catalog integration using Apache Polaris and Databricks Unity Catalog across all major cloud providers.
The Teradata Open Table Format framework is extended by:
- Introducing two new name–value pairs
- Reusing existing name–value pairs in the CREATE DATALAKE statement
These extensions maintain backward compatibility.
Additionally, two new identity provider (IDP) types are introduced to support different REST catalog authentication mechanisms.
CREATE DATALAKE Components for REST Catalog Integration
When configuring a REST catalog with object storage, the CREATE DATALAKE statement includes the following sections:
- Catalog Section: Configures the REST catalog and metadata management settings.
- Identity Provider Section: Defines OAuth 2.0 authentication endpoints and token management parameters.
- Storage Section: Specifies cloud-specific object storage and dependency settings.