These features and updates were added to VantageCloud Lake for August 2024. Because there was no July 2024 release, this also includes all the July updates.
Enhanced VantageCloud Lake Console Navigation
Teradata has revised and enhanced the navigation in the VantageCloud Lake Console. Menu options are now organized based on your role and task. The actual items will vary, depending on your permissions, organization settings, and the selected environment. The toolbar on the top includes SQL editor, ask.ai, context-specific help and your user settings.
In Learn , find out about common tasks and view guides about what's new, getting started, and new features.
In the Resource center , select Show Me under Improved navigation and new dashboards for a tour of the new experience.
Discover VantageCloud Lake Learning Resources
Get the right learning content at the right time with the new learning resource. From the menu, select Learn . The Learn menu offers the following:
- Get started – includes step-by-step instructions for the most common and required tasks for organization administrators and database users to get up and running with the VantageCloud Lake Console.
- Resource center – provides guided tours of tasks to help you get the job done quickly and efficiently.
Be sure to visit regularly to view updated content!
VantageCloud Lake Supported AWS Regions
VantageCloud Lake on AWS is now available in the following regions:
| Region Name | Region |
|---|---|
| South America | |
| South America (São Paulo) | sa-east-1 |
| Asia Pacific | |
| Asia Pacific (Mumbai) | ap-south-1 |
Immutability of Backups (AWS)
You can now have immutability of backups on AWS environments with the support of your Teradata account team. This functionality allows you to protect your backups from modifications or deletions either accidentally or by malware attacks before the defined retention period. See Immutability of Backups.
Lake-to-Lake Connectivity (AWS, Azure)
You can now connect two VantageCloud Lake environments on the same platform using QueryGrid on VantageCloud Lake.
| Lake environment | Connects to | With connector |
|---|---|---|
| VantageCloud Lake on AWS | VantageCloud Lake on AWS | Teradata-to-Teradata |
| VantageCloud Lake on Azure | VantageCloud Lake on Azure | Teradata-to-Teradata |
Mainframe Cloud-Network Connectivity
VantageCloud Lake now supports Mainframe Cloud-Network Connectivity. You can now integrate your mainframe data processing with VantageCloud Lake using mainframe gateway mediated connectivity.
Setting Up PrivateLink for AWS
You can now set up a PrivateLink connectivity to VantageCloud Lake from any Availability Zone in the same AWS region. See Setting PrivateLink for AWS.
AutoStats Feature
AutoStats is an automated performance tuning feature that collects and refreshes statistics needed for accurate query optimization which results in more efficient execution plans. AutoStats tuning jobs are automatically scheduled through a VantageCloud Lake tenant service and employ best practices suitable for data residing in a variety of storage classes including the Block File System (BFS), Object File System (OFS), and Native Object Store (NOS). Although capable of running in a fully autonomous mode, APIs are available for expert DBAs that want to review and approve tuning recommendations or customize other behavior. For users migrating from VantageCloud Enterprise to VantageCloud Lake, the AutoStats tuning service replaces the Teradata® Viewpoint Stats Manager portlet.
See Automated Statistics Management APIs, AUTODBA Option (CREATE TABLE), and "AUTODBA Option" in CREATE DATABASE Usage Notes.
Collect Statistics
You can now run Collect Statistics on compute clusters for your data in the Object File System (OFS).
Telemetry data and DBQL/ResUsage data in OFS
You can now run performance collection data and reporting for primary cluster only environments using TD_Metric_SVC views. The underlying data for these views is the same DBQL and ResUsage data. Support for several system logs that were not managed earlier is now available. The Object File System (OFS) provides low-cost storage and takes advantage of the compute cluster architecture so you can scale and isolate performance analysis workloads. See dbqlsummaryV.
System Defined Alerts for Actual Consumption at Environment Level
Alerts are now available for actual consumption at the environment level. You will get an alert notification once the forecasted consumption for an environment reaches the defined threshold values. Organization admins will now receive an email alert when the organizational actual consumption at an environment level reaches a threshold of 75%, 90%, 100% of the maximum forecasted consumption of a given period (Month/Week).
Unified Query Monitoring Temporarily Unavailable
This feature released in May 2024 for public preview is being updated to remove some limitations and is temporarily unavailable. See Query Monitoring.
Query Performance Report Temporarily Unavailable
This system defined report in the VantageCloud Lake Console Reports page is temporarily unavailable. It was released in June 2024 but is currently being updated to remove some limitations. See System Defined Reports.Support for Simplified LOCATION URL (AWS)
The LOCATION clause is essential for creating foreign tables, as it facilitates connections to external S3 storage and buckets. Accessing these external storage buckets requires using complex, lengthy URLs, which can lead to errors and make the process more cumbersome. Specifying redundant and extended endpoints further added to the complexity.
To simplify this, a new, streamlined LOCATION URL format has been introduced. This format is universally recognized and makes specifying locations more concise and user friendly.
Additionally, a new optional ENDPOINT parameter has been introduced, allowing users to customize their access configurations. This feature supports specifying custom endpoints, including virtual private clouds, private endpoints, or S3-compatible object stores like MinIO or Ceph.
The current LOCATION format is still fully supported, ensuring a smooth transition for users familiar with the old method while offering a more efficient and user-friendly option for everyone.
For DDL statement updates, see CREATE FOREIGN TABLE and ALTER FOREIGN TABLE. For YOUR-OBJECT-STORE-URL updates, see Native Object Store.
Generate AWS Role Permission Policy and Trust Policy
A new role permission and trust policies generator is available to simplify and streamline the authorization setup with AWS IAM. When working on the source and target authorization step, select this option to help guide you through granting Flow access to the data in your AWS S3 buckets.
Support for Native Object Store (NOS) Volatile Tables
VantageCloud Lake now supports the use of NOS volatile tables to analyze, explore, and process data in object stores without requiring the CREATE TABLE access grant. You can create volatile tables in the spool space for temporary work; they are dropped automatically when a session ends.
See CREATE FOREIGN TABLE.
NOS Schema Evolution
The NOS Schema Evolution feature facilitates evolving the foreign table schema based on any structural changes to Parquet files. You can add, update, or remove columns from any position within the file without necessitating a complete rebuilding of the Data Definition Language (DDL). Schema evolution of the Parquet file can be incorporated into the DDL using ALTER FOREIGN TABLE.
For DDL statement updates and examples, see CREATE FOREIGN TABLE and ALTER FOREIGN TABLE. For Parquet file usage updates, see Native Object Store.
Object File System Spool Space Reporting
Object File System Spool is spool that is placed on the object store. OFS Spools do not have an upper size limit and are also not governed by existing space accounting mechanisms. System level alerts were implemented to document queries consuming excessive amounts of spool space usage on the object store. Tools have also been enhanced to report OFS Spool usage. The alerts generated will contain information identifying the offending spool table, the user, query, or session breaching these system limits. If necessary, actions can be taken to abort the query or session.
To view OFS Spools breaching these system limits using standard SQL, refer to the macros CreateFsysInfoTable/CreateFsysInfoTable_ANSI and PopulateFsysInfoTable/PopulateFsysInfoTable_ANSI.
Error Tables (OFS)
Error tables are now supported in the Object File System (OFS) and hence you can run foreign table queries on the compute clusters. The error table is associated with the foreign table specified in the CREATE ERROR TABLE statement, and only contains rows that came from queries against the foreign table. For syntax and other details, see Create Error Table.max_models Argument Added to teradataml
An optional max_models argument has been added as an early stopping criterion to limit the maximum number of models to be trained.
See AutoML in teradataml.
TD_SMOTE
To alleviate the problem of poor classification modeling for imbalanced datasets, you can perform minority oversampling using four different techniques provided by TD_SMOTE.
On the top of the toolbar, select the SQL editor then in-database analytics functions explorer to access the TD_SMOTE analytic function, which is located under the Feature engineering transform category.
See TD_SMOTE.
Unbounded Array Framework Time Series Function Updates
- The TD_GOLDFELD_QUANDT function parameters were enhanced to provide better ease of use.
- The TD_DICKEY_FULLER function was updated to address FUNC_PARAMS updates to align with Python statsmodel package functionality.
See Database Unbounded Array Framework Time Series Functions.