Google Vertex AI is a cloud machine learning platform which offers services to train machine learning models using Google Cloud compute resources and then host those models in Google Cloud containers. These hosted models are called 'endpoint' and can be accessed using web address. They are divided into two categories:
- Online endpoint : Used for real-time scoring.
- Batch endpoint: Used for batch scoring.
The integration with Google Vertex AI enables Teradata customers to do real-time scoring using Teradata tables or queries and online endpoints.
Models created using Google Vertex AI can be downloaded locally. Teradata customers have the option to either use Google Vertex AI for online scoring, or insert these models in Vantage and do the scoring using the BYOM feature.
The integration with Google Vertex AI includes the following:
- API_Request In-database Function
This in-database function enables Vantage users to connect with an Vertex AI endpoint for scoring using a Vantage query (SQL).
- Google Vertex AI teradataml Extension Library (tdapiclient)
This client package allows data scientists and developers to use their Python development environment to connect to Vantage and use easier API to train and predict using teradataml Dataframe objects with Teradata tables or queries.
API_Request In-database Function
Typical steps to use API_Request in-database function:
- Data cleaning, feature engineering inside the database;
- Exporting data for training and model fitting;
- Google Vertex AI model training and model deployment;
- Collecting information about endpoint (data types, number of columns, authentication keys);
- Real-time scoring using Teradata API_Request in-database function with API_TYPE set to "vertex-ai".
Google Vertex AI teradataml Extension Library (tdapiclient)
The Google Vertex AI teradataml extension library (tdapiclient) uses Vantage DataFrame to train Google Vertex AI models.
- Enable users to prepare the training data by leveraging Teradata’s Python based in-DB analytics functions.
- Leveraging teradataml and Vertex AI Python SDK capabilities which allow users to create model over Vertex AI directly from Vantage.
- Once created models are deployed as endpoint in Google Cloud or over Vantage, business users can get access of Vertex AI analytic services for real-time scoring directly from Vantage.