Deploy QueryGrid on Azure VMSS | QueryGrid - Automatically Deploy QueryGrid on Azure Virtual Machine Scale Set - Teradata QueryGrid

QueryGridâ„¢ Installation and User Guide - 3.06

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
Lake
VMware
Product
Teradata QueryGrid
Release Number
3.06
Published
December 2024
ft:locale
en-US
ft:lastEdition
2024-12-07
dita:mapPath
ndp1726122159943.ditamap
dita:ditavalPath
ft:empty
dita:id
lxg1591800469257
lifecycle
latest
Product Category
Analytical Ecosystem
This option is available for use with the Oracle or Generic JDBC connector.

This procedure creates an auto-scalable cluster of Azure instances with QueryGrid installed. When deploying QueryGrid to hosts that are members of Azure Virtual Machine Scale Set (VMSS), you can automate the tdqg-node installations and registration process by specifying a bootstrap script that runs on all newly added members of the Azure VMSS.

The required script, TDQG_DEPLOYMENT.sh is packaged in the node package tdqg-node-version.tar.gz. The script must be uploaded to your Azure Storage Account and used as a Custom Script extension along with the tdqg-node.json token.

This procedure assumes the following prerequisites:
  • You have required privileges to create a Virtual Machine Scale Set, Storage Account, and add roles to Managed Identity.
The following software is installed automatically if not already installed on the node:
  • OpenJDK 11 if Java is not already present
  • AzureCLI
  • cURL
  • JQ
  • ACL
  1. Add a system in Viewpoint and download the tdqg-node.json token file that was generated by the QueryGrid Manager.
    For information about downloading tdqg-node.json, see Adding Nodes Manually.
  2. Download the node package, see Downloading Required Packages.
  3. Unzip the package using the tar -xzvf tdqg-node-version.tar.gz command.
    TDQG_DEPLOYMENT.sh is available in the qgdeployment/azure path.
  4. Upload the TDQG_DEPLOYMENT.sh script and the tdqg-node.json token to a Storage Account container.
  5. Create Azure VMSS with the following options:
    • Orchestration Mode: Uniform
    • Scaling Policy: Manual
    • Upgrade Policy: Automatic
    • System Assigned Managed Identity: Enable
  6. After creating the VMSS, perform the following:
    Step Action
    Add scaling options
    1. Select Scaling in the left menu.
    2. Select Custom autoscale.
    3. Edit rule for scale out with intended metric.
    4. Delete Scale-in rule (scaling is handled by QueryGrid).
    Add extensions
    1. Select Extensions in the left menu.
    2. Add Custom Script for Linux extension.
    3. Select Browse.

      Add the tdqg-node.json and TDQG_DEPLOYMENT.sh scripts that you uploaded to a storage account in step 4.

    4. Add bash TDQG_DEPLOYMENT.sh --tdqg_node_json_file tdqg-node.json --scale-in-enabled true to the Command field.
    scale-in-enabled:true
    This enables automated scale-in performed by the QueryGrid software when a driver host has been idle for a certain amount of time. When combined with an Autoscale only out policy defined in the VMSS Scaling options, both scale in and scale out are automated.
    Because this task is performed by QueryGrid, if set to true, scale in occurs even if Scale-in rule is deleted.
    Add Managed Identity
    1. Select Identity in the left menu.
    2. Under System Assigned, add Role Assignment for Resource Group with the Contributor role.
    Allowing Azure to perform the auto scale-in rather than using the QueryGrid scale-in enabled feature can cause queries to fail while the scale-in is being performed.