Cloud Staging Area using configured target group names | Teradata Data Mover - Using Configured Target Group Names - Teradata Data Mover

Teradata® Data Mover Installation, Configuration, and Upgrade Guide for Customers - 20.01

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
Lake
VMware
Product
Teradata Data Mover
Release Number
20.01
Published
November 2023
Language
English (United States)
Last Update
2023-12-05
dita:mapPath
jvt1700556161677.ditamap
dita:ditavalPath
stp1591127384938.ditaval
dita:id
pqq1467243714524
Product Category
Analytical Ecosystem

To create the cloud Staging Area:

  1. Configure the AWS account with DSC.
    1. Run the command dsc config_aws -file aws_config.xml. The aws_config.xml contains:
      <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
      <dscConfigAmzS3 xmlns="http://schemas.teradata.com/v2012/DSC">
          <config_aws_list>
              <account_name>aws-account-name</account_name>
              <buckets_by_region>
                  <region>us-west-2</region>
                  <buckets>
                      <bucket_name>my-s3-bucket</bucket_name>
                      <prefix_list>
                          <prefix_name>backup</prefix_name>
                          <storage_devices>100</storage_devices>
                      </prefix_list>
                  </buckets>
              </buckets_by_region>
          </config_aws_list>
      </dscConfigAmzS3>
    2. Enter the AWS Access Id and Key separately as the script prompts.
  2. Configure the target group with DSC for each node.
    1. Run the command dsc config_target_groups -type TARGET_S3 -file aws_source_tg.xml. The aws_source_tg.xml contains:
      <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
      <dscConfigTargetGroupsAmzS3 xmlns="http://schemas.teradata.com/v2012/DSC">
          <target_group_name>source-tg-name</target_group_name>
          <is_enabled>true</is_enabled>
          <account_name>aws-account-name</account_name>
          <region>us-west-2</region>
          <targetMediaBuckets>
              <bar_media_server>sourceSystem1_ms</bar_media_server>
              <buckets>
                  <bucket_name>my-s3-bucket</bucket_name>
                  <prefix_list>
                      <prefix_name>backup/</prefix_name>
                      <storage_devices>100</storage_devices>
                  </prefix_list>
              </buckets>
          </targetMediaBuckets>
      </dscConfigTargetGroupsAmzS3>
    2. Enter the name of the media server for the source or the target in bar_media_server.
    3. Enter the name of the AWS account in account_name.
  3. Run the command dsc config_target_group_map -f aws_tg_map.xml to configure the target group map with DSC. The aws_tg_map.xml contains:
    <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
    <dscConfigTargetGroupsAmzS3 xmlns="http://schemas.teradata.com/v2012/DSC">
        <target_group_name>source-tg-name</target_group_name>
        <is_enabled>true</is_enabled>
        <account_name>aws-account-name</account_name>
        <region>us-west-2</region>
        <targetMediaBuckets>
            <bar_media_server>sourceSystem1_ms</bar_media_server>
            <buckets>
                <bucket_name>my-s3-bucket</bucket_name>
                <prefix_list>
                    <prefix_name>backup/</prefix_name>
                    <storage_devices>100</storage_devices>
                </prefix_list>
            </buckets>
        </targetMediaBuckets>
    </dscConfigTargetGroupsAmzS3>
  4. Specify the target group names in the createCloudStaging.xml. The createCloudStaging.xml contains:
    <?xml version='1.0' encoding='UTF-8'?>
    <dmCreateCloudStaging xmlns="http://schemas.teradata.com/dataMover/v2009" xsi:schemaLocation="http://schemas.teradata.com/unity/DataMover.xsd" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
        <name>csa1</name>
        <storage_type>S3</storage_type>
        <source_target_pairs>
            <source_target_pair>
                <source_system>sourceSystem1</source_system>
                <source_system_target_group>source-tg-name</source_system_target_group> 
                <target_system>targetSystem1</target_system>
                <target_system_target_group>target-tg-name</target_system_target_group> 
            </source_target_pair>
        </source_target_pairs>
    </dmCreateCloudStaging>
  5. Run the command datamove create_cloud_staging -f createCloudStaging.xml to create a cloud staging area.

    For further information on the Cloud Staging Area, refer to the Teradata® Data Mover User Guide, B035-4101