Migrate Repository Data - Analytics Database to Postgres: Single System DSU | DSE - Migrating Repository Data from Analytics Database to Postgres on a Single System - BAR - Data Stream Architecture - Data Stream Extensions

Teradata® DSA - DSE for Veritas NetBackup Installation, Configuration, and Upgrade Guide

Deployment
VantageCloud
VantageCore
Edition
Enterprise
IntelliFlex
VMware
Product
BAR
Data Stream Architecture
Data Stream Extensions
Release Number
17.20
Published
November 2022
Language
English (United States)
Last Update
2023-08-18
dita:mapPath
trj1632417653238.ditamap
dita:ditavalPath
ufq1576617582483.ditaval
dita:id
B035-3151
Product Category
Software
Teradata Tools and Utilities
Follow these instructions to migrate the DSC to a Postgres repository on the same system.
Important:
  • This process installs Teradata Parallel Transporter (TPT) and Postgres if they are not already installed.

    If the TPT install fails, you must manually install it and if necessary, CLIv2.

    • If the DSC is currently on Teradata Database 15.10, both TPT and CLIv2 must be version 15.10.
    • If the DSC is currently on Analytics Database 16.20, both TPT and CLIv2 must be version 16.20.
  • A folder, pgdata, is created during this process. Do not delete it or its content until the migration is successfully completed.
  1. ssh to the DSC system and navigate to a folder where you have enough free space to export the BAR repository.
  2. Download DSAMetaDataMigrator__sles12-15_x8664.17.xx.xx.xx-xxx.tar.gz from the Teradata Software server (https://support.teradata.com) and transfer to the DSC system.
  3. Extract the content.
    tar -xvzf DSAMetaDataMigrator__sles12-15_x8664.17.xx.xx.xx-xxx.tar.gz
  4. Go to the extracted folder and run the following steps from there.
  5. Install python3 and its dependency module.
    installpython3.sh
  6. Generate a property file using these commands:
    • On SLES15 run python3 runAutoMigration.py - g
    • On SLES12.3-TDC/STND run python3.6 runAutoMigration.py - g
    This generates a properties.xml file prepopulated with values available from the DSC installation. Use this file as input for rest of the options.
  7. Edit properties.xml to update it with credentials of DSC box, systems and and media servers.
    More information about properties.xml (and a commented sample) can be found in Properties.xml File.
  8. Export the metadata:
    • On SLES15 run python3 runAutoMigration.py - e
    • On SLES12.3-TDC/STND run python3.6 runAutoMigration.py - e
    The metadata from from the Teradata repository is exported to a flat file in .csv format in a folder called pgdata.
  9. Run ./dscinstall.sh -r DSC.17.xx.xx.xx-xxxxxx.rpm to upgrade the currently installed DSC version to new DSC version DSC 17.xx.00.00 having Postgres as the repository.
    Be sure to use the same credentials as are put in the properties file.
  10. Verify DSC with REST API is running.
    /etc/init.d/dsc status
    If DSA >=17.20.04.00 then, run $DSA_DSC_ROOT/postgres_access.sh -t disable
  11. Import the metadata from the flat files to the new repository.
    • On SLES15 run python3 runAutoMigration.py - i
    • On SLES12.3-TDC/STND run python3.6 runAutoMigration.py - i
    This imports the exported data from flat file to Postgres database. If not in silent mode, and any user data is present in the Postgres repo, user is asked if clean up can proceed.
  12. [Optional] Validate the import process.
    • On SLES15 run python3 runAutomigration.py - v
    • On SLES12.3-TDC/STND run python3.6 runAutomigration.py - v
    This validates the export and import process by comparing the number of rows for each table in the Teradata repo and Postgres.
  13. Reconfigure the new DSC.
    • On SLES15 run python3 runAutoMigration.py - r
    • On SLES12.3-TDC/STND run python3.6 runAutoMigration.py - r
  14. Download and upgrade the ClientHandler, Access Modules, and the BAR command line components (See Installing Software with Scripts). In case you have ClientHandler locally installed to new DSC, then make sure it's up and running.
    If DSA >=17.20.04.00 then run, $DSA_DSC_ROOT/postgres_access.sh -t disable