Set the Hadoop NameNode for High Availability | Teradata Data Mover - Setting the Hadoop NameNode for High Availability - Teradata Data Mover

Teradata® Data Mover User Guide

Product
Teradata Data Mover
Release Number
17.00
Published
November 30, 2021
Language
English (United States)
Last Update
2021-11-04
dita:mapPath
gmn1574692806523.ditamap
dita:ditavalPath
cjo1509024828169.ditaval
dita:id
B035-4101
lifecycle
previous
Product Category
Analytical Ecosystem
  1. Get the value for fs.defaultFS through the Web UI (HDFS Configs) or from core-site.xml in the Hadoop cluster.
  2. From /teradata/tdch/services.json in the HDFS file system, set the NameNode for high availability:
    "NameNodeHAConfigured":true
  3. Set the fs.defaultFS value to NameNodeHA, for example:
    "NameNodeHA":"hdfs://myCluster"
  4. If jobs fail with the error below and NameNode high availability is not configured, edit the Data Mover jobs with the active NameNode value for WebHDFS_url:
    ERROR: Unable to load services.json file from HDFS