DNS Configuration - Hortonworks Data Platform

Hortonworks Data Platform for Teradata® Administrator Guide

Product
Hortonworks Data Platform
Release Number
SLES 12
3.1.5
3.1.4
3.0.1
Published
August 2020
Language
English (United States)
Last Update
2020-09-14
dita:mapPath
rix1551812220422.ditamap
dita:ditavalPath
jbc1497974574502.ditaval
dita:id
B035-6097
Product Category
Open Source
Hadoop nodes use a single name. The /etc/hosts file is used to resolve hostnames when communicating to nodes within its cluster. The name returned by the hostname -f command is used to resolve IP addresses. The Hadoop hostname must be the leftmost name on the line in /etc/hosts in order for Hadoop to recognize it. For example, a hosts file entry is similar to:
39.0.8.2     newname1
  • Hostnames must be lowercase as certain functions require it (for example, Kerberos).
  • Do not change hostnames for your site configuration after Hadoop installation as unexpected results could occur. For more information, contact your Teradata Customer Support representative.

Internal IP addresses are either manually configured and included in the hosts file or assigned by Server Management using DHCP and referenced using the CMIC configuration.

External interfaces and corporate DNS must use the same hostnames that Hadoop uses on the internal BYNET network.

If an application or user requests data from the namenode service, the service returns a location based on the hostname Hadoop is using. When external clients access Hadoop, the Hadoop hostnames must be included in the corporate DNS or resolve the Hadoop hostname to its external interface using the local /etc/hosts.

The diagram illustrates the Hadoop cluster configured for external client access. The /etc/hosts file in each Hadoop node has hostnames associated with the internal BYNET network, while the external client’s /etc/hosts file is associated with the Hadoop node’s public IP.

Example of Networking Layout
Internal IP address in /etc/hosts 39.0.8.2 newname1 39.0.8.3 newname2 39.0.8.5 newname3 153.0.1.2 newname1 153.0.1.3 newname2 153.0.1.5 newname3 $ hostname-f newname1 newname1 (39.0.8.2) Public (153.0.1.2) NameNode newname 2 (39.0.8.3) Public (153.0.1.3) Secondary NameNode newname 18 (39.0.8.20) IB Switch Customer LAN newname 3 (39.0.8.5) Public (153.0.1.5) Data Node 1 newname 4 (39.0.8.6) Public (153.0.1.6) Data Node 2 Public (153.0.1.20) Data Node 16 HDP_0004 External IP address in /etc/hosts