Cluster Service Matrices - Cloudera Distribution for Hadoop

Cloudera Distribution for Hadoop for Teradata Administrator Guide

Product
Cloudera Distribution for Hadoop
Release Number
5.11
Published
July 2017
Language
English (United States)
Last Update
2018-04-12
dita:mapPath
lrq1499784642284.ditamap
dita:ditavalPath
cdh_Cloudera.ditaval
dita:id
ndz1467245415037
lifecycle
previous
Product Category
Open Source

These tables provide the install locations of the numerous Hadoop services across the nodes in a cluster.

Core Hadoop

Cluster Service Matrix (Three Master Nodes)
  M1 M2 M3 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X X
HiveServer2 X X
Hive WebHCat Server X X
Hue Server X X X
Hue Load Balancer     X    
HDFS JournalNode X X X
HDFS NameNode X X
HDFS HttpFS X
HDFS Failover Controller X X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
ZooKeeper Server X X X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X X X
Hive Gateway X X X X X
YARN (MR2 Included) Gateway X X X X X
Cluster Service Matrix (Five Master Nodes)
  M1 M2 M3 M4 M5 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X X
HiveServer2 X X
Hive WebHCat Server X X
Hue Server X X X  
Hue Load Balancer     X        
HDFS JournalNode X X X X X
HDFS NameNode X X
HDFS HttpFS X
HDFS Failover Controller X X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
ZooKeeper Server X X X X X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X X X X X
Hive Gateway X X X X X X X
YARN (MR2 Included) Gateway X X X X X X X
Cluster Service Matrix (Single Master Node)
  M1 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X
HiveServer2 X
Hive WebHCat Server X
Hue Server X
HDFS JournalNode X
HDFS NameNode X
HDFS HttpFS X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
ZooKeeper Server X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X
Hive Gateway X X X
YARN (MR2 Included) Gateway X X X

Post-Install Services

Cluster Service Matrix (Three Master Nodes)
    M1 M2 M3 Data / Worker Edge
Cloudera Manager Server X          
Agent X X X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X X X
Flume Agent X X
HBase Master X X
RegionServer X With Java API
Thrift Server X HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store X
Catalog Server X
Daemon X
Kafka Broker X
MirrorMaker X

(optional)

Kafka MirrorMaker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X X X
Cluster Service Matrix (Five Master Nodes)
    M1 M2 M3 M4 M5 Data/ Worker Edge
Cloudera Manager Server X              
Agent X X X X X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X X X X X
Flume Agent X X
HBase Master X X
Region Server X With Java API
Thrift Server X HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store X
Catalog Server X
Daemon X
Kafka Broker X
Mirror Maker X (optional) Kafka Mirror Maker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X X X X X
Cluster Service Matrix (One Master Node)
    M1 Data/ Worker Edge
Cloudera Manager Server X      
Agent X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X
Flume Agent X X
HBase Master X
RegionServer X With Java API :- The Java API is the most common mechanism for getting data into HBase, through PUT operations
Thrift Server X (optional) HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X (optional) HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store  
Catalog Server X
Daemon X
Kafka Broker X
Kafka MirrorMaker X (optional) Kafka MirrorMaker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X