Cluster Service Matrices - Cloudera Distribution for Hadoop

Cloudera Distribution for Hadoop for Teradata Administrator Guide

Product
Cloudera Distribution for Hadoop
Release Number
5.9
5.8
Published
December 2016
Language
English (United States)
Last Update
2018-04-12
dita:mapPath
ldg1478810858348.ditamap
dita:ditavalPath
cdh54.ditaval.ditaval
dita:id
ndz1467245415037
lifecycle
previous
Product Category
Open Source

These tables provide the install locations of the numerous Hadoop services across the nodes in a cluster.

Core Hadoop

Cluster Service Matrix (Three Master Nodes)
  M1 M2 M3 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X X
HiveServer2 X X
Hive WebHCat Server X X
Hue Server X
HDFS JournalNode X X X
HDFS NameNode X X
HDFS HttpFS X
HDFS Failover Controller X X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
Zookeeper Server X X X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X X X
Hive Gateway X X X X X
YARN (MR2 Included) Gateway X X X X X
Cluster Service Matrix (Five Master Nods)
  M1 M2 M3 M4 M5 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X X
HiveServer2 X X
Hive WebHCat Server X X
Hue Server X
HDFS JournalNode X X X X X
HDFS NameNode X X
HDFS HttpFS X
HDFS Failover Controller X X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
Zookeeper Server X X X X X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X X X X X
Hive Gateway X X X X X X X
YARN (MR2 Included) Gateway X X X X X X X
Cluster Service Matrix (Single Master Node)
  M1 Data Edge
Cloudera Manager X
Cloudera Management Service X
Hive Metastore Server X
HiveServer2 X
Hive WebHCat Server X
Hue Server X
HDFS JournalNode X
HDFS NameNode X
HDFS HttpFS X
Oozie Server X
PostgreSQL X
YARN (MR2 Included) ResourceManager X
Sqoop 2 Server X
YARN (MR2 Included) JobHistory Server X
Zookeeper Server X
HDFS DataNode X
YARN (MR2 Included) NodeManager X
HDFS Gateway X X X
Hive Gateway X X X
YARN (MR2 Included) Gateway X X X

Post-Install Services

Cluster Service Matrix (Three Master Nodes)
    M1 M2 M3 Data / Worker Edge
Cloudera Manager Server X          
Agent X X X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X X X
Flume Agent X X
HBase Master X X
RegionServer X With Java API
Thrift Server X HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store X
Catalog Server X
Daemon X
Kafka Broker X
MirrorMaker X

(optional)

Kafka MirrorMaker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X X X
Cluster Service Matrix (Five Master Nodes)
    M1 M2 M3 M4 M5 Data/ Worker Edge
Cloudera Manager Server X              
Agent X X X X X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X X X X X
Flume Agent X X
HBase Master X X
Region Server X With Java API
Thrift Server X HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store X
Catalog Server X
Daemon X
Kafka Broker X
Mirror Maker X (optional) Kafka Mirror Maker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X X X X X
Cluster Service Matrix (One Master Node)
    M1 Data/ Worker Edge
Cloudera Manager Server X      
Agent X X X
Accumulo Master X
Tablet Server X
Garbage Collector X
Tracer X
Monitor X
Gateway X X
Flume Agent X X
HBase Master X
RegionServer X With Java API :- The Java API is the most common mechanism for getting data into HBase, through PUT operations
Thrift Server X (optional) HBase without Java: Thrift interface (the more lightweight and hence faster of the two options)
REST Server X (optional) HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action.
Impala State Store  
Catalog Server X
Daemon X
Kafka Broker X
Kafka MirrorMaker X (optional) Kafka MirrorMaker cross-cluster replication service
Navigator Audit Server X
Metadata Server X
Sentry Server X
Solr Server X
Spark History Server X
Gateway X X