These tables provide the install locations of the numerous Hadoop
services across the nodes in a cluster.
Core Hadoop
Cluster Service Matrix (Three Master Nodes)
|
M1 |
M2 |
M3 |
Data |
Edge |
Cloudera Manager |
X |
|
|
|
|
Cloudera Management Service |
X |
|
|
|
|
Hive Metastore Server |
X |
X |
|
|
|
HiveServer2 |
X |
X |
|
|
|
Hive WebHCat Server |
X |
X |
|
|
|
Hue Server |
X |
|
|
|
|
HDFS JournalNode |
X |
X |
X |
|
|
HDFS NameNode |
|
X |
X |
|
|
HDFS HttpFS |
|
X |
|
|
|
HDFS Failover Controller |
|
X |
X |
|
|
Oozie Server |
X |
|
|
|
|
PostgreSQL |
X |
|
|
|
|
YARN (MR2 Included) ResourceManager |
|
X |
X |
|
|
Sqoop 2 Server |
X |
|
|
|
|
YARN (MR2 Included) JobHistory Server |
|
X |
|
|
|
Zookeeper Server |
X |
X |
X |
|
|
HDFS DataNode |
|
|
|
X |
|
YARN (MR2 Included) NodeManager |
|
|
|
X |
|
HDFS Gateway |
X |
X |
X |
X |
X |
Hive Gateway |
X |
X |
X |
X |
X |
YARN (MR2 Included) Gateway |
X |
X |
X |
X |
X |
Cluster Service Matrix (Five Master Nods)
|
M1 |
M2 |
M3 |
M4 |
M5 |
Data |
Edge |
Cloudera Manager |
X |
|
|
|
|
|
|
Cloudera Management Service |
X |
|
|
|
|
|
|
Hive Metastore Server |
|
|
|
X |
X |
|
|
HiveServer2 |
|
|
|
X |
X |
|
|
Hive WebHCat Server |
|
|
|
X |
X |
|
|
Hue Server |
|
|
|
|
X |
|
|
HDFS JournalNode |
X |
X |
X |
X |
X |
|
|
HDFS NameNode |
|
X |
X |
|
|
|
|
HDFS HttpFS |
|
X |
|
|
|
|
|
HDFS Failover Controller |
|
X |
X |
|
|
|
|
Oozie Server |
|
|
|
|
X |
|
|
PostgreSQL |
X |
|
|
|
|
|
|
YARN (MR2 Included) ResourceManager |
|
X |
X |
|
|
|
|
Sqoop 2 Server |
|
|
|
|
X |
|
|
YARN (MR2 Included) JobHistory Server |
|
|
|
|
X |
|
|
Zookeeper Server |
X |
X |
X |
X |
X |
|
|
HDFS DataNode |
|
|
|
|
|
X |
|
YARN (MR2 Included) NodeManager |
|
|
|
|
|
X |
|
HDFS Gateway |
X |
X |
X |
X |
X |
X |
X |
Hive Gateway |
X |
X |
X |
X |
X |
X |
X |
YARN (MR2 Included) Gateway |
X |
X |
X |
X |
X |
X |
X |
Cluster Service Matrix (Single Master Node)
|
M1 |
Data |
Edge |
Cloudera Manager |
X |
|
|
Cloudera Management Service |
X |
|
|
Hive Metastore Server |
X |
|
|
HiveServer2 |
X |
|
|
Hive WebHCat Server |
X |
|
|
Hue Server |
X |
|
|
HDFS JournalNode |
X |
|
|
HDFS NameNode |
X |
|
|
HDFS HttpFS |
X |
|
|
Oozie Server |
X |
|
|
PostgreSQL |
X |
|
|
YARN (MR2 Included) ResourceManager |
X |
|
|
Sqoop 2 Server |
X |
|
|
YARN (MR2 Included) JobHistory Server |
X |
|
|
Zookeeper Server |
X |
|
|
HDFS DataNode |
|
X |
|
YARN (MR2 Included) NodeManager |
|
X |
|
HDFS Gateway |
X |
X |
X |
Hive Gateway |
X |
X |
X |
YARN (MR2 Included) Gateway |
X |
X |
X |
Post-Install Services
Cluster Service Matrix (Three Master Nodes)
|
|
M1 |
M2 |
M3 |
Data / Worker |
Edge |
|
Cloudera Manager |
Server |
X |
|
|
|
|
|
|
Agent |
X |
X |
X |
X |
X |
|
Accumulo |
Master |
|
|
X |
|
|
|
|
Tablet Server |
|
|
|
X |
|
|
|
Garbage Collector |
|
|
X |
|
|
|
|
Tracer |
|
|
X |
|
|
|
|
Monitor |
|
|
X |
|
|
|
|
Gateway |
X |
X |
X |
X |
|
|
Flume |
Agent |
|
|
|
X |
X |
|
HBase |
Master |
X |
X |
|
|
|
|
|
RegionServer |
|
|
|
X |
|
With Java API |
|
Thrift Server |
|
|
|
X |
|
HBase without Java: Thrift interface (the more lightweight and hence faster of the two options) |
|
REST Server |
|
|
|
X |
|
HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action. |
Impala |
State Store |
|
X |
|
|
|
|
|
Catalog Server |
|
X |
|
|
|
|
|
Daemon |
|
|
|
X |
|
|
Kafka |
Broker |
|
|
|
|
X |
|
|
MirrorMaker |
|
|
|
|
X (optional)
|
Kafka MirrorMaker cross-cluster replication service |
Navigator |
Audit Server |
|
|
X |
|
|
|
|
Metadata Server |
|
|
X |
|
|
|
Sentry |
Server |
|
|
X |
|
|
|
Solr |
Server |
|
|
|
X |
|
|
Spark |
History Server |
|
X |
|
|
|
|
|
Gateway |
X |
X |
X |
X |
|
|
Cluster Service Matrix (Five Master Nodes)
|
|
M1 |
M2 |
M3 |
M4 |
M5 |
Data/ Worker |
Edge |
|
Cloudera Manager |
Server |
X |
|
|
|
|
|
|
|
|
Agent |
X |
X |
X |
X |
X |
X |
X |
|
Accumulo |
Master |
|
|
|
X |
|
|
|
|
|
Tablet Server |
|
|
|
|
|
X |
|
|
|
Garbage Collector |
|
|
|
X |
|
|
|
|
|
Tracer |
|
|
|
X |
|
|
|
|
|
Monitor |
|
|
|
X |
|
|
|
|
|
Gateway |
X |
X |
X |
X |
X |
X |
|
|
Flume |
Agent |
|
|
|
|
|
X |
X |
|
HBase |
Master |
X |
X |
|
|
|
|
|
|
|
Region Server |
|
|
|
|
|
X |
|
With Java API |
|
Thrift Server |
|
|
|
|
|
X |
|
HBase without Java: Thrift interface (the more lightweight and hence faster of the two options) |
|
REST Server |
|
|
|
|
|
X |
|
HBase without Java: REST interface (aka Stargate) uses HTTP verbs to perform an action. |
Impala |
State Store |
|
|
|
X |
|
|
|
|
|
Catalog Server |
|
|
|
X |
|
|
|
|
|
Daemon |
|
|
|
|
|
X |
|
|
Kafka |
Broker |
|
|
|
|
|
|
X |
|
|
Mirror Maker |
|
|
|
|
|
|
X (optional) |
Kafka Mirror Maker cross-cluster replication service |
Navigator |
Audit Server |
|
|
|
|
X |
|
|
|
|
Metadata Server |
|
|
|
|
X |
|
|
|
Sentry |
Server |
|
|
X |
|
|
|
|
|
Solr |
Server |
|
|
|
|
|
X |
|
|
Spark |
History Server |
|
X |
|
|
|
|
|
|
|
Gateway |
X |
X |
X |
X |
X |
X |
|
|
Cluster Service Matrix (One Master Node)
|
|
M1 |
Data/ Worker |
Edge |
|
Cloudera Manager |
Server |
X |
|
|
|
|
Agent |
X |
X |
X |
|
Accumulo |
Master |
X |
|
|
|
|
Tablet Server |
|
X |
|
|
|
Garbage Collector |
X |
|
|
|
|
Tracer |
X |
|
|
|
|
Monitor |
X |
|
|
|
|
Gateway |
X |
X |
|
|
Flume |
Agent |
|
X |
X |
|
HBase |
Master |
X |
|
|
|
|
RegionServer |
|
X |
|
With Java API :- The Java API is the most common mechanism for getting data into HBase, through PUT operations |
|
Thrift Server |
|
X (optional) |
|
HBase without Java: Thrift interface (the
more lightweight and hence faster of the two options) |
|
REST Server |
|
X (optional) |
|
HBase without Java: REST interface (aka
Stargate) uses HTTP verbs to perform an action. |
Impala |
State Store |
|
|
|
|
|
Catalog Server |
X |
|
|
|
|
Daemon |
|
X |
|
|
Kafka |
Broker |
|
|
X |
|
Kafka |
MirrorMaker |
|
|
X (optional) |
Kafka MirrorMaker cross-cluster replication
service |
Navigator |
Audit Server |
X |
|
|
|
|
Metadata Server |
X |
|
|
|
Sentry |
Server |
X |
|
|
|
Solr |
Server |
|
X |
|
|
Spark |
History Server |
X |
|
|
|
|
Gateway |
X |
X |
|
|