These tables provide the install locations of the numerous Hadoop services across the nodes in a cluster.
Core Hadoop
M1 | M2 | M3 | DATANODES | EDGENODES | |
---|---|---|---|---|---|
Ambari Server (Ambari) | X | ||||
Metrics Monitor (Ambari) | X | X | X | X | X |
Metrics Collector (Ambari) | X | ||||
Grafana (Ambari) | X | ||||
NameNode (HDFS) | X | X | X | ||
ZKFailoverController (HDFS) | X | X | X | ||
JournalNodes (HDFS) | X | X | X | ||
App Timeline Server (YARN) | X | ||||
ResourceManager (YARN) | X | X | |||
NodeManagers (YARN) | X | ||||
History Server (MapReduce2) | X | ||||
Hive Metastore (Hive) | X | X | |||
HiveServer2 (Hive) | X | X | |||
HBase Master (HBase) | X | X | |||
RegionServers (HBase) | X | ||||
Oozie Server (Oozie) | X | X | |||
ZooKeeper Server (ZooKeeper) | X | X | X | ||
HDFS DataNode | X | ||||
HBase, HDFS, Hive, MapReduce2, Oozie, Pig, Sqoop, Tez, YARN, ZooKeeper (Clients) | X | X | X | X | X |
M1 | DATANODES | EDGENODES | |
---|---|---|---|
Ambari Server (Ambari) | X | ||
Metrics Monitor (Ambari) | X | X | X |
Metrics Collector (Ambari) | X | ||
Grafana (Ambari) | X | ||
NameNode (HDFS) | X | ||
NameNode Secondary (HDFS) | DATA-1 | ||
ZKFailoverController (HDFS) | N/A | ||
JournalNodes (HDFS) | N/A | ||
App Timeline Server (YARN) | X | ||
ResourceManager (YARN) | X | ||
NodeManagers (YARN) | X | ||
History Server (MapReduce2) | X | ||
Hive Metastore (Hive) | X | ||
HiveServer2 (Hive) | X | ||
HBase Master (HBase) | X | ||
RegionServers (HBase) | X | ||
Oozie Server (Oozie) | X | ||
ZooKeeper Server (ZooKeeper) | X | DATA-1, DATA-2 | |
HDFS DataNode | X | ||
HBase, HDFS, Hive, MapReduce2, Oozie, Pig, Sqoop, Tez, YARN, ZooKeeper (Clients) | X | X | X |
Post-Install Services
M1 | M2 | M3 | DATANODES | EDGENODES | |
---|---|---|---|---|---|
Infra Solr Instance (Ambari) | X | ||||
Accumulo Master (Accumulo) | X | ||||
Accumulo Monitor (Accumulo) | X | ||||
Accumulo Tracer (Accumulo) | X | ||||
Accumulo GC (Accumulo) | X | ||||
Accumulo TServer (Accumulo) | X | ||||
Atlas Metadata Server (Atlas) | X | ||||
Druid Broker (Druid) | X | ||||
Druid Coordinator (Druid) | X | ||||
Druid Historicals (Druid) | X | ||||
Druid MiddleManagers (Druid) | X | ||||
Druid Overlord (Druid) | X | ||||
Druid Router (Druid) | X | ||||
HiveServer2 Interactive (LLAP) | X | ||||
Kafka Broker (Kafka) | X | ||||
Knox Gateway (Knox) | X | ||||
Log Search Server (Log Search) | X | ||||
Log Search Solr Instance (Log Search) | X | ||||
Ranger Usersync (Ranger) | X | ||||
Ranger Tagsync (Ranger) | X | ||||
Ranger Admin (Ranger) | X | ||||
Ranger KMS Server (Ranger KMS) | X | ||||
Spark2 History Server (Spark) | X | ||||
Livy for Spark2 Server (Spark2) | X | ||||
Spark2 Thrift Server (Spark2) | X | ||||
Nimbus (Storm) | X | ||||
Storm UI Server (Storm) | X | ||||
DRPC Server (Storm) | X | ||||
Supervisor (Storm) | X | ||||
Zeppelin Notebook (Zeppelin Notebook) | X |
M1 | DATANODES | EDGENODES | |
---|---|---|---|
Infra Solr Instance (Ambari) | X | ||
Accumulo Master (Accumulo) | X | ||
Accumulo Monitor (Accumulo) | X | ||
Accumulo Tracer (Accumulo) | X | ||
Accumulo GC (Accumulo) | X | ||
Accumulo TServer (Accumulo) | X | ||
Atlas Metadata Server (Atlas) | X | ||
Druid Broker (Druid) | X | ||
Druid Coordinator (Druid) Default port=8081. Change the port if installing on Master Node #1. |
X | ||
Druid Historicals (Druid) | X | ||
Druid MiddleManagers (Druid) | X | ||
Druid Overlord (Druid) | X | ||
Druid Router (Druid) | X | ||
HiveServer2 Interactive (LLAP) | X | ||
Kafka Broker (Kafka) | X | ||
Knox Gateway (Knox) | X | ||
Log Search Server (Log Search) | X | ||
Log Feeders (Log Search) | X | X | X |
Ranger Usersync (Ranger) | X | ||
Ranger Tagsync (Ranger | X | ||
Ranger Admin (Ranger) | X | ||
Ranger KMS Server (Ranger KMS) | X | ||
Spark2 History Server (Spark) | X | ||
Livy for Spark2 Server (Spark2) | X | ||
Spark2 Thrift Server (Spark) | X | ||
Nimbus (Storm) | X | ||
Storm UI Server (Storm) | X | ||
DRPC Server (Storm) | X | ||
Supervisor (Storm) | X | ||
Zeppelin Notebook (Zeppelin Notebook) | X |