System Topology for Up To 36 Groups - Appliance for Hadoop

Appliance for Hadoop 6 Platform Product and Site Preparation Guide

Product
Appliance for Hadoop
Published
February 2018
Language
English (United States)
Last Update
2018-04-13
dita:mapPath
cwt1471885643827.ditamap
dita:ditavalPath
hadoop6.ditaval.ditaval
dita:id
ikf1471650918043
Product Category
Hardware
The system can accommodate up to 36 groups of nodes using six pairs of second-tier, 36-port switches. This allows for up to 972 nodes.
In this document, a group is defined as the collective of nodes connected to a common pair of first tier switches. Each group contains up to 27 nodes.

Second-tier switches are located in Cabinet 2, Cabinet 6, Cabinet 9, Cabinet 12, Cabinet 15, and Cabinet 18, in systems with 19 to 36 groups.

Hadoop 6 System Network Topology for a 36-Group System
Switch_0323 28 29 30 31 32 33 34 35 36 1 2 3 4 5 6 7 8 9 Six pairs of 2nd tier switchesreside in cabinets 2, 6, 9, 12,15, and 18. 1 1 11 11 111111

  • The system consists of up to 36 groups.
  • The first cabinet contains Hadoop 6 processing nodes and may contain additional systems (680, 2800, or 2850 systems).
  • The other cabinets contain Hadoop 6 processing nodes.
  • The first cabinet contains a System VMS for server management, and may contain additional TMSs.
  • Each additional cabinet may contain a Cabinet VMS for server management.
  • 6 ports on each of the InfiniBand switches in cabinets 1, 3, 4, 5, 7, 8, ... 52, 53 are used to provide the uplink connections to the second-tier switches.
  • The system uses six pairs of 36-port second-tier switches. These switches are located in Cabinet 2, Cabinet 6, Cabinet 9, Cabinet 12, Cabinet 15, and Cabinet 18.
  • Of the six uplinks leaving each first tier switch, one uplink connection goes to each of the six second tier switches (for each fabric).
  • When connected to a UDA network, the second-tier switches can be used for UDA connections. Distribute the UDA connections evenly across the pairs of second-tier switches for best performance. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.