Inter-Cabinet Server Management Network Topology to 162 Nodes - Appliance for Hadoop

Appliance for Hadoop 3 and 4 Platforms Product and Site Preparation Guide

Product
Appliance for Hadoop
Published
March 2018
Language
English (United States)
Last Update
2018-04-13
dita:mapPath
alw1471885284809.ditamap
dita:ditavalPath
hadoop3_4.ditaval.ditaval
dita:id
byo1471650857173
Product Category
Hardware
Server Management Network for System with Maximum 162 Nodes, 2 InfiniBand Switch Cabinets

  • This configuration is built on the cabinet and collective topology defined in Collectives.
  • The topology shown in the illustration above is based on an appliance system with 1-9 cabinets.
  • Each cabinet shown above represents a collective. The collective may include Platform Framework Cabinets (not shown).
  • This configuration has a pair of InfiniBand switch cabinets for redundancy (Network-0 Cabinet and Network-1 Cabinet). Each InfiniBand switch cabinet contains one primary server management Ethernet switch and one secondary server management Ethernet switch.
    Although cabinet numbers are not shown for the redundant InfiniBand switch cabinets (Network-0 Cabinet and Network-1 Cabinet), the cabinet numbers for these cabinets must also be unique in the system.
  • Separate paths for the primary and secondary server management networks ensure network backup. The primary and secondary networks are configured as follows:
    • The primary Ethernet switch in the Network-0 Cabinet acts as the gathering switch for the primary switches in all the cabinets in the system.
    • The secondary Ethernet switch in the Network-1 Cabinet acts as the gathering switch for the secondary switches in all the cabinets in the system.
    • Each InfiniBand switch cabinet connects to the gathering switch in the other InfiniBand switch cabinet (Network-0 Cabinet primary to Network-1 Cabinet primary, Network-1 Cabinet secondary to Network-0 Cabinet secondary).
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.