Maximum 54-Node System Configuration (36-Port Switches) - Appliance for Hadoop

Appliance for Hadoop 6 Platform Product and Site Preparation Guide

Product
Appliance for Hadoop
Published
February 2018
Language
English (United States)
Last Update
2018-04-13
dita:mapPath
cwt1471885643827.ditamap
dita:ditavalPath
hadoop6.ditaval.ditaval
dita:id
ikf1471650918043
Product Category
Hardware
InfiniBand Network Topology for a Maximum 54-Node System

  • Consists of three processing/storage cabinets.
  • Cabinets contain processing nodes and a VMS for server management.
  • Cabinets can contain other nodes and servers.
  • Scalable up to 54 nodes and servers in any combination.
  • 36-port InfiniBand switches provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
    • Each processing node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Other nodes and servers may contain a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Individual optical InfiniBand cables are used to connect nodes in cabinets without first tier switches to first tier switches in other cabinets.
  • 36-port second tier InfiniBand switches provide switch-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1):
    • 36-port first tier InfiniBand switches in Cabinet 1 and Cabinet 3 connect to the 36-port second tier switches in Cabinet 2 using optical uplink cables.
  • If the system is included in a UDA environment, some ports on the second tier InfiniBand switch are used for UDA connections. The number of ports needed depends on the UDA configuration. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.