Maximum 486-Node System Configuration (108-Port Switches) - Appliance for Hadoop

Appliance for Hadoop 5 Platform Product and Site Preparation Guide

prodname
Appliance for Hadoop
created_date
February 2018
category
Product Guide
featnum
B035-6030-075K
InfiniBand Network Topology for a Maximum 486-Node System (108-Port Switches): Switch-to-Switch

InfiniBand Network Topology for a Maximum 486-Node System (108-Port Switches): Node-to-Switch

  • Consists of twenty-seven processing/storage cabinets and one required InfiniBand switch cabinet.
  • Cabinets contain processing nodes and a VMS for server management.
  • Cabinets can contain other nodes and servers.
  • Scalable up to 486 nodes and servers in any combination.
  • 36-port InfiniBand switches provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
    • Each processing node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Other nodes and servers may contain a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Individual optical InfiniBand cables are used to connect nodes in cabinets with switches to nodes in cabinets without switches.
  • 108-port InfiniBand switches provide switch-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
    • 108-port InfiniBand switches in the InfiniBand cabinet connect to 36-port switches in processing/storage cabinets.
    • Uplink cables connect InfiniBand switches to InfiniBand switches.
  • If the system is included in a UDA environment, some ports on the InfiniBand switch are used for UDA connections. The number of ports needed depends on the UDA configuration. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • If the system is included in a UDA environment, six ports on each InfiniBand switch are used for UDA connections. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.