Maximum 108-Node System Configuration (36-Port Switches) - Appliance for Hadoop

Appliance for Hadoop 3 and 4 Platforms Product and Site Preparation Guide

prodname
Appliance for Hadoop
created_date
March 2018
category
Product Guide
featnum
B035-5523-113K
InfiniBand Network Topology for a Maximum 108-Node System (36-Port Switches)

  • Consists of one or more appliance cabinets, a VMS with SWS VM, plus additional (optional) Platform Framework Cabinets.
  • Scalable up to 108 nodes (up to six cabinets):
    • 0-18 nodes (one cabinet): Two 36-port InfiniBand switches in the base cabinet provide redundant network connectivity.
    • 19-36 nodes (two cabinets): Two 36-port InfiniBand switches in the base cabinet provide redundant network connectivity.
    • 37-108 nodes (three to six cabinets): Three to six pairs of cascaded 36-port InfiniBand switches, two switches per cabinet, provide redundant network connectivity.
  • Each node contains a dual port InfiniBand adapter that connects to the network InfiniBand switches.
  • InfiniBand cables connect nodes to switches, and cascaded switches to cascaded switches, as follows:
    • 0-18 nodes (one cabinet, non-cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in a base cabinet to the InfiniBand switches in the same cabinet.
    • 19-36 nodes (two cabinets, non-cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in the expansion cabinet to the InfiniBand switches in the base cabinet.
    • 37-108 nodes (three to six cabinets, cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in cabinets to the InfiniBand switches in the same cabinet. Cascaded switches are connected to each other. The number of connections depends on the system configuration.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.