Maximum 108-Node System Configuration (36-Port Switches) - Aster Appliances

Aster Appliance 3H and 4 Platforms Product and Site Preparation Guide

Product
Aster Appliances
Published
February 2018
Language
English (United States)
Last Update
2018-04-16
dita:mapPath
vjp1471886019008.ditamap
dita:ditavalPath
aster3.ditaval.ditaval
dita:id
zua1471650759470
lifecycle
previous
Product Category
Hardware
InfiniBand Network Topology for a Maximum 108-Node System (36-Port Switches)

  • Consists of one or more appliance cabinets, a VMS with SWS VM, plus additional (optional) Platform Framework Cabinets.
  • Scalable up to 108 nodes (up to six cabinets):
    • 0-18 nodes (one cabinet): Two 36-port InfiniBand switches in the base cabinet provide redundant network connectivity.
    • 19-36 nodes (two cabinets): Two 36-port InfiniBand switches in the base cabinet provide redundant network connectivity.
    • 37-108 nodes (three to six cabinets): Three to six pairs of cascaded 36-port InfiniBand switches, two switches per cabinet, provide redundant network connectivity.
  • Each node contains a dual port InfiniBand adapter that connects to the network InfiniBand switches.
  • InfiniBand cables connect nodes to switches, and cascaded switches to cascaded switches, as follows:
    • 0-18 nodes (one cabinet, non-cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in a base cabinet to the InfiniBand switches in the same cabinet.
    • 19-36 nodes (two cabinets, non-cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in the expansion cabinet to the InfiniBand switches in the base cabinet.
    • 37-108 nodes (three to six cabinets, cascaded 36-port switches): Individual InfiniBand cables are used to connect nodes in cabinets to the InfiniBand switches in the same cabinet. Cascaded switches are connected to each other. The number of connections depends on the system configuration.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.