System Network Topology for an 81-Group IntelliFlex System
- Consists of up to 81 groups and two required InfiniBand switch cabinets (for redundancy).
- Cabinets contain processing nodes, SAS HPA worker nodes (Dell R730 or R730xd) or SAS worker nodes (Dell R740xd), and a VMS for Server Management.
- A cabinet VMS for Server Management is added for every 50 servers.
- Cabinets can contain other nodes and servers.
- Scalable up to 1,053 nodes and servers in a variety of combinations.
- 36-port InfiniBand switches provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1).
- Each IntelliFlex processing node connects to the InfiniBand fabric.
- Additional nodes and servers connect to the InfiniBand fabric.
- Individual optical InfiniBand cables are used to connect nodes in cabinets with switches to nodes in cabinets without switches.
- 324-port InfiniBand switches provide switch-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1).
- 324-port InfiniBand switches in the InfiniBand cabinet connect to 36-port switches in IntelliFlex cabinets.
- Four ports on each of the first-tier switches are used to provide the uplink connections to the second-tier switch.
- If the system is included in a UDA environment, some ports on the InfiniBand switch are used for UDA connections. The number of ports needed depends on the UDA configuration.