System
configurations larger than 324 nodes (to a maximum of 1,024 nodes) are accommodated
by special order.
Device | Platform | Switches, Adapters, and Cables Used | |
---|---|---|---|
2-18 Nodes | |||
Switches |
6750 |
Use existing 36-port Mellanox InfiniBand IS5030 switches or install 36-port Mellanox IS5030 or SX6036 switch (6750 cabinet) | |
6700 |
Use existing 36-port Mellanox InfiniBand IS5030 switches or install 36-port Mellanox IS5030 or SX6036 switch (6700C cabinet) | ||
6690 |
Disable or remove existing BYA32S switches and then install (or use) 36-port Mellanox InfiniBand IS5030 or SX6036 switches in the 6800 or 9212 cabinet | ||
6650C/H |
Disable or remove existing BYA32S switches and then install (or use) 36-port Mellanox InfiniBand IS5030 or SX6036 switches in the 6800 or 9212 cabinet | ||
Adapters |
6750 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | |
6700 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | ||
6690 |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
6650C/H |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
Cables |
6750 6700 6690 6650C/H |
|
|
19-108 Nodes | |||
Switches |
6750 |
Use existing 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet) | |
6700 |
Use existing 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet) | ||
6690 |
Install 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet) | ||
6650C/H |
Install 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet) | ||
Adapters |
6750 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | |
6700 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | ||
6690 |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
6650C/H |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
Cables |
6750 6700 6690 6650C/H |
Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to Mellanox InfiniBand SX6506-NR 108-port switches (9107 cabinet) | |
109-324 Nodes | |||
Switches |
6750 6700 6690 6650C/H |
Use existing 162-port Mellanox InfiniBand GD4200 switch (9107 cabinet) or install 324-port Mellanox InfiniBand SX6518 switch (9107 cabinet) | |
Adapters |
6750 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | |
6700 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | ||
6690 |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
6650C/H |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
Cables |
6750 6700 6690 6650C/H |
Use BYNET active
optical QSFP+ cables from nodes with:
|
|
325-648 Nodes | |||
Switches |
6750 6700 6690 6650C/H |
Use existing 648-port Mellanox InfiniBand SX6536 switches (9107 cabinets) | |
Adapters |
6750 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | |
6700 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | ||
6690 |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
6650C/H |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
Cables |
6750 6700 6690 6650C/H |
Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to 648-port Mellanox InfiniBand SX6536 switches (9107 cabinets) | |
649-1,024 Nodes | |||
Switches |
6750 6700 6690 6650C/H |
Use existing cascaded 648-port Mellanox InfiniBand SX6536 switches (two 9107 cabinets per fabric) | |
Adapters |
6750 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | |
6700 |
Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters | ||
6690 |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
6650C/H |
Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters | ||
Cables |
6750 6700 6690 6650C/H |
Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to cascaded 648-port Mellanox InfiniBand SX6536 switches (two 9107 cabinets per fabric) |