BYNET V5
Network Topology for a Maximum 1,024-Node System (Network-0)
![]()
BYNET V5
Network Topology for a Maximum 1,024-Node System (Network-0 and Network-1)
![]()
- Consists of one or more 1800 processing/storage cabinets, a Service Workstation (SWS), a required Platform Framework Cabinet for server management connectivity, plus additional (optional ) Platform Framework Cabinets.
- Scalable from 1 to 1,024 processing nodes (TPA nodes and hot standby nodes), channel servers, NCSs, and TMSs in any combination.
- Two pairs of 648-port BYNET V5 cabinets (four cabinets total) provide redundant BYNET V5 networks. Each pair has two cabinets for Network-0 and two cabinets for Network-1. Each cabinet in the set contains one 648-port BYNET V5 switch.
- Each 648-port BYNET V5
switch contains 1 to 36 leaf boards.
- 29 leaf boards (leaf board 7 and leaf boards 9 to 36) support up to 18 processing nodes , channel servers, NCSs, and TMSs per leaf board.Leaf board 7 in Network-0 cabinet 2 and leaf board 7 in Network-1 cabinet 2 are not used.
- 7 cascading leaf boards (leaf boards 1, 2, 3, 4, 5, 6, and 8) connect one 648-port switch to the corresponding cascading leaf boards in the other 648-port switch in the same network. The number of leaf boards (5, 6, or 7) depends on the number of nodes in the system.
- For a system with 649-730 nodes, 5 leaf boards are required (leaf boards 3, 4, 5, 6, and 8).
- For a system with 731-878 nodes, 6 leaf boards are required (leaf boards 1, 3, 4, 5, 6, and 8).
- For a system with 879-1024 nodes, 7 leaf boards are required (leaf boards 1, 2, 3, 4, 5, 6, and 8).
- Each switch has 18 spine boards that allow the leaf boards to communicate with each other, and one chassis management board that manages the spine boards and leaf boards.
- A subnet manager server provides subnet network management between the two cascaded 648-port switches in the same network. Subnet manager servers, one for each BYNET V5 network, are housed in separate 1800 expansion cabinets. In the second cabinet of each network (Network-0 and Network-1), port 1 of cascading leaf board 8 connects to its corresponding subnet manager server.
- 29 leaf boards (leaf board 7 and leaf boards 9 to 36) support up to 18 processing nodes , channel servers, NCSs, and TMSs per leaf board.
- Each processing node , channel server, or NCS contains a dual port InfiniBand adapter that connects to the BYNET V5 switch in each BYNET V5 cabinet. A TMS may contain a dual port InfiniBand adapter that connects to the switches.
- Individual optical InfiniBand cables are used to connect processing nodes , channel servers, NCSs, and TMSs in expansion cabinets, or channel servers NCSs, and TMSs in (optional) Platform Framework Cabinets, to the BYNET V5 switches in each BYNET V5 cabinet.
- An associated Platform Framework Cabinet with up to four pairs of primary/secondary server management switches (depending on system configuration) is required. Switches are used for the system server management network.
- For port-to-port cabling, see the appropriate Hardware Installation Guide.