Inter-Cabinet Server Management Network Topology to 1,024 Nodes - Integrated Big Data Platforms

1800 Platform Product and Site Preparation Guide

Product
Integrated Big Data Platforms
Published
February 2018
Language
English (United States)
Last Update
2018-04-17
dita:mapPath
jjw1471890141106.ditamap
dita:ditavalPath
1800.ditaval.ditaval
dita:id
vve1471647838623
Product Category
Hardware
Server Management Network for System with Maximum 1,024 Nodes, One Platform Framework Cabinet for Server Management Connectivity

  • This configuration is built on the cabinet and collective topology defined in Collectives.
  • The topology shown in the illustration above is based on a 1800 system with 342 cabinets in a 2+1 or 3+0 configuration with one clique per cabinet. The topology may differ depending on the number of cabinets in the system. The number of cabinets is determined by the clique configuration (1+0, 1+1, 2+0, 2+1, or 3+0) of the cabinets in the system.
  • Except for the Platform Framework Cabinet (PFC) shown above, each cabinet shown represents a collective. A collective may include additional PFCs (not shown).
  • The BYNET V5 Network-0 cabinet contains one primary server management Ethernet switch, and the BYNET V5 Network-1 cabinet contains one secondary server management Ethernet switch.
    Although cabinet numbers are not shown for the redundant BYNET V5 cabinets (Network-0 cabinet and Network-1 cabinet), the cabinet numbers for these cabinets must also be unique in the system.
  • A PFC with four pairs of primary/secondary server management switches provides server management connectivity. The primary switches in the cabinet are connected to each other, and the secondary switches are connected to each other.
  • Separate paths for the primary and secondary server management networks ensure network redundancy.
  • The primary network is configured as follows:
    • The lower primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 1-89. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 2-90.
    • The lower middle primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 91-181. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 92-182.
    • The upper middle primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 183-273. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 184-274.
    • The upper primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 275-341. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 276-342.
  • The secondary network is configured as follows:
    • The lower secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 2-90. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 1-89.
    • The lower middle secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 92-182. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 91-181.
    • The upper middle secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 184-274. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 183-273.
    • The upper secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 276-342. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 275-341.
  • This configuration has two pairs of redundant BYNET V5 cabinets.
    • The primary Ethernet switches in both BYNET V5 Network-0 cabinets connect to the lower primary Ethernet switch in the PFC.
    • The secondary Ethernet switches in both BYNET V5 Network-1 cabinets connect to the lower secondary Ethernet switch in the PFC.
  • If the system is included in a UDA environment, UDA ports will be accommodated by open ports on the primary and secondary server management switches for UDA connections to the other system or systems in the UDA environment. These UDA connections are not shown in the illustration above. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.