Inter-Cabinet Server Management Network Topology to 1,024 Nodes - Active Enterprise Data Warehouse

6800 Platform Product and Site Preparation Guide

Product
Active Enterprise Data Warehouse
Published
February 2018
Language
English (United States)
Last Update
2018-04-19
dita:mapPath
vyt1471885165825.ditamap
dita:ditavalPath
6800.ditaval.ditaval
dita:id
jso1471649458844
Product Category
Hardware
6800 Server Management Network for System with Maximum 1,024 Nodes, One Platform Framework Cabinet for Server Management Connectivity

  • This configuration is built on the cabinet and collective topology defined in Collectives.
  • The topology shown in the illustration above is based on a 6800 system with 342 cabinets in a 2+1 configuration with one clique per cabinet. The topology may differ depending on the number of cabinets in the system. The number of cabinets is determined by the clique configuration (1+1, 2+1, or 3+1) of the cabinets in the system.
  • One or more of the 6800 processing/storage cabinets shown above may be in single collective, depending on system configuration. The Platform Framework Cabinet (PFC) shown above may be in its own collective, or in another collective. A collective may include additional PFCs (not shown).
  • The BYNET V5 Network-0 cabinet contains one primary server management Ethernet switch, and the BYNET V5 Network-1 cabinet contains one secondary server management Ethernet switch.
    Although cabinet numbers are not shown for the redundant BYNET V5 cabinets (Network-0 cabinet and Network-1 cabinet), the cabinet numbers for these cabinets must also be unique in the system.
  • A PFC with four pairs of primary/secondary server management switches provides server management connectivity. The primary switches in the cabinet are connected to each other, and the secondary switches are connected to each other.
  • Separate paths for the primary and secondary server management networks ensure network redundancy.
  • The primary network of a 6800 system is configured as follows:
    • The lower primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 1-89. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 2-90.
    • The lower middle primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 91-181. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 92-182.
    • The upper middle primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 183-273. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 184-274.
    • The upper primary Ethernet switch in the PFC acts as the gathering switch for the primary switches in odd-numbered cabinets 275-341. The primary switches in those odd-numbered cabinets act as gathering switches for the primary switches in even-numbered cabinets 276-342.
  • The secondary network of a 6800 system is configured as follows:
    • The lower secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 2-90. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 1-89.
    • The lower middle secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 92-182. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 91-181.
    • The upper middle secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 184-274. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 183-273.
    • The upper secondary Ethernet switch in the PFC acts as the gathering switch for the secondary switches in even-numbered cabinets 276-342. The secondary switches in those even-numbered cabinets act as gathering switches for the secondary switches in odd-numbered cabinets 275-341.
  • This configuration has two pairs of redundant BYNET V5 cabinets.
    • The primary Ethernet switches in both BYNET V5 Network-0 cabinets connect to the lower primary Ethernet switch in the PFC.
    • The secondary Ethernet switches in both BYNET V5 Network-1 cabinets connect to the lower secondary Ethernet switch in the PFC.
    Although cabinet numbers are not shown for the redundant BYNET V5 cabinets (Network-0 cabinet and Network-1 cabinet), the cabinet numbers for these cabinets must also be unique in the system.
  • If the system is included in a UDA environment, UDA ports will be accommodated by open ports on the primary and secondary server management switches for UDA connections to the other system or systems in the UDA environment. These UDA connections are not shown in the illustration above. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.