Maximum 1,024-Node System Configuration - Active Enterprise Data Warehouse

6800 Platform Product and Site Preparation Guide

Product
Active Enterprise Data Warehouse
Published
February 2018
Language
English (United States)
Last Update
2018-04-19
dita:mapPath
vyt1471885165825.ditamap
dita:ditavalPath
6800.ditaval.ditaval
dita:id
jso1471649458844
Product Category
Hardware
BYNET V5 Network Topology for a Maximum 1,024-Node System (Network-0)

BYNET V5 Network Topology for a Maximum 1,024-Node System (Network-0 and Network-1)

  • Consists of one or more 6800 processing/storage cabinets, a Service Workstation (SWS), a required Platform Framework Cabinet for server management connectivity, plus additional (optional or required) Platform Framework Cabinets.
  • Scalable from 1 to 1,024 Teradata Database nodes, hot standby nodes, PE nodes, channel servers, and TMSs in any combination.
  • Two pairs of 648-port BYNET V5 cabinets (four cabinets total) provide redundant BYNET V5 networks. Each pair has two cabinets for Network-0 and two cabinets for Network-1. Each cabinet in the set contains one 648-port BYNET V5 switch.
  • Each 648-port BYNET V5 switch contains 1 to 36 leaf boards.
    • 29 leaf boards (leaf board 7 and leaf boards 9 to 36) support up to 18 Teradata Database nodes, hot standby nodes, PE nodes, TMSs, channel servers, and TMSs per leaf board.
      Leaf board 7 in Network-0 cabinet 2 and leaf board 7 in Network-1 cabinet 2 are not used.
    • 7 cascading leaf boards (leaf boards 1, 2, 3, 4, 5, 6, and 8) connect one 648-port switch to the corresponding cascading leaf boards in the other 648-port switch in the same network. The number of leaf boards (5, 6, or 7) depends on the number of nodes in the system.
      • For a system with 649-730 nodes, 5 leaf boards are required (leaf boards 3, 4, 5, 6, and 8).
      • For a system with 731-878 nodes, 6 leaf boards are required (leaf boards 1, 3, 4, 5, 6, and 8).
      • For a system with 879-1024 nodes, 7 leaf boards are required (leaf boards 1, 2, 3, 4, 5, 6, and 8).
    • Each switch has 18 spine boards that allow the leaf boards to communicate with each other, and one chassis management board that manages the spine boards and leaf boards.
    • A subnet manager server provides subnet network management between the two cascaded 648-port switches in the same network. Subnet manager servers, one for each BYNET V5 network, are housed in separate 6800 expansion cabinets. In the second cabinet of each network (Network-0 and Network-1), port 1 of cascading leaf board 8 connects to its corresponding subnet manager server.
  • Each Teradata Database node, hot standby node, PE node, or channel server contains a dual port InfiniBand adapter that connects to the BYNET V5 switch in each BYNET V5 cabinet. A TMS may contain a dual port InfiniBand adapter that connects to the switches.
  • Individual optical InfiniBand cables are used to connect Teradata Database nodes, hot standby nodes, PE nodes, channel servers and TMSs in expansion cabinets, or (optional) channel servers and TMSs in Platform Framework Cabinets, to the BYNET V5 switches in each BYNET V5 cabinet.
  • An associated Platform Framework Cabinet with up to four pairs of primary/secondary server management switches (depending on system configuration) is required. Switches are used for the system server management network.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.