System Topology for Up To 36 Cabinets - Data Warehouse Appliances

2850 Platform Product and Site Preparation Guide

Product
Data Warehouse Appliances
Published
February 2018
Language
English (United States)
Last Update
2018-04-17
dita:mapPath
ipe1471887155021.ditamap
dita:ditavalPath
2850.ditaval.ditaval
dita:id
ibv1471648709644
Product Category
Hardware

The system can accommodate up to 36 cabinets using a four pairs of second-tier 36-port switches. This allows for up to 432 nodes.

Second-tier switches are located in Cabinet 2, Cabinet 4, Cabinet 6, and Cabinet 8 in systems with 19 to 36 cabinets.

2850 System Network Topology for a 36-Cabinet System
Switch_0311 1st T ier Switches Cabinets 1 and 2 1st TierSwitchesCabinets19 and 20 1st TierSwitchesCabinets21 and 22 1st TierSwitchesCabinets23 and 24 1st TierSwitchesCabinets25 and 26 1st TierSwitchesCabinets27 and 28 1st TierSwitchesCabinets29 and 30 1st TierSwitchesCabinets31 and 32 1st TierSwitchesCabinets33 and 34 1st TierSwitchesCabinets35 and 36 1st T ier Switches Cabinets 3 and 4 1st T ier Switches Cabinets 5 and 6 1st T ier Switches Cabinets 7 and 8 1st T ier Switches Cabinets 9 and 10 1st T ier Switches Cabinets 11 and 12 1st T ier Switches Cabinets 13 and 14 1st T ier Switches Cabinets 15 and 16 1st T ier Switches Cabinets 17 and 18 2 2 2 2 2 2 2 2

  • The system consists of up to 36 cabinets.
  • The first cabinet contains 2850 processing nodes (2-node or 4-node cliques) and may contain additional systems (680, 2800, or 2850 systems).
  • The other cabinets contain 2850 processing nodes (2-node or 4-node cliques).
  • The first cabinet contains a System VMS for server management, and may contain additional TMSs.
  • Each additional cabinet may contain a Cabinet VMS for server management.
  • Each pair of cabinets (Cabinets 1 and 2, Cabinets 3 and 4, and so on) form a group of up to 24 nodes. The nodes in the cluster share the first-tier switches in the first cabinet of the pair.
  • Eight ports on each of the InfiniBand switches in Cabinet 1, Cabinet 3, Cabinet 5, Cabinet 7, and the remaining odd-numbered cabinets are used to provide the uplink connections to the second-tier switches.
  • The system uses four sets of 36-port second-tier switches. These second-tier switches are located in Cabinet 2, Cabinet 4, Cabinet 6, and Cabinet 8.
  • Of the eight uplink connections to the second-tier switches, two connect to the first second-tier switch, two connect to the second second-tier switch, two connect to the third second-tier switch, and two connect to the fourth second-tier switch (for each fabric).
  • When connected to a UDA network, the second-tier switches can be used for UDA connections. Distribute the UDA connections evenly across the pairs of second-tier switches for best performance. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.