System Topology for Up To 72 Cabinets - Data Warehouse Appliances

2850 Platform Product and Site Preparation Guide

Product
Data Warehouse Appliances
Published
February 2018
Language
English (United States)
Last Update
2018-04-17
dita:mapPath
ipe1471887155021.ditamap
dita:ditavalPath
2850.ditaval.ditaval
dita:id
ibv1471648709644
Product Category
Hardware

The system can accommodate up to 72 cabinets using eight pairs of second-tier 36-port switches. This allows for up to 864 nodes.

Second-tier switches are located in Cabinets 2, 4, 6, 8, 10, 12, 14, and 16 in systems with 37 to 72 cabinets.

2850 System Network Topology for a 72-Cabinet System

  • The system consists of up to 72 cabinets (up to 36 clusters).
  • The first cabinet contains 2850 processing nodes (2-node or 4-node cliques) and may contain additional systems (680, 2800, or 2850 systems).
  • The other cabinets contain 2850 processing nodes (2-node or 4-node cliques).
  • The first cabinet contains a System VMS for server management, and may contain additional TMSs.
  • Each additional cabinet may contain a Cabinet VMS for server management.
  • Each pair of cabinets (Cabinets 1 and 2, Cabinets 3 and 4, and so on) form a group of up to 24 nodes. The nodes in the cluster share the first-tier switches in the first cabinet of the pair.
  • Eight ports on each of the InfiniBand switches in Cabinet 1, Cabinet 3, Cabinet 5, Cabinet 7, and the remaining odd-numbered cabinets are used to provide the uplink connections to the second-tier switches.
  • The system uses eight sets of 36-port second-tier switches.
  • Of the eight uplink connections to the second-tier switches, one connects to the first second-tier switch, one connects to the second second-tier switch, one connects to the third second-tier switch, and so on, resulting in one uplink connection to each second-tier switch (for each fabric).
  • When connected to a UDA network, the second-tier switches can be used for UDA connections. Distribute the UDA connections evenly across the pairs of second-tier switches for best performance. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.