System Topology for 3-Cabinet Systems up to 36 Nodes - Data Warehouse Appliances

2850 Platform Product and Site Preparation Guide

Product
Data Warehouse Appliances
Published
February 2018
Language
English (United States)
Last Update
2018-04-17
dita:mapPath
ipe1471887155021.ditamap
dita:ditavalPath
2850.ditaval.ditaval
dita:id
ibv1471648709644
Product Category
Hardware

Three-cabinet systems can accommodate second-tier switches, but second-tier switches are not required. The purpose of the second-tier switch is to interconnect the first-tier switches and provide the connection point for the uplinks that connect to the UDA fabric. A second-tier switch also allows for future expansion to additional nodes and cabinets.

3-Cabinet System With Second-Tier Switches

When second-tier switches are installed, they are located in Cabinet 2 in 3-cabinet systems.

2850 System Network Topology for a 3-Cabinet System: Using Second-Tier Switches

This configuration allows for connection to the UDA, and for future expansion beyond 36 nodes.

  • The system consists of up to three cabinets.
  • The first cabinet contains 2850 processing nodes (2-node or 4-node cliques) and may contain additional systems (680, 2800, or 2850 systems).
  • The other cabinets contain 2850 processing nodes (2-node or 4-node cliques).
  • The first cabinet contains a System VMS for server management, and may contain additional TMSs.
  • Each additional cabinet may contain a Cabinet VMS for server management.
  • 36-port InfiniBand switches in cabinets 1 and 3 provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure. Each node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
  • Eight ports on each of the InfiniBand switches in Cabinets 1 and 3 are used to provide the uplink connections to the second-tier switch.
  • When connected to a UDA network, the second-tier switches can be used for UDA connections. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.

3-Cabinet System Without Second-Tier Switches

This configuration provides for up to 36 nodes, but is not easily expandable, and does not provide connection to the UDA.

2850 System Network Topology for a 3-Cabinet System: No Second-Tier Switches

  • The system consists of up to three cabinets.
  • The first cabinet contains 2850 processing nodes (2-node or 4-node cliques) and may contain additional systems (680, 2800, or 2850 systems).
  • The other cabinets contain 2850 processing nodes (2-node or 4-node cliques).
  • The first cabinet contains a System VMS for server management, and may contain additional TMSs.
  • Each additional cabinet may contain a Cabinet VMS for server management.
  • 36-port InfiniBand switches in cabinet 1 provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure. Each node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.