Maximum 540-Node System Configuration (108-Port Switches, Up to 25 or 27 Cabinets) - Active Enterprise Data Warehouse

Model 750 Platform Product and Site Preparation Guide
Product
Active Enterprise Data Warehouse
Published
February 2018
ft:locale
en-US
ft:lastEdition
2018-04-16
dita:mapPath
afm1471885800147.ditamap
dita:ditavalPath
750.ditaval.ditaval
dita:id
mqr1471649564269
Product Category
Hardware

This configuration can be scaled to a maximum of 25 cabinets in a UDA environment.

This configuration can be scaled to a maximum of 27 cabinets in a Teradata Connect environment.

InfiniBand Network Topology for a Maximum 540-Node System (108-Port Switches): Switch-to-Switch

InfiniBand Network Topology for a Maximum 540-Node System (108-Port Switches): Node-to-Switch

  • Systems connected via InfiniBand to the UDA fabric consist of up to 25 cabinets and one required InfiniBand switch cabinet.
  • Systems connected via BYNET V4 or BYNET-Over-Ethernet to the Teradata system consist of up to 27 cabinets and one required InfiniBand switch cabinet.
  • Leaf boards for the 108-port switch are populated in this order: 5, 6, 3, 4, 1, 2
  • Cabinets contain SAS HPA nodes and App Servers and a VMS for server management.
  • Cabinets can contain other nodes and servers.
  • Scalable up to 540 nodes and servers in any combination.
  • 36-port InfiniBand switches provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
    • Each processing node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Other nodes and servers may contain a dual port InfiniBand adapter that connects to the InfiniBand switches.
    • Individual optical InfiniBand cables are used to connect nodes in cabinets with switches to nodes in cabinets without switches.
  • 108-port InfiniBand switches provide switch-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
    • 108-port InfiniBand switches in the InfiniBand cabinet connect to 36-port switches in base/expansion cabinets.
    • Uplink cables connect InfiniBand switches to InfiniBand switches.
  • In a UDA environment, the second-tier switches are used for UDA connections. For more information, see the Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide, B035-6001.
  • For port-to-port cabling, see the appropriate Hardware Installation Guide.