Maximum 162-Node System Configuration (36-Port Switches) - Appliance for Hadoop
Appliance for Hadoop 5 Platform Product and Site Preparation Guide
Product
Appliance for Hadoop
Published
February 2018
Language
English (United States)
Last Update
2018-05-03
dita:mapPath
pgm1471885501602.ditamap
dita:ditavalPath
hadoop5.ditaval.ditaval
dita:id
axw1471650877780
Product Category
Hardware
Product Information
Product Description
Platform Features Summary
Cabinet Descriptions
Cabinet Builds for Hadoop
Cabinet Build Conventions
Type A Power: Hadoop Base and Expansion Cabinet Builds
Type A Power: Hadoop Base and Expansion Cabinet Builds with Optional 10 Gb Ethernet Switch
Type A Power: Hadoop Base Cabinet Build with 680 System
Type A Power: Hadoop Base Cabinet Builds with 2800 4+0 Clique or 2800 2+0 Clique
Type B, C, D Power: Hadoop Base and Expansion Cabinet Builds
Type B, C, D Power: Hadoop Base and Expansion Cabinet Builds with Optional 10 Gb Ethernet Switch
Type B, C, D Power: Hadoop Base Cabinet Build with 680 System
Type B, C, D Power: Hadoop Base Cabinet Builds with 2800 4+0 Clique or 2800 2+0 Clique
Type B, C, D Power: Hadoop Base Cabinet Builds with 680 and 2800 4+0 Clique or 2800 2+0 Clique
Cabinet Builds for InfiniBand
Cabinet Build Conventions
InfiniBand 108-Port Switch Cabinet Build
InfiniBand 324-Port Switch Cabinet Build
InfiniBand Network Topology
InfiniBand Network Topology (Switches in Base/Expansion Cabinets)
Maximum 18-Node System Configuration (36-Port Switches)
Maximum 36-Node System Configuration (36-Port Switches)
Maximum 54-Node System Configuration (36-Port Switches)
Maximum 162-Node System Configuration (36-Port Switches)
InfiniBand Network Topology (Switches in InfiniBand Cabinets)
Maximum 486-Node System Configuration (108-Port Switches)
Maximum 1,458-Node System Configuration (324-Port Switches)
Server Management Network Topology
Server Management Network Interface
Server Management Network Terminology and Topology
Collectives
Single-System Configurations
Multi-System Configurations
In-Cabinet Server Management Network Topology for Hadoop Cabinets
In-Cabinet Server Management Network Topology for 108-Port InfiniBand Switch Cabinets
In-Cabinet Server Management Network Topology for 324-Port InfiniBand Switch Cabinets
Inter-Cabinet Server Management Network Topology to 162 Nodes (36-Port Switches)
Inter-Cabinet Server Management Network Topology to 486 Nodes (108-Port Switches)
Inter-Cabinet Server Management Network Topology to 1,458 Nodes (324-Port Switches)
Product Statements
Regulatory Compliance
Declaration of Conformity 9233
Declaration of Conformity 9107
RCM Supplier's Declaration of Conformity 9233
RCM Supplier's Declaration of Conformity 9107
China Declaration Certificate
China Declaration Certificate (continued)
Taiwan Declaration Certificate
Taiwan Declaration Certificate (continued)
Electromagnetic Compatibility Notices
Regulatory Compliance Disclaimer
Product Safety Disclaimer
Cautions and Warnings
Site Preparation Summary
Site Preparation Task List
Hardware Installation Planning
Policy on Moving and Relocating Cabinets
Preinstallation Checklist
Uncrating and Installation
Uncrating the Equipment
Important Information
Tools Needed
Uncrating a Cabinet
Performing Environmental Stabilization
Inspecting the Cabinet for Damage
Disposing of the Shipping Materials
Repacking for Shipment
Positioning and Assembling Staged Cabinets
Positioning a Cabinet
Ganging Cabinets
Installing Stand-Alone Cabinet Stabilizers
Installing the Bottom Front Cabinet Air Baffle
Removing the Shipping Clips for an 18.5-Inch KVM Console
Installing Cabinet Side Panels and Doors
Installing Side Panels
Installing and Aligning Front and Rear Doors
Physical Specifications for Site Planning
Cabinet Descriptions
Dimensions: 42-U Cabinet
42-U Cabinet Footprint and Clearances
Data Center Considerations
Weight and Floor Loading
Site Floor and Ceiling Height Specifications
Floor Layouts
Cables
Cable Management
Network Cables and Hardware
HCA FICON Cables and Connectors
Available Cable Lengths
Delivery and Installation
Shipping Dimensions and Weights
Moving and Handling Guidelines
Installation Overview
About Environmental Stabilization
Seismic Bracing for a Teradata Cabinet
Site Power Distribution Planning
AC Input Power Distribution
Dual AC Concept
Site Wiring Options for Dual AC
System Load Configurations
Site Wiring for System Integrity
AC Power Cord Egress from Top or Bottom of Cabinet
Input Power Plugs and Receptacles
Platform or Appliance Cabinet Input Power Plugs and Receptacles
Type A Power: Processing/Storage Cabinet Four-Cord 30A/32A Phase- Phase or Single Phase with Splash-Proof Power Plugs and Receptacles
Type B Power: Appliance Cabinet Four-Cord 30A Three-Phase Delta with Watertight Power Plugs and Receptacles
Type C Power: Appliance Cabinet Two-Cord 60A Three-Phase Delta with Watertight Power Plugs and Receptacles
Type D Power: Appliance Cabinet Two-Cord 30/32A Three-Phase Wye with Splash-Proof Power Plugs and Receptacles
Switch Cabinet Input Power Plugs and Receptacles
InfiniBand 108-Port and 324-Port Cabinet Two-Cord 30A/32A Splash-Proof Power Plugs and Receptacles
Three-Phase AC Box - Phase Current Balancing
About Grounding
Emergency Power Off (EPO)
Site Environmental Planning
Objectives of Site Environmental Control and Preparation
Environmental Requirements
Power Consumption
Estimated Power for Teradata Appliance for Hadoop 5 Cabinets
Estimated Power for InfiniBand Switch Cabinets
System Thermal Report
Cooling Considerations for Installation Site
About Cooling Capacity Planning
About Cold and Hot Aisles in Floor Layout
Floor Layouts
About Equipment Floor Layout
Hardware Placement Guidelines for Raised Floor and Open Return Environment
Hardware Placement Guidelines for Non-Raised Floor and Containment Environment
Best Practices for Floor Layout
Environmental Elements
How to Measure Environmental Elements
Environmental Measurement Instruments
About Measuring Temperature and Humidity
About Measuring Air Flow
Measuring Air Flow Rate Using an Air Flow Meter and Handmade Air Capture Hood
Evaluating Environmental Elements Before and After an Installation
Evaluating Air Flow
Evaluating Temperature and Humidity
About Environmental Contaminants
Additional Information
Audience
Changes and Additions
Teradata Links
InfiniBand Network Topology for a Maximum 162-Node System
Consists of nine processing/storage cabinets.
Cabinets contain processing nodes and a VMS for server management.
Cabinets can contain other nodes and servers.
Scalable up to 162 nodes and servers in any combination.
36-port InfiniBand switches provide node-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
Each processing node contains a dual port InfiniBand adapter that connects to the InfiniBand switches.
Other nodes and servers may contain a dual port InfiniBand adapter that connects to the InfiniBand switches.
Individual optical InfiniBand cables are used to connect nodes in cabinets with switches to nodes in cabinets without switches.
36-port InfiniBand switches provide switch-to-switch connections for the redundant InfiniBand networks (Network-0 and Network-1). Connections are shown in the figure.
36-port InfiniBand switches in Cabinet 1, Cabinet 3, Cabinet 4, Cabinet 5, Cabinet 7, and Cabinet 8 connect to the 36-port switches in Cabinet 2.
Uplink cables connect InfiniBand switches to InfiniBand switches.
If the system is included in a UDA environment, some ports on the second tier InfiniBand switches are used for UDA connections. The number of ports needed depends on the UDA configuration. For more information, see the
Teradata Unified Data Architecture InfiniBand and Server Management Configuration Guide , B035-6001 .
For port-to-port cabling, see the appropriate Hardware Installation Guide .