BYNET Switches, Adapters, and Cables - Active Enterprise Data Warehouse

6800 Platform Product and Site Preparation Guide

Product

Active Enterprise Data Warehouse

Published

February 2018

Language

English (United States)

Last Update

2018-04-19

dita:mapPath

vyt1471885165825.ditamap

dita:ditavalPath

6800.ditaval.ditaval

dita:id

jso1471649458844

Product Category

Hardware

System configurations larger than 324 nodes (to a maximum of 1,024 nodes) are accommodated by special order.

BYNET Switches, Adapters, and Cables
Device	Platform	Switches, Adapters, and Cables Used
2-18 Nodes
Switches	6750	Use existing 36-port Mellanox InfiniBand IS5030 switches or install 36-port Mellanox IS5030 or SX6036 switch (6750 cabinet)
	6700	Use existing 36-port Mellanox InfiniBand IS5030 switches or install 36-port Mellanox IS5030 or SX6036 switch (6700C cabinet)
	6690	Disable or remove existing BYA32S switches and then install (or use) 36-port Mellanox InfiniBand IS5030 or SX6036 switches in the 6800 or 9212 cabinet
	6650C/H	Disable or remove existing BYA32S switches and then install (or use) 36-port Mellanox InfiniBand IS5030 or SX6036 switches in the 6800 or 9212 cabinet
Adapters	6750	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6700	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6690	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
	6650C/H	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
Cables	6750 6700 6690 6650C/H	For nodes in the same cabinet as the BYNET switch, use BYNET copper QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to 36-port Mellanox InfiniBand switches For nodes that are not in the same cabinet as the BYNET switch, use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to 36-port Mellanox InfiniBand switches
19-108 Nodes
Switches	6750	Use existing 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet)
	6700	Use existing 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet)
	6690	Install 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet)
	6650C/H	Install 108-port Mellanox InfiniBand SX6506-NR switches (9107 cabinet)
Adapters	6750	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6700	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6690	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
	6650C/H	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
Cables	6750 6700 6690 6650C/H	Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to Mellanox InfiniBand SX6506-NR 108-port switches (9107 cabinet)
109-324 Nodes
Switches	6750 6700 6690 6650C/H	Use existing 162-port Mellanox InfiniBand GD4200 switch (9107 cabinet) or install 324-port Mellanox InfiniBand SX6518 switch (9107 cabinet)
Adapters	6750	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6700	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6690	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
	6650C/H	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
Cables	6750 6700 6690 6650C/H	Use BYNET active optical QSFP+ cables from nodes with: Mellanox Dual InfiniBand adapters to Mellanox InfiniBand switches (9107 cabinet) Mellanox Dual InfiniBand adapters to 324-port Mellanox InfiniBand SX6518 switches (9107 cabinets)
325-648 Nodes
Switches	6750 6700 6690 6650C/H	Use existing 648-port Mellanox InfiniBand SX6536 switches (9107 cabinets)
Adapters	6750	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6700	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6690	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
	6650C/H	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
Cables	6750 6700 6690 6650C/H	Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to 648-port Mellanox InfiniBand SX6536 switches (9107 cabinets)
649-1,024 Nodes
Switches	6750 6700 6690 6650C/H	Use existing cascaded 648-port Mellanox InfiniBand SX6536 switches (two 9107 cabinets per fabric)
Adapters	6750	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6700	Use existing Mellanox Dual InfiniBand MCX354A-FCBT adapters
	6690	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
	6650C/H	Replace BIC2SE adapters with Mellanox Dual InfiniBand ConnectX-3 adapters
Cables	6750 6700 6690 6650C/H	Use BYNET active optical QSFP+ cables from nodes with Mellanox Dual InfiniBand adapters to cascaded 648-port Mellanox InfiniBand SX6536 switches (two 9107 cabinets per fabric)