Mellanox Technologies SwitchX-2 MSX1012B-2BFS User manual

Type
User manual

This manual is also suitable for

www.mellanox.com
SwitchX®-2 12 Port Ethernet Switch System
Hardware User Manual
P/N: MSX1012B-1BFS, MSX1012B-2BFS
Rev 1.0
Document Number: MLNX-15-891
Rev 1.0
Mellanox Technologies
2
Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: (408) 970-3400
Fax: (408) 970-3403
Mellanox Technologies, Ltd.
Beit Mellanox
PO Box 586 Yokneam 20692
Israel
www.mellanox.com
Tel: +972 (0)74 723 7200
Fax: +972 (0)4 959 3245
© Copyright 2013. Mellanox Technologies. All Rights Reserved.
Mellanox®, Mellanox logo, BridgeX®, ConnectX®, CORE-Direct®, InfiniBridge®, InfiniHost®, InfiniScale®,
MLNX-OS®, PhyX®, SwitchX®, UFM®, Virtual Protocol Interconnect® and Voltaire® are registered trademarks of
Mellanox Technologies, Ltd.
Connect-IB™, FabricIT™, Mellanox Open Ethernet™, Mellanox Virtual Modular Switch™, MetroX™, MetroDX™,
ScalableHPC™, Unbreakable-Link™ are trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE
THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT
HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE
PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND
DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST
QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES
FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND
(INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE
OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED
DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
3
Table of Contents
Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Related Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Mellanox Part Numbering Legend . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
Chapter 1 Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
1.1 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
1.2 Serial Number and Product Version Information . . . . . . . . . . . . . . . . . . . . . . . . 13
1.3 Ethernet Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Chapter 2 Basic Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.1 Switch Platform Hardware Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.2 Status LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.3 Port Connector LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2.4 Air Flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
2.5 QSFP Cable Power Budget Classification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
2.6 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Chapter 3 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.1 Installation Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.2 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
3.3 Mechanical Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3.4 Grounding the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
3.5 Power Connections and Initial Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
3.6 Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Chapter 4 Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1 Cable Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.2 Splitting the Data Stream Using Breakout (Fanout) Cables . . . . . . . . . . . . . . . . 44
Chapter 5 Switch Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
5.1 Upgrading Software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Chapter 6 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Appendix A Specification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
A.1 Approved Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
A.2 EMC Certifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
A.3 China CCC Warning Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Appendix B Thermal Threshold Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Appendix C QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Appendix D RJ-45 CONSOLE and I2C Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Rev 1.0
Mellanox Technologies
4
Appendix E Accessory and Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Appendix F Disassembly of the Switch from the Rack . . . . . . . . . . . . . . . . . . . . . . . . . 57
F.1 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Appendix G Avertissements de sécurité pour l'installation (French) . . . . . . . . . . . . . . 58
Appendix H Installation – Sicherheitshinweise(German) . . . . . . . . . . . . . . . . . . . . . . . 63
Appendix I Advertencias de seguridad de instalación(Spanish) . . . . . . . . . . . . . . . . . 67
Appendix J Предупреждения по технике безопасности при установке(Russian) 72
Appendix K Avertismente privind siguranţa la instalare (Romanian) . . . . . . . . . . . . 77
Appendix L 安裝安全性警告 (Chinese) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
5
List of Figures
Figure 1: 12 Port Ethernet Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Figure 2: Connector Side View of the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Figure 3: Pull out tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Figure 4: Switch System Connector Side Panels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Figure 5: System Status LEDS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Figure 6: Switch Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Figure 7: Fan Status LED Connector Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Figure 8: Power Status LED Connector Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Figure 9: Bad Port LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Figure 10: Identifier LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 11: Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 12: Management Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 13: Rear of Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Figure 14: Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 15: Port Numbering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 16: Top and Bottom QSFP Port Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Figure 17: Placing the Bumpers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 18: Installation Kit Parts for a Side by Side Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Figure 19: Screw on the Switch Mounted Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Figure 20: Two Switch Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 21: Placement of Frame in the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 22: Placing the Spacer in the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Figure 23: Using the Spacer Bushings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Figure 24: Insert Switch into Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 25: Status LEDs 5 Minutes After Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Figure 26: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Figure 27: Console Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Figure 28: Top and Bottom QSFP Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Figure 29: Breakout or Fanout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Figure 30: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
Rev 1.0
Mellanox Technologies
6
List of Tables
Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Table 2: Reference Documents and Web Sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Table 3: General System Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
Table 4: Management Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
Table 5: Ethernet Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Table 6: System Status LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Table 7: Switch Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Table 8: Fan Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Table 9: PS Unit Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Table 10: Bad Port LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Table 11: Port Connector Physical and Logical Link Assignments for Ethernet Mode . . . . . . . . . .20
Table 12: Serial Terminal Program Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Table 13: Configuration Wizard Session - DHCP Configuration (Example) . . . . . . . . . . . . . . . . .39
Table 14: Configuration Wizard Session - Static IP Configuration . . . . . . . . . . . . . . . . . . . . . . . . .40
Table 15: Configuration Wizard Session - Zeroconf Configuration . . . . . . . . . . . . . . . . . . . . . . . .41
Table 16: SX1012 Specification Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Table 17: RJ-45 CONSOLE Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Table 18: RJ-45 I2C Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Table 19: OPNs for Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
7
Revision History
Table 1 - Revision History Table
Date Revision Description
July 2013 1.0 Initial Draft
Rev 1.0
Mellanox Technologies
8
About this Manual
This manual describes the installation and basic use of the Mellanox MSX1012 switch which is
based on the SwitchX® -2 switch device.
Intended Audience
This manual is intended for users and system administrators responsible for installing, running,
and managing switch platforms.
This manual Assumes familiarity with Ethernet protocol and specifications.
Related Documentation
Additional Documentation available from Mellanox:
All of these documents can be found on the Mellanox Website at www.mellanox.com. They are
available either through the product pages www.mellanox.com Products Select your prod-
uct or through the support page with a login and password.
Conventions
Throughout this manual, the name SX1012 and the term switch are used to describe the 12-port
switch unless explicitly indicated otherwise.
The following icons are used throughout this document to indicate information that is important
to the user.
Table 2 - Reference Documents and Web Sites
Document Name Description
SwitchX®-2 Switch Product Hardware
Release Notes
For possible hardware issues see the switch support product page. This
document can be found on the support web page for this product.
This requires a customer support login. Look up the relevant SwitchX®-
based switch system/series release note file.
Mellanox MLNX-OS® Software User
Manual
This document contains information regarding configuring and manag-
ing Mellanox Technologies Switch Platforms.
MLNX-OS® Software Command Ref-
erence Guide
Command Reference Guide for MLNX-OS® listing all of the commands
available through MLNX-OS® with explanations and examples.
This icon makes recommendations to the user.
This icon indicates information that is helpful to the user.
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
9
Mellanox Part Numbering Legend
This icon indicates a situation that can potentially cause damage to hardware or soft-
ware.
BEWARE! This icon indicates a situation that can potentially cause personal injury or
damage to hardware or software.
Place Field Decoder
M Mellanox Technologies
SX System Type SwitchX® switch Family
P Data Transfer Protocol 1 = Ethernet
R Size of box 0 = 1U
1 = 1.5U
2 = 2U
FF Management Capabilities 05 = 12 Ports externally managed
12 = 12 Ports internally managed
15 = 18 Ports externally managed
18 = 18 Ports internally managed
25 = 36 Ports externally managed
36 = 36 Ports internally managed
C Data Rate B = 40Gb/s Ethernet
- Separator
P # Power Supplies 1=1, 2=2....
M Depth of the Unit S = standard depth, B = short depth
Y Air Flow direction R= Connector side to Power side airflow
F= Power Side side to Connector side airflow
R Chip Generation R – SwitchX
S – SwitchX-2
OverviewRev 1.0
Mellanox Technologies
10
1 Overview
Mellanox SX1012 switch systems provide the highest performing fabric solution in a 1U half-
width form factor by delivering up to 1.3Tb/s of non-blocking bandwidth throughput to High-
Performance Computing (HPC), high frequency trading and Enterprise Data Centers (EDC),
with ultra-low-latency. It has 12 40/56GbE ports, each can be individually split into 4 discrete
interfaces of 10GbE and when connected to Mellanox NICs with Mellanox cables and adapters
gives you the optimal end-to-end solution for Ethernet Data-Centers. These switches are the
industry's most cost-effective building blocks for embedded systems and storage with the need
for a low port density switch. Whether looking at price-to-performance or energy-to-perfor
-
mance, the Mellanox 12 port switches offer superior performance, power and space reducing
capital and operating expenses, providing the best return-on-investment.
Installation, hot-swapping components and hardware maintenance is covered in “Basic Opera-
tion” on page 14.
Figure 1: 12 Port Ethernet Switch
Figure 2: Connector Side View of the Switch
1.1 Features
The switch includes the following features:
RST
PS1
UID
Mellanox
SX1012
PS2
1
2
3
4
5
6
7
8
9
10
11
12
RST
PS1
UID
SX1012
1
2
3
4
5
6
7
8
9
10
11
12
PS2
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
11
Table 3 - General System Features
Feature Description
Hardware features Network Interfaces
12 QSPF+ interfaces
Interface type – Ethernet
Ethernet speed: 10/40/56 GbE
Switch options Ethernet
Compliance RoHS 6
Advanced Features Ethernet features
Table 4 - Management Software
Feature Description
Management Software
(MLNX-OS®)
Software Management Dual software image
Software and firmware updates
File management •FTP
TFTP
•SCP
Logging Event history log
SysLog support
Management Interface DHCP/Zeroconf
•IPv6
Chassis Management Monitoring environmental controls
Power management
Auto temperature control
High availability
Network Management Inter-
faces
SNMP v1,v2c,v3
REST interfaces (XML Gateway)
Security •SSH
•Telnet
•RADIUS
TACACS+
Date and Time •NTP
Cables & Transceivers Transceiver info
OverviewRev 1.0
Mellanox Technologies
12
Table 5 - Ethernet Features
Feature Description
General
Jumbo Frames (9K)
ACL - 24K rules (permit/deny)
Breakout cables
Ethernet support
48K Unicast MAC addresses
VLAN (802.1Q) - 4K
LAG/LACP (802.3ad), 16 links per LAG (36 LAGs)
Rapid Spanning Tree (802.1w)
Flow control (802.3x)
IGMP snooping v1,2
•LLDP
ETS (802.1Qaz)
PFC (802.1Qbb)
Port mirroring
IP routing
VLAN interface
•ECMP
OSPF
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
13
1.2 Serial Number and Product Version Information
The serial number and the MAC for the switch are found on the pull out tab below the CON-
SOLE connector.
Figure 3: Pull out tab
1.3 Ethernet Ports
The switch contains 12 ports of 40GbE. Each port can be connected with QSFP cables and con-
nectors for 40Gb/s speed, or 10Gb/s speed when connecting through QSA Mellanox adaptors.
All 12 ports can support breakout cables. See “Splitting the Data Stream Using Breakout
(Fanout) Cables” on page 44 for more information.
All Ethernet ports can be manually configured through the CLI management interface.
Each QSFP port is capable of up to 40GbE, upgradable to 56 GbE with a license, as well as
10GbE with a QSA, QSFP to SFP+ adapter or QSFP to SFP+ cables.
40 GbE and 56 GbE are only guaranteed to work with approved cables and modules.
56GbE is operational on Mellanox 56Gb/s VPI cables only.
S/N:MT1117X00014
P/N:MSX1012F1BFS
GUID:0002C9020040DDB0
MadeinIsrael
Rev:A1
MGT1:
00:02:C9:11:A2:01
322X6519220002
Pull out tab
Mellanox
SX1012
9
10
11
12
Basic OperationRev 1.0
Mellanox Technologies
14
2 Basic Operation
2.1 Switch Platform Hardware Overview
Figure 4 shows the connector side panel views of the switches. The figure shows port configura-
tions for the switch systems. This switch has:
1 – Ethernet RJ-45 connector for management
1 – RJ-45 connector for connecting to a host PC
1 – USB connector.
All switches have various status LEDs for on site status information.
Figure 4: Switch System Connector Side Panels
All connectivity is via the connector side panel. All connectors can support fiber cables.
2.2 Status LEDs
The System Status LEDs are located to the left of the connectors on the connector side panel.
2.2.1 System Status LEDs
Figure 5: System Status LEDS
RST
PS1
UID
Mellanox
SX1012
PS2
1
2
3
4
5
6
7
8
9
10
11
12
RST
PS1
UID
Mellanox
SX1012
PS2
1
2
3
4
5
6
7
8
9
10
11
12
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
15
The system status LEDs should display as follows:
when the switch is plugged in, within five minutes the switch status LED should light
up green
the FAN LED should light up green. If the FAN LED shows red, replace the switch.
the PS1 LED for the plugged in PS unit should light up green
the PS2 LED for the second PS unit should light up green only if a second PS unit is
installed in the switch for redundancy and it is connected to a power source
if two PS units are installed and only one PS unit is connected to a power supply the PS2
LED will be red
if only one PS unit is installed in the switch, the PS2 LED will be off
If the PS LEDs are not green, this indicates a problem with the power supplies. The switch is
operational only if at least one of the PS LEDs is green.
Table 6 - System Status LEDs
Symbol Name Description Normal Conditions
Switch Status LED Shows the health of the switch
Solid green after 5 minutes
Fan Status LED Shows the health of the fans Green
Power supply #1 Shows the health of the right side power supply unit Green
Power supply #2 Shows the health of the left side power supply unit
Depends on switch
Bad Port LED lights up when a symbol error is detected Off
Unit Identifier LED Lights up on command through the CLI Off
As long as there is power to the switch (one PS unit is connected), and the switch is
booted up and running, the switch status LED should be green.
If the status LED shows red after five minutes, unplug the switch and call your Mella-
nox representative for assistance.
If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes
and replug in the switch. For more information See
page 47.
UID
PS2
PS1
Basic OperationRev 1.0
Mellanox Technologies
16
2.2.2 Switch Status LED
Figure 6: Switch Status LED
2.2.3 Fan Status LED
Table 7 - Switch Status LED Assignments
LED Configuration STATUS/ System Health LED
Solid Green OK – The system is up and running.
Flashing Green The system is booting up. This assignment is valid on managed systems only.
Solid Yellow To be implemented in a future SW release.
Solid Red
Major Error – Possible damage can result to the switch. Turn off immediately.
e.g. bad firmware, can’t boot, overheated. If the system is booting up, it can take
up to 5 minutes for the status led to change to green.
Off Off – The system has no power.
All fans must be operating while the power supply is plugged in.
If the switch shuts down due to over temperature, unplug the switch , wait 5 minutes
and replug in the
switch . For more information See page 47.
RST
UID
PS2
PS1
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
17
Figure 7: Fan Status LED Connector Side
Table 8 shows the fan status LED assignment.
Table 8 - Fan Status LED Assignments
LED Configuration FAN LED
Solid Green OK – All fans are up and running.
Solid Red Error – One or more fans is not operating properly. The system should be powered
down and troubleshoot the fan module.
Off Off – The fan unit is not receiving any power. Check that the fan unit is properly
and completely inserted.
Basic OperationRev 1.0
Mellanox Technologies
18
2.2.4 Power Supply Status LEDs
Figure 8: Power Status LED Connector Side
This switch can come with two power supply units for redundancy.
The primary power supply (PS) unit is located on the left side and if there is a secondary PS unit
it will be on the right side.
Table 9 shows the power supply unit status LED assignment.
Table 9 - PS Unit Status LED Assignments
LED Color Status
Solid Green OK – The Power supply is delivering the correct voltage – 12VDC.
Solid Red Error – The PS unit is not operational.
Off Off – There is no power to the system (neither PS unit is receiving power). If one
PS unit is showing green and the second PS unit is unplugged it will show a red
indication.
RST
UID
PS2
PS1
SwitchX®-2 12 Port Ethernet Switch System Hardware User Manual Rev 1.0
Mellanox Technologies
19
2.2.5 Bad Port LED
Figure 9: Bad Port LED
The Bad Port indicator is located on the left side of the connector side panel of the unit. Table 10
shows the bad port status LED assignment.
This LED lights up when one or more ports is receiving a symbol error. The LED immediately
goes off until the next symbol error is received.
2.2.6 UID LED Switch Identifier
1
The UID LED is a debug feature that lights a blue LED on the switch connector side panel for
ease in finding a particular switch within a cluster.
Table 10 - Bad Port LED Assignments
LED Configuration Description
Off OK – No symbol errors have been received in last few seconds.
Flashing Orange Error – One or possibly more ports have just received a symbol error
Possible causes are:
Bad cable
Bad connection
Bad connector
1. This feature will be available in a coming software release.
RST
UID
PS2
PS1
Basic OperationRev 1.0
Mellanox Technologies
20
Figure 10: Identifier LED
2.3 Port Connector LEDs
Above the downlink ports are two LEDs one for the upper port and one for the lower port
. Table 11 shows the port status according to the LED indication for Ethernet protocol.
Figure 11: Port LEDs
Table 11 - Port Connector Physical and Logical Link Assignments for Ethernet Mode
LED Configuration LED Description
Off Physical link is down / Default.
Solid Green Physical link is up with no traffic.
Flashing Green Physical link is up with traffic.
Flashing Orange Physical errors.
RST
UID
PS2
PS1
M
1
2
3
4
5
6
7
8
9
10
11
12
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56
  • Page 57 57
  • Page 58 58
  • Page 59 59
  • Page 60 60
  • Page 61 61
  • Page 62 62
  • Page 63 63
  • Page 64 64
  • Page 65 65
  • Page 66 66
  • Page 67 67
  • Page 68 68
  • Page 69 69
  • Page 70 70
  • Page 71 71
  • Page 72 72
  • Page 73 73
  • Page 74 74
  • Page 75 75
  • Page 76 76
  • Page 77 77
  • Page 78 78
  • Page 79 79
  • Page 80 80
  • Page 81 81
  • Page 82 82
  • Page 83 83
  • Page 84 84
  • Page 85 85
  • Page 86 86

Mellanox Technologies SwitchX-2 MSX1012B-2BFS User manual

Type
User manual
This manual is also suitable for

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI