Mellanox Technologies MHQH19C-XSR User manual

www.mellanox.com

ConnectX®-2 VPI Single and Dual Port QSFP

InfiniBand and Ethernet Adapter Card User

Manual

P/N:

MHRH29B-XTR, MHRH29B-XSR, MHQH29B-XTR, MHQH29B-XSR, MHQH29C-XTR, MHQH29C-

XSR, MHRH19C-XTR, MHRH19C-XSR, MHQH19C-XTR, MHQH19C-XSR, MHQH19B-XSR,

MHQH19B-XTR, MHRH19B-XSR, MHRH19B-XTR

Rev 1.6

Mellanox Technologies

350 Oakmead Parkway Suite 100

Sunnyvale, CA 94085

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies, Ltd.

PO Box 586 Hermon Building

Yokneam 20692

Israel

Tel: +972-4-909-7200

Fax: +972-4-959-3245

Mellanox®, BridgeX®, ConnectX®, InfiniBlast®, InfiniBridge®, InfiniHost®, InfiniRISC®, InfiniScale®, InfiniPCI®, PhyX® CORE-

Direct®, and Virtual Protocol Interconnect® are registered trademarks of Mellanox Technologies, Ltd. FabricIT™ and SwitchX™ are

trademarks of Mellanox Technologies, Ltd. All other marks and names mentioned herein may be trademarks of their respective companies.

Document Number: 3156

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User ManualRev 1.6

Mellanox Technologies

2

NOTE:

THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE

PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE

OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE

CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX

TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX

TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE

HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED

WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE

DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,

INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO,

PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS

INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,

OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANYWAY FROM THE USE OF THE PRODUCT(S) AND

RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

3

Table of Contents

Table of Contents 3

List of Figures 5

List of Tables 6

Revision History 7

About this Manual 8

Intended Audience 8

Related Documentation 8

Online Resources 8

Document Conventions 8

Technical Support 8

Firmware and Software Updates 9

Chapter 1 Overview 10

1.1 Adapter Cards Covered in this Manual 11

1.2 Mellanox Part Numbering Legend 13

1.3 Finding the GUID/ MAC and Serial Number on the Adapter Cards 14

1.4 Safety Warnings 14

Chapter 2 Adapter Card Interfaces 16

2.1 I/O Interfaces 16

2.1.1 InfiniBand Interface 16

2.1.2 Ethernet Interface 17

2.1.3 VPI Port Configuration 17

2.1.4 PCI Express Interface 17

2.1.5 LED Assignment 18

2.1.6 I2C-compatible Interface 18

2.2 Power 19

2.3 QSFP Power Level 19

2.4 Memory 19

2.4.1 System Memory 19

2.4.2 SPI (Flash) 19

2.4.3 EEPROM 19

Chapter 3 VPI Adapter Card Installation 27

3.1 Hardware Requirements 27

3.2 Installation Instructions 27

3.3 Identify the Card in Your System 27

3.3.1 On Windows 27

3.3.1.1 Linux 29

3.4 Cables and Modules 29

3.4.1 Optical Modules for QSFP 29

3.4.2 Modules for QSFP to SFP+ 29

3.4.3 Cable Installation 29

3.4.3.1 Inserting a Cable into the Adapter Card 30

3.4.3.2 Removing a Cable from the Adapter Card 31

Chapter 4 Driver Software and Firmware 32

4.1 Driver Software 32

4.1.1 Linux 32

4.1.2 Windows 35

4.2 Port Type Management Via Driver SW 36

4.2.1 Linux 36

4.2.2 Windows 37

Rev 0.10

Mellanox Technologies

4

4.3 FlexBoot 38

4.4 NVIDIA GPUDirect Support 39

4.4.1 Hardware and Software Requirements 39

4.4.2 Installation 39

4.4.2.1 Kernel Installation: 39

4.4.2.2 MLNX OFED Drivers Installation: 39

4.4.2.3 NVIDIA Driver Installation: 40

4.5 CORE-Direct (Collectives Offload Resource Engine) 40

4.5.1 Hardware and Software Requirements 40

4.5.2 Installation 40

4.6 RDMA over Converged Ethernet (RoCE) 40

4.6.1 Hardware and Software Requirements 41

4.6.2 Installation 41

4.7 Updating Adapter Card Firmware 41

Appendix A Specifications 44

A.1 MHQH19C-X[TSR] Specifications 44

A.2 MHRH19B-X[ST]R Specifications 45

A.3 MHQH19B-X[ST]R Specifications 46

A.4 MHQH29C-X[ST]R Specifications 47

A.5 MHRH29B-X[ST]R Specifications 48

A.6 MHQH29B-X[ST]R Specifications 49

A.7 Board Mechanical Drawing and Dimensions 50

A.8 Regulatory Statements 52

Appendix B Interface Connectors Pinout 53

B.1 I2C-Compatible Connector Pinout 53

B.2 PCI Express x8 Connector Pinout 53

B.3 QSFP Connector Pinout 54

Appendix C Replacing a Tall Bracket With a Short Bracket 56

C.1 Remove the Existing Bracket from the Adapter Card 57

C.2 Installing the New Bracket 57

Appendix D Avertissements de sécurité d’installation (Warnings in French) 60

Appendix E Installation - Sicherheitshinweise (German) 62

Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) 63

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

5

List of Figures

Figure 1: Single Port Card Component Side 11

Figure 2: Dual Port Card Component Side 12

Figure 3: Card Product Label 14

Figure 4: Dual Port Numbering 16

Figure 5: LED - Port Association 18

Figure 6: I2C Connector 18

Figure 7: Flash Jumper 19

Figure 8: PCI Device 28

Figure 9: Connector Orientation (example) 31

Figure 10: Device Manager 36

Figure 11: Support Download Assistant 42

Figure 12: Schematic of the Dual Port Adapter Card MHQH29C 50

Figure 13: Schematic of the Dual Port Adapter Card MH[RQ]H29B-X[ST]R 51

Figure 14: Schematic of the Single Port Adapter Card MH[QR]H19[BC]-X[ST]R 51

Figure 15: Compatible Connector Plug and Pinout 53

Figure 16: Connector and Cage Views 54

Figure 17: Remove the Bracket 57

Figure 18: Gasket Installation 58

Figure 19: Placing the Bracket on the Card 59

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual

Rev 1.6

Mellanox Technologies

6

List of Tables

Table 1: Revision History Table 7

Table 2: Documents List 8

Table 3: Single Port Cards List 11

Table 4: Dual Port Cards List 12

Table 5: Mellanox Cards Part Numbering Key 13

Table 6: Supported Port Configurations 17

Table 7: Unsupported Port Configurations 17

Table 8: Physical and Logical Link Indications 18

Table 9: Jumper Configuration 19

Table 10: MHQH[12]9B-XTR 20

Table 11: MHRH[12]9B-XT[CR] 21

Table 12: MH[QR]H19C-X[STN]R VPD 22

Table 13: MHRH19B-X[ST]R 23

Table 14: MHQH19B-X[ST]R 24

Table 15: MHQH29B-X[ST]R VPD 25

Table 16: MHQH29C-X[ST]R VPD 26

Table 17: Hardware Requirements 27

Table 18: Specifications for MHQH19C-X[ST]R 44

Table 19: Specifications for MHRH19B-X[ST]R 45

Table 20: Specifications for MHQH19B-X[ST]R 46

Table 21: Specifications for MHQH29C-X[ST]R 47

Table 22: Specifications for MHRH29B-X[ST]R 48

Table 23: Specifications for MHQH29B-X[ST]R 49

Table 24: I2C-Compatible Connector Pinout 53

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

7

Revision History

This document was printed on October 30, 2011.

Table 1 - Revision History Table

Date Rev

Comments/Changes

Feb. 14th, 2010 1.6 Added MHRH19B-X[ST]R and MHQH19B-X[ST]R

Changed Air Flow to min. 200LFM

Made changes to the Set Up section

Minor fixes

Nov. 24th, 2010 1.5 Added MHRH19C-X[ST]R and MHQH19C-X[ST]R

Nov. 21st, 2010 1.4 Added MHQH29C-X[ST]R

Oct. 27th, 2010 1.3 Added Technical Support and Firmwar

e and Software sections to the Preface

sections

Added KCC statement

Added GPUDirect

Added CORE-Direct

Added RoCE

Added Flexboot

Added Set Up section

Fixed card dimensions

Updated photographs

Updated Figure 11

Formatted EMC table

Changed EN 60950-1:2011 to EN 60950-1:2006

Added LED Port Association figure

Used graphics from media kit

Changed regulatory section on 2 products

Minor formatting

New overview

MAC is derived from GUID

New template

Apr. 2010 1.2 Updated power numbers

Added VPI

Feb. 2010 1.1 Combined singleand dual port cards

Jan. 2010 1.0 Initial Release

Rev 1.6

Mellanox Technologies

8

About this Manual

This User Manual describes Mellanox Technologies ConnectX®-2 Single and Dual Port VPI

InfiniBand and Ethernet PCI Express x8 adapter cards. It provides details as to the interfaces of the

board, specifications, required software and firmware for operating the board, and relevant docu-

mentation.

Intended Audience

This manual is intended for the installer and user of these cards.

The manual assumes basic familiarity

with InfiniBand® and Ethernet networks and architecture

specifications.

Related Documentation

Table 2 -

Mellanox Firmware Tools (MFT) User Manual

Document no. 2204UG

User Manual describing the set of MFT firmware management tools for a

single node.

See http://www

.mellanox.com => Firmware & Downloads => Download

Firmware Tools

Or

http://www.mellanox.com => Support => Download Firmware

Tools

IBTA Specification Release 1.2.1 InfiniBand Architecture Specification

IEEE Std 802.3 Specification This is the IEEE Ethernet specification

http://standards.ieee.org/getieee802

PCI Express 2.0 Specifications Industry Standard PCI Express 2.0 Card Electromechan

ical Specification,

Rev 1.3.

Documents List

Online Resources

• Mellanox Technologies Web pages: http://www.mellanox.com

• Mellanox Technologies Firmware download Web page:

http://www.mellanox.com => Support => Download Center

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in mega

bytes. The use of Mb or Mbits (small b) indicates size in mega bits.

Technical Support

Customers who purchased Mellanox products directly from Mellanox are invited to contact us

through the following methods:

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

9

•URL: http://www.mellanox.com => Support

• E-mail: support@mellanox.com

• Tel: +1.408.916.0055

Customers who purchased Mellanox M-1 Global Support Services, please see your contract for

details regarding Technical Support.

Customers who purchased Mellanox products through a Mellanox approved reseller should first

seek assistance through their reseller.

Firmware and Software Updates

The Mellanox support downloader contains software, firmware and knowledge database informa-

tion for Mellanox products. Access the data base from the Mellanox Support Web page,

http://www.mellanox.com => Support

or use the following link to go directly to the Mellanox Support Download Assistant page:

http://www.mellanox.com/supportdownloader/.

Overview

Rev 1.6

Mellanox Technologies

10

1 Overview

This document is a User Manual for Mellanox Technologies VPI adapter cards based on the Con-

nectX®-2 VPI integrated circuit device. The cards described in this manual have the following

main features:

• Virtual Protocol Interconnect

• InfiniBand Architecture Specification v1.2.1 compliant

• Compliant with QSFP MSA spec Rev. 1.0

• PCI Express 2.0 (1.1 compatible) through an x8 edge connector up to 5GT/s

• Single- and Dual-Port options available

• Compatible with copper cables and optical cables with the use of QSFP connectors. Support for

SFP+ cables is available through QSA (Quad to Serial) adapters.

• CPU offload of transport operations

• CORE-Direct® application offload

• GPU-Direct application offload

• RDMA over converged Ethernet (RoCE)

• End-to-end QoS and congestion control

• Hardware-based I/O virtualization

• TCP/UDP/IP stateless offload

• Fibre Channel encapsulation (FCoIB or FCoE)

•RoHS-R6

• Two bracket heights: short and tall

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

11

1.1 Adapter Cards Covered in this Manual

Table 3 lists the single VPI adapter cards described in this manual.

Table 4 lists the dual port VPI adapter cards described

in this manual.

Table 3 - Single Port Cards List

Ordering Part Number

(OPN)

PCI Express

SERDES

Speed

Data Transmis-

sion Rate/

# of ports

Short / Tall

Bracket

RoHS Adapter IC Part Number

MHRH19C-XSR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Short R-6 MT25414B0-FCCR-QI

MHRH19C-XTR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Tall R-6 MT25414B0-FCCR-QI

MHQH19C-XSR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Short R-6 MT25414B0-FCCR-QI

MHQH19C-XTR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Tall R-6 MT25414B0-FCCR-QI

MHRH19B-XSR PCIe Gen2

5.0 GT/s

20 Gb/s DDR

1 port

Short R-6 MT25408B0-FCCR-GI

MHRH19B-XTR PCIe Gen2

5.0 GT/s

20 Gb/s DDR

1 port

Tall R-6 MT25408B0-FCCR-GI

MHQH19B-XSR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Short R-6 MT25408B0-FCCR-QI

MHQH19B-XTR PCIe Gen2

5.0 GT/s

40 Gb/s QDR

1 port

Tall R-6 MT25408B0-FCCR-QI

Figure 1: Single Port Card Component Side

Table 4 - Dual Port Cards List

Ordering Part Number

(OPN)

PCI Express

SERDES Speed

IB Port Speed

Short /

Tall

Bracket

RoHS

HCA IC

Part Number

MHRH29B-XSR PCIe Gen2

5.0 GT/s

20Gb/s (DDR)

Dual port

Short R-6 MT25408B0-FCCR-GI

MHRH29B-XTR PCIe Gen2

5.0 GT/s

20Gb/s (DDR)

Dual port

Tall R-6 MT25408B0-FCCR-GI

MHQH29B-XSR PCIe Gen2

5.0 GT/s

40Gb/s (QDR)

Dual port

Short R-6 MT25408B0-FCCR-QI

MHQH29B-XTR PCIe Gen2

5.0 GT/s

40Gb/s (QDR)

Dual port

Tall R-6 MT25408B0-FCCR-QI

MHQH29C-XSR PCIe Gen2

5.0 GT/s

40Gb/s (QDR)

Dual port

Short R-6 MT25408B0-FCCR-QI

MHQH29C-XTR PCIe Gen2

5.0 GT/s

40Gb/s (QDR)

Dual port

Tall R-6 MT25408B0-FCCR-QI

Overview

Rev 1.6

Mellanox Technologies

12

Figure 2: Dual Port Card Component Side

MH[QR]H29B

MHQH29C

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

13

1.2 Mellanox Part Numbering Legend

Table 5 describes the Mellanox Technologies adapter cards part numbering legend.

Table 5 - Mellanox Cards Part Numbering Key

Adapter Card

OPN

MHTS#I-XBR

Field Decoder

M

Mellanox

Technologies

H

Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card

T

Media Q = QSFP QDR, R = QSFP DDR,

S

Adapter

Architecture

H = ConnectX® or ConnectX-2

#

# ports 1 = 1, 2 = 2

I

Host Interface X = PCI-X, 4 = PCIe x4, 8 = PCIe Gen1 x8, 9 = PCIe (Gen2 x8),

G

Generation <blank> = Initial product generation, B= generation B, C= generation C

-

Separator

X

Memory Size X = MemFree, 1=128MB, 2=256MB, 3=512MB

B

Bracket S = Short, T = Tall, N = None

R

RoHS <blank> = non RoHS, C = RoHS R-5 w/ Exemption, R = RoHS R-6 Lead-Free

For example, the part number MHQH19B-XTR describes Mellanox Technologies’ ConnectX

®

-2

VPI card with 1 QSFP port, a PCIe2.0 x8 5.0GT/s interface, no on-board memory (mem-free), a

tall PCI bracket, and RoHS R6 compliance. Using the legend,

• field M = M to indicate a Mellanox

Technologies product,

• field H = H to indicate an InfiniBand Adapter

Card,

• field T = Q to indicate QSFP QDR,

• field S = H to indicate ConnectX®-2

• field # = 1 to indicate one port,

• field I = 9 to indicate PCI Express 2.0 x8 running at 5.0GT/s,

• field G = B to indicate Generation B

• field X = X to indicate no on-board memory,

• field B = T to indicate a tall bracket, and

• field R = R to indicate RoHS R6 (with no exemptions) compliance

Overview

Rev 1.6

Mellanox Technologies

14

1.3 Finding the GUID/ MAC and Serial Number on the Adapter Cards

Each Mellanox adapter card has a label on the print side that shows the card serial number, the card

MAC for Ethernet protocol, and the card GUID for InfiniBand protocol. VPI cards have both a

GUID and a MAC (derived from the GUID).

Figure 3: Card Product Label

Port 1 uses the GUID or MAC ID described on the label. For Port 2 GUID or MAC

add 1 to Port 1's respective values.

1.4 Safety Warnings

For safety warnings in French see “Avertissements de sécurité d’installation (Warnings in French)”

on page 60. For safety warnings in German see “Installation - Sicherheitshinweise (German)” on

page 62. For safety warnings in Spanish see “Advertencias de seguridad para la instalación (Warn-

ings in Spanish)” on page 63.

1. Installation Instructions

Read all installation instructions before connecting the equipment to the power source.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

15

2. Over-temperature

This equipment should not be operated in an area with an ambient temperature exceed-

ing the maximum recommended: 55°C (131°F).

To guarantee proper air flow, allow at least 8cm (3 inches) of clearance

around the ven-

tilation openings.

3. During Lightning - Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or dis-

connect cables.

4. Copper Cable Connecting/Disconnecting

Some copper cables are heavy and not flexible, as such they should be carefully

attached to or detached from the connectors. Refer to the cable manufacturer for spe-

cial warnings and instructions.

5. Equipment Installation

This equipment should be installed, replaced, or serviced only by trained and qualified

personnel.

6.

Disposal of this equipment should be in accordance to all national laws and regula-

tions.

Equipment Disposal

7.

This equipment should be installed in compliance with local and national electrical

codes.

Local and National Electrical Codes

Adapter Card Interfaces

Rev 1.6

Mellanox Technologies

16

2 Adapter Card Interfaces

2.1 I/O Interfaces

Each adapter card includes the following interfaces:

• QSFP ports

• PCI Express x8 edge connector

• I/O panel LEDs

•I

2

C-compatible connector (for debug)

For dual port cards, port 1 connects to connector 1 o

f the device, while port 2 connects to connec-

tor 2 of the device.

Figure 4:

Port 2

Port 1

Dual Port Numbering

2.1.1 InfiniBand Interface

The ConnectX®-2 adapter card is compliant with the InfiniBand Architecture Specification, Release

1.2.1.

VPI adapter cards listed above, based on this device, provide access to its network ports by

means of QSFP connectors.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

17

2.1.2 Ethernet Interface

The ConnectX-2 adapter card is compliant with the IEEE Std 802.3. The VPI adapter cards listed

above, based on this device, provide access to the Ethernet ports by means of QSFP connec-

tors.The Mellanox QSA (QSFP to SFP+) adapter modules can be ordered through Mellanox T

ech-

nologies authorized dealers.

2.1.3 VPI Port Configuration

VPI ports are auto-sensing but can be manually configured using a script.

Table 6 lists the configuration

s supported by dual-port VPI adapter cards.

Table 6 - Supported Port Configurations

Port 1 Port 2

Ethernet Ethernet

IB IB

auto-sensing auto-sensing

IB Ethernet

IB auto-sensing

auto-sensing Ethernet

Table 7 lists the configurations not supported by dual-port VPI adapter cards.

Table 7 - Unsupported Port Configurations

Port 1 Port 2

Ethernet IB

Ethernet auto-sensing

auto-sensing IB

For port type configuration instructions please refer to Section 4.2, “Port Type Management Via

Driver SW,” on page 36.

2.1.4 PCI Express Interface

The ConnectX®-2 adapter cards support PCI Express 2.0 (1.1 compatible) through an x8 edge

connector. The device can be either a master initiating the PCI Express bus operations or a slave

responding to PCI bus operations.

Adapter Card Interfaces

Rev 1.6

Mellanox Technologies

18

2.1.5 LED Assignment

There are two I/O LEDs per port, green and yellow, located on the I/O panel. Table 8 outlines the

different LED functions.

Figure 5: LED - Port Association

Table 8 - Physical and Logical Link Indications

LED Function

Green - Physical link

• Constant on indicates a good physical link

• Blinking indicates a problem with the physical link

• If neither LED is lit, then the physical

link has not been established

Yellow -

Logical (data activity) link

• A constant yellow indicates a valid logical (data activity) link without

data transfer.

• A blinking yellow indicates a valid logical link with data transfer

• If only the green LED is lit and the yellow LED is of

f, then the logical

link has not been established.

The short bracket has the same port and LED footprints as the tall bracket.

2.1.6 I

2

C-compatible Interface

A three-pin header on the adapter card is provided as the I

2

C-compatible interface. See

Appendix A,“Specifications,” on page 44 for the location on the board.

Figure 6: I

2

C Connector

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6

Mellanox Technologies

19

2.2 Power

All adapter cards receive 12V and 3.3V power from the PCI Express Edge connector. All other

required power voltages are generated by on-board switch mode regulators. See “Specifications”

on page 44.

2.3 QSFP Power Level

The card supports power level 3, according to SFF Committee SFF-8436 Specification for QSFP

(Quad Small Form-factor Pluggable) Transceiver.

2.4 Memory

The adapter cards support multiple memory devices through the PCI, SPI (Flash) and I

2

C inter-

faces.

2.4.1 System Memory

The adapter cards utilize the PCI Express interface to store and access IB fabric and/or Ethernet

fabric connection information and packet data on the system memory.

2.4.2 SPI (Flash)

Each of the adapter cards includes one 16MB SPI Flash device (M25P16-VME6G device by ST

Microelectronics) accessible via the Flash interface of the ConnectX®-2 VPI adapter card.

There is a jumper on each adapter card that indica

tes to the device whether an on-board Flash

device is to be used or not. Table 9 provides information on this ju

mper. See the appropriate sche-

matic in Appendix A,“Specifications,” on page 44 for the jumper location.

Table 9 - Jumper Configuration

Description Option

Card Default

Configuration

Comments

Flash present/

not present

connection open – Flash present

connection shorted – Flash not present

Figure 7: Flash Jumper

connection open –

Flash present

Header 1x2

2.4.3 EEPROM

Each board incorporates an EEPROM that is accessible through the I

2

C-compatible interface. The

EEPROM capacity is 4Kb. The EEPROM is used for storing the Vital Product Data (VPD).

Adapter Card Interfaces

Rev 1.6

Mellanox Technologies

20

The PCI VPD (Vital Product Data) layout, for each of the adapter cards complies with the format

defined in the PCI 2.3 Specification, Appendix I.

Table 10 - MHQH[12]9B-XTR

Offset

(Decimal)

Item Value Format Description

0 Large Resource Type ID String Tag

(0

x02)

0x82

1 Length [7:0] LSB 0xA

2 Length [15:8] MSB 0x0

3 Data FALCON QDR STR

13 Large Resource Type VPD-R Tag

(0

x10)

0x90

14 Length [7:0] LSB 0x4F

15 Length [15:8] MSB 0x00

16 VPD Keyword PN STR Add in Card Part Number

18 Length 0x15

19 PN PN %STR_SPC

40 VPD Keyword EC STR Engineering Change Level of the card

(rev

)

42 Length 0x2

43 Revision RV %STR PCB revision

45 VPD Keyword SN STR Serial Number

47 Length 0x18

48 SerialNumber %STR_SPC “00..00XXXX..XX”

72 VPD Keyword V0 STR Misc Information

74 Length 0x10

75 Data PCIe Gen2 x8 STR_SPC

91 VPD Keyword RV STR

93 Length 0x1

94 Data 0,93 %CS0

95 Large Resource Type VPD-W Tag

(

0x11)

0x91

96 Length [7:0] LSB 0x9D

97 Length [15:8] MSB 0x00

98 VPD Keyword V1 STR EFI Driver version

100 Length 0x6

101 Data N/A STR_SPC

107 VPD Keyword YA STR Asset Tag

109 Length 0x20

110 Data N/A STR_SPC “N/A”

142 VPD Keyword RW STR Remaining read/write area

144 Length 0x6E

145 Data STR_ZERO Reserved (0x00)

255 Small Resource Type END Tag

(

0x11)

0x78

Page is loading ...

Mellanox Technologies MHQH19C-XSR User manual

Mellanox Technologies MHQH19C-XSR User manual

Related papers

Other documents