Oracle Dual Port 25 Gb User manual

Oracle

®

Dual Port 25 Gb Ethernet Adapter

User's Guide

Part No: E87989-01

September 2017

Oracle Dual Port 25 Gb Ethernet Adapter User's Guide

Part No: E87989-01

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except

as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform,

publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is

prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,

delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental

regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the

hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous

applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all

appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this

software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of

SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered

trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are

not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement

between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content,

products, or services, except as set forth in an applicable agreement between you and Oracle.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?

ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Référence: E87989-01

Ce logiciel et la documentation qui l'accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d'utilisation et

de divulgation. Sauf stipulation expresse de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, accorder de licence, transmettre,

distribuer, exposer, exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute

ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des fins d'interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.

Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu'elles soient exemptes d'erreurs et vous

invite, le cas échéant, à lui en faire part par écrit.

Si ce logiciel, ou la documentation qui l'accompagne, est livré sous licence au Gouvernement des Etats-Unis, ou à quiconque qui aurait souscrit la licence de ce logiciel pour le

compte du Gouvernement des Etats-Unis, la notice suivante s'applique :

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,

delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental

regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the

hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

Ce logiciel ou matériel a été développé pour un usage général dans le cadre d'applications de gestion des informations. Ce logiciel ou matériel n'est pas conçu ni n'est destiné à être

utilisé dans des applications à risque, notamment dans des applications pouvant causer un risque de dommages corporels. Si vous utilisez ce logiciel ou ce matériel dans le cadre

d'applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans

des conditions optimales de sécurité. Oracle Corporation et ses affiliés déclinent toute responsabilité quant aux dommages causés par l'utilisation de ce logiciel ou matériel pour des

applications dangereuses.

Oracle et Java sont des marques déposées d'Oracle Corporation et/ou de ses affiliés. Tout autre nom mentionné peut correspondre à des marques appartenant à d'autres propriétaires

qu'Oracle.

Intel et Intel Xeon sont des marques ou des marques déposées d'Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques

déposées de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d'Advanced Micro Devices. UNIX est une

marque déposée de The Open Group.

Ce logiciel ou matériel et la documentation qui l'accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et des services émanant de

tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée

dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des

dommages causés par l'accès à des contenus, produits ou services tiers, ou à leur utilisation, sauf mention contraire stipulée dans un contrat entre vous et Oracle.

Accès aux services de support Oracle

Les clients Oracle qui ont souscrit un contrat de support ont accès au support électronique via My Oracle Support. Pour plus d'informations, visitez le site http://www.oracle.com/

pls/topic/lookup?ctx=acc&id=info ou le site http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs si vous êtes malentendant.

Contents

Using This Documentation ................................................................................. 9

Product Documentation Library ......................................................................... 9

Feedback ....................................................................................................... 9

Understanding the Installation Process ............................................................ 11

Installation Task Overview (Oracle Solaris x86) .................................................. 11

Installation Task Overview (Linux) ................................................................... 12

Installation Task Overview (Windows) .............................................................. 13

Understanding the Adapter ............................................................................... 15

Shipping Kit Contents .................................................................................... 15

Adapter Overview ......................................................................................... 16

Front Panel Connectors and LEDs .................................................................... 17

Confirming Specifications and Requirements ................................................... 19

Physical Specifications ................................................................................... 19

Electrical Specifications .................................................................................. 20

Environmental Specifications ........................................................................... 20

Hardware and Software Requirements ............................................................... 21

Updating Software and Firmware ...................................................................... 23

▼ Update the OS (Oracle Solaris x86) ............................................................. 23

Firmware Update Tool Overview ..................................................................... 24

Related Information ............................................................................... 24

Installing the Driver ........................................................................................... 25

▼ Verify the bnxt Driver (Oracle Solaris x86) .................................................. 25

5

Contents

▼ Download and Install the bnxt_en Driver (Linux) .......................................... 26

▼ Verify the bnxt_en Driver (Linux) .............................................................. 27

▼ Download and Install the bnxt_en Driver (Windows) ...................................... 28

Installing the Adapter ........................................................................................ 31

Adapter Description ....................................................................................... 32

Related Information ............................................................................... 32

Cable and Transceiver Overview ...................................................................... 32

Cable Cautions .............................................................................................. 33

Related Information ............................................................................... 34

▼ Install the Adapter .................................................................................... 34

▼ Install the SFP28 Transceivers .................................................................... 35

▼ Verify the Adapter Installation (Oracle Solaris x86) ........................................ 36

▼ Verify the Adapter Installation (Linux) ......................................................... 37

▼ Verify the Adapter Installation (Windows) .................................................... 37

Configuring the Network ................................................................................... 39

▼ Configure the Network Interface (Oracle Solaris x86) ..................................... 40

▼ Configure the Network Interface (Windows) ................................................. 40

Boot Options ................................................................................................ 41

▼ Boot Over the Network (PXE) ................................................................... 41

▼ Boot Over a 10GbE Network (Oracle Solaris x86 and Linux) ........................... 42

Installing RoCE ............................................................................................ 44

▼ Install RoCE (Linux) ........................................................................ 45

▼ Install RoCE in Windows Kernel Mode ................................................ 46

▼ Install RoCE in Windows User Mode .................................................. 47

▼ Install RoCE in VMware ESXi ........................................................... 47

Verifying RoCE ............................................................................................ 48

▼ Verify RoCE in Windows .................................................................. 48

Configuring Driver Parameters ......................................................................... 51

▼ Set Driver Parameters (Oracle Solaris x86) ................................................... 51

Driver Parameters (Oracle Solaris x86) ............................................................. 53

▼ Set Driver Parameters (Linux) .................................................................... 53

Driver Parameters (Linux) .............................................................................. 54

6 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Contents

Configuring Jumbo Frames .............................................................................. 55

▼ Change the MTU Permanently (Oracle Solaris x86) ........................................ 55

▼ Change the MTU Temporarily (Oracle Solaris x86) ........................................ 56

▼ Configure Jumbo Frames (Linux) ................................................................ 56

▼ Configure Jumbo Frames (Windows) ........................................................... 57

Configuring a Link Aggregation (Oracle Solaris x86) ........................................ 59

▼ Configure a Link Aggregation (Oracle Solaris x86) ........................................ 59

▼ Display Information About a Link Aggregation (Oracle Solaris x86) .................. 60

▼ Delete a Link Aggregation (Oracle Solaris x86) ............................................. 61

Configuring VLANs and VXLANs ...................................................................... 63

VLANs Overview .......................................................................................... 63

▼ Configure VLANs (Oracle Solaris x86) ........................................................ 64

▼ Configure VLANs (Linux) ......................................................................... 65

▼ Configure VLANs (Windows) .................................................................... 65

▼ Configure VXLANs (Oracle Solaris x86) ..................................................... 66

Removing the Driver ......................................................................................... 69

▼ Remove the bnxt Driver (Oracle Solaris x86) ................................................ 69

▼ Remove the bnxt_en Driver (Linux) ............................................................ 70

▼ Remove the bnxt_en Driver (Windows) ....................................................... 70

Upgrading the Adapter (Linux) ......................................................................... 71

▼ Install the Upgrade Package ....................................................................... 71

▼ Verify the Upgrade ................................................................................... 72

Troubleshooting the Adapter (Oracle Solaris x86) ............................................ 75

▼ Analyze Why the Device Link Is Missing (Oracle Solaris x86) ......................... 75

▼ Recover From a Port Hang (Oracle Solaris x86) ............................................ 76

▼ Analyze Slow Network Performance (Oracle Solaris x86) ................................ 77

▼ Analyze Why the Link Is Not Up After Back-To-Back Cable Connection (Oracle

Solaris x86) .................................................................................................. 78

▼ Analyze Why Changing the MTU Does Not Correctly Set the Link Property

(Oracle Solaris x86) ....................................................................................... 79

7

Contents

Glossary ............................................................................................................ 81

Index .................................................................................................................. 85

8 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Using This Documentation

■

Overview – Provides specifications and describes how to install and administer the Oracle

Dual Port 25 Gb Ethernet Adapter.

■

Audience – Technicians, system administrators, and authorized service providers.

■

Required knowledge – Advanced experience troubleshooting and replacing hardware.

In this document, the term “adapter” refers to the Oracle Dual Port 25 Gb Ethernet Adapter, the

term “x86” refers to 64-bit and 32-bit systems manufactured using processors compatible with

the AMD64, Intel Xeon, or Intel Pentium product families , and the term “Oracle Solaris” refers

to Oracle Solaris 11.3 SRU23 for x86.

Product Documentation Library

Documentation and resources for this product and related products are available at https://

docs.oracle.com/cd/E87266_01/.

Feedback

Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback.

Using This Documentation 9

10 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Understanding the Installation Process

These topics provide an overview of the installation process for the adapter:

■

“Installation Task Overview (Oracle Solaris x86)” on page 11

■

“Installation Task Overview (Linux)” on page 12

■

“Installation Task Overview (Windows)” on page 13

Related Information

■

“Understanding the Adapter” on page 15

■

“Confirming Specifications and Requirements” on page 19

■

“Updating Software and Firmware” on page 23

■

“Installing the Driver” on page 25

■

“Installing the Adapter” on page 31

■

“Troubleshooting the Adapter (Oracle Solaris x86)” on page 75

Installation Task Overview (Oracle Solaris x86)

Step Description Links

1. Understand the adapter. “Understanding the Adapter” on page 15

2. Confirm the adapter specifications and technical

requirements.

“Physical Specifications” on page 19

“Electrical Specifications” on page 20

“Environmental Specifications” on page 20

3. Determine if the driver is supported on your server

and the driver is up to date.

“Hardware and Software Requirements” on page 21

4. If your OS is out of date, update the entire OS image,

or download and apply the latest OS patch.

“Update the OS (Oracle Solaris x86)” on page 23

5. Verify the driver installation.

“Verify the bnxt Driver (Oracle Solaris x86)” on page 25

Understanding the Installation Process 11

Installation Task Overview (Linux)

Step Description Links

6. Install and verify the adapter. “Install the Adapter” on page 34

“Verify the Adapter Installation (Oracle Solaris x86)” on page 36

7. Configure the network. “Configure the Network Interface (Oracle Solaris x86)” on page 40

“Boot Over a 10GbE Network (Oracle Solaris x86 and

Linux)” on page 42

8. Configure the driver parameters. “Set Driver Parameters (Oracle Solaris x86)” on page 51

10. (Optional) Configure link aggregation. “Configure a Link Aggregation (Oracle Solaris x86)” on page 59

11. (Optional) Configure a VLAN or a VXLAN. “Configure VLANs (Oracle Solaris x86)” on page 64

“Configure VXLANs (Oracle Solaris x86)” on page 66

12. If desired, remove a driver.

“Remove the bnxt Driver (Oracle Solaris x86)” on page 69

13. Upgrade the adapter. “Install the Upgrade Package” on page 71

14. Troubleshoot adapter issues. “Troubleshooting the Adapter (Oracle Solaris x86)” on page 75

Related Information

■

“Installation Task Overview (Linux)” on page 12

■

“Installation Task Overview (Windows)” on page 13

Installation Task Overview (Linux)

Step Description Links

1. Understand the adapter. “Understanding the Adapter” on page 15

2. Confirm the adapter specifications and technical

requirements.

“Physical Specifications” on page 19

“Electrical Specifications” on page 20

“Environmental Specifications” on page 20

3. Determine if the driver is supported on your server

and the driver is up to date.

“Hardware and Software Requirements” on page 21

4. If your OS is out of date, update the entire OS image,

or download and apply the latest OS patch.

“Updating Software and Firmware” on page 23

5. Install and verify the driver.

“Download and Install the bnxt_en Driver (Linux)” on page 26

“Verify the bnxt_en Driver (Linux)” on page 27

6. Install and verify the adapter. “Install the Adapter” on page 34

“Verify the Adapter Installation (Linux)” on page 37

12 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Installation Task Overview (Windows)

Step Description Links

7. Boot over the network. “Boot Over a 10GbE Network (Oracle Solaris x86 and

Linux)” on page 42

8. Configure the driver parameters. “Set Driver Parameters (Linux)” on page 53

“Driver Parameters (Linux)” on page 54

9. (Optional) Configure jumbo frames. “Configure Jumbo Frames (Linux)” on page 56

10. (Optional) Configure VLANs. “Configure VLANs (Linux)” on page 65

11. (Optional) Remove a driver.

“Remove the bnxt_en Driver (Linux)” on page 70

12. Upgrade the adapter. “Install the Upgrade Package” on page 71

Related Information

■

“Installation Task Overview (Oracle Solaris x86)” on page 11

■

“Installation Task Overview (Windows)” on page 13

Installation Task Overview (Windows)

Step Description Links

1. Understand the adapter. “Understanding the Adapter” on page 15

2. Confirm the adapter specifications and technical

requirements.

“Physical Specifications” on page 19

“Electrical Specifications” on page 20

“Environmental Specifications” on page 20

3. Determine if the driver is supported on your server

and the driver is up to date.

“Hardware and Software Requirements” on page 21

4. If your OS is out of date, update the entire OS image,

or download and apply the latest OS patch.

“Updating Software and Firmware” on page 23

5. Verify the driver installation.

“Download and Install the bnxt_en Driver (Windows)” on page 28

6. Install the adapter and verify the installation. “Install the Adapter” on page 34

“Verify the Adapter Installation (Windows)” on page 37

7. Boot over the network. “Configure the Network Interface (Windows)” on page 40

8. Configure jumbo frames. “Configure Jumbo Frames (Windows)” on page 57

9. Configure a VLAN. “Configure VLANs (Windows)” on page 65

10. If desired, remove a driver.

“Remove the bnxt_en Driver (Windows)” on page 70

11. Upgrade the adapter. “Install the Upgrade Package” on page 71

Understanding the Installation Process 13

Installation Task Overview (Windows)

Related Information

■

“Installation Task Overview (Oracle Solaris x86)” on page 11

■

“Installation Task Overview (Linux)” on page 12

■

“Understanding the Adapter” on page 15

14 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Understanding the Adapter

These topics provide an overview of the adapter:

■

“Shipping Kit Contents” on page 15

■

“Adapter Overview” on page 16

■

“Front Panel Connectors and LEDs” on page 17

Related Information

■

“Understanding the Installation Process” on page 11

■

“Confirming Specifications and Requirements” on page 19

■

“Updating Software and Firmware” on page 23

■

“Installing the Driver” on page 25

■

“Installing the Adapter” on page 31

■

“Configuring the Network” on page 39

■

“Configuring Driver Parameters” on page 51

■

“Configuring Jumbo Frames” on page 55

■

“Configuring a Link Aggregation (Oracle Solaris x86)” on page 59

■

“Configuring VLANs and VXLANs” on page 63

■

“Removing the Driver” on page 69

■

“Troubleshooting the Adapter (Oracle Solaris x86)” on page 75

Shipping Kit Contents

The carton in which the adapter was shipped contains these items:

■

Adapter with a low-profile bracket attached

■

Dual Port 25Gb Ethernet Adapter Where To Find documentation

Understanding the Adapter 15

Adapter Overview

Related Information

■

“Adapter Overview” on page 16

■

“Front Panel Connectors and LEDs” on page 17

Adapter Overview

The Dual Port 25Gb Ethernet Adapter is a standalone card that is used for virtualized cloud

deployments and network virtualization. Each adapter port uses a 25GbE SFP28 optical

transceiver with an LC/LC cable or a copper DAC that has transceivers attached at each end.

Both ports operate at the same speed. The adapter is a PCIe 3.0 x8 low-profile card.

Feature Specification

Data rate supported per port 2 x 25 GbE, where both ports operate at 25 GbpsGbps per port

Bus type PCIe V3.0, 8.0 GTps

Bus width 8-lane PCIe bus connector

Conforms to Ethernet standard 802.3

Boot ROM 8 Mb SPI Flash

EMI FCC Class A

Related Information

■

“Shipping Kit Contents” on page 15

■

“Front Panel Connectors and LEDs” on page 17

16 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Front Panel Connectors and LEDs

On the front panel, two LEDs display the port speed and activity for each port. Both ports

operate at the same speed. This figure and the table explain the meaning of the LEDs for ports 1

and 2. The LEDs are the same for a full panel and a half-height panel.

Note - If your adapter is installed horizontally, the ports are numbered 1 and 2, left to right. In a

vertical orientation, the ports are numbered 1-2 bottom to top.

No. Description Device Mbit

1 Port 1

2 Port 2

3 Activity LED Off

Blinking Green

No activity

Traffic flowing activity

4 Link LED Off

Solid Green

Solid Yellow

No link

Linked at 25 Gbps

Linked at 1 Gbps or 10 Gbps

Related Information

■

“Shipping Kit Contents” on page 15

■

“Adapter Overview” on page 16

■

“Confirming Specifications and Requirements” on page 19

Understanding the Adapter 17

18 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Confirming Specifications and Requirements

These topics provide technical information and airflow precautions you need to understand

before installing the adapter:

■

“Physical Specifications” on page 19

■

“Electrical Specifications” on page 20

■

“Environmental Specifications” on page 20

■

“Hardware and Software Requirements” on page 21

Related Information

■

“Understanding the Installation Process” on page 11

■

“Understanding the Adapter” on page 15

■

“Updating Software and Firmware” on page 23

■

“Installing the Driver” on page 25

■

“Installing the Adapter” on page 31

■

“Configuring the Network” on page 39

■

“Configuring Driver Parameters” on page 51

■

“Configuring Jumbo Frames” on page 55

■

“Configuring a Link Aggregation (Oracle Solaris x86)” on page 59

■

“Configuring VLANs and VXLANs” on page 63

■

“Removing the Driver” on page 69

■

“Troubleshooting the Adapter (Oracle Solaris x86)” on page 75

Physical Specifications

Description U.S. Metric

Length 3.154 in. 169.30 mm

Confirming Specifications and Requirements 19

Electrical Specifications

Description U.S. Metric

Height 6.665 in. 80.11 mm

Weight 0.201 lbs. 0.091 kg

Related Information

■

“Electrical Specifications” on page 20

■

“Environmental Specifications” on page 20

■

“Hardware and Software Requirements” on page 21

Electrical Specifications

Description Value

Max power consumption 9.9W at 12V

Typical active power 9.1W at 2x25GbE mode; 5% traffic

Supply voltage 12V ± 15%

Related Information

■

“Physical Specifications” on page 19

■

“Environmental Specifications” on page 20

■

“Hardware and Software Requirements” on page 21

Environmental Specifications

Specification Operation Storage

Temperature

†

5°C to 35°C (-23°C to 95°F), noncondensing -40°C to 65°C (-40°F to 149°F),

noncondensing

Humidity 10% to 90% noncondensing relative humidity at

27°C (80.6°F) maximum wet bulb

93% noncondensing relative humidity at

38°C (100.4°F) maximum wet bulb

20 Oracle Dual Port 25 Gb Ethernet Adapter User's Guide • September 2017

Page is loading ...

Oracle Dual Port 25 Gb User manual

Oracle Dual Port 25 Gb User manual

Related papers

Other documents