Qlogic 5800 Series Installation guide

Category
Networking
Type
Installation guide
51031-00 B
Installation Guide
Architecting, Installing, and Validating a
Converged Network
QLogic 8100 Series Adapters, QLogic 5800 Series Switches,
Cisco Nexus 5000 Series Switches, JDSU Xgig Platform
ii 51031-00 B
Installation Guide Architecting, Installing, and Validating a Converged Network
Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no
responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its
use. QLogic Corporation reserves the right to change product specifications at any time without notice. Applications
described in this document for any of these products are for illustrative purposes only. QLogic Corporation makes no
representation nor warranty that such applications are suitable for the specified use without further testing or
modification. QLogic Corporation assumes no responsibility for any errors that may appear in this document.
Document Revision History
Revision A, August, 2010
Revision B, November 2010
Changes Sections Affected
Changed the document title
51031-00 B iii
Table of Contents
Preface
Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
1Overview
2 Planning
Selecting a Test Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Organizational Ownership—Fibre Channel/Storage, Ethernet/Networking . 2-1
Where and How to Deploy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
3 Architecture
Approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Process Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Reference Architecture Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Equipment Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
4 Installation
Determine Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Equipment Installation and Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Install the Converged Network Adapter Hardware . . . . . . . . . . . . . . . 4-2
Install the Adapter Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3
Install SANsurfer FC HBA Manager . . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5
Fibre Channel Switches. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5
FCoE Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5
Configuring DCB on a Nexus Switch. . . . . . . . . . . . . . . . . . . . . . . . . . 4-6
Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9
Verify Equipment Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-10
5 Validation Methods for DCB and FCoE
Validation Step 1—Verify PFC and ETS Parameters. . . . . . . . . . . . . . . . . . 5-1
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-1
iv 51031-00 B
Installation Guide Architecting, Installing, and Validating a Converged Network
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-4
Validation Step 2—FIP Validation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-7
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8
Validation Step 3—FCoE Function and I/O Tests. . . . . . . . . . . . . . . . . . . . . 5-12
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-12
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-13
Validation Step 4—Validate PFC and Lossless Link . . . . . . . . . . . . . . . . . . 5-15
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-15
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-16
Validation Step 5—ETS Verification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-18
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-18
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-20
Exchange Completion Time (Latency Monitor) . . . . . . . . . . . . . . . . . . 5-25
Validation Step 6—iSCSI Function and I/O Test. . . . . . . . . . . . . . . . . . . . . . 5-26
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-26
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-27
Validation Step 7—Virtualization Verification . . . . . . . . . . . . . . . . . . . . . . . . 5-29
Validation Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-29
Validation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-30
A Hardware and Software
Cisco Unified Fabric Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1
JDSU (formerly Finisar) Equipment and Software . . . . . . . . . . . . . . . . . . . . A-2
JDSU Xgig. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-2
JDSU Medusa Labs Test Tool Suite . . . . . . . . . . . . . . . . . . . . . . . . . . A-2
QLogic QLE8142 Converged Network Adapter . . . . . . . . . . . . . . . . . . . . . . A-3
QLogic 5800V Series Fibre Channel Switch . . . . . . . . . . . . . . . . . . . . . . . . A-3
B Data Center Bridging Technology
Data Center Bridging (DCB). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-1
DCBX and ETS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-1
Priority Flow Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-2
Fibre Channel Over Ethernet. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-3
iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-4
C References
Index
51031-00 B v
Installation Guide Architecting, Installing, and Validating a Converged Network
List of Figures
Figure Page
3-1 Reference Architecture Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
4-1 Driver Download Page Model Selection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3
4-2 Driver Download Page Driver Link. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
4-3 Driver Download Page Driver and Documentation . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
4-4 Device Manager Interface—Verify Server and Adapter Login . . . . . . . . . . . . . . . . . 4-10
4-5 Device Manager Interface—Verify Storage Login . . . . . . . . . . . . . . . . . . . . . . . . . . 4-10
4-6 NETApp Zone Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-11
4-7 SANsurfer Management Validation Screen 1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-12
4-8 SANsurfer Management Validation Screen 2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-12
5-1 Setup for Validating Unified Fabric. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-1
5-2 Analyzer TraceControl Configured to Capture LLDP Frames Only Between the
Adapter, Switch, and Target . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-2
5-3 DCBX Exchanges Between QLogic QLE8152 Adapter and the
Cisco Nexus 5000 FCoE Switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-4
5-4 FCoE Switch Validation with Emulator Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-5
5-5 FIP Test Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-6
5-6 FIP Verification Results—Converged Network Adapter
and FCoE Switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-8
5-7 Test Results of FIP Keep_Alive and Discovery Advertisement for FCoE Virtual Link
Maintenance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-9
5-8 Time Difference Between Two Adjacent FIP Keep_Alive Frames . . . . . . . . . . . . . . 5-9
5-9 Time Difference Between Two Adjacent FIP Discovery Advertisement Multicast
Frames (to All_E_Nodes). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-10
5-10 Link De-instantiated by the Switch 20 Seconds after the Last Keep Alive Frame . . 5-10
5-11 Time Difference Between the Last FIP Keep Alive Sent and the FIP Clear
Virtual Link Message from the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-11
5-12 I/O Test with Fibre Channel SAN Storage Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-12
5-13 MLTT Configures Various I/O Applications to Verify I/O Benchmarking
Performance of Different Storage Networks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-13
5-14 PFC Validation Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-15
5-15 Trace Shows the PFC Event to Pause the Transmitting FCoE Data Frame Further 5-16
5-16 Expert Validating the Reaction to PFC Pause Frames . . . . . . . . . . . . . . . . . . . . . . 5-17
5-17 Expert Generates Reports with Detailed Protocol Analysis and Statistics. . . . . . . . 5-17
5-18 Verifying ETS with Write Operations to the Storage. . . . . . . . . . . . . . . . . . . . . . . . . 5-19
5-19 Verifying ETS with Read Operations from the Storage . . . . . . . . . . . . . . . . . . . . . . 5-19
5-20 Throughput per Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-20
5-21 FCoE Traffic in a Read Operation from Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-21
5-22 FCoE Traffic Plus TCP Traffic in a Read from Storage . . . . . . . . . . . . . . . . . . . . . . 5-21
5-23 Enabling Cross Port Analysis in Expert . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-22
5-24 Switch Issue Pause to Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-22
5-25 LAN Traffic Only. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-23
5-26 Relationship Between FCoE, TCP Traffic, and Pause Frames . . . . . . . . . . . . . . . . 5-24
5-27 Read Latency Measurement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-25
vi 51031-00 B
Installation Guide Architecting, Installing, and Validating a Converged Network
5-28 iSCSI Traffic Performance Validation Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-26
5-29 Throughput Results Showing the Fibre Channel and iSCSI Application
Performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-27
5-30 Setup for Verifying Virtualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-29
5-31 FCoE and iSCSI Application Throughput in a Virtual Environment . . . . . . . . . . . . . 5-30
5-32 Expert Shows PFC Pause Request Released from the Target to the Switch Port. . 5-31
B-1 Priority Flow Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-3
B-2 FCoE Mapping Illustration (Source: FC-BB-5 Rev 2.0) . . . . . . . . . . . . . . . . . . . . . . B-3
List of Tables
Table Page
3-1 Converged Network Equipment Inventory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
3-2 JDSU Converged Network Validation Equipment . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
5-1 I/O Performance Comparison Among FCoE Storage Network Scenarios. . . . . . . . 5-14
5-2 FCoE Application Performance Statistics Evaluated by Expert . . . . . . . . . . . . . . . . 5-18
5-3 Analyzer Port Setup Reference for Monitoring Links. . . . . . . . . . . . . . . . . . . . . . . . 5-20
5-4 Summary of Throughput Characteristic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-23
5-5 Performance Comparison Between Separate and Combined Applications. . . . . . . 5-28
5-6 FCoE and iSCSI Application Throughput when Running Separate Virtual
Machines on One Physical Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5-31
51031-00 B vii
Preface
This document describes how to install and certify a pilot unified fabric
configuration. This configuration demonstrates lossless Ethernet and data center
bridging (DCB), which includes priority flow control (PFC), enhanced transmission
selection (ETS), and data center bridging exchange protocol (DCBX) for a Fibre
Channel and 10Gb Ethernet unified fabric.
Intended Audience
This guide is for system engineers and planners who want to provide converged
networking products, solutions, and services to their customers. It is also intended
for network planners and administrators who are implementing a converged
network for their company. This guide describes how to install and validate a pilot
converged network in preparation for production deployment.
This guide assumes basic knowledge of Enhanced Ethernet and the associated
standards. If the you are not familiar with Fibre Channel over Ethernet (FCoE) and
Enhanced Ethernet, review the documents listed in “Related Materials” on
page vii.
Related Materials
In addition to this guide, the FCoE Design Guide, developed jointly by Cisco and
QLogic (Cisco document number C11-569320-01), is a valuable resource and is
referenced throughout this guide.
The following links provide more detailed information, and connect to the IEEE
documents that define the Enhanced Ethernet functions:
P802.1Qbb: Priority-based Flow Control
http://www.ieee802.org/1/files/public/docs2008/bb-pelissier-pfc-proposal-05
08.pdf
P802.1Qaz: Enhanced Transmission Selection (Priority Groups):
http://www.ieee802.org/1/files/public/docs2008/az-wadekar-ets-proposal-06
08-v1.01.pdf
P802.1Qaz: DCB Capability Exchange Protocol (DCBX):
http://www.ieee802.org/1/files/public/docs2008/az-wadekar-dcbx-capability-
exchange-discoveryprotocol-1108-v1.01.pdf
Preface
Documentation Conventions
viii 51031-00 B
The Ethernet Alliance has white papers that further describe Enhanced Ethernet:
http://www.ethernetalliance.org/library/ethernet_in_the_data_center/white_papers
Documentation Conventions
This guide uses the following documentation conventions:
NOTE: provides additional information.
CAUTION!
indicates the presence of a hazard that has the potential of
causing damage to data or equipment.
WARNING!!
indicates the presence of a hazard that has the potential of
causing personal injury.
Text in blue font indicates a hyperlink (jump) to a figure, table, or section in
this guide, and links to Web sites are shown in underlined blue
. For
example:
Table 9-2 lists problems related to the user interface and remote agent.
See “Installation Checklist” on page 3-6.
For more information, visit www.qlogic.com
.
Text in bold font indicates user interface elements such as a menu items,
buttons, check boxes, or column headings. For example:
Click the Start button, point to Programs, point to Accessories, and
then click Command Prompt.
Under Notification Options, select the Warning Alarms check box.
Text in Courier font indicates a file name, directory path, or command line
text. For example:
To return to the root directory from anywhere in the file structure:
Type
cd /root and press ENTER.
Enter the following command: sh ./install.bin
Key names and key strokes are indicated with UPPERCASE:
Press CTRL+P.
Press the UP ARROW key.
Preface
Documentation Conventions
51031-00 B ix
Text in italics indicates terms, emphasis, variables, or document titles. For
example:
For a complete listing of license agreements, refer to the QLogic
Software End User License Agreement.
What are shortcut keys?
To enter the date type mm/dd/yyyy (where mm is the month, dd is the
day, and yyyy is the year).
Topic titles between quotation marks identify related topics either within this
manual or in the online help, which is also referred to as the help system
throughout this document.
Preface
Documentation Conventions
x 51031-00 B
51031-00 B 1-1
1 Overview
Martin (2010) defines a converged network as follows: "A unified data center
fabric is a networking fabric that combines traditional LAN and storage area
network (SAN) traffic on the same physical network with the aim of reducing
architecture complexity and enhancing data flow and access. To make this work,
the traditional Ethernet network must be upgraded to become lossless and
provide additional data center networking features and functions. In turn, the
storage protocol must be altered to run on Ethernet." Lossless means that no
Fibre Channel packets are dropped.
Deploying FCoE over a unified fabric reduces data center costs by converging
data and storage networking. Standard TCP/IP and Fibre Channel traffic share the
same high-speed 10Gbps Ethernet wire, resulting in cost savings through
reduced adapter, switch, cabling, power, cooling, and management requirements.
FCoE has rapidly gained market acceptance because it delivers excellent
performance, reduces data center total cost of ownership (TCO), and protects
current data center investments. A unified fabric with FCoE preserves existing
investments in Fibre Channel and Ethernet while providing Enhanced Ethernet for
unified data networking.
To provide some assurance that FCoE can be deployed in a data center without
disrupting operations, Cisco
®
, JDSU™ (formerly Finisar
®
), and QLogic have
collaborated to produce this guide to simplify the installation and certification of an
FCoE pilot. The guide provides system engineers, architects, and end users with
a step-by-step method to implement and validate a unified fabric and measure
performance of a pilot operation. This guide does not provide methods to measure
performance under load or to contrast performance between various protocols,
media types, or file systems. This guide is intended to assist in implementing an
FCoE and unified fabric pilot using current storage and protocols. It is also
intended to assist system engineers in implementing an FCoE and unified fabric
pilot for their customers.
1–Overview
1-2 51031-00 B
51031-00 B 2-1
2 Planning
Selecting a Test Architecture
When planning the pilot of a unified network, it is important to choose both Fibre
Channel and traditional Ethernet-based traffic flows. Combining a test SAN
infrastructure and a test LAN infrastructure is often the easiest and most available
option for a pilot project. Alternatively, a critical business application test system
can closely simulate a production environment. The architecture you choose must
demonstrate that a unified network improves efficiency and performance in your
environment. The reference architecture described in this guide was assembled
from equipment that was available in the QLogic NETtrack Developer Center. You
will need to substitute your own equipment, and modify the installation and
validation process accordingly.
Organizational Ownership—Fibre
Channel/Storage, Ethernet/Networking
A critical factor for successfully implementing a unified data center fabric is the
stability of network and storage management practices. Cooperation between the
network and storage management teams is important as they configure the
converged data center fabric.
Where and How to Deploy
The unified fabric has two components:
10Gb Ethernet switches that support DCB and FCoE—These switches
support the connection of traditional Ethernet and Fibre Channel
infrastructures. These switches are known as a top of rack (TOR) switches,
implementing DCB and encapsulating Fibre Channel frames into Ethernet
frames for transport over 10Gb Ethernet media.
10Gb Converged Network Adapters that support both Ethernet LAN and
Fibre Channel SAN over 10Gb Ethernet media—These adapters replace the
NIC and Fibre Channel host bus adapter, and connect to a DCB-enabled
10Gb Ethernet switch.
2–Planning
Where and How to Deploy
2-2 51031-00 B
Currently, a Converged Network Adapter must always be connected to a switch
that has DCB. There are two types of switches that have DCB: a DCB switch and
an FCoE switch. The DCB switch has enhanced Ethernet support, but does not
have Fibre Channel forwarder (FCF) capabilities, and does not support the
conversion of Fibre Channel frames to FCoE frames. A DCB switch supports
converging-Ethernet-based protocols, but does not support Fibre Channel
protocols. The DCB switch requires an external device to manage Fibre Channel
and FCoE functions. An FCoE switch supports both DCB and Fibre Channel.
There are three ways to connect Fibre Channel storage to a unified fabric:
Converged Network Adapter > FCoE switch > Fibre Channel switch >
Fibre Channel storage
The adapter connects to the FCoE switch with Ethernet infrastructure, and
the FCoE switch connects to storage through a Fibre Channel switch
(Martin, 2010). This is the most common implementation in today's data
centers because the Fibre Channel switch and SAN storage are typically
already in place.
Converged Network Adapter > DCB switch > FCF > Fibre Channel
switch > Fibre Channel storage
The DCB switch requires an external device to provide FCF function to the
attached Fibre Channel storage. This approach is not as common because
most data centers do not have an FCF device, and will acquire an FCoE
switch to connect to their Fibre Channel Infrastructure.
Converged Network Adapter > FCoE switch > FCoE storage
This implementation is not common because, most data centers use Fibre
Channel SAN storage. As more storage vendors deliver FCoE storage,
more pilot projects will support direct Ethernet connection from the FCoE
switch to FCoE-capable storage controllers (Martin, 2010).
In all cases, Ethernet LAN and iSCSI storage connect directly to Ethernet ports on
the DCB or FCoE switch.
The reference architecture, described in Section 3, uses direct-attached native
FCoE storage and Fibre Channel switch-connected SAN storage. Section 4
describes the implementation of the reference architecture and Section 5
describes the validation.
51031-00 B 3-1
3 Architecture
Approach
The test configuration described in this section was installed and validated at the
QLogic NETtrack Developer Center (NDC) located in Shakopee, MN. The NDC
provides QLogic customers and alliance partners with the test tracks and
engineering staff to test interoperability and optimize performance with the latest
server, networking, and storage technology.
Process Summary
To establish a repeatable process, the team created a converged network in the
NDC and installed a validation environment based on JDSU hardware and
software. Screen shots and trace data were captured to show the results from the
seven-step validation process, and to demonstrate the various DCB functions.
Reference Architecture Description
Architecture Overview
Figure 3-1 illustrates the unified Ethernet infrastructure enhanced with DCB.
FCoE and iSCSI storage traffic was tested and validated with LAN traffic, which
shared the unified 10GbE bandwidth driven by Converged Network Adapters.
JDSU testing tools were installed in the fabric, either in-line or at the edge, with
hardware and software to test and certify system-level behavior. These tools also
provided expert-system support that simplified troubleshooting and reduced
installation time.
3–Architecture
Reference Architecture Description
3-2 51031-00 B
Figure 3-1. Reference Architecture Diagram
3–Architecture
Reference Architecture Description
51031-00 B 3-3
Equipment Details
Table 3-1 lists the referenced architecture equipment. Table 3-2 lists the JDSU
Xgig equipment and testing software.
Table 3-1. Converged Network Equipment Inventory
Quantity Product
Model
Number
3
Dell
®
PowerEdge
®
servers
a
a
Two Windows 2008, one VMware
®
ESX™ with one Windows 2008 and Red Hat
®
Enterprise Linux
guest with Microsoft
®
iSCSI initiator. All servers use the QLogic QLE8142 adapter.
1950
4 QLogic QLE8142 adapters (server connectivity) QLE8142
1 Cisco UCS general-purpose rack-mount server
Windows
®
2008
UCS C210 M1
1 Cisco UCS high-density rack-mount server
Windows 2008
UCS C200 M1
1
NetApp
®
FAS3040 storage system
(10Gb iSCSI storage and 10Gb native FCoE storage)
FAS3040
1
HDS
®
AMS500 Storage Array
(4Gb Fibre Channel storage)
AMS500
1 QLogic 5800V 8Gb Fibre Channel switch
(Fibre Channel connection)
SB5802V
1 Cisco Nexus™ 5020 FCoE switch
(unified fabric interconnect)
Nexus 5020
Table 3-2. JDSU Converged Network Validation Equipment
Product
Model/Part
Number
Xgig four-slot chassis Xgig-C042
10GbE/10G Fibre Channel multi-functional blade Xgig-B2100C
Four-port, 1, 2, 4, 8Gbps Fibre Channel Analyzer blade Xgig-B480FA
Two-port, Xgig 10GbE Fibre Channel Analyzer function key Xgig-2FG10G1-SW
Two-port, 10GE Analyzer and Jammer function key Xgig-S20JFE
Two-port, 10GEE FCoE Analyzer and Load Tester function key Xgig-S20LEA
Four-port, 1, 2, 4, 8Gbps Fibre Channel Analyzer function key Xgig-S48AFA
3–Architecture
Reference Architecture Description
3-4 51031-00 B
51031-00 B 4-1
4 Installation
This section describes how to set up an FCoE environment. It assumes a general
understanding of SAN administration concepts.
Determine Configuration
QLogic FCoE adapters are supported on multiple hardware platforms and
operating systems. Generally, the following specifications apply, but you should
always check the QLogic Web site for current information. This configuration uses
a subset of the following equipment:
Server bus interface—PCIe
®
Gen1 x8 or PCIe Gen2 x4
Hardware platforms—IA32 (x86), Intel64, AMD64 (x64), IA64, SPARC
®
,
PowerPC
®
Operating systems—Windows Server
®
2003, 2008, 2008 R2 (targeted); Red
Hat EL AP 5.x; Novell
®
SLES 10.x, 11; VMware ESX/ESXi 3.5 and 4.0;
Solaris
®
10, OpenSolaris™. This list can be found under the specifications
tab for QLogic adapters on the QLogic Web site.
Storage—The following storage systems are in most data centers:
Fibre Channel
iSCSI
FCoE (NetApp)
Switches—The following switches are typical in this configuration:
Fibre Channel
FCoE
Ethernet
Cabling
Fiber optic cable (OM2/OM3) between servers, switches, and storage
Cat5e and Cat6 Ethernet for device management and 1GbE iSCSI
storage
4–Installation
Equipment Installation and Configuration
4-2 51031-00 B
Equipment Installation and Configuration
This section focuses on the converged network installation and configuration. You
do not have to change your current storage and network management practices.
Install the Converged Network Adapter Hardware
Begin by identifying a pilot server that meets Converged Network Adapter
hardware requirements (PCI slot type, length, available slot) and install the
adapters.
To install the adapter hardware:
1. Use a ground strap to avoid damaging the card or server.
2. Power off the computer and disconnect the power cable.
3. Remove the computer cover, and find an empty PCIe x8 bus slot (Gen1) or
PCIe x4 bus slot (Gen2).
4. Pull out the slot cover (if any) by removing the screw or releasing the lever.
5. Install the low-profile bracket, if required.
6. Grasp the adapter by the top edge, and then insert it firmly into the
appropriate slot.
7. Refasten the adapter's retaining bracket using the existing screw or lever.
8. Close the computer cover.
9. Plug the appropriate Ethernet cable (either copper or optical) into the
adapter.
Optical models ship with optical transceivers installed. QLogic 8100
Series adapters used for this project operate only with optical
transceivers sold by QLogic.
The list of approved copper cables is available at the following link:
http://www.qlogic.com/Products/ConvergedNetworking/ConvergedNet
workAdapters/Pages/CopperCables.aspx.
10. Plug in the power cable, and turn on the computer.
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56
  • Page 57 57
  • Page 58 58
  • Page 59 59
  • Page 60 60
  • Page 61 61
  • Page 62 62
  • Page 63 63
  • Page 64 64
  • Page 65 65
  • Page 66 66
  • Page 67 67
  • Page 68 68
  • Page 69 69
  • Page 70 70
  • Page 71 71
  • Page 72 72
  • Page 73 73
  • Page 74 74
  • Page 75 75
  • Page 76 76

Qlogic 5800 Series Installation guide

Category
Networking
Type
Installation guide

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI