Cisco Fabric Manager Configuration Guide

Brand: Cisco

Model: Fabric Manager

Category: Software

Type: Configuration Guide

This manual is also suitable for

Fabric Manager Release 4.1

Send documentation comments to mdsfeedbac[email protected]

Americas Headquarters

Cisco Systems, Inc.

170 West Tasman Drive

San Jose, CA 95134-1706

USA

http://www.cisco.com

Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 527-0883

Cisco MDS 9000 Family Fabric Manager

Configuration Guide, Release 4.x

Cisco MDS NX-OS Release 4.1(1b) Through 4.1(3a)

Cisco MDS 9000 FabricWare Release 4.x

March 2009

Text Part Number: OL-17256-03

Send documentation comments to mdsfeedbac[email protected]

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL

STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT

WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT

SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE

OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH

ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT

LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF

DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,

WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO

OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

CCDE, CCENT, Cisco Eos, Cisco HealthPresence, the Cisco logo, Cisco Lumin, Cisco Nexus, Cisco StadiumVision, Cisco TelePresence, Cisco WebEx, DCE, and Welcome

to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn and Cisco Store are service marks; and Access Registrar, Aironet, AsyncOS,

Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS,

Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, EtherFast, EtherSwitch, Event Center, Fast Step,

Follow Me Browsing, FormShare, GigaDrive, HomeLink, Internet Quotient, IOS, iPhone, iQuick Study, IronPort, the IronPort logo, LightStream, Linksys, MediaTone,

MeetingPlace, MeetingPlace Chime Sound, MGX, Networkers, Networking Academy, Network Registrar, PCNow, PIX, PowerPanels, ProConnect, ScriptShare, SenderBase,

SMARTnet, Spectrum Expert, StackWise, The Fastest Way to Increase Your Internet Quotient, TransPath, WebEx, and the WebEx logo are registered trademarks of

Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.

All other trademarks mentioned in this document or website are the property of their respective owners. The use of the word partner does not imply a partnership relationship

between Cisco and any other company. (0812R)

Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the

document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.

Cisco MDS 9000 Family Fabric Manager Configuration Guide

Send documentation comments to mdsfeedbac[email protected]

iii

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

CONTENTS

New and Changed Information lvii

Preface lxi

Audience lxi

Organization lxi

Document Conventions lxvi

Related Documentation lxvii

Release Notes lxvii

Regulatory Compliance and Safety Information lxvii

Compatibility Information lxvii

Hardware Installation lxviii

Software Installation and Upgrade lxviii

Cisco Fabric Manager lxviii

Command-Line Interface lxviii

Intelligent Storage Networking Services Configuration Guides lxviii

Troubleshooting and Reference lxviii

Obtaining Documentation and Submitting a Service Request lxix

PART

1Getting Started

CHAPTER

1Product Overview 1-1

Hardware Overview 1-1

Cisco MDS 9500 Series Multilayer Directors 1-2

Cisco MDS 9200 Series Fabric Switches 1-3

Cisco MDS 9216i Multiprotocol Fabric Switch 1-3

Cisco MDS 9222i Multilayer Fabric Switch 1-3

Cisco MDS 9100 Series Fixed Configuration Fabric Switches 1-4

Cisco NX-OS Software Configuration 1-4

Tools for Software Configuration 1-5

CLI 1-5

Cisco MDS 9000 Fabric Manager 1-5

Software Configuration Overview 1-6

Basic Configuration 1-6

Advanced Configuration 1-7

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

2Installing Cisco MDS NX-OS and Fabric Manager 2-1

Starting a Switch in the Cisco MDS 9000 Family 2-1

Initial Setup Routine 2-2

Preparing to Configure the Switch 2-2

Default Login 2-3

Setup Options 2-3

Assigning Setup Information 2-4

Configuring Out-of-Band Management 2-4

Configuring In-Band Management 2-9

Using the setup Command 2-12

Accessing the Switch 2-12

Where Do You Go Next? 2-13

About Cisco Fabric Manager 2-13

Fabric Manager Server 2-14

Fabric Manager Client 2-14

Fabric Manager Server Proxy Services 2-14

Device Manager 2-15

Performance Manager 2-15

Fabric Manager Web Server 2-15

Cisco MDS 9000 Switch Management 2-15

Storage Management Solutions Architecture 2-16

In-Band Management and Out-of-Band Management 2-17

mgmt0 2-17

IPFC 2-17

Installing the Management Software 2-18

Before You Install 2-18

Supported Software 2-19

Java Database Connectivity 2-19

Minimum Hardware Requirements 2-20

Upgrading Fabric Manager in Cisco SAN-OS Releases Prior to 3.1(2b) 2-20

Upgrading Fabric Manager in Cisco SAN-OS Releases 3.1(2b) and Later to 3.2(1) 2-20

Installing the Database 2-20

Directory Structure 2-21

2-21

Installing Oracle 2-22

Increasing UDP Buffer Size 2-23

Database Backup and Restore-PostgresSQL 2-23

Backup 2-23

Restore 2-24

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

Importing PM Statitics Data to Fabric Manager 2-24

Installing Fabric Manager 2-24

Installing Device Manager 2-34

Creating FM/DM Shortcut Manually 2-36

Upgrading the Management Software 2-38

Upgrading Fabric Manager Server and Fabric Manager Standalone Version Using the Fabric Manager

Update Installer 2-39

Integrating Cisco Fabric Manager with Other Management Tools 2-40

Running Fabric Manager Behind a Firewall 2-40

Uninstalling the Management Software 2-43

CHAPTER

3Fabric Manager Server 3-1

Fabric Manager Server Overview 3-1

Fabric Manager Server Features 3-1

Installing and Configuring Fabric Manager Server 3-2

Installing Fabric Manager Server 3-2

Unlicensed Versus Licensed Fabric Manager Server 3-3

Verifying Performance Manager Collections 3-3

Managing a Fabric Manager Server Fabric 3-3

Selecting a Fabric to Manage Continuously 3-3

Fabric Manager Server Properties File 3-4

Modifying Fabric Manager Server 3-5

Adding or Removing Fabric Manager Server Users 3-6

Changing the Fabric Manager Server User Name and Password 3-7

Changing the Polling Period and Fabric Rediscovery Time 3-7

Using Device Aliases or FC Aliases 3-7

CHAPTER

4Authentication in Fabric Manager 4-1

Fabric Manager Authentication Overview 4-1

Best Practices for Discovering a Fabric 4-3

Setting Up Discovery for a Fabric 4-3

Performance Manager Authentication 4-4

Fabric Manager Web Server Authentication 4-4

CHAPTER

5Fabric Manager Client 5-1

About Fabric Manager Client 5-1

Fabric Manager Advanced Mode 5-2

Launching Fabric Manager Client in Cisco SAN-OS Release 3.2(1) and Later 5-2

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

Fabric Manager Client Quick Tour: Server Admin Perspective 5-7

Fabric Manager Main Window 5-7

Menu Bar 5-9

Tool Bar 5-9

Logical Domains Pane 5-9

Physical Attributes Pane 5-9

Information Pane 5-10

Fabric Pane 5-11

Fabric Manager Client Quick Tour: Admin Perspective 5-12

Menu Bar 5-13

File 5-13

View 5-14

Zone 5-14

Tools 5-15

Performance 5-17

Server 5-17

Help 5-17

Toolbar 5-17

Logical Domains Pane 5-19

Filtering 5-19

Physical Attributes Pane 5-20

Context Menu for Tables 5-20

Information Pane 5-22

Detachable Tables 5-24

Fabric Pane 5-24

Context Menus 5-26

Saving the Map 5-26

Purging Down Elements 5-27

Multiple Fabric Display 5-27

Filtering by Groups 5-28

Status Bar 5-29

Setting Fabric Manager Preferences 5-30

Network Fabric Discovery 5-31

Modifying the Device Grouping 5-32

Using Alias Names as Enclosures 5-32

Controlling Administrator Access with Users and Roles 5-34

Using Fabric Manager Wizards 5-34

Fabric Manager Troubleshooting Tools 5-35

Send documentation comments to mdsfeedbac[email protected]

Contents

vii

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

6Device Manager 6-1

About Device Manager 6-1

Launching Device Manager 6-2

Using Device Manager 6-2

Menu Bar 6-3

Toolbar Icons 6-4

Dialog Boxes 6-5

Tabs 6-5

Legend 6-5

Supervisor and Switching Modules 6-7

Context Menus 6-7

Setting Device Manager Preferences 6-8

CHAPTER

7Fabric Manager Web Client 7-1

About Fabric Manager Web Client 7-1

Navigating Fabric Manager Web Client 7-2

Installing Fabric Manager Web Client 7-3

Using Fabric Manager Web Client with SSL 7-5

Launching Fabric Manager Web Client 7-7

Health 7-9

Viewing Summary Information 7-9

Viewing Fabric Information 7-10

Viewing Syslog Information 7-11

Viewing Analysis Reports 7-12

Performance 7-13

Viewing Performance Summary Information 7-14

Performance Detail Summary Report 7-15

7-15

Viewing Performance Information for End Devices 7-16

Viewing Performance Information for ISLs 7-17

Viewing Performance Information for NPV Links 7-21

Viewing Performance Information for Flows 7-22

Viewing Performance Information for Gigabit Ethernet and Ethernet Ports 7-23

Viewing Other Statistics 7-23

Viewing Detailed Traffic Information 7-24

Viewing Predicted Future Performance 7-25

Using the Default Values 7-25

Using Your Own Values 7-26

Send documentation comments to mdsfeedbac[email protected]

Contents

viii

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

Viewing Switch Bandwidth 7-27

Inventory 7-28

Viewing Summary Inventory Information 7-28

Viewing Detailed Summary Inventory Information 7-29

Viewing Detailed Information for VSANs 7-29

Viewing Detailed Information for Switches 7-30

Viewing License Information 7-31

Viewing Detailed Information for Modules 7-32

Viewing Detailed Information for End Devices 7-33

Viewing Detailed Information for ISLs 7-34

Viewing Detailed Information for NPV Links 7-35

Viewing Detailed Information for Zones 7-36

Reports 7-37

Creating a Custom Report Template 7-37

Viewing Custom Reports by Template 7-39

Viewing Custom Reports by Users 7-39

Generating Custom Reports by Template 7-40

Modifying a Custom Report Template 7-41

Deleting Custom Reports 7-42

Viewing Scheduled Jobs by Report Template 7-43

Modifying Scheduled Jobs 7-43

Admin 7-44

Recovering a Web Server Password 7-45

Starting, Restarting, and Stopping Services 7-45

Adding, Editing, and Removing Managed Fabrics 7-46

Viewing Trap and Syslog Registration Information 7-48

Configuring Forwarding of Notifications for Events 7-49

Viewing and Disconnecting Clients 7-50

Configuring Fabric Manager Server Preferences 7-51

Adding and Removing Communities 7-51

Configuring AAA Information 7-53

Adding and Removing Users 7-53

Adding and Removing Roles 7-54

Creating Performance Collections 7-56

Configuring Other Statistics 7-57

Configuring Collection Thresholds 7-59

Importing the RRD Statistics Index 7-60

Configuring the RRD Database 7-60

Viewing Log Information 7-62

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

Downloading Fabric Manager Client 7-62

CHAPTER

8Performance Manager 8-1

Performance Manager Architecture 8-1

Data Interpolation 8-2

Data Collection 8-2

Using Performance Thresholds 8-2

Flow Setup Wizards 8-3

Creating a Flow Using Flow Configuration Wizard 8-3

Flow Statistics Configuration 8-6

About Flow Statistics 8-6

CHAPTER

9Cisco Traffic Analyzer 9-1

Understanding SPAN 9-1

Using Cisco Traffic Analyzer with Performance Manager 9-2

Understanding the PAA-2 9-2

Understanding Cisco Traffic Analyzer 9-3

Installing Cisco Traffic Analyzer 9-3

Accessing Traffic Analyzer from Fabric Manager Web Server 9-5

PART

2Installation and Switch Management

CHAPTER

10 Obtaining and Installing Licenses 10-1

Licensing Terminology 10-1

Licensing Model 10-2

Licensing High Availability 10-8

Options to Install a License 10-8

Obtaining a Factory-Installed License 10-9

Performing a Manual Installation 10-9

Obtaining the License Key File 10-9

Installing the License Key File 10-10

Installing Licenses Using Fabric Manager License Wizard 10-11

Installing or Updating Licenses Using Device Manager 10-12

Identifying License Features in Use 10-13

Uninstalling Licenses 10-14

Updating Licenses 10-14

Grace Period Alerts 10-15

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

License Transfers Between Switches 10-16

Displaying License Information 10-16

Viewing License Information in Fabric Manager 10-16

Viewing License Information in Device Manager 10-16

Viewing Licenses Using Fabric Manager Web Server 10-17

Fabric Manager Server Licensing 10-17

CHAPTER

11 On-Demand Port Activation Licensing 11-1

About On-Demand Port Activation Licensing 11-1

Port-Naming Conventions 11-2

Port Licensing 11-2

License Status Definitions 11-3

Configuring Port Activation Licenses 11-4

Checking the Status of Licenses 11-4

Making a Port Eligible for a License 11-5

Acquiring a License for a Port 11-6

CHAPTER

12 Initial Configuration 12-1

Assigning a Switch Name 12-1

Verifying the Module Status 12-2

Configuring Date, Time, and Time Zone 12-3

NTP Configuration 12-4

About NTP 12-4

NTP Configuration Guidelines 12-5

Configuring NTP 12-6

Editing an NTP Server or Peer Configuration 12-6

Deleting an NTP Server or Peer 12-7

NTP CFS Distribution 12-8

Configuring NTP with CFS 12-8

Committing NTP Configuration Changes 12-9

Discarding NTP Configuration Changes 12-9

Releasing Fabric Session Lock 12-9

Database Merge Guidelines 12-10

Management Interface Configuration 12-10

Default Gateway Configuration 12-10

Telnet Server Connection 12-11

Disabling a Telnet Connection 12-11

Configuring CDP 12-12

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

13 Using the CFS Infrastructure 13-1

About CFS 13-1

Cisco MDS NX-OS Features Using CFS 13-2

CFS Features 13-2

CFS Protocol 13-3

CFS Distribution Scopes 13-3

CFS Distribution Modes 13-4

Uncoordinated Distribution 13-4

Coordinated Distribution 13-4

Unrestricted Uncoordinated Distributions 13-4

Disabling CFS Distribution on a Switch 13-4

CFS Application Requirements 13-5

Enabling CFS for an Application 13-5

Locking the Fabric 13-6

Committing Changes 13-7

Discarding Changes 13-8

Saving the Configuration 13-8

Clearing a Locked Session 13-8

CFS Merge Support 13-9

Displaying CFS Configuration Information 13-9

CFS Distribution over IP 13-10

Configuring Static IP Peers for CFS over IP 13-11

Adding Peers to List 13-12

Removing an NPV Device from the Peer List 13-14

CFS Regions 13-16

About CFS Regions 13-16

Managing CFS Regions Using Fabric Manager 13-17

Creating CFS Regions 13-17

Assigning Features to CFS Regions 13-17

Moving a Feature to a Different Region 13-18

Removing a Feature from a Region 13-19

Deleting CFS Regions 13-19

CFS Example Using Fabric Manager 13-20

CFS Example Using Device Manager 13-23

Default Settings 13-23

Send documentation comments to mdsfeedbac[email protected]

Contents

xii

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

14 Configuring FlexAttach Virtual pWWN 14-1

About FlexAttach Virtual pWWN 14-1

FlexAttach Virtual pWWN Guidelines and Requirements 14-2

Configuring FlexAttach Virtual pWWN 14-2

Enabling FlexAttach Virtual pWWN 14-2

Automatically Enabling FlexAttach Virtual pWWN 14-2

Launching FlexAttach in Fabric Manager 14-3

Manually Enabling FlexAttach Virtual pWWN 14-4

Mapping pWWN to Virtual pWWN 14-6

Debugging FlexAttach Virtual pWWN 14-8

Security Settings for FlexAttach Virtual pWWN 14-8

FlexAttach Virtual pWWN CFS Distribution 14-9

Using the Server Admin FlexAttach Wizards 14-9

Pre-Configuring FlexAttach for a New Server 14-9

Pre-Configuring FlexAttach for All the Ports 14-10

Pre-Configuring FlexAttach for Each Port Individually 14-12

Moving a Server to Another Port or Switch 14-15

Replacing a Server with Another Server 14-18

Replacing a Server on the Same Port 14-19

Replacing the Server to a Different Port on the Same Switch 14-21

Replacing with a Server on a Different Switch 14-22

Difference Between San Device Virtualization and FlexAttach Port Virtualization 14-23

CHAPTER

15 Software Images 15-1

About Software Images 15-1

Dependent Factors for Software Installation 15-1

Selecting the Correct Software Images for Cisco MDS 9100 Series Switches 15-2

Selecting the Correct Software Images for Cisco MDS 9200 Series Switches 15-2

Selecting the Correct Software Images for Cisco MDS 9500 Family Switches 15-2

Essential Upgrade Prerequisites 15-3

Software Upgrade Methods 15-5

Determining Software Compatibility 15-5

Automated Upgrades 15-6

Benefits of Using the Software Install Wizard 15-6

Recognizing Failure Cases 15-7

Using the Software Install Wizard 15-8

Upgrading Services Modules 15-12

Nondisruptive Upgrades on Fabric and Modular Switches 15-13

Send documentation comments to mdsfeedbac[email protected]

Contents

xiii

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

Preparing for a Nondisruptive Upgrade on Fabric and Modular Switches 15-13

Performing a Nondisruptive Upgrade on a Fabric Switch 15-14

Maintaining Supervisor Modules 15-14

Replacing Supervisor Modules 15-15

Migrating from Supervisor-1 Modules to Supervisor-2 Modules 15-15

Standby Supervisor Module Boot Variable Version 15-15

Standby Supervisor Module Bootflash Memory 15-16

Standby Supervisor Module Boot Alert 15-16

Installing Generation 2 Modules in Generation 1 Chassis 15-16

Replacing Modules 15-17

Default Settings 15-17

CHAPTER

16 Managing Configuration Files 16-1

About Flash Devices 16-1

Internal bootflash: 16-2

Formatting Flash Devices and File Systems 16-2

Using the File System 16-2

Flash Files 16-3

Creating a Directory 16-3

Deleting an Existing File or Directory 16-4

Copying Files 16-5

Performing Other File Manipulation Tasks 16-7

Working with Configuration Files 16-7

Downloading Configuration Files to the Switch 16-7

Saving the Configuration 16-8

Saving the Running Configuration 16-8

Saving Startup Configurations in the Fabric 16-9

Backing Up the Current Configuration 16-9

CHAPTER

17 Configuring High Availability 17-1

About High Availability 17-1

Switchover Mechanisms 17-2

HA Switchover Characteristics 17-2

Initiating a Switchover 17-2

Switchover Guidelines 17-3

Process Restartability 17-3

Synchronizing Supervisor Modules 17-3

Send documentation comments to mdsfeedbac[email protected]

Contents

xiv

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

18 Managing System Hardware 18-1

Displaying Switch Hardware Inventory 18-1

Running the CompactFlash Report 18-2

Displaying the Switch Serial Number 18-3

Displaying Power Usage Information 18-3

Power Supply Configuration Modes 18-4

Power Supply Configuration Guidelines 18-5

About Crossbar Management 18-7

Operational Considerations When Removing Crossbars 18-9

Gracefully Shutting Down a Crossbar 18-9

Backward Compatibility for Generation 1 Modules in Cisco MDS 9513 Directors 18-10

About Module Temperature 18-11

Displaying Module Temperature 18-11

About Fan Modules 18-12

Default Settings 18-13

CHAPTER

19 Managing Modules 19-1

About Modules 19-1

Supervisor Modules 19-2

Switching Modules 19-3

Services Modules 19-3

Verifying the Status of a Module 19-3

Obtaining Supervisor Module Statistics 19-4

Checking the State of a Module 19-4

Reloading Modules 19-5

Reloading a Switch 19-6

Power Cycling Modules 19-6

Preserving the Module Configuration 19-7

Powering Off Switching Modules 19-8

Identifying Module LEDs 19-9

Managing SSMs and Supervisor Modules 19-13

Considerations for Replacing SSMs and Supervisor Modules 19-13

Default Settings 19-13

PART

3Switch Configuration

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

20 Configuring Interfaces 20-1

Common Interface Configuration 20-1

Fibre Channel Interfaces 20-2

Generation 1 Interfaces Configuration Guidelines 20-2

About Interface Modes 20-3

E Port 20-4

F Port 20-5

FL Port 20-5

NP Ports 20-5

TL Port 20-5

TE Port 20-6

TF Port 20-6

TNP Port 20-6

SD Port 20-6

ST Port 20-6

Fx Port 20-7

B Port 20-7

Auto Mode 20-7

About Interface States 20-7

Administrative States 20-7

Operational States 20-8

Reason Codes 20-8

Graceful Shutdown 20-11

Setting the Interface Administrative State 20-11

Configuring Interface Modes 20-12

Configuring Administrative Speeds 20-12

Autosensing 20-13

Specifying a Port Owner 20-13

Configuring Port Guard 20-16

About Interface Descriptions 20-18

About Frame Encapsulation 20-18

About Receive Data Field Size 20-19

Configuring Receive Data Field Size 20-19

Identifying the Beacon LEDs 20-19

About Speed LEDs 20-20

About Beacon Mode 20-20

Configuring Beacon Mode 20-20

About Bit Error Thresholds 20-21

Switch Port Attribute Default Values 20-21

Send documentation comments to mdsfeedbac[email protected]

Contents

xvi

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

About SFP Transmitter Types 20-22

Displaying SFP Transmitter Types 20-22

About Gathering Interface Statistics 20-22

Gathering Interface Statistics 20-23

TL Ports for Private Loops 20-23

About TL Ports 20-24

Configuring TL Ports 20-25

About TL Port ALPA Caches 20-25

Buffer Credits 20-26

About Buffer-to-Buffer Credits 20-26

Configuring Buffer-to-Buffer Credits 20-26

About Performance Buffers 20-27

Configuring Performance Buffers 20-27

About Extended BB_credits 20-28

Extended BB_credits on Generation 1 Switching Modules 20-28

Extended BB_credits on Generation 2 and Generation 3 Switching Modules 20-29

Configuring Extended BB_credits 20-29

Management Interfaces 20-29

About Management Interfaces 20-30

Configuring Management Interfaces 20-30

VSAN Interfaces 20-30

About VSAN Interfaces 20-31

Creating VSAN Interfaces 20-31

Default Settings 20-32

CHAPTER

21 Configuring N Port Virtualization 21-1

About NPV 21-1

NPV Mode 21-3

NP Ports 21-3

NP Links 21-3

Internal FLOGI Parameters 21-3

Default Port Numbers 21-5

NPV CFS Distribution over IP 21-5

NPV Traffic Management 21-5

Auto 21-5

Traffic Map 21-5

Disruptive 21-6

Multiple VSAN Support 21-6

NPV Guidelines and Requirements 21-6

Send documentation comments to mdsfeedbac[email protected]

Contents

xvii

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

NPV Traffic Management Guidelines 21-7

Configuring NPV 21-7

Configuring NPV Traffic Management 21-9

Configuring List of External Interfaces per Server Interface 21-9

Enabling or Disabling the Global Policy for Disruptive Load Balancing 21-11

Using the NPV Setup Wizard 21-12

DPVM Configuration 21-31

NPV and Port Security 21-31

CHAPTER

22 Configuring Generation 2 and Generation 3 Switching Modules 22-1

About Generations of Modules and Switches 22-1

Port Groups and Port Rate Modes 22-3

Port Groups 22-3

Port Rate Modes 22-4

Dedicated Rate Mode 22-6

Shared Rate Mode 22-7

Dedicated Rate Mode Configurations for the 8-Gbps Modules 22-7

Reserving Bandwidth Quickly for the 8-Gbps Modules 22-8

Dynamic Bandwidth Management 22-9

Out-of-Service Interfaces 22-10

Buffer Credit Allocation 22-10

Buffer Pools 22-10

BB_Credit Buffers for Switching Modules 22-13

48-Port 8-Gbps Fibre Channel Module BB_Credit Buffers 22-14

24-Port 8-Gbps Fibre Channel Module BB_Credit Buffers 22-15

4/44-Port 8-Gbps Host-Optimized Fibre Channel Module BB_Credit Buffers 22-16

48-Port 4-Gbps Fibre Channel Module BB_Credit Buffers 22-17

24-Port 4-Gbps Fibre Channel Module BB_Credit Buffers 22-18

18-Port Fibre Channel/4-Port Gigabit Ethernet Multiservice Module BB_Credit Buffers 22-19

12-Port 4-Gbps Switching Module BB_Credit Buffers 22-20

4-Port 10-Gbps Switching Module BB_Credit Buffers 22-21

BB_Credit Buffers for Fabric Switches 22-22

Cisco MDS 9134 Fabric Switch BB_Credit Buffers 22-22

Cisco MDS 9124 Fabric Switch BB_Credit Buffers 22-23

Cisco MDS 9222i Multiservice Modular Switch BB_Credit Buffers 22-23

Extended BB_Credits 22-23

Combining Generation 1, Generation 2, and Generation 3 Modules 22-24

Port Indexes 22-24

PortChannels 22-26

Send documentation comments to mdsfeedbac[email protected]

Contents

xviii

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

Configuring Module Interface Shared Resources 22-28

Configuration Guidelines for 48-Port, 24-Port, and 4/44-Port 8-Gbps Fibre Channel Switching

Modules 22-28

Migrating from Shared Mode to Dedicated Mode 22-29

Migrating from Dedicated Mode to Shared Mode 22-29

Configuration Guidelines for 48-Port and 24-Port 4-Gbps Fibre Channel Switching Modules 22-30

Migrating from Shared Mode to Dedicated Mode 22-30

Migrating from Dedicated Mode to Shared Mode 22-30

Configuration Guidelines for 12-Port 4-Gbps Switching Module Interfaces 22-31

Configuration Guidelines for 4-Port 10-Gbps Switching Module Interfaces 22-31

Configuring Port Speed 22-32

Configuring Rate Mode 22-33

Configuring Oversubscription Ratio Restrictions 22-34

Disabling Restrictions on Oversubscription Ratios 22-35

Enabling Restrictions on Oversubscription Ratios 22-37

Configuring Bandwidth Fairness 22-37

Enabling Bandwidth Fairness 22-38

Disabling Bandwidth Fairness 22-39

Upgrade or Downgrade Scenario 22-40

Taking Interfaces Out of Service 22-40

Releasing Shared Resources in a Port Group 22-41

Displaying SFP Diagnostic Information 22-41

Default Settings 22-43

CHAPTER

23 Configuring PortChannels 23-1

About PortChannels 23-1

About E PortChannels 23-2

About F and TF PortChannels 23-3

About PortChanneling and Trunking 23-3

About Load Balancing 23-4

About PortChannel Modes 23-6

Configuration Guidelines and Restrictions 23-7

Generation 1 PortChannel Restrictions 23-7

F and TF PortChannel Restrictions 23-8

PortChannel Configuration 23-9

About PortChannel Configuration 23-10

Configuring PortChannels Using the Wizard 23-11

Configuring the PortChannel Mode 23-16

About PortChannel Deletion 23-16

Send documentation comments to mdsfeedbac[email protected]

Contents

xix

Cisco MDS 9000 Family Fabric Manager Configuration Guide

OL-17256-03, Cisco MDS NX-OS Release 4.x

Deleting PortChannels 23-16

Interfaces in a PortChannel 23-17

About Interface Addition to a PortChannel 23-17

Compatibility Check 23-17

Suspended and Isolated States 23-18

Adding an Interface to a PortChannel 23-18

Forcing an Interface Addition 23-19

About Interface Deletion from a PortChannel 23-20

Deleting an Interface from a PortChannel 23-20

PortChannel Protocols 23-20

About Channel Group Creation 23-21

About Autocreation 23-22

Enabling and Configuring Autocreation 23-23

About Manually Configured Channel Groups 23-23

Converting to Manually Configured Channel Groups 23-23

Verifying the PortChannel Configuration 23-24

Default Settings 23-25

CHAPTER

24 Configuring Trunking 24-1

About Trunking 24-1

Trunking E Ports 24-2

Trunking F Ports 24-2

Key Concepts 24-3

Trunking Guidelines and Restrictions 24-3

Trunking Misconfiguration Examples 24-4

Upgrade and Downgrade Restrictions 24-5

Difference Between TE Ports and TF-TNP Ports 24-5

Enabling the Trunking Protocols 24-6

About Trunking Protocols 24-6

Enabling the F Port Trunking and Channeling Protocol 24-7

Configuring Trunk Mode and VSAN List 24-7

About Trunk Modes 24-7

Configuring Trunk Mode 24-8

About Trunk-Allowed VSAN Lists and VF_IDs 24-9

Configuring an Allowed-Active List of VSANs 24-11

Default Settings 24-11

Send documentation comments to mdsfeedbac[email protected]

Contents

Cisco MDS 9000 Family Fabric Manager Configuration Guide OL-17256-03, Cisco MDS NX-OS Release 4.x

CHAPTER

25 Configuring Domain Parameters 25-1

Fibre Channel Domains 25-2

About Domain Restart 25-3

Restarting a Domain 25-3

About Switch Priority 25-5

Configuring Switch Priority 25-5

About fcdomain Initiation 25-5

Enabling or Disabling fcdomains 25-6

Setting Fabric Names 25-6

About Incoming RCFs 25-6

Rejecting Incoming RCFs 25-7

About Autoreconfiguring Merged Fabrics 25-7

Enabling Autoreconfiguration 25-8

Domain IDs 25-8

About Domain IDs 25-8

Specifying Static or Preferred Domain IDs 25-10

About Allowed Domain ID Lists 25-11

Configuring Allowed Domain ID Lists 25-11

About CFS Distribution of Allowed Domain ID Lists 25-12

Enabling Distribution 25-12

Locking the Fabric 25-13

Committing Changes 25-13

Discarding Changes 25-13

Clearing a Fabric Lock 25-14

Displaying Pending Changes 25-14

Displaying Session Status 25-15

About Contiguous Domain ID Assignments 25-15

Enabling Contiguous Domain ID Assignments 25-15

FC IDs 25-16

About Persistent FC IDs 25-17

Enabling the Persistent FC ID Feature 25-17

About Persistent FC ID Configuration 25-17

Configuring Persistent FC IDs 25-18

About Unique Area FC IDs for HBAs 25-19

Configuring Unique Area FC IDs for an HBA 25-19

About Persistent FC ID Selective Purging 25-21

Purging Persistent FC IDs 25-21

Displaying fcdomain Statistics 25-22

Default Settings 25-22

Page is loading ...

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
1438
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
1474
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490

Cisco Fabric Manager Configuration Guide

Brand: Cisco

Model: Fabric Manager

Category: Software

Type: Configuration Guide

This manual is also suitable for

Fabric Manager Release 4.1

Download PDF

report

Cisco Fabric Manager Configuration Guide

This manual is also suitable for

Cisco Fabric Manager Configuration Guide

Related papers

Other documents