Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

Americas Headquarters

Cisco Systems, Inc.

170 West Tasman Drive

San Jose, CA 95134-1706

USA

http://www.cisco.com

Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 527-0883

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS,

INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,

EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH

THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY,

CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB's public domain version of

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS" WITH ALL FAULTS.

CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF

MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT

LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS

HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network

topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional

and coincidental.

All printed copies and duplicate soft copies of this document are considered uncontrolled. See the current online version for the latest version.

Cisco has more than 200 offices worldwide. Addresses and phone numbers are listed on the Cisco website at www.cisco.com/go/offices.

Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL:

https://www.cisco.com/c/en/us/about/legal/trademarks.html. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a

partnership relationship between Cisco and any other company. (1721R)

CONTENTS

Full Cisco Trademarks with Software License ?

Preface xix

PREFACE

Audience xix

Document Conventions xix

Related Documentation xx

Communications, Services, and Additional Information xx

New and Changed Information 1

CHAPTER 1

Change Summary 1

Fabric Overview 3

CHAPTER 2

Virtual SANs 3

Dynamic Port VSAN Membership 4

SAN Device Virtualization 4

Zoning 4

Distributed Device Alias Services 5

Fibre Channel Routing Services and Protocols 5

Multiprotocol Support 5

Configuring and Managing VSANs 7

CHAPTER 3

About VSANs 7

VSANs Topologies 8

VSAN Advantages 10

VSANs Versus Zones 10

VSAN Configuration 11

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

iii

Reserved VSAN Range and Isolated VSAN Range Guidelines 12

VSAN Creation 12

Creating VSANs Statically 12

Creating VSANs 12

Port VSAN Membership 13

Assigning Static Port VSAN Membership 13

Displaying VSAN Static Membership 14

Default VSAN 15

Isolated VSAN 15

Displaying Isolated VSAN Membership 16

Operational State of a VSAN 16

Static VSAN Deletion 16

Deleting Static VSANs 17

Load Balancing 17

Configuring Load Balancing 17

Interop Mode 18

FICON VSANs 18

Displaying Static VSAN Configuration 18

Default Settings 19

Displaying Fabric Switch Information 19

Creating Dynamic VSANs 21

CHAPTER 4

About DPVM 21

About DPVM Configuration 22

Enabling DPVM 22

DPVM Device Configuration (Static) 23

Configuring DPVM 23

Activating DPVM 24

DPVM Autolearn 25

Enabling Autolearn 25

Clearing Learned Entries 26

Disabling Autolearn 26

DPVM Distribution 26

About DPVM Distribution 27

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

iv

Contents

Disabling DPVM Distribution 27

About Locking the Fabric 27

Locking the Fabric 27

Committing Changes 28

Discarding Changes 28

Clearing a Locked Session 29

DPVM Configuration Merge Guidelines 29

About Copying DPVM DPVM Configurations 29

Copying DPVM Active Configuration 30

Comparing Database Differences 30

Displaying DPVM Merge Status and Statistics 30

Displaying DPVM Configurations 31

Sample DPVM Configuration 32

Default Settings 35

Configuring and Managing Zones 37

CHAPTER 5

Finding Feature Information 37

Feature History for Configuring and Managing Zones 38

About Zoning 38

Zoning Example 40

Zone Implementation 41

Zone Member Configuration Guidelines 41

Active and Full Zoneset Considerations 41

Using the Quick Config Wizard 42

Autozone 45

Guidelines and Limitations for Autozone 46

Configuring Autozone in Automatic Mode 47

Enabling Autozone in Automatic Mode 47

Enabling Autosave 47

Executing Autozone in Manual mode 48

Enabling Autozone in Automatic Mode by a Remotely Authenticated (AAA) User 48

Disabling Autosave 48

Disabling Autozone Automatic Mode 48

Displaying All the Zone Configurations 49

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

v

Contents

Displaying Pending Zone Configurations 49

Applying Pending Zone Configurations (Manual Mode) 49

Deleting Zones and Zoneset Created by Autozone 49

Example: Configuring Autozone 49

Verifying Autozone Configuration 51

Autozone Example Scenario 52

Zone Configuration 55

About the Edit Local Full Zone Database Tool 55

Configuring a Zone 56

Configuring a Zone Using the Zone Configuration Tool 59

Adding Zone Members 61

Filtering End Devices Based on Name, WWN or FC ID 63

Adding Multiple End Devices to Multiple Zones 63

Zone Sets and FC Aliases 63

ZoneSet Creation 64

Activating a Zoneset 64

Activating a Zoneset Using DCNM SAN Client 65

Deactivating a Zoneset 66

Displaying Zone Membership Information 67

Overwrite Control for an Active Zoneset 67

Default Zone 68

Configuring the Default Zone Access Permission 69

Configuring the Default Zone Access Permission Using DCNM SAN Client 70

About FC Alias Creation 70

Creating FC Aliases 71

Creating FC Aliases Using DCNM SAN Client 72

Adding Members to Aliases 73

Converting Zone Members to pWWN-Based Members 75

Creating Zone Sets and Adding Member Zones 75

Filtering Zones, Zone Sets, and Device Aliases Based on Name 77

Adding Multiple Zones to Multiple Zone Sets 77

Zone Enforcement 77

ZoneSet Distribution 78

Enabling Full Zoneset Distribution 78

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

vi

Contents

Enabling Full Zoneset Distribution Using DCNM SAN Client 79

Enabling a One-Time Distribution 79

Enabling a One-Time Distribution Using DCNM SAN Client 80

About Recovering from Link Isolation 80

Importing and Exporting Zone Sets 81

Importing and Exporting Zone Sets Using DCNM SAN Client 81

Zoneset Duplication 82

Copying Zone Sets 83

Copying Zone Sets Using DCNM SAN Client 83

About Backing Up and Restoring Zones 84

Backing Up Zones Using DCNM SAN Client 84

Restoring Zones 85

Renaming Zones, Zone Sets, and Aliases 87

Renaming Zones, Zone Sets, and Aliases Using DCNM SAN Client 87

Cloning Zones, Zone Sets, FC Aliases, and Zone Attribute Groups 88

Cloning Zones, Zone Sets, FC Aliases, and Zone Attribute Groups Using DCNM SAN Client 89

Migrating a Non-MDS Database 89

Clearing the Zone Server Database 90

Advanced Zone Attributes 90

About Zone-Based Traffic Priority 90

Configuring Zone-Based Traffic Priority 91

Configuring Zone-Based Traffic Priority Using DCNM SAN Client 92

Configuring Default Zone QoS Priority Attributes 92

Configuring Default Zone QoS Priority Attributes Using DCNM SAN Client 93

Configuring the Default Zone Policy 94

About Smart Zoning 94

Smart Zoning Member Configuration 95

Enabling Smart Zoning on a VSAN 95

Setting Default Value for Smart Zoning 96

Converting Zones Automatically to Smart Zoning 96

Configuring Device Types for Zone Members 97

Removing Smart Zoning Configuration 98

Disabling Smart Zoning at Zone Level in the Basic Zoning Mode 98

Disabling Smart Zoning at Zone Level for a VSAN in the Enhanced Zoning Mode 98

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

vii

Contents

Disabling Smart Zoning at Zone Level Using DCNM SAN Client 99

Displaying Zone Information 100

Enhanced Zoning 108

About Enhanced Zoning 108

Changing from Basic Zoning to Enhanced Zoning 109

Changing from Enhanced Zoning to Basic Zoning 109

Enabling Enhanced Zoning 109

Enabling Enhanced Zoning Using DCNM SAN Client 110

Modifying the Zone Database 110

Enabling Automatic Zone Pending Diff Display 111

Releasing Zone Database Locks 111

Creating Attribute Groups 112

Merging the Database 112

Merge Process 113

Analyzing a Zone Merge 122

Configuring Zone Merge Control Policies 123

Preventing Zones From Flooding FC2 Buffers 124

Permitting or Denying Traffic in the Default Zone 124

Broadcasting a Zone 124

Configuring System Default Zoning Settings 125

Configuring Zone Generic Service Permission Settings 126

Displaying Enhanced Zone Information 126

Controlling Zoning Configuration Sessions 128

Configuring Zoning Session Limit 129

Compacting the Zone Database for Downgrading 129

Zone and ZoneSet Analysis 130

Zoning Best Practice 133

TCAM Regions 133

Zoning Types 134

Forwarding Engines 137

F, TF, NP, and TNP Port Channels 141

E and TE Port Channels and IVR 142

Enhancing Zone Server Performance 145

Zone Server-Fibre Channel Name Server Shared Database 145

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

viii

Contents

Enabling the Zone Server-FCNS Shared Database 145

Disabling Zone Server-FCNS shared database 145

Zone Server SNMP Optimization 146

Enabling Zone Server SNMP Optimization 146

Disabling Zone Server SNMP Optimization 147

Zone Server Delta Distribution 147

Enabling Zone Server Delta Distribution 147

Disabling Zone Server Delta Distribution 148

Default Settings 148

Distributing Device Alias Services 151

CHAPTER 6

Understanding Device Aliases 151

Device Alias Modes 151

Guidelines and Limitations 152

Changing Mode Settings 153

Device Alias Mode Distribution 153

Device Alias Diffs-Only Distribution 153

Configuring Device Alias Diffs-Only Distribution 153

Merging Device Alias with the Diffs-Only Distribution Feature Enabled 155

Merging Device Alias in Different Modes 155

Resolving Merge Failure and Device Alias Mode Mismatch 156

Device Alias Features 156

Device Alias Requirements 156

Zone Aliases Versus Device Aliases 157

Device Alias Databases 158

Creating Device Aliases 158

About Device Alias Distribution 158

About Creating a Device Alias 159

About Device Alias Configuration Best Practices 159

Committing Changes 160

Enabling the Device Alias Pending Diff Display 161

Discarding Changes 161

Fabric Lock Override 162

Clearing Database Content 162

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

ix

Contents

Clearing Statistics 163

Disabling and Enabling Device Alias Distribution 163

About Legacy Zone Alias Configuration Conversion 164

Importing a Zone Alias 164

Device Alias Statistics Cleanup 165

Database Merge Guidelines 165

Device Alias Configuration Verification 165

Default Settings 168

Resolving Device Alias Merge Failures 168

Device Alias Best Practices 168

Resolving Device Alias Mismatches 170

Resolving Merge Failures 171

Resolving Duplicate Device Alias Names (Same Device Alias Name, Different pWWNs) 171

Resolving Duplicate pWWNs (Different Device Alias Names, Same pWWN) 173

Resolving Mode Mismatch 175

Resolving a Validation Failure 176

Resolving Database Conflicts 178

Verifying the Device-Alias Database Status 179

Configuring Fibre Channel Routing Services and Protocols 181

CHAPTER 7

About FSPF 181

FSPF Examples 182

Fault Tolerant Fabric 182

Redundant Links 182

Failover Scenarios for PortChannels and FSPF Links 183

FSPF Global Configuration 184

About SPF Computational Hold Times 184

About Link State Record Defaults 184

Configuring FSPF on a VSAN 185

Resetting FSPF to the Default Configuration 185

Enabling or Disabling FSPF 185

Clearing FSPF Counters for the VSAN 186

FSPF Interface Configuration 186

About FSPF Link Cost 186

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

x

Contents

Configuring FSPF Link Cost 186

About Hello Time Intervals 187

Configuring Hello Time Intervals 187

About Dead Time Intervals 187

Configuring Dead Time Intervals 188

About Retransmitting Intervals 188

Configuring Retransmitting Intervals 188

About Disabling FSPF for Specific Interfaces 189

Disabling FSPF for Specific Interfaces 189

Clearing FSPF Counters for an Interface 190

FSPF Routes 190

About Fibre Channel Routes 190

About Broadcast and Multicast Routing 190

About Multicast Root Switch 191

Setting the Multicast Root Switch 191

Load Balancing 192

Load Balancing Schemes 192

Hashing Methods 193

In-Order Delivery 196

About Reordering Network Frames 196

About Reordering PortChannel Frames 197

About Enabling In-Order Delivery 197

Enabling In-Order Delivery Globally 198

Enabling In-Order Delivery for a VSAN 198

Displaying the In-Order Delivery Status 199

Configuring the Drop Latency Time 199

Displaying Latency Information 200

Flow Statistics Configuration 200

About Flow Statistics 200

Counting Aggregated Flow Statistics 201

Counting Individual Flow Statistics 201

Clearing FIB Statistics 201

Displaying Flow Statistics 202

Displaying Global FSPF Information 202

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xi

Contents

Displaying the FSPF Database 203

Displaying FSPF Interfaces 204

Default Settings 205

Managing FLOGI, Name Server, FDMI, and RSCN Databases 207

CHAPTER 8

About FLOGI 207

FLOGI Scale Optimization 207

FLOGI Quiesce Timeout 208

Restrictions 208

Enabling FLOGI Scale Optimization and Quiesce Timeout 208

Disabling FLOGI Scale Optimization and Quiesce Timeout 209

Displaying FLOGI Details 210

Name Server 211

Bulk Notification Sent from the Name Server 211

Enabling Name Server Bulk Notification 212

Disabling Name Server Bulk Notification 212

Disabling Name Server Bulk Notification for NX-OS Release 6.2(9) 213

Re-enabling Name Server Bulk Notification 213

Name Server Proxy Registration 213

Registering Name Server Proxies 213

About Rejecting Duplicate pWWN 214

Rejecting Duplicate pWWNs 214

Name Server Database Entries 214

Optimizing Name Server Database Sync 215

Verifying the Number of Name Server Database Entries 215

Displaying Name Server Database Entries 215

FDMI 217

Displaying FDMI 217

VMID 219

Guidelines and Limitations for VMID 221

Configuring the VMID Server 222

Enabling the VMID Server 222

Disabling the VMID Server 222

Configuring a VMID Range 222

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xii

Contents

Examples: Configuring the VMID Server 223

Verifying a VMID Configuration 223

RSCN 226

About RSCN Information 227

Displaying RSCN Information 227

multi-pid Option 228

Configuring the multi-pid Option 228

Suppressing Domain Format SW-RSCNs 229

Coalesced SW-RSCN 229

Enabling Coalesced SW-RSCNs 229

Disabling Coalesced SW-RSCNs 230

Clearing RSCN Statistics 230

RSCN Timer Configuration Distribution Using CFS 231

Configuring the RSCN Timer 231

Verifying the RSCN Timer Configuration 232

RSCN Timer Configuration Distribution 232

Enabling RSCN Timer Configuration Distribution 233

Locking the Fabric 234

Committing the RSCN Timer Configuration Changes 234

Discarding the RSCN Timer Configuration Changes 234

Clearing a Locked Session 234

Displaying RSCN Configuration Distribution Information 235

Default Settings 236

Enabling Port Pacing 236

Discovering SCSI Targets 237

CHAPTER 9

About SCSI LUN Discovery 237

About Starting SCSI LUN Discovery 237

Starting SCSI LUN Discovery 237

About Initiating Customized Discovery 238

Initiating Customized Discovery 238

Displaying SCSI LUN Information 239

Configuring FICON 243

CHAPTER 10

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xiii

Contents

About FICON 243

FICON Requirements 244

MDS-Specific FICON Advantages 245

Fabric Optimization with VSANs 245

FCIP Support 246

PortChannel Support 246

VSANs for FICON and FCP Mixing 246

Cisco MDS-Supported FICON Features 247

FICON Cascading 249

FICON VSAN Prerequisites 249

FICON Port Numbering 249

Default FICON Port Numbering Scheme 250

Port Addresses 253

Implemented and Unimplemented Port Addresses 253

About the Reserved FICON Port Numbering Scheme 253

Installed and Uninstalled Ports 254

FICON Port Numbering Guidelines 254

Assigning FICON Port Numbers to Slots 254

Displaying the FICON Port Number Assignments 255

About Port Numbers for FCIP and PortChannel 255

Reserving FICON Port Numbers for FCIP and PortChannel Interfaces 256

FC ID Allocation 256

Configuring FICON 257

About Enabling FICON on a VSAN 257

Enabling FICON on the Switch 258

Setting Up a Basic FICON Configuration 258

Manually Enabling FICON on a VSAN 261

Configuring the code-page Option 262

Allowing the Host to Move the Switch Offline 263

Allowing the Host to Change FICON Port Parameters 263

Allowing the Host to Control the Timestamp 264

Clearing the Time Stamp 265

Configuring SNMP Control of FICON Parameters 265

About FICON Device Allegiance 265

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xiv

Contents

Clearing FICON Device Allegiance 265

Automatically Saving the Running Configuration 266

Configuring FICON Ports 267

Binding Port Numbers to PortChannels 267

Binding Port Numbers to FCIP Interfaces 268

Configuring Port Blocking 268

Port Prohibiting 269

Configuring the Default State for Port Prohibiting 270

Configuring Port Prohibiting 270

Assigning a Port Address Name 271

About RLIR 271

Specifying an RLIR Preferred Host 272

Displaying RLIR Information 273

Clearing RLIR Information 276

FICON Configuration Files 277

About FICON Configuration Files 277

Applying the Saved Configuration Files to the Running Configuration 278

Editing FICON Configuration Files 278

Displaying FICON Configuration Files 279

Copying FICON Configuration Files 280

Port Swapping 280

About Port Swapping 281

Swapping Ports 282

Swapping Ports on the Switch with Duplicate Port Numbers 282

FICON Tape Acceleration 282

Configuring FICON Tape Acceleration 284

Configuring FICON Tape Read Acceleration 285

Configuring XRC Acceleration 286

Moving a FICON VSAN to an Offline State 286

CUP In-Band Management 287

Placing CUPs in a Zone 287

Displaying Control Unit Information 288

Displaying FICON Information 288

Receiving FICON Alerts 288

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xv

Contents

Displaying FICON Port Address Information 289

Displaying FICON Configuration File Information 290

Displaying the Configured FICON State 292

Displaying a Port Administrative State 292

Displaying Buffer Information 293

Viewing the History Buffer 293

Displaying FICON Information in the Running Configuration 294

Displaying FICON Information in the Startup Configuration 294

Displaying FICON-Related Log Information 295

Default Settings 296

Advanced Features and Concepts 297

CHAPTER 11

Common Information Model 297

Fibre Channel Time-Out Values 297

Timer Configuration Across All VSANs 298

Timer Configuration Per-VSAN 298

About fctimer Distribution 299

Enabling fctimer Distribution 299

Committing fctimer Changes 300

Discarding fctimer Changes 300

Fabric Lock Override 301

Database Merge Guidelines 301

Displaying Configured fctimer Values 301

Organizationally Unique Identifiers 302

Guidelines and Limitations 302

Adding and Deleting OUIs 302

Configuration Examples for Adding and Deleting OUIs 303

Example: Adding and Deleting OUIs 303

Example: Displaying OUIs 303

World Wide Names 303

Displaying WWN Information 303

Link Initialization WWN Usage 304

Configuring a Secondary MAC Address 304

FC ID Allocation for HBAs 305

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xvi

Contents

Default Company ID List 305

Verifying the Company ID Configuration 307

Switch Interoperability 307

About Interop Mode 308

Configuring Interop Mode 1 309

Configuring Interop Mode 1 311

Default Settings 314

Configuring Fibre Channel Common Transport Management Security 317

CHAPTER 12

About Fibre Channel Common Transport 317

Configuration Guidelines 317

Configuring the Fibre Channel Common Transport Query 318

Verifying Fibre Channel Common Transport Management Security 318

Default Settings 319

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xvii

Contents

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xviii

Contents

Preface

This preface describes the audience, organization of, and conventions used in the Cisco MDS 9000 Series

Configuration Guides. It also provides information on how to obtain related documentation, and contains the

following chapters:

•Audience, on page xix

•Document Conventions, on page xix

•Related Documentation, on page xx

•Communications, Services, and Additional Information, on page xx

Audience

To use this installation guide, you need to be familiar with electronic circuitry and wiring practices, and

preferably be an electronic or electromechanical technician.

Document Conventions

This document uses the following conventions:

Means reader take note. Notes contain helpful suggestions or references to material not covered in the manual.

Note

Means reader be careful. In this situation, you might do something that could result in equipment damage or

loss of data.

Caution

Warnings use the following conventions:

This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work

on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard

practices for preventing accidents. Use the statement number provided at the end of each warning to locate

its translation in the translated safety warnings that accompanied this device. Statement 1071.

Warning

Cisco MDS 9000 Series Fabric Configuration Guide, Release 9.x

xix

Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

This manual is also suitable for

Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

Related papers

Other documents