Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

Cisco MDS 9000 Series System Management Configuration Guide,

Release 8.x

First Published: 2017-05-05

Last Modified: 2020-09-30

Americas Headquarters

Cisco Systems, Inc.

170 West Tasman Drive

San Jose, CA 95134-1706

USA

http://www.cisco.com

Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 527-0883

CONTENTS

Preface xxi

PREFACE

Audience xxi

Document Conventions xxi

Related Documentation xxii

Communications, Services, and Additional Information xxii

New and Changed Information 1

CHAPTER 1

Change Summary 1

Change Summary 4

System Management Overview 5

CHAPTER 2

Cisco Fabric Services 5

System Messages 5

Call Home 6

Scheduler 6

System Processes and Logs 6

Embedded Event Manager 6

SNMP 7

RMON 7

Pathtrace 7

Domain Parameters 7

SPAN 7

Fabric Configuration Server 8

Uniform Timestamps 8

Configuring Uniform Timestamps 8

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

iii

Using the CFS Infrastructure 9

CHAPTER 3

Information About CFS 9

Cisco MDS NX-OS Features Using CFS 9

CFS Features 10

Enabling CFS for an Application 10

CFS Protocol 11

CFS Distribution Scopes 11

CFS Distribution Modes 11

Uncoordinated Distribution 11

Coordinated Distribution 11

Unrestricted Uncoordinated Distributions 12

CFS Connectivity in a Mixed Fabric 12

Locking the Fabric 12

Committing Changes 13

CFS Merge Support 13

CFS Distribution over IP 13

Static IP Peers for CFS 15

About CFS Regions 15

Guidelines and Limitations 16

Default Settings 16

Configuring CFS 17

Disabling CFS Distribution on a Switch 17

Committing Changes 18

Discarding Changes 18

Saving the Configuration 18

Clearing a Locked Session 18

Enabling CFS over IP 19

Enabling or Disabling CFS over IPv4 19

Enabling or Disabling CFS Over IPv6 19

Configuring IP Multicast Address for CFS over IP 19

Configuring IP Multicast Address for CFS over IPv4 20

Configuring IP Multicast Address for CFS over IPv6 20

Configuring Static IP Peers for CFS 21

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

iv

Contents

Configuring CFS Regions 22

Creating CFS Regions 22

Assigning Applications to CFS Regions 22

Moving an Application to a Different CFS Region 23

Removing an Application from a Region 23

Deleting CFS Regions 24

Verifying CFS Configurations 24

Verifying CFS Distribution Status 25

Verifying Application Registration Status 25

Verifying CFS Lock Status 26

Verifying the CFS over IP Configuration 26

Verifying IP Multicast Address Configuration for CFS over IP 27

Verifying Static IP Peer Configuration 27

Verifying CFS Regions 27

Additional References 28

Configuring System Message Logging 29

CHAPTER 4

Information About System Message Logging 29

System Message Logging 32

SFP Diagnostics 32

Outgoing System Message Logging Server Facilities 32

System Message Logging Configuration Distribution 33

Fabric Lock Override 34

Guidelines and Limitations 34

Default Settings 34

Configuring System Message Logging 35

Task Flow for Configuring System Message Logging 35

Enabling or Disabling Message Logging 35

Configuring Console Severity Level 36

Configuring Monitor Severity Level 36

Configuring Module Logging 37

Configuring Facility Severity Levels 37

Sending Log Files 38

Configuring System Message Logging Servers 39

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

v

Contents

Configuring System Message Logging Server IPv4 Addresses 39

Configuring System Message Logging Server IPv6 Addresses 40

Configuring System Message Logging Distribution 40

Committing Changes 41

Discarding Changes 41

Fabric Lock Override 41

Displaying System Message Logging Information 41

Additional References 47

Configuring Call Home 49

CHAPTER 5

Information About Call Home 49

Call Home Features 50

About Smart Call Home 51

Obtaining Smart Call Home 52

Call Home Destination Profiles 52

Call Home Alert Groups 52

Customized Alert Group Messages 53

Call Home Message Level Feature 53

Syslog-Based Alerts 53

RMON-Based Alerts 54

General EMail Options Using HTTPS Support 54

Multiple SMTP Server Support 54

Periodic Inventory Notification 55

Duplicate Message Throttle 55

Call Home Configuration Distribution 55

Fabric Lock Override 55

Clearing Call Home Name Server Database 56

EMC Email Home Delayed Traps 56

Event Triggers 56

Call Home Message Levels 58

Message Contents 60

Guidelines and Limitations 68

Call Home Database Merger Guidelines 68

Call Home Configuration Guidelines 69

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

vi

Contents

Default Settings 69

Configuring Call Home 70

Task Flow for Configuring Call Home 70

Configuring Contact Information 70

Configuring Contact Information Using DCNM-SAN 71

Enabling Call Home Function 72

Enabling Call Home Function Using DCNM-SAN 73

Configuring a Destination Profile 73

Configuring a Predefined Destination Profile Using DCNM-SAN 75

Configuring a New Destination Profile 75

Configuring a New Destination Profile Using DCNM-SAN 76

Associating an Alert Group with a Destination Profile 76

Associating Alert Group Using DCNM-SAN 78

Customizing Alert Group Messages 78

Configuring Scripts for Call Home Alerts 79

Examples for Configuring Scripts for Call Home Alerts 80

Customizing Alert Group Messages Using DCNM-SAN 80

Setting the Call Home Message Levels 81

Configuring the Syslog-Based Alerts 81

Configuring the Syslog-Based Alerts Using DCNM-SAN 82

Configuring RMON Alerts 83

Configuring RMON Alerts Using DCNM-SAN 83

Configuring Event Trap Notifications 83

Configuring General EMail Options 84

Configuring General EMail Options Using DCNM-SAN 85

Configuring HTTPS Support 85

Enable or Disable Transport Method 86

Configuring an HTTP Proxy Server 86

Configuring an HTTP Proxy Server Using DCNM-SAN 87

Configuring Call Home Wizard 88

Task Flow for Configuring Call Home Wizard 88

Launching Call Home Wizard 88

Configuring SMTP Server and Ports 89

Configuring Multiple SMTP Server Support 89

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

vii

Contents

Enabling Periodic Inventory Notifications 91

Enabling Periodic Inventory Notifications Using DCNM-SAN 91

Configuring Duplicate Message Throttle 92

Configuring Duplicate Message Throttle Using DCNM-SAN 92

Enabling Call Home Fabric Distribution 93

Committing the Call Home Configuration Changes 93

Discarding the Call Home Configuration Changes 94

Enabling Call Home Fabric Distribution Using DCNM-SAN 94

Fabric Lock Override 95

Call Home Communications Test 95

Call Home Communications Test Using DCNM-SAN 95

Configuring Delayed Traps 96

Enabling the Delayed Trap Feature 96

Enabling the Delayed Trap Feature Using DCNM-SAN 97

Enabling Delayed Traps Using Cisco Device Manager 97

Viewing Event Filter Notification 97

Verifying Call Home Configuration 98

Displaying Call Home Information 98

Displaying Delayed Trap Information 102

Verifying Alert Group Customization 102

Verifying Event Notification Trap 102

Verifying Call Home Transport 102

Monitoring Call Home 103

Sample Syslog Alert Notification in Full-txt Format 103

Sample Syslog Alert Notification in XML Format 103

Sample RMON Notification in XML Format 106

Field Descriptions for Call Home 108

Call Home General 108

Call Home Destinations 108

Call Home SMTP Servers 109

Call Home Email Setup 109

Call Home Alerts 109

Call Home User Defined Command 110

Delayed Traps 110

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

viii

Contents

Call Home Profiles 110

Event Destinations Addresses 110

Event Destinations Security (Advanced) 111

Event Filters General 111

Event Filters Interfaces 112

Event Filters Control 112

Additional References 113

Feature History for Call Home 113

Scheduling Maintenance Jobs 115

CHAPTER 6

Information About the Command Scheduler 115

Scheduler Terminology 115

Licensing Requirements for Command Scheduler 116

Guidelines and Limitations 116

Default Settings 116

Configuring the Command Scheduler 117

Task Flow for Configuring the Command Scheduler 117

Enabling the Command Scheduler 117

Examples 118

Configuring Remote User Authentication 118

Defining a Job 119

Deleting a Job 120

Specifying a Schedule 120

Examples 121

Specifying a One-Time Schedule 122

Deleting a Schedule 123

Removing an Assigned Job 123

Deleting a Schedule Time 123

Configuring Execution Logs 124

Clearing the Execution Log File Contents 124

Verifying Scheduler Configuration 124

Verifying the Command Scheduler Configuration 125

Verifying the Command Scheduler Execution Status 125

Verifying the Job Definition 125

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

ix

Contents

Displaying Execution Log File Contents 126

Clearing the Execution Log File Contents 126

Configuration Examples for Scheduler 127

System Status Monitoring 129

CHAPTER 7

Feature History for System Status Monitoring 129

Information About System Status Monitoring 130

Online Health Management System 130

Loopback Test Configuration Frequency 131

Loopback Test Configuration Frame Length 131

Hardware Failure Action 131

Performing Test Run Requirements 131

Tests for a Specified Module 132

Clearing Previous Error Reports 132

Interpreting the Current Status 132

On-Board Failure Logging 133

Core Files 133

First and Last Core 134

Default Settings 134

Configuring System Health 134

Task Flow for Configuring System Health 134

Configuring System Health Initiation 135

Configuring Loopback Test Configuration Frequency 135

Configuring Loopback Test Configuration Frame Length 136

Configuring Hardware Failure Action 136

Performing Test Run Requirements 137

Clearing Previous Error Reports 138

Performing Internal Loopback Tests 138

Performing External Loopback Tests 139

Performing Serdes Loopbacks 140

Configuring On-Board Failure Logging 141

Configuring OBFL for a Switch 141

Configuring OBFL for a Module 142

Clearing the Module Counters 143

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

x

Contents

Resetting Counters for All Modules 143

Configuring Alerts, Notifications, and Monitoring of Counters 143

Monitoring the CPU Utilization 143

Obtaining RAM Usage Information 144

Monitoring Rx and Tx Traffic Counters 144

Monitoring Status of Interfaces 144

Monitoring Transceiver Thresholds 145

Configuring Supervisor Switchover Notification 146

Configuring a Counter to Include CRC and FCS Errors 146

Configuring Call Home for Alerts 146

Monitoring User Authentication Failures 147

Configuring Cores 147

Configuring Kernel Core Collection 147

Copying Cores Manually 148

Copying Cores Automatically 148

Deleting Cores 148

Example: Configuring Cores 149

Verifying System Status Monitoring Configuration 149

Displaying System Health 149

Verifying Loopback Test Configuration Frame Length 152

Verifying OBFL for the Switch 152

Verifying OBFL for a Module 152

Verifying Kernel Core Collection 153

Verifying Automatic Core Copying 153

Displaying OBFL Logs 153

Displaying the Module Counters Information 154

Displaying System Processes 154

Displaying System Status 157

Displaying Process Fault Logs 159

Additional References 160

About Embedded Event Manager 161

CHAPTER 8

Feature History for EEM 161

Information About EEM 161

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xi

Contents

EEM Overview 162

Policies 162

Event Statements 164

Action Statements 165

VSH Script Policies 165

Environment Variables 165

EEM Event Correlation 166

High Availability 166

Licensing Requirements for EEM 166

Prerequisites for EEM 166

Guidelines and Limitations 166

Default Settings 167

Configuring Embedded Event Manager 167

Defining a User Policy Using the CLI 167

Configuring Event Statements 168

Configuring Action Statements 172

Defining a Policy Using a VSH Script 175

Registering and Activating a VSH Script Policy 176

Overriding a Policy 176

Defining an Environment Variable 177

Verifying the EEM Configuration 178

Configuration Examples for EEM 178

Additional References 179

Configuring RMON 181

CHAPTER 9

Information About RMON 181

RMON Configuration Information 181

RMON Configuration Using Threshold Manager 182

RMON Alarm Configuration Information 182

Default Settings 183

Configuring RMON 183

Configuring the RMON Traps in SNMP 183

Configuring the RMON Alarm 184

Configuring the RMON Event 184

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xii

Contents

Verifying the RMON Configuration 185

Additional References 186

Feature History for RMON 186

Configuring Online Diagnostics 187

CHAPTER 10

Information About Online Diagnostics 187

Online Diagnostic Overview 187

Bootup Diagnostics 188

Health Monitoring Diagnostics 189

On-Demand Diagnostics 191

Recovery Actions on Specified Health Monitoring Diagnostics 192

Corrective (recovery) Action for Supervisor 193

Corrective (Recovery) Action for Cisco MDS 48-Port 16-Gbps Fibre Channel Module 193

Corrective (Recovery) Action for Cisco MDS 48-Port 10-Gbps FCoE Module 193

High Availability 194

Licensing Requirements for Online Diagnostics 194

Default Settings 194

Configuring Online Diagnostics 195

Setting the Bootup Diagnostic Level 195

Displaying the List of Available Tests 196

Activating a Health Monitoring Diagnostic Test 196

Deactivating a Health Monitoring Diagnostic Test 197

Starting or Stopping an On-Demand Diagnostic Test 198

Starting an On-Demand Diagnostic Test in On-demand Mode 199

Clearing Diagnostic Results 200

Simulating Diagnostic Results 200

Enabling Corrective (Recovery) Actions 201

Verifying the Online Diagnostics 201

Configuration Examples for Online Diagnostics 202

Additional References 202

Configuring Interswitch Link Diagnostics 205

CHAPTER 11

Information About ISL Diagnostics 205

Supported Platforms 205

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xiii

Contents

Guidelines and Limitations 206

Latency Test 206

Single Hop Traffic Test 207

Multihop End-to-End Traffic Test 208

Configuring ISL Diagnostics 209

Configuring Latency Test on Cisco MDS 9700 Series Switches 209

Configuring Latency Test on Other Supported Platforms 210

Configuring a Single Hop Traffic Test on Cisco MDS 9700 Series Switches 212

Configuring a Single Hop Traffic Test on Other Supported Platforms 213

Configuring a Multihop Traffic Test on Cisco MDS 9700 Series Switches 215

Configuring a Multihop Traffic Test on Other Supported Platforms 217

Debugging ISL Diagnostics 219

Additional References 222

Using Pathtrace 223

CHAPTER 12

Pathtrace 223

Guidelines and Limitations for Pathtrace 223

Pathtrace Multipath 224

Guidelines and Limitations for Pathtrace Multipath 224

Using Pathtrace or Pathtrace Multipath 224

Configuring HBA Link Diagnostics 231

CHAPTER 13

Overview 231

Supported Platforms 231

Guidelines and Limitations 232

HBA Link Diagnostics Tests 232

Latency Test 233

Loopback Traffic Tests 233

Levels of HBA Link Diagnostics Tests 233

Remote Switched 234

MAC 234

Electrical 234

Optical 235

Configuring HBA Link Diagnostics 235

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xiv

Contents

Configuring Link Diagnostic Mode on a Port 235

Running Link Diagnostic Tests on a Port 236

Terminating Link Diagnostic Tests on a Port 238

Troubleshooting HBA Link Diagnostics 239

Configuring SNMP 241

CHAPTER 14

Information About SNMP Security 241

SNMP Version 1 and Version 2c 242

SNMP Version 3 242

SNMPv3 CLI User Management and AAA Integration 243

CLI and SNMP User Synchronization 243

AAA Exclusive Behavior in SNMPv3 Servers 243

Restricting Switch Access 244

Group-Based SNMP Access 244

Creating and Modifying Users 245

AES Encryption-Based Privacy 245

Traps, Notifications, and Informs 245

EngineID 246

LinkUp/LinkDown Notifications for Switches 246

Scope of LinkUp and LinkDown Trap Settings 247

Default Settings 247

Configuring SNMP 247

Assigning SNMP Switch Contact and Location Informations 247

Configuring SNMP Users from the CLI 248

Creating or Modifying Passwords 249

Enforcing SNMPv3 Message Encryption 250

Enforcing SNMPv3 Message Encryption Globally 250

Assigning SNMPv3 Users to Multiple Roles 251

Adding Communities 251

Configuring SNMP Trap and Inform Notifications 252

Configuring SNMPv2c Notifications 252

Configuring SNMPv2c Notifications using IPv4 252

Configuring SNMPv2c Notifications using IPv6 253

Configuring SNMPv2c Notifications using DNS Name 253

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xv

Contents

Configuring SNMPv3 Notifications 254

Configuring SNMPv3 Notifications using IPv4 254

Configuring SNMPv3 Notifications using IPv6 255

Configuring SNMPv3 Notifications using DNS Name 255

Authenticating SNMPv3 Users Based on Location 256

Enabling SNMP Notifications 257

Configuring the Notification Target User 258

Configuring LinkUp/LinkDown Notifications for Switches 259

Configuring Up/Down SNMP Link-State Traps for Interfaces 260

Configuring Entity (FRU) Traps 261

Modifying the AAA Synchronization Time 262

Verifying SNMP Configuration 262

Viewing the Up/Down SNMP Link-State Traps for Interfaces 263

Displaying SNMP Traps 263

Displaying SNMP Security Information 264

Additional References 267

Configuring Domain Parameters 269

CHAPTER 15

Information About Fibre Channel Domains 269

Domain Restart 270

Domain Manager All Optimization 271

Domain Manager Fast Restart 271

Domain Manager Scale Restart 271

Domain Manager Selective Restart 272

Switch Priority 272

fcdomain Initiation 272

Incoming RCFs 272

Autoreconfiguring Merged Fabrics 272

Domain IDs 273

Specifying Static or Preferred Domain IDs 275

Allowed Domain ID Lists 275

CFS Distribution of Allowed Domain ID Lists 275

Contiguous Domain ID Assignments 276

Locking the Fabric 276

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xvi

Contents

Committing Changes 276

Clearing a Fabric Lock 276

FC IDs 277

Persistent FC IDs 277

Persistent FC ID Configuration 277

About Unique Area FC IDs for HBAs 278

Persistent FC ID Selective Purging 278

Guidelines and Limitations 278

Default Settings 278

Configuring Fibre Channel Domains 279

Restarting a Domain 279

Enabling Domain Manager All Optimization 280

Enabling Domain Manager Fast Restart 280

Enabling Domain Manager Scale Restart 281

Enabling Domain Manager Selective Restart 281

Configuring Switch Priority 282

Configuring Fabric Names 282

Rejecting Incoming RCFs 283

Enabling Autoreconfiguration 283

Configuring Domain IDs 283

Specifying Static or Preferred Domain IDs 284

Configuring Allowed Domain ID Lists 284

Enabling Allowed Domain ID Distribution 285

Committing Changes 286

Discarding Changes 286

Enabling Contiguous Domain ID Assignments 286

Configuring FC IDs 287

Enabling the Persistent FC ID Feature 287

Configuring Persistent FC IDs 288

Configuring Unique Area FC IDs for an HBA 288

Purging Persistent FC IDs 290

Clearing a Fabric Lock 290

Verifying FC Domain Configuration 291

Displaying CFS Distribution Status 291

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xvii

Contents

Displaying Pending Changes 291

Displaying Session Status 292

Displaying fcdomain Information 292

Monitoring Network Traffic Using SPAN 297

CHAPTER 16

Information About SPAN 297

SPAN Sources 298

IPS Source Ports 298

Allowed Source Interface Types 299

VSAN as a Source 300

SPAN Sessions 300

Specifying Filters 300

SD Port Characteristics 300

SPAN Conversion Behavior 301

Monitoring Traffic Using Fibre Channel Analyzers 303

Monitoring Without SPAN 303

Monitoring with SPAN 303

Single SD Port to Monitor Traffic 304

SD Port Configuration 305

Mapping the FC Tunnel 305

Creating VSAN Interfaces 306

Remote SPAN 306

Advantages of Using RSPAN 307

FC and RSPAN Tunnels 307

ST Port Configuration 308

ST Port Characteristics 308

Creating Explicit Paths 309

Guidelines and Limitations 309

Cisco MDS 9700 Series Switches Guidelines 309

SPAN Configuration Guidelines 309

Guidelines to Configure VSANs as a Source 310

Guidelines to Specifying Filters 311

RSPAN Configuration Guidelines 311

Default SPAN and RSPAN Settings 312

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xviii

Contents

Configuring SPAN 312

Configuring SD Ports for SPAN 313

Configuring SD Port for SPAN Monitoring 313

Configuring SPAN Session 313

Configuring SPAN Filter 315

Configuring SPAN for Generation 2 Fabric Switches 315

Configuring Ingress SPAN Sessions 315

Configuring Egress SPAN Session 316

Examples 316

Suspending and Reactivating SPAN Sessions 317

Encapsulating Frames 317

Configuring Fibre Channel Analyzers Using SPAN 318

319

Configuring Single SD Port to Monitor Traffic 319

Configuring the Source Switch 319

Creating VSAN Interfaces 320

Enabling FC Tunnels 320

Initiating the FC Tunnel 321

Configuring the ST Port 321

Configuring an RSPAN Session 322

Configuring All Intermediate Switches 322

Configuring VSAN Interfaces 322

Enabling IP Routing 323

Configuring the Destination Switch 323

Configuring VSAN Interfaces 323

Configuring the SD Port 324

Mapping the FC Tunnel 324

Creating Explicit Paths 324

Referencing the Explicit Path 326

Monitoring RSPAN Traffic 326

Verifying SPAN Configuration 326

Displaying SPAN Information 327

Displaying RSPAN Information 329

Configuration Examples for RSPAN 332

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xix

Contents

Single Source with One RSPAN Tunnel 332

Single Source with Multiple RSPAN Tunnels 332

Multiple Sources with Multiple RSPAN Tunnels 333

Configuring Fabric Configuration Server 335

CHAPTER 17

Information About FCS 335

Significance of FCS 336

Default Settings 337

Configuring FCS 337

Specifying a FCS Name 337

Registering Platform Attributes 337

Verifying FCS Configuration 339

Displaying FCS Elements 339

Additional References 342

Configuring Port Pacing 345

CHAPTER 18

Information About Port Pacing 345

Guidelines and Limitations 345

Configuring Port Pacer 346

Enabling Port Pacing 346

Disabling the Port Pacing Configuration 346

Cisco MDS 9000 Series System Management Configuration Guide, Release 8.x

xx

Contents

Page is loading ...

Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

This manual is also suitable for

Cisco MDS 9000 NX-OS and SAN-OS Software Configuration Guide

Related papers

Other documents