Dell PowerEdge M IO Aggregator Owner's manual

Category
Software
Type
Owner's manual
Dell PowerEdge Conguration Guide for the M
I/O Aggregator
9.14.1.5
Notes, cautions, and warnings
NOTE: A NOTE indicates important information that helps you make better use of your product.
CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem.
WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
© 2019 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks
may be trademarks of their respective owners.
2019 - 05
Rev. A00
Contents
1 About this Guide........................................................................................................................................... 15
Audience............................................................................................................................................................................ 15
Conventions...................................................................................................................................................................... 15
Information Symbols.........................................................................................................................................................15
Related Documents.......................................................................................................................................................... 16
2 Before You Start........................................................................................................................................... 17
Operational Modes............................................................................................................................................................17
Standalone mode........................................................................................................................................................ 17
VLT mode.....................................................................................................................................................................17
Programmable MUX mode........................................................................................................................................ 17
Stacking mode............................................................................................................................................................ 18
Default Settings................................................................................................................................................................ 18
Other Auto-Congured Settings.................................................................................................................................... 18
Data Center Bridging Support.........................................................................................................................................19
FCoE Connectivity and FIP Snooping............................................................................................................................19
iSCSI Operation.................................................................................................................................................................19
Link Aggregation............................................................................................................................................................... 19
Link Tracking.....................................................................................................................................................................20
Conguring VLANs.......................................................................................................................................................... 20
Uplink LAG.................................................................................................................................................................. 20
Server-Facing LAGs.................................................................................................................................................. 20
Where to Go From Here..................................................................................................................................................20
Deploying FN I/O Module................................................................................................................................................21
Conguration Examples............................................................................................................................................ 22
Ensuring the FN IOM system is in Standalone Mode............................................................................................23
Congure Interfaces and Port Channel...................................................................................................................24
Verifying the Congurations..................................................................................................................................... 24
3 Conguration Fundamentals........................................................................................................................ 26
Accessing the Command Line........................................................................................................................................26
CLI Modes.........................................................................................................................................................................27
Navigating CLI Modes............................................................................................................................................... 27
The do Command............................................................................................................................................................ 28
Undoing Commands........................................................................................................................................................ 29
Obtaining Help..................................................................................................................................................................29
Entering and Editing Commands....................................................................................................................................29
Command History............................................................................................................................................................30
Filtering show Command Outputs.................................................................................................................................30
Multiple Users in Conguration Mode...........................................................................................................................32
Conguring a Unique Host Name on the System........................................................................................................32
Enabling Secured CLI Mode........................................................................................................................................... 32
Contents
3
Viewing the Reason for Last System Reboot...............................................................................................................32
4 Conguration Cloning.................................................................................................................................. 34
Cloning Conguration Output Status............................................................................................................................34
5 Data Center Bridging (DCB)........................................................................................................................ 37
Supported Modes.............................................................................................................................................................37
Ethernet Enhancements in Data Center Bridging........................................................................................................37
Priority-Based Flow Control..................................................................................................................................... 38
Enhanced Transmission Selection............................................................................................................................39
Data Center Bridging Exchange Protocol (DCBx)..................................................................................................41
Data Center Bridging in a Trac Flow......................................................................................................................41
Enabling Data Center Bridging........................................................................................................................................ 41
Conguring DCB Maps and its Attributes...............................................................................................................42
Data Center Bridging: Default Conguration................................................................................................................45
Data Center Bridging: Auto-DCB-Enable Mode...........................................................................................................46
Conguring Priority-Based Flow Control...................................................................................................................... 47
How Priority-Based Flow Control is Implemented.................................................................................................49
Conguring Enhanced Transmission Selection............................................................................................................ 50
How Enhanced Transmission Selection is Implemented....................................................................................... 50
ETS Operation with DCBx......................................................................................................................................... 51
Hierarchical Scheduling in ETS Output Policies............................................................................................................ 51
DCBx Operation............................................................................................................................................................... 52
DCBx Operation......................................................................................................................................................... 52
DCBx Port Roles........................................................................................................................................................ 52
DCB Conguration Exchange...................................................................................................................................53
Conguration Source Election..................................................................................................................................54
Propagation of DCB Information..............................................................................................................................54
Auto-Detection of the DCBx Version...................................................................................................................... 54
DCBx Example............................................................................................................................................................55
DCBx Prerequisites and Restrictions.......................................................................................................................56
DCBx Error Messages............................................................................................................................................... 57
Debugging DCBx on an Interface.............................................................................................................................57
Verifying the DCB Conguration....................................................................................................................................57
QoS dot1p Trac Classication and Queue Assignment............................................................................................ 67
Troubleshooting PFC, ETS, and DCBx Operation........................................................................................................ 67
Conguring the Dynamic Buer Method......................................................................................................................69
6 Dynamic Host Conguration Protocol (DHCP).............................................................................................71
Supported Modes.............................................................................................................................................................71
Assigning an IP Address using DHCP.............................................................................................................................71
Debugging DHCP Client Operation................................................................................................................................73
DHCP Client......................................................................................................................................................................74
How DHCP Client is Implemented................................................................................................................................. 75
DHCP Client on a Management Interface.................................................................................................................... 75
DHCP Client on a VLAN..................................................................................................................................................76
4
Contents
DHCP Packet Format and Options................................................................................................................................76
Option 82...........................................................................................................................................................................77
Releasing and Renewing DHCP-based IP Addresses.................................................................................................. 78
Viewing DHCP Statistics and Lease Information......................................................................................................... 78
7 FIP Snooping............................................................................................................................................... 80
Supported Modes............................................................................................................................................................80
Fibre Channel over Ethernet.......................................................................................................................................... 80
Ensuring Robustness in a Converged Ethernet Network........................................................................................... 80
FIP Snooping on Ethernet Bridges................................................................................................................................ 82
How FIP Snooping is Implemented................................................................................................................................84
FIP Snooping on VLANs............................................................................................................................................84
FC-MAP Value............................................................................................................................................................84
Bridge-to-FCF Links.................................................................................................................................................. 84
Impact on other Software Features........................................................................................................................ 84
FIP Snooping Prerequisites.......................................................................................................................................84
FIP Snooping Restrictions........................................................................................................................................ 85
Conguring FIP Snooping...............................................................................................................................................85
Displaying FIP Snooping Information.............................................................................................................................86
FIP Snooping Example..................................................................................................................................................... 91
Debugging FIP Snooping.................................................................................................................................................92
8 Internet Group Management Protocol (IGMP).............................................................................................93
IGMP Overview................................................................................................................................................................93
IGMP Version 2................................................................................................................................................................ 93
Joining a Multicast Group......................................................................................................................................... 94
Leaving a Multicast Group........................................................................................................................................ 94
IGMP Version 3................................................................................................................................................................ 94
Joining and Filtering Groups and Sources.....................................................................................................................95
Leaving and Staying in Groups.......................................................................................................................................96
IGMP Snooping................................................................................................................................................................ 97
How IGMP Snooping is Implemented on an Aggregator.............................................................................................97
Disabling Multicast Flooding........................................................................................................................................... 97
Displaying IGMP Information.......................................................................................................................................... 97
9 Interfaces...................................................................................................................................................100
Basic Interface Conguration....................................................................................................................................... 100
Advanced Interface Conguration............................................................................................................................... 100
Interface Auto-Conguration.........................................................................................................................................101
Interface Types................................................................................................................................................................ 101
Viewing Interface Information........................................................................................................................................101
Disabling and Re-enabling a Physical Interface...........................................................................................................103
Layer 2 Mode.................................................................................................................................................................. 103
Management Interfaces................................................................................................................................................ 104
Accessing an Aggregator.........................................................................................................................................104
Conguring a Management Interface....................................................................................................................104
Contents
5
Conguring a Static Route for a Management Interface....................................................................................105
VLAN Membership.........................................................................................................................................................105
Default VLAN ...........................................................................................................................................................106
Port-Based VLANs...................................................................................................................................................106
VLANs and Port Tagging.........................................................................................................................................106
Conguring VLAN Membership..............................................................................................................................107
Displaying VLAN Membership................................................................................................................................ 108
Adding an Interface to a Tagged VLAN................................................................................................................. 108
Adding an Interface to an Untagged VLAN.......................................................................................................... 109
VLAN Conguration on Physical Ports and Port-Channels................................................................................ 109
Port Channel Interfaces................................................................................................................................................. 110
Port Channel Denitions and Standards................................................................................................................. 111
Port Channel Benets............................................................................................................................................... 111
Port Channel Implementation...................................................................................................................................111
1GbE and 10GbE Interfaces in Port Channels........................................................................................................112
Uplink Port Channel: VLAN Membership...............................................................................................................112
Server-Facing Port Channel: VLAN Membership................................................................................................. 112
Displaying Port Channel Information.......................................................................................................................112
Interface Range............................................................................................................................................................... 114
Bulk Conguration Examples................................................................................................................................... 114
Monitor and Maintain Interfaces................................................................................................................................... 115
Maintenance Using TDR...........................................................................................................................................116
Conguring wavelength for 10–Gigabit SFP+ optics................................................................................................. 117
Flow Control Using Ethernet Pause Frames................................................................................................................117
Enabling Pause Frames...................................................................................................................................................117
MTU Size..........................................................................................................................................................................118
Setting the Speed and Duplex Mode of Ethernet Interfaces.................................................................................... 119
Auto-Negotiation on Ethernet Interfaces....................................................................................................................120
Setting Auto-Negotiation Options..........................................................................................................................122
Viewing Interface Information.......................................................................................................................................123
Clearing Interface Counters.................................................................................................................................... 124
Enabling the Management Address TLV on All Interfaces of an Aggregator..........................................................124
Enhanced Validation of Interface Ranges....................................................................................................................124
Enhanced Control of Remote Fault Indication Processing........................................................................................125
10 iSCSI Optimization....................................................................................................................................126
Supported Modes...........................................................................................................................................................126
iSCSI Optimization Overview........................................................................................................................................126
Monitoring iSCSI Trac Flows......................................................................................................................................127
Information Monitored in iSCSI Trac Flows..............................................................................................................128
Detection and Auto conguration for Dell EqualLogic Arrays................................................................................... 128
iSCSI Optimization: Operation...................................................................................................................................... 128
Displaying iSCSI Optimization Information.................................................................................................................. 129
11 Isolated Networks for Aggregators............................................................................................................. 131
Conguring and Verifying Isolated Network Settings.................................................................................................131
6
Contents
12 Link Aggregation....................................................................................................................................... 132
Supported Modes...........................................................................................................................................................132
How the LACP is Implemented on an Aggregator......................................................................................................132
Uplink LAG.................................................................................................................................................................133
Server-Facing LAGs................................................................................................................................................. 133
LACP Modes.............................................................................................................................................................133
Auto-Congured LACP Timeout............................................................................................................................ 134
LACP Example................................................................................................................................................................ 134
Link Aggregation Control Protocol (LACP).................................................................................................................135
Conguration Tasks for Port Channel Interfaces................................................................................................. 135
Creating a Port Channel.......................................................................................................................................... 135
Adding a Physical Interface to a Port Channel..................................................................................................... 135
Reassigning an Interface to a New Port Channel.................................................................................................137
Conguring the Minimum Oper Up Links in a Port Channel............................................................................... 138
Conguring VLAN Tags for Member Interfaces................................................................................................... 138
Deleting or Disabling a Port Channel......................................................................................................................139
Conguring Auto LAG....................................................................................................................................................139
Conguring the Minimum Number of Links to be Up for Uplink LAGs to be Active.............................................. 141
Optimizing Trac Disruption Over LAG Interfaces On IOA Switches in VLT Mode.............................................. 142
Preserving LAG and Port Channel Settings in Nonvolatile Storage.........................................................................142
Enabling LACP link-fallback...........................................................................................................................................142
Enabling the Verication of Member Links Utilization in a LAG Bundle...................................................................143
Monitoring the Member Links of a LAG Bundle......................................................................................................... 143
Verifying LACP Operation and LAG Conguration.....................................................................................................144
Multiple Uplink LAGs...................................................................................................................................................... 147
Multiple Uplink LAGs with 10G Member Ports........................................................................................................... 147
Multiple Uplink LAGs with 40G Member Ports...........................................................................................................148
13 Layer 2.......................................................................................................................................................151
Supported Modes............................................................................................................................................................151
Managing the MAC Address Table................................................................................................................................151
Clearing the MAC Address Entries..........................................................................................................................151
Displaying the MAC Address Table.........................................................................................................................152
Network Interface Controller (NIC) Teaming..............................................................................................................152
MAC Address Station Move....................................................................................................................................153
MAC Move Optimization.........................................................................................................................................154
14 Link Layer Discovery Protocol (LLDP)...................................................................................................... 155
Supported Modes...........................................................................................................................................................155
Protocol Data Units........................................................................................................................................................155
Congure LLDP...............................................................................................................................................................157
Related Conguration Tasks....................................................................................................................................157
Important Points to Remember.............................................................................................................................. 157
CONFIGURATION versus INTERFACE Congurations............................................................................................. 157
Enabling LLDP.................................................................................................................................................................158
Contents
7
Disabling and Undoing LLDP...................................................................................................................................158
Advertising TLVs.............................................................................................................................................................158
Optional TLVs..................................................................................................................................................................159
Management TLVs................................................................................................................................................... 159
IEEE Organizationally Specic TLVs.......................................................................................................................160
LLDP-MED Capabilities TLV.................................................................................................................................... 161
LLDP-MED Network Policies TLV..........................................................................................................................162
Extended Power via MDI TLV.................................................................................................................................163
LLDP Operation.............................................................................................................................................................. 163
Storing and Viewing Unrecognized LLDP TLVs..........................................................................................................164
Reserved Unrecognized LLDP TLVs...................................................................................................................... 164
Organizational Specic Unrecognized LLDP TLVs...............................................................................................164
Viewing Unrecognized LLDP TLVs.........................................................................................................................165
Viewing the LLDP Conguration.................................................................................................................................. 165
Viewing Information Advertised by Adjacent LLDP Agents...................................................................................... 165
Conguring LLDPDU Intervals......................................................................................................................................166
Conguring a Time to Live.............................................................................................................................................167
Clearing LLDP Counters................................................................................................................................................ 168
Debugging LLDP.............................................................................................................................................................168
Relevant Management Objects....................................................................................................................................169
15 Object Tracking......................................................................................................................................... 174
Object Tracking Overview..............................................................................................................................................174
Track Layer 2 Interfaces...........................................................................................................................................175
Track Layer 3 Interfaces...........................................................................................................................................175
Track IPv4 and IPv6 Routes.................................................................................................................................... 176
Set Tracking Delays.................................................................................................................................................. 176
VRRP Object Tracking............................................................................................................................................. 176
Object Tracking Conguration...................................................................................................................................... 176
Tracking a Layer 2 Interface.................................................................................................................................... 177
Tracking a Layer 3 Interface.................................................................................................................................... 178
Track an IPv4/IPv6 Route....................................................................................................................................... 179
Displaying Tracked Objects............................................................................................................................................180
16 Port Monitoring........................................................................................................................................ 182
Supported Modes...........................................................................................................................................................182
Conguring Port Monitoring......................................................................................................................................... 182
Important Points to Remember.................................................................................................................................... 183
Port Monitoring...............................................................................................................................................................184
17 Security.................................................................................................................................................... 186
Supported Modes...........................................................................................................................................................186
Understanding Banner Settings....................................................................................................................................186
Accessing the I/O Aggregator Using the CMC Console Only.................................................................................. 187
AAA Authentication........................................................................................................................................................187
Conguration Task List for AAA Authentication................................................................................................... 187
8
Contents
AAA Authorization..........................................................................................................................................................190
Privilege Levels Overview........................................................................................................................................190
Conguration Task List for Privilege Levels........................................................................................................... 191
RADIUS............................................................................................................................................................................194
RADIUS Authentication........................................................................................................................................... 195
Conguration Task List for RADIUS....................................................................................................................... 196
TACACS+........................................................................................................................................................................ 199
Conguration Task List for TACACS+....................................................................................................................199
TACACS+ Remote Authentication........................................................................................................................ 200
Enabling SCP and SSH.................................................................................................................................................. 201
Using SCP with SSH to Copy a Software Image................................................................................................ 202
Secure Shell Authentication................................................................................................................................... 203
Troubleshooting SSH...............................................................................................................................................206
Telnet...............................................................................................................................................................................206
VTY Line and Access-Class Conguration................................................................................................................. 206
VTY Line Local Authentication and Authorization...............................................................................................206
VTY Line Remote Authentication and Authorization...........................................................................................207
VTY MAC-SA Filter Support...................................................................................................................................207
Dell EMC Networking OS Security Hardening...........................................................................................................208
Dell EMC Networking OS Image Verication.......................................................................................................208
Startup Conguration Verication.........................................................................................................................209
Conguring the root User Password......................................................................................................................210
Enabling User Lockout for Failed Login Attempts................................................................................................. 211
18 Simple Network Management Protocol (SNMP).......................................................................................212
Supported Modes...........................................................................................................................................................212
Implementation Information.......................................................................................................................................... 213
Conguring the Simple Network Management Protocol.......................................................................................... 213
Important Points to Remember.............................................................................................................................. 213
Setting up SNMP..................................................................................................................................................... 213
Creating a Community............................................................................................................................................. 213
Setting Up User-Based Security (SNMPv3).............................................................................................................. 214
Subscribing to Managed Object Value Updates using SNMP.................................................................................. 215
Enabling a Subset of SNMP Traps............................................................................................................................... 216
Reading Managed Object Values..................................................................................................................................217
Displaying the Ports in a VLAN using SNMP.............................................................................................................. 218
Fetching Dynamic MAC Entries using SNMP.............................................................................................................219
Deriving Interface Indices.............................................................................................................................................. 221
MIB Support to Display Reason for Last System Reboot..........................................................................................221
Viewing the Reason for Last System Reboot Using SNMP...............................................................................222
MIB Support to Display Egress Queue Statistics.......................................................................................................222
Monitoring BGP sessions via SNMP...........................................................................................................................222
Monitor Port-Channels..................................................................................................................................................224
Entity MIBS.................................................................................................................................................................... 225
Example of Sample Entity MIBS outputs..............................................................................................................225
SNMP Traps for Link Status.........................................................................................................................................227
Contents
9
Standard VLAN MIB...................................................................................................................................................... 227
Enhancements..........................................................................................................................................................227
Fetching the Switchport Conguration and the Logical Interface Conguration ...........................................227
MIB Support to Display the Available Memory Size on Flash...................................................................................228
Viewing the Available Flash Memory Size.............................................................................................................228
MIB Support to Display the Software Core Files Generated by the System......................................................... 229
Viewing the Software Core Files Generated by the System..............................................................................229
MIB Support to Display the Available Partitions on Flash.........................................................................................230
Viewing the Available Partitions on Flash............................................................................................................. 230
MIB Support to Display Egress Queue Statistics........................................................................................................231
MIB Support to Display Egress Queue Statistics........................................................................................................231
Viewing the ECMP Group Count Information......................................................................................................232
MIB Support for entAliasMappingTable ..................................................................................................................... 234
Viewing the entAliasMappingTable MIB................................................................................................................234
MIB Support for LAG.................................................................................................................................................... 235
Viewing the LAG MIB..............................................................................................................................................236
MIB Support to Display Unrecognized LLDP TLVs....................................................................................................237
MIB Support to Display Reserved Unrecognized LLDP TLVs............................................................................ 237
MIB Support to Display Organizational Specic Unrecognized LLDP TLVs.....................................................238
Transceiver Monitoring..................................................................................................................................................239
19 Stacking....................................................................................................................................................241
Supported Modes...........................................................................................................................................................241
Stacking Aggregators.....................................................................................................................................................241
Stack Management Roles.......................................................................................................................................242
Stack Master Election............................................................................................................................................. 243
Failover Roles........................................................................................................................................................... 243
MAC Addressing...................................................................................................................................................... 244
Stacking LAG............................................................................................................................................................244
Stacking VLANs....................................................................................................................................................... 244
Stacking Port Numbers.................................................................................................................................................245
Stacking in PMUX Mode.............................................................................................................................................. 245
Conguring a Switch Stack..........................................................................................................................................246
Stacking Prerequisites.............................................................................................................................................246
Master Selection Criteria........................................................................................................................................ 247
Conguring Priority and stack-group.................................................................................................................... 247
Cabling Stacked Switches...................................................................................................................................... 248
Accessing the CLI....................................................................................................................................................248
Conguring and Bringing Up a Stack.................................................................................................................... 249
Adding a Stack Unit.................................................................................................................................................249
Resetting a Unit on a Stack....................................................................................................................................250
Removing an Aggregator from a Stack and Restoring Quad Mode..................................................................250
Conguring the Uplink Speed of Interfaces as 40 Gigabit Ethernet........................................................................251
Merging Two Operational Stacks.................................................................................................................................252
Verifying a Stack Conguration................................................................................................................................... 252
Using Show Commands..........................................................................................................................................252
10
Contents
Troubleshooting a Switch Stack...................................................................................................................................254
Failure Scenarios......................................................................................................................................................256
Upgrading a Switch Stack............................................................................................................................................ 258
Upgrading a Single Stack Unit..................................................................................................................................... 259
20 Storm Control..........................................................................................................................................260
Congure Storm Control...............................................................................................................................................260
Conguring Storm Control from CONFIGURATION Mode................................................................................260
Conguring Storm Control from INTERFACE Mode............................................................................................261
21 Broadcast Storm Control..........................................................................................................................262
Supported Modes..........................................................................................................................................................262
Disabling Broadcast Storm Control..............................................................................................................................262
Displaying Broadcast-Storm Control Status...............................................................................................................262
Conguring Storm Control........................................................................................................................................... 262
22 SupportAssist.......................................................................................................................................... 263
Conguring SupportAssist Using a Conguration Wizard........................................................................................ 264
Conguring SupportAssist Manually........................................................................................................................... 264
Conguring SupportAssist Activity............................................................................................................................. 266
Conguring SupportAssist Company.......................................................................................................................... 267
Conguring SupportAssist Person.............................................................................................................................. 268
Conguring SupportAssist Server...............................................................................................................................268
Viewing SupportAssist Conguration..........................................................................................................................269
23 System Time and Date..............................................................................................................................271
Supported Modes...........................................................................................................................................................271
Setting the Time for the Software Clock.................................................................................................................... 271
Setting the Timezone.................................................................................................................................................... 272
Setting Daylight Savings Time......................................................................................................................................272
Setting Daylight Saving Time Once....................................................................................................................... 272
Setting Recurring Daylight Saving Time................................................................................................................273
Conguring the Oset-Threshold for NTP Audit Log................................................................................................274
Conguring NTP control key password.......................................................................................................................274
24 Uplink Failure Detection (UFD).................................................................................................................275
Supported Modes.......................................................................................................................................................... 275
Feature Description....................................................................................................................................................... 275
How Uplink Failure Detection Works........................................................................................................................... 276
UFD and NIC Teaming................................................................................................................................................... 277
Important Points to Remember....................................................................................................................................278
Uplink Failure Detection (SMUX mode)...................................................................................................................... 278
Conguring Uplink Failure Detection (PMUX mode).................................................................................................279
Clearing a UFD-Disabled Interface (in PMUX mode)................................................................................................280
Displaying Uplink Failure Detection...............................................................................................................................281
Sample Conguration: Uplink Failure Detection.........................................................................................................283
Contents
11
25 PMUX Mode of the IO Aggregator...........................................................................................................285
I/O Aggregator (IOA) Programmable MUX (PMUX) Mode.....................................................................................285
Conguring and Changing to PMUX Mode............................................................................................................... 285
Conguring the Commands without a Separate User Account.............................................................................. 286
Virtual Link Trunking (VLT)........................................................................................................................................... 286
Overview...................................................................................................................................................................286
Setting up VLT..........................................................................................................................................................287
Virtual Link Trunking (VLT) in PMUX Mode......................................................................................................... 288
VLT Terminology...................................................................................................................................................... 290
Congure Virtual Link Trunking...............................................................................................................................291
Verifying a VLT Conguration................................................................................................................................ 295
Additional VLT Sample Congurations.................................................................................................................. 297
Troubleshooting VLT................................................................................................................................................298
26 FC Flex IO Modules................................................................................................................................. 300
FC Flex IO Modules.......................................................................................................................................................300
Understanding and Working of the FC Flex IO Modules.......................................................................................... 300
FC Flex IO Modules Overview............................................................................................................................... 300
FC Flex IO Module Capabilities and Operations................................................................................................... 301
Guidelines for Working with FC Flex IO Modules................................................................................................ 302
Processing of Data Trac...................................................................................................................................... 304
Installing and Conguring the Switch....................................................................................................................304
Interconnectivity of FC Flex IO Modules with Cisco MDS Switches................................................................306
Fibre Channel over Ethernet for FC Flex IO Modules...............................................................................................308
27 FC FLEXIO FPORT.................................................................................................................................. 309
FC FLEXIO FPORT........................................................................................................................................................309
Conguring Switch Mode to FCF Port Mode.............................................................................................................310
Name Server....................................................................................................................................................................311
FCoE Maps...................................................................................................................................................................... 311
Creating an FCoE Map.................................................................................................................................................. 312
Zoning.............................................................................................................................................................................. 313
Creating Zone and Adding Members........................................................................................................................... 314
Creating Zone Alias and Adding Members.................................................................................................................. 314
Creating Zonesets.......................................................................................................................................................... 314
Activating a Zoneset...................................................................................................................................................... 315
Displaying the Fabric Parameters................................................................................................................................. 315
28 NPIV Proxy Gateway................................................................................................................................ 318
Supported Modes...........................................................................................................................................................318
NPIV Proxy Gateway Conguration............................................................................................................................. 318
NPIV Proxy Gateway Operations and Capabilities..................................................................................................... 318
NPIV Proxy Gateway Operation ............................................................................................................................ 318
NPIV Proxy Gateway: Protocol Services............................................................................................................... 319
NPIV Proxy Gateway Functionality........................................................................................................................ 319
12
Contents
NPIV Proxy Gateway: Terms and Denitions........................................................................................................ 319
Conguring an NPIV Proxy Gateway........................................................................................................................... 321
Enabling Fibre Channel Capability on the Switch................................................................................................ 322
Creating a DCB Map .............................................................................................................................................. 323
Applying a DCB Map on Server-facing Ethernet Ports ..................................................................................... 324
Creating an FCoE VLAN......................................................................................................................................... 324
Creating an FCoE Map ...........................................................................................................................................324
Applying an FCoE Map on Server-facing Ethernet Ports...................................................................................325
Applying an FCoE Map on Fabric-facing FC Ports..............................................................................................326
Sample Conguration.............................................................................................................................................. 327
Displaying NPIV Proxy Gateway Information..............................................................................................................327
show interfaces status Command Example......................................................................................................... 328
show fcoe-map Command Examples .................................................................................................................. 329
show qos dcb-map Command Examples ............................................................................................................ 330
show npiv devices brief Command Example........................................................................................................330
show npiv devices Command Example ................................................................................................................ 331
show fc switch Command Example ..................................................................................................................... 332
29 Upgrade Procedures................................................................................................................................ 334
Get Help with Upgrades............................................................................................................................................... 334
30 Debugging and Diagnostics......................................................................................................................335
Supported Modes..........................................................................................................................................................335
Debugging Aggregator Operation................................................................................................................................335
All interfaces on the Aggregator are operationally down.................................................................................... 335
Broadcast, unknown multicast, and DLF packets switched at a very low rate............................................... 336
Flooded packets on all VLANs are received on a server.....................................................................................336
Software show Commands.......................................................................................................................................... 337
Oine Diagnostics.........................................................................................................................................................338
Important Points to Remember............................................................................................................................. 339
Running Oine Diagnostics....................................................................................................................................339
Trace Logs...................................................................................................................................................................... 340
Auto Save on Crash or Rollover.............................................................................................................................340
Using the Show Hardware Commands.......................................................................................................................340
Environmental Monitoring.............................................................................................................................................342
Recognize an Over-Temperature Condition..........................................................................................................343
Troubleshoot an Over-Temperature Condition..................................................................................................... 343
Recognize an Under-Voltage Condition................................................................................................................ 344
Troubleshoot an Under-Voltage Condition............................................................................................................344
Buer Tuning..................................................................................................................................................................345
Deciding to Tune Buers........................................................................................................................................ 346
Sample Buer Prole Conguration......................................................................................................................349
Troubleshooting Packet Loss........................................................................................................................................349
Displaying Drop Counters....................................................................................................................................... 350
Dataplane Statistics..................................................................................................................................................351
Displaying Stack Port Statistics............................................................................................................................. 352
Contents
13
Enabling Buer Statistics Tracking .............................................................................................................................352
Restoring the Factory Default Settings...................................................................................................................... 354
Important Points to Remember............................................................................................................................. 354
31 Standards Compliance..............................................................................................................................356
IEEE Compliance............................................................................................................................................................356
RFC and I-D Compliance.............................................................................................................................................. 356
General Internet Protocols......................................................................................................................................357
General IPv4 Protocols............................................................................................................................................357
Network Management............................................................................................................................................358
MIB Location.................................................................................................................................................................. 360
14 Contents
About this Guide
This guide describes the supported protocols and software features, and provides conguration instructions and examples, for the Dell
Networking M I/O Aggregator running Dell Networking OS version 9.7(0.0).
The MI/O Aggregator is installed in a Dell PowerEdge M I/O Aggregator. For information about how to install and perform the initial switch
conguration, refer to the Getting Started Guides on the Dell Support website at http://www.dell.com/support/manuals
Though this guide contains information about protocols, it is not intended to be a complete reference. This guide is a reference for
conguring protocols on Dell Networking systems. For complete information about protocols, refer to other documentation, including IETF
requests for comment (RFCs). The instructions in this guide cite relevant RFCs, and Standards Compliance contains a complete list of the
supported RFCs and management information base les (MIBs).
NOTE: You can perform some of the conguration tasks described in this document by using either the Dell command line or the
chassis management controller (CMC) graphical interface. Tasks supported by the CMC interface are shown with the CMC icon:
CMC
Topics:
Audience
Conventions
Information Symbols
Related Documents
Audience
This document is intended for system administrators who are responsible for conguring and maintaining networks and assumes knowledge
in Layer 2 and Layer 3 networking technologies.
Conventions
This guide uses the following conventions to describe command syntax.
Keyword
Keywords are in Courier (a monospaced font) and must be entered in the CLI as listed.
parameter Parameters are in italics and require a number or word to be entered in the CLI.
{X} Keywords and parameters within braces must be entered in the CLI.
[X] Keywords and parameters within brackets are optional.
x|y Keywords and parameters separated by a bar require you to choose one option.
x||y Keywords and parameters separated by a double bar allows you to choose any or all of the options.
Information Symbols
This book uses the following information symbols.
NOTE
: The Note icon signals important operational information.
CAUTION: The Caution icon signals information about situations that could result in equipment damage or loss of data.
WARNING: The Warning icon signals information about hardware handling that could result in injury.
1
About this Guide 15
* (Exception). This symbol is a note associated with additional text on the page that is marked with an asterisk.
Related Documents
For more information about the Dell PowerEdge M I/O Aggregator MXL 10/40GbE Switch IO Module, refer to the following documents:
Dell Networking OS Command Line Reference Guide for the M I/O Aggregator
Dell Networking OS Getting Started Guide for the M I/O Aggregator
Release Notes for the M I/O Aggregator
16 About this Guide
Before You Start
To install the Aggregator in a Dell PowerEdge M1000e Enclosure, use the instructions in the Dell PowerEdge M I/O Aggregator Getting
Started Guide that is shipped with the product.The I/O Aggregator (also known as Aggregator) installs with zero-touch conguration. After
you power it on, an Aggregator boots up with default settings and auto-congures with software features enabled. This chapter describes
the default settings and software features that are automatically congured at startup. To recongure the Aggregator for customized
network operation, use the tasks described in the other chapters.
Operational Modes
IOA supports four operational modes. Select the operational mode that meets your deployment needs. To enable a new operational mode,
reload the switch.
Standalone mode
stack-unit unit iom-mode standalone
CONFIGURATION mode
Dell(conf)#stack-unit 0 iom-mode standalone
This mode is the default mode for IOA. It is a fully automated zero-touch mode that allows you to congure VLAN memberships.
(Supported in CMC)
VLT mode
stack-unit unit iom-mode vlt
CONFIGURATION mode
Dell(conf)#stack-unit 0 iom-mode vlt
Select this mode to multihome server interfaces to dierent IOA modules. This mode is a low-touch mode where all conguration except
VLAN membership is automated. To enable VLAN, congure the VLANs at the server port level. In this mode, port 9 link, which is
associated with LAG-127, is dedicated to VLT interconnect.
Programmable MUX mode
stack-unit unit iom-mode programmable-mux
CONFIGURATION mode
Dell(conf)#stack-unit 0 iom-mode programmable-mux
Select this mode to congure PMUX mode CLI commands.
2
Before You Start 17
For more information on the PMUX mode, see PMUX Mode of the IO Aggregator.
Stacking mode
stack-unit unit iom-mode stack
CONFIGURATION mode
Dell(conf)#stack-unit 0 iom-mode stack
Select this mode to congure Stacking mode CLI commands.
For more information on the Stacking mode, see Stacking.
Default Settings
The I/O Aggregator provides zero-touch conguration with the following default conguration settings:
default user name (root)
password (calvin)
VLAN (vlan1) and IP address for in-band management (DHCP)
IP address for out-of-band (OOB) management (DHCP)
read-only SNMP community name (public)
broadcast storm control (enabled in Standalone mode and disabled in VLT mode)
IGMP multicast ooding (enabled)
VLAN conguration (in Standalone mode, all ports belong to all VLANs)
You can change any of these default settings using the CLI. Refer to the appropriate chapter for details.
NOTE
: You can also change many of the default settings using the chassis management controller (CMC) interface. For
information about how to access the CMC to congure the aggregator, refer to the
Dell Chassis Management Controller (CMC)
User’s Guide
on the Dell Support website at http://support.dell.com/
Other Auto-Congured Settings
After the Aggregator powers on, it auto-congures and is operational with software features enabled, including:
Ports: Ports are administratively up and auto-congured to operate as hybrid ports to transmit tagged and untagged VLAN trac.
Ports 1 to 32 are internal server-facing ports, which can operate in 10GbE mode. Ports 33 to 56 are external ports auto-congured to
operate by default as follows:
The base-module ports operate in standalone 4x10GbE mode. You can congure these ports to operate in 40GbE stacking mode.
When congured for stacking, you cannot use 40GbE base-module ports for uplinks.
Ports on the 2-Port 40-GbE QSFP+ module operate only in 4x10GbE mode. You cannot use them for stacking.
Ports on the 4-Port 10-GbE SFP+ and 4-Port 10GBASE-T modules operate only in 10GbE mode.
For more information about how ports are numbered, refer to Port Numbering.
Link aggregation: All uplink ports are congured in a single LAG (LAG 128).
VLANs: All ports are congured as members of all (4094) VLANs. All VLANs are up and can send or receive layer 2 trac. For more
information, refer to VLAN Membership.
Data center bridging capability exchange protocol (DCBx): Server-facing ports auto-congure in auto-downstream port roles; uplink
ports auto-congure in auto-upstream port roles.
Fibre Channel over Ethernet (FCoE) connectivity and FCoE initiation protocol (FIP) snooping: The uplink port channel (LAG 128) is
enabled to operate in Fibre channel forwarder (FCF) port mode.
18
Before You Start
Link layer discovery protocol (LLDP): Enabled on all ports to advertise management TLV and system name with neighboring devices.
Internet small computer system interface (iSCSI)optimization.
Internet group management protocol (IGMP) snooping.
Jumbo frames: Ports are set to a maximum MTU of 12,000 bytes by default.
Link tracking: Uplink-state group 1 is automatically congured. In uplink state-group 1, server-facing ports auto-congure as
downstream interfaces; the uplink port-channel (LAG 128) auto-congures as an upstream interface. Server-facing links are auto-
congured to be brought up only if the uplink port-channel is up.
In VLT mode, port 9 is automatically congured as VLT interconnect ports. VLT domain conguration is automatic. This includes peer-
link, congured MAC, backup link and setting every port channel as VLT port-channel.
Data Center Bridging Support
To eliminate packet loss and provision links with required bandwidth, Data Center Bridging (DCB) enhancements for data center networks
are supported.
The aggregator provides zero-touch conguration for DCB. The aggregator auto-congures DCBX port roles as follows:
Server-facing ports are congured as auto-downstream interfaces.
Uplink ports are congured as auto-upstream interfaces.
In operation, DCBx auto-congures uplink ports to match the DCB conguration in the ToR switches to which they connect.
The Aggregator supports DCB only in standalone mode.
FCoE Connectivity and FIP Snooping
Many data centers use Fiber Channel (FC) in storage area networks (SANs). Fiber Channel over Ethernet (FCoE) encapsulates Fiber
Channel frames over Ethernet networks.
On an Aggregator, the internal ports support FCoE connectivity and connects to the converged network adapter (CNA) in servers. FCoE
allows Fiber Channel to use 10-Gigabit Ethernet networks while preserving the Fiber Channel protocol.
The Aggregator also provides zero-touch conguration for FCoE connectivity. The Aggregator auto-congures to match the FCoE settings
used in the switches to which it connects through its uplink ports.
FIP snooping is automatically congured on an Aggregator. The auto-congured port channel (LAG 128) operates in FCF port mode.
iSCSI Operation
Support for iSCSI trac is turned on by default when the Aggregator powers up. No conguration is required.
When an aggregator powers up, it monitors known TCP ports for iSCSI storage devices on all interfaces. When a session is detected, an
entry is created and monitored as long as the session is active.
The Aggregator also detects iSCSI storage devices on all interfaces and autocongures to optimize performance. Performance optimization
operations, such as Jumbo frame size support and disabling storm control on interfaces connected to an iSCSI equallogic (EQL) storage
device, are applied automatically.
Link Aggregation
All uplink ports are congured in a single LAG (LAG 128). Server-facing ports are auto-congured as part of link aggregation groups if the
corresponding server is congured for LACP-based network interface controller (NIC) teaming. Static LAGs are not supported.
NOTE
: The recommended LACP timeout is Long-Timeout mode.
Before You Start 19
Link Tracking
By default, all server-facing ports are tracked by the operational status of the uplink LAG. If the uplink LAG goes down, the aggregator
loses its connectivity and is no longer operational; all server-facing ports are brought down after the specied defer-timer interval, which is
10 seconds by default. If you have congured VLAN, you can reduce the defer time by changing the defer-timer value or remove it by using
the no defer-timer command.
NOTE: If installed servers do not have connectivity to a switch, check the Link Status LED of uplink ports on the aggregator. If all
LEDs are on, to ensure the LACP is correctly congured, check the LACP conguration on the ToR switch that is connected to
the aggregator .
Conguring VLANs
By default, in Standalone mode, all aggregator ports belong to all 4094 VLANs and are members of untagged VLAN 1. To congure only the
required VLANs on a port, use the CLI or CMC interface.
You can congure VLANs only on server ports. The uplink LAG will automatically get the VLANs, based on the server ports VLAN
conguration.
When you congure VLANs on server-facing interfaces (ports from 1 to 32), you can assign VLANs to a port or a range of ports by
entering the vlan tagged or vlan untagged commands in Interface Conguration mode; for example:
Dell(conf)# interface range tengigabitethernet 0/2 - 4
Dell(conf-if-range-te-0/2-4)# vlan tagged 5,7,10-12
Dell(conf-if-range-te-0/2-4)# vlan untagged 3
Uplink LAG
The tagged VLAN membership of the uplink LAG is automatically congured based on the VLAN conguration of all server-facing ports
(ports from 1 to 32).
The untagged VLAN used for the uplink LAG is always the default VLAN.
Server-Facing LAGs
The tagged VLAN membership of a server-facing LAG is automatically congured based on the server-facing ports that are members of
the LAG.
The untagged VLAN of a server-facing LAG is congured based on the untagged VLAN to which the lowest numbered server-facing port
in the LAG belongs.
NOTE
: Dell Networking recommends conguring the same VLAN membership on all LAG member ports.
Where to Go From Here
You can customize the Aggregator for use in your data center network as necessary. To perform additional switch conguration, do one of
the following:
For remote out-of-band management, enter the OOB management interface IP address into a Telnet or SSH client and log in to the
switch using the user ID and password to access the CLI.
For local management using the CLI, use the attached console connection.
For remote in-band management from a network management station, enter the IP address of the default VLAN and log in to the
switch to access the CLI.
20
Before You Start
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56
  • Page 57 57
  • Page 58 58
  • Page 59 59
  • Page 60 60
  • Page 61 61
  • Page 62 62
  • Page 63 63
  • Page 64 64
  • Page 65 65
  • Page 66 66
  • Page 67 67
  • Page 68 68
  • Page 69 69
  • Page 70 70
  • Page 71 71
  • Page 72 72
  • Page 73 73
  • Page 74 74
  • Page 75 75
  • Page 76 76
  • Page 77 77
  • Page 78 78
  • Page 79 79
  • Page 80 80
  • Page 81 81
  • Page 82 82
  • Page 83 83
  • Page 84 84
  • Page 85 85
  • Page 86 86
  • Page 87 87
  • Page 88 88
  • Page 89 89
  • Page 90 90
  • Page 91 91
  • Page 92 92
  • Page 93 93
  • Page 94 94
  • Page 95 95
  • Page 96 96
  • Page 97 97
  • Page 98 98
  • Page 99 99
  • Page 100 100
  • Page 101 101
  • Page 102 102
  • Page 103 103
  • Page 104 104
  • Page 105 105
  • Page 106 106
  • Page 107 107
  • Page 108 108
  • Page 109 109
  • Page 110 110
  • Page 111 111
  • Page 112 112
  • Page 113 113
  • Page 114 114
  • Page 115 115
  • Page 116 116
  • Page 117 117
  • Page 118 118
  • Page 119 119
  • Page 120 120
  • Page 121 121
  • Page 122 122
  • Page 123 123
  • Page 124 124
  • Page 125 125
  • Page 126 126
  • Page 127 127
  • Page 128 128
  • Page 129 129
  • Page 130 130
  • Page 131 131
  • Page 132 132
  • Page 133 133
  • Page 134 134
  • Page 135 135
  • Page 136 136
  • Page 137 137
  • Page 138 138
  • Page 139 139
  • Page 140 140
  • Page 141 141
  • Page 142 142
  • Page 143 143
  • Page 144 144
  • Page 145 145
  • Page 146 146
  • Page 147 147
  • Page 148 148
  • Page 149 149
  • Page 150 150
  • Page 151 151
  • Page 152 152
  • Page 153 153
  • Page 154 154
  • Page 155 155
  • Page 156 156
  • Page 157 157
  • Page 158 158
  • Page 159 159
  • Page 160 160
  • Page 161 161
  • Page 162 162
  • Page 163 163
  • Page 164 164
  • Page 165 165
  • Page 166 166
  • Page 167 167
  • Page 168 168
  • Page 169 169
  • Page 170 170
  • Page 171 171
  • Page 172 172
  • Page 173 173
  • Page 174 174
  • Page 175 175
  • Page 176 176
  • Page 177 177
  • Page 178 178
  • Page 179 179
  • Page 180 180
  • Page 181 181
  • Page 182 182
  • Page 183 183
  • Page 184 184
  • Page 185 185
  • Page 186 186
  • Page 187 187
  • Page 188 188
  • Page 189 189
  • Page 190 190
  • Page 191 191
  • Page 192 192
  • Page 193 193
  • Page 194 194
  • Page 195 195
  • Page 196 196
  • Page 197 197
  • Page 198 198
  • Page 199 199
  • Page 200 200
  • Page 201 201
  • Page 202 202
  • Page 203 203
  • Page 204 204
  • Page 205 205
  • Page 206 206
  • Page 207 207
  • Page 208 208
  • Page 209 209
  • Page 210 210
  • Page 211 211
  • Page 212 212
  • Page 213 213
  • Page 214 214
  • Page 215 215
  • Page 216 216
  • Page 217 217
  • Page 218 218
  • Page 219 219
  • Page 220 220
  • Page 221 221
  • Page 222 222
  • Page 223 223
  • Page 224 224
  • Page 225 225
  • Page 226 226
  • Page 227 227
  • Page 228 228
  • Page 229 229
  • Page 230 230
  • Page 231 231
  • Page 232 232
  • Page 233 233
  • Page 234 234
  • Page 235 235
  • Page 236 236
  • Page 237 237
  • Page 238 238
  • Page 239 239
  • Page 240 240
  • Page 241 241
  • Page 242 242
  • Page 243 243
  • Page 244 244
  • Page 245 245
  • Page 246 246
  • Page 247 247
  • Page 248 248
  • Page 249 249
  • Page 250 250
  • Page 251 251
  • Page 252 252
  • Page 253 253
  • Page 254 254
  • Page 255 255
  • Page 256 256
  • Page 257 257
  • Page 258 258
  • Page 259 259
  • Page 260 260
  • Page 261 261
  • Page 262 262
  • Page 263 263
  • Page 264 264
  • Page 265 265
  • Page 266 266
  • Page 267 267
  • Page 268 268
  • Page 269 269
  • Page 270 270
  • Page 271 271
  • Page 272 272
  • Page 273 273
  • Page 274 274
  • Page 275 275
  • Page 276 276
  • Page 277 277
  • Page 278 278
  • Page 279 279
  • Page 280 280
  • Page 281 281
  • Page 282 282
  • Page 283 283
  • Page 284 284
  • Page 285 285
  • Page 286 286
  • Page 287 287
  • Page 288 288
  • Page 289 289
  • Page 290 290
  • Page 291 291
  • Page 292 292
  • Page 293 293
  • Page 294 294
  • Page 295 295
  • Page 296 296
  • Page 297 297
  • Page 298 298
  • Page 299 299
  • Page 300 300
  • Page 301 301
  • Page 302 302
  • Page 303 303
  • Page 304 304
  • Page 305 305
  • Page 306 306
  • Page 307 307
  • Page 308 308
  • Page 309 309
  • Page 310 310
  • Page 311 311
  • Page 312 312
  • Page 313 313
  • Page 314 314
  • Page 315 315
  • Page 316 316
  • Page 317 317
  • Page 318 318
  • Page 319 319
  • Page 320 320
  • Page 321 321
  • Page 322 322
  • Page 323 323
  • Page 324 324
  • Page 325 325
  • Page 326 326
  • Page 327 327
  • Page 328 328
  • Page 329 329
  • Page 330 330
  • Page 331 331
  • Page 332 332
  • Page 333 333
  • Page 334 334
  • Page 335 335
  • Page 336 336
  • Page 337 337
  • Page 338 338
  • Page 339 339
  • Page 340 340
  • Page 341 341
  • Page 342 342
  • Page 343 343
  • Page 344 344
  • Page 345 345
  • Page 346 346
  • Page 347 347
  • Page 348 348
  • Page 349 349
  • Page 350 350
  • Page 351 351
  • Page 352 352
  • Page 353 353
  • Page 354 354
  • Page 355 355
  • Page 356 356
  • Page 357 357
  • Page 358 358
  • Page 359 359
  • Page 360 360

Dell PowerEdge M IO Aggregator Owner's manual

Category
Software
Type
Owner's manual

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI