Text formatting conventions.........................................................................................................................................................................................................7

Command syntax conventions....................................................................................................................................................................................................9

Notes, cautions, and warnings.....................................................................................................................................................................................................9

Brocade resources.....................................................................................................................................................................................................................................9

Contacting Brocade Technical Support......................................................................................................................................................................................... 10

Brocade customers.......................................................................................................................................................................................................................10

Brocade OEM customers.......................................................................................................................................................................................................... 10

Document feedback.............................................................................................................................................................................................................................. 10

Supported hardware and software...................................................................................................................................................................................................11

What's new in this document............................................................................................................................................................................................................. 11

Changes made for this release (53-1003507-08).......................................................................................................................................................14

Changes made for this release (53-1003507-09).......................................................................................................................................................14

Brocade Extension concepts..............................................................................................................................................................................................................15

Brocade IP Extension concepts...............................................................................................................................................................................................15

VE_Ports and VEX_Ports..........................................................................................................................................................................................................16

Extension interfaces, circuits, and trunks............................................................................................................................................................................. 17

Extension Trunking ................................................................................................................................................................................................................................18

Redundancy and fault tolerance..............................................................................................................................................................................................18

Tunnel restrictions for Fibre Channel Protocol and FICON Acceleration...............................................................................................................19

Compression options............................................................................................................................................................................................................................ 21

Brocade 7800 switch and FX8-24 blade..........................................................................................................................................................................21

Brocade 7840 switch compression options......................................................................................................................................................................22

FastWrite and Open Systems Tape Pipelining............................................................................................................................................................................22

FastWrite and OSTP congurations...................................................................................................................................................................................... 23

Support for IPv6 addressing..............................................................................................................................................................................................................24

IPv6 with embedded IPv4 addresses...................................................................................................................................................................................25

Memory use limitations for large-device tunnel congurations.......................................................................................................................................... 26

Control blocks created during FCP trac ow..................................................................................................................................................................26

Control blocks created during FICON trac ow............................................................................................................................................................ 26

Brocade FX8-24 Extension Blade..................................................................................................................................................................................................34

Removing Brocade FX8-24 blades......................................................................................................................................................................................37

License options.............................................................................................................................................................................................................................. 37

10 GbE port considerations......................................................................................................................................................................................................37

Multigigabit circuits....................................................................................................................................................................................................................... 38

Crossports........................................................................................................................................................................................................................................ 38

Bandwidth allocation and restrictions....................................................................................................................................................................................41

Brocade 7840 Extension Switch.....................................................................................................................................................................................................44

Brocade 7840 Fibre Channel port groups.........................................................................................................................................................................45

Brocade 7840 DP components and VE_Port distribution.........................................................................................................................................45

Path Maximum Transmission Unit discovery..............................................................................................................................................................................57

Tunnel and circuit requirements........................................................................................................................................................................................................57

General tunnel, circuit, and port requirements...................................................................................................................................................................58

Brocade 7800 extension switches........................................................................................................................................................................................ 58

Brocade FX8-24 extension blades....................................................................................................................................................................................... 59

Brocade 7840 extension switches........................................................................................................................................................................................ 60

Circuit failover........................................................................................................................................................................................................................................... 61

Circuit Failover Grouping............................................................................................................................................................................................................ 62

10 GbE Lossless Link Loss (FX8-24 blade).....................................................................................................................................................................65

Failover in TI zones....................................................................................................................................................................................................................... 67

Conguring VEX_Ports........................................................................................................................................................................................................................ 71

Conguring the media type for GbE ports 0 and 1 (Brocade 7800 switch).................................................................................................................72

Setting the GbE port operating mode on FX8-24 blade only.............................................................................................................................................72

Conguring switch and port modes (7840 switch)..................................................................................................................................................................73

Conguring port speed (Brocade 7840 switch)........................................................................................................................................................................ 74

Conguring an IPIF................................................................................................................................................................................................................................ 75

Conguring an IP route.........................................................................................................................................................................................................................76

Commands for conguring IP routes....................................................................................................................................................................................77

Commands for modifying IP routes......................................................................................................................................................................................78

Validating IP connectivity.....................................................................................................................................................................................................................78

Creating an Extension tunnel..............................................................................................................................................................................................................78

Tunnel conguration options.....................................................................................................................................................................................................80

Keep-alive timeout option..........................................................................................................................................................................................................80

Creating additional circuits ................................................................................................................................................................................................................. 81

Modifying a tunnel..................................................................................................................................................................................................................................86

Modifying a circuit...................................................................................................................................................................................................................................86

Deleting an IP interface ....................................................................................................................................................................................................................... 87

Deleting an IP route .............................................................................................................................................................................................................................. 87

Deleting a trunk........................................................................................................................................................................................................................................87

Deleting a circuit .....................................................................................................................................................................................................................................88

Conguring Per-Priority TCP QoS priorities over a trunk......................................................................................................................................................88

Modifying default priority values.......................................................................................................................................................................................................89

Using logical switches...........................................................................................................................................................................................................................90

Logical switch overview ............................................................................................................................................................................................................. 90

Considerations for logical switches........................................................................................................................................................................................92

Implementing IPsec over tunnels..................................................................................................................................................................................................102

Limitations using IPsec over tunnels..................................................................................................................................................................................102

IPsec for the extension switches and blades...................................................................................................................................................................103

Enabling IPsec and IKE policies...........................................................................................................................................................................................103

Brocade 7840 IKE authentication failures.......................................................................................................................................................................105

Trac Isolation Zoning.......................................................................................................................................................................................................................105

Conguration preparation for IP Extension features..............................................................................................................................................................107

Conguration steps for IP Extension features..........................................................................................................................................................................108

Conguring hybrid mode for IP Extension features.............................................................................................................................................................. 109

In-band management........................................................................................................................................................................................................................ 119

IP routing........................................................................................................................................................................................................................................119

IP forwarding support............................................................................................................................................................................................................... 124

WAN performance analysis tools..................................................................................................................................................................................................126

The tperf option...........................................................................................................................................................................................................................126

Displaying switch mode information with the extncfg command.......................................................................................................................... 133

Displaying GbE port information with the portcfgge command.............................................................................................................................134

Listing the MAC addresses of LAN and GE ports....................................................................................................................................................... 134

Displaying LAG information...................................................................................................................................................................................................134

Displaying tunnel information................................................................................................................................................................................................135

Displaying tunnel HCL information.....................................................................................................................................................................................135

Displaying TCL information....................................................................................................................................................................................................135

Displaying IP Extension LAN statistics..............................................................................................................................................................................135

Displaying performance statistics........................................................................................................................................................................................136

Displaying QoS statistics.........................................................................................................................................................................................................136

Displaying details........................................................................................................................................................................................................................136

Displaying TCP statistics for circuits...................................................................................................................................................................................137

Displaying circuit performance ............................................................................................................................................................................................ 137

Displaying QoS prioritization for a circuit......................................................................................................................................................................... 137

Displaying tunnel information (FX8-24 blade)...............................................................................................................................................................138

Tunnel issues ........................................................................................................................................................................................................................................ 138

Tunnel does not come online................................................................................................................................................................................................ 138

Notes, cautions, and warning statements may be used in this document. They are listed in the order of increasing severity of potential

hazards.

A Note provides a tip, guidance, or advice, emphasizes important information, or provides a reference to related information.

An Attention statement indicates a stronger note, for example, to alert you when trac might be interrupted or the device might

reboot.

White papers, data sheets, and the most recent versions of Brocade software and hardware manuals are available at www.brocade.com.

Product documentation for all supported releases is available to registered users at MyBrocade.

locate documentation by product or by operating system.

• WAN bandwidth pooling — pool bandwidth from multiple links/providers

You must congure unique IPIFs at the endpoint of each circuit. An IPIF consists of an IP address for a circuit endpoint, subnet mask,

and an MTU size. For the Brocade 7840 switch, the IPIF can also contain a VLAN ID for VLAN tagging and the ability to enable PMTU.

If the remote IPIF is not on the same subnet as the local IPIF, you must congure an IP route to that destination specifying the gateway

to use. You can dene a specic number of routes per IPIF based on the extension platform. Refer to Tunnel and circuit requirements on

page 57 for specications. An Ethernet interface can contain multiple IPIFs.

In this publication, the "source" or "local" is the switch you are conguring, while the "destination" or "remote" is the switch on the

other end of the tunnel.

Congure an extension tunnel by specifying a VE_Port for a source and destination interface. When you congure a circuit on the tunnel,

you will provide two IP addresses, one for the source and one for the destination IP interface.

communicate across the IP infrastructure. Extension HCL is supported only on the Brocade 7840. For additional information, refer to

Conguring Extension HCL on page 82.

the FX8-24 Extension Blade, refer to the Extension Features on Brocade Extension Switches and Blades chapter.

Extension Trunking is a method for managing the use of WAN bandwidth and providing redundant paths over the WAN that can protect

against transmission loss due to WAN failure. Extension Trunking also provides granular load balancing on a weighted round-robin basis

per batch. Trunking is enabled by creating multiple circuits within a tunnel so that the tunnel utilizes multiple circuits to carry

trac

between multiple source and destination addresses. For circuit capacities for Brocade extension switches and blades, refer to Tunnel and

circuit requirements on page 57.

Multiple extension tunnels can be

and blades, refer to Circuit failover on page 61.

When you create multiple parallel tunnels between the same switch domains, you must enable Lossless Dynamic Load Sharing

(DLS). This is because there can be routing updates that will occur when tunnels come up or go down. Each routing update can

cause dropped, or unrouteable frames if the destination is via the peer tunnel connected switch domain.

switch/logical fabric (LS/LF) congurations are used to provide deterministic ows between the switches. These features require

deterministic FC frame routing between initiators and targets when multiple tunnels or VE_Ports exist. Non-controlled, parallel (equal-

controlling the routing of SID/DID pairs to a specic tunnel using TI Zones or Virtual Fabrics (VF) LS/LF congurations.

Note the following additional restrictions:

• FICON networks with or without FICON Acceleration do not support exchange-based routing (EBR) congurations.

device tunnel congurations on page 26.

Because Brocade Extension tunnels use TCP connections over an existing wide area network, consult with the WAN carrier and IP

network administrator to ensure that the network hardware and software equipment operating in the data path can properly support the

TCP connections. Keep the following considerations in mind:

• Routers and

rewalls that are in the data path must be congured to pass trac through a specic TCP port on the switch. If

IPsec is used, the network must allow Encapsulating Security Payload (ESP) trac to pass through (UDP port 500). The

Brocade WO-TCP implementation selects a port between 49152 and 65535 as the ephemeral (or initiating) port to open up

to port 3225 and 3226.

Adaptive Rate Limiting (ARL) is performed on circuits to change the rate in which the tunnel transmits data through the IP network. ARL

uses information from the TCP connections to determine and adjust the rate limit for the circuit dynamically. This allows connections to

utilize the maximum available bandwidth while providing a minimum bandwidth guarantee. ARL is

because each circuit may have available dierent amounts of bandwidth.

ARL is supported only if Fabric OS v7.0.0 and later is running on both ends of the tunnel. For Fabric OS v7.0.0 and later, you can

congure minimum and maximum rates for each circuit of a tunnel using the following ports:

• XGE (10 GbE) ports on the Brocade FX8-24 blade (xge0 and xge1).

• 10G (1/10 GbE) ports on the Brocade 7840 switch (ge2-ge17).

ARL applies a minimum and maximum trac rate, and allows the trac demand and WAN connection quality to determine the rate

and consume larger and faster links. On the Brocade 7840, the enhanced response time of ARL provides faster rate limiting adaptation,

which permits optimized throughput of not only Extension trac, but also the competing ows.

The back-o mechanism implemented by ARL is optimized to increase overall throughput. ARL dynamically preserves bandwidth and

evaluates network conditions to see whether additional back-os are required.

ARL maintains Round Trip Time (RTT) stateful information to better predict network conditions and to allow intelligent and granular

decisions about proper adaptive rate limiting. When ARL encounters a network error, it looks back at prior stateful information, which will

be dierent relative to the current state. Rate limit decisions are then modied using the ARL algorithm. When congured for automatic

selection, ARL will dynamically determine which algorithm to use based on the changing network conditions.

Fabric Shortest Path First (FSPF) is a link state path selection protocol that directs

• If the bandwidth is greater than or equal to 2 Gbps, the link cost is 500.

When running multiple parallel tunnels, set the static link costs if you want all tunnels used at all times. Otherwise, a circuit outage can

take a tunnel out of service because of a link cost change. If multiple parallel tunnels are used, congure Lossless DLS. This avoids circuit

bounce because of disruptive bandwidth updates.

To congure the minimum and maximum committed rates for ARL on a circuit, refer to Tunnel conguration options on page 80.