Juniper QFX3000-G QFabric Deployment Manual

Category
Software
Type
Deployment Manual
QFX3000-G QFabric System Deployment Guide
Release
13.1
Modified: 2015-06-30
Copyright © 2015, Juniper Networks, Inc.
Juniper Networks, Inc.
1133 Innovation Way
Sunnyvale, California 94089
USA
408-745-2000
www.juniper.net
Juniper Networks, Junos, Steel-Belted Radius, NetScreen, and ScreenOS are registered trademarks of Juniper Networks, Inc. in the United
States and other countries. The Juniper Networks Logo, the Junos logo, and JunosE are trademarks of Juniper Networks, Inc. All other
trademarks, service marks, registered trademarks, or registered service marks are the property of their respective owners.
Juniper Networks assumes no responsibility for any inaccuracies in this document. Juniper Networks reserves the right to change, modify,
transfer, or otherwise revise this publication without notice.
QFX3000-G QFabric System Deployment Guide
13.1
Copyright © 2015, Juniper Networks, Inc.
All rights reserved.
The information in this document is current as of the date on the title page.
YEAR 2000 NOTICE
Juniper Networks hardware and software products are Year 2000 compliant. Junos OS has no known time-related limitations through the
year 2038. However, the NTP application is known to have some difficulty in the year 2036.
END USER LICENSE AGREEMENT
The Juniper Networks product that is the subject of this technical documentation consists of (or is intended for use with) Juniper Networks
software. Use of such software is subject to the terms and conditions of the End User License Agreement (“EULA”) posted at
http://www.juniper.net/support/eula.html. By downloading, installing or using such software, you agree to the terms and conditions of
that EULA.
Copyright © 2015, Juniper Networks, Inc.ii
Table of Contents
About the Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Documentation and Release Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Supported Platforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Using the Examples in This Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Merging a Full Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxii
Merging a Snippet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxii
Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Documentation Feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxv
Requesting Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxv
Self-Help Online Tools and Resources . . . . . . . . . . . . . . . . . . . . . . . . . . xxv
Opening a Case with JTAC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvi
Part 1 Overview
Chapter 1 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
QFabric System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Legacy Data Center Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
QFX Series QFabric System Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Understanding QFabric System Terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Understanding Interfaces on the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Four-Level Interface Naming Convention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
QSFP+ Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Link Aggregation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Chapter 2 Hardware Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Understanding the QFabric System Hardware Architecture . . . . . . . . . . . . . . . . . . 15
QFabric System Hardware Architecture Overview . . . . . . . . . . . . . . . . . . . . . . 15
QFX3000-G QFabric System Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
QFX3000-M QFabric System Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Understanding the Director Group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Director Group Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Director Group Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Understanding Routing Engines in the QFabric System . . . . . . . . . . . . . . . . . . . . . 19
Hardware-Based Routing Engines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Software-Based External Routing Engines . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Understanding Interconnect Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Interconnect Device Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
QFX3008-I Interconnect Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
QFX3600-I Interconnect Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
iiiCopyright © 2015, Juniper Networks, Inc.
Understanding Node Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Node Device Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
QFX3500 Node Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
QFX3600 Node Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Understanding Node Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Network Node Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Server Node Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Understanding Port Oversubscription on Node Devices . . . . . . . . . . . . . . . . . . . . 29
Chapter 3 Software Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Understanding the QFabric System Software Architecture . . . . . . . . . . . . . . . . . . 31
Understanding the Director Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Understanding Partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
QFabric System Default Partition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Understanding the QFabric System Control Plane . . . . . . . . . . . . . . . . . . . . . . . . . 35
Control Plane Elements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Control Plane Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Understanding the QFabric System Data Plane . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Data Plane Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
QFabric System Fabric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Chapter 4 Software Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
QFX Series Software Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Understanding Software Upgrade on the QFabric System . . . . . . . . . . . . . . . . . . 42
Operational Software Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Operational Reboot Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Understanding Nonstop Software Upgrade for QFabric Systems . . . . . . . . . . . . . 43
Understanding Statements and Commands on the QFabric System . . . . . . . . . . 47
Chassis Statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Chassis Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Understanding NTP on the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Understanding Network Management Implementation on the QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Understanding the Implementation of SNMP on the QFabric System . . . . . . . . . 50
Understanding the Implementation of System Log Messages on the QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Understanding User and Access Management Features on the QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Understanding QFabric System Login Classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Understanding Interfaces on the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . 56
Four-Level Interface Naming Convention . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
QSFP+ Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Link Aggregation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Understanding Layer 3 Features on the QFabric System . . . . . . . . . . . . . . . . . . . . 59
Understanding Security Features on the QFabric System . . . . . . . . . . . . . . . . . . . 60
Understanding Port Mirroring on the QFabric System . . . . . . . . . . . . . . . . . . . . . . . 61
Understanding Fibre Channel Fabrics on the QFabric System . . . . . . . . . . . . . . . . 61
Copyright © 2015, Juniper Networks, Inc.iv
QFX3000-G QFabric System Deployment Guide
Understanding CoS Fabric Forwarding Class Sets . . . . . . . . . . . . . . . . . . . . . . . . . 62
Default Fabric Forwarding Class Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Fabric Forwarding Class Set Configuration and Implementation . . . . . . . . . . 67
Mapping Forwarding Classes to Fabric Forwarding Class Sets . . . . . . . . 67
Fabric Forwarding Class Set Implementation . . . . . . . . . . . . . . . . . . . . . 68
Fabric Forwarding Class Set Scheduling (CoS) . . . . . . . . . . . . . . . . . . . . . . . 69
Class Groups for Fabric Forwarding Class Sets . . . . . . . . . . . . . . . . . . . . 69
Class Group Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
QFabric System CoS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Support for Flow Control and Lossless Transport Across the Fabric . . . . . . . . 71
Viewing Fabric Forwarding Class Set Information . . . . . . . . . . . . . . . . . . . . . . 73
Summary of Fabric Forwarding Class Set and Node Device Forwarding Class
Set Differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Chapter 5 Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Junos OS Feature Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Software Features That Require Licenses on the QFX Series . . . . . . . . . . . . . . . . . 77
Junos OS License Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Licensable Ports on MX5, MX10, and MX40 Routers . . . . . . . . . . . . . . . . . . . . 79
Part 2 Installation
Chapter 6 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
QFX3000-G QFabric System Installation Overview . . . . . . . . . . . . . . . . . . . . . . . 83
Understanding QFX3000-G QFabric System Hardware Configurations . . . . . . . 85
Planning a QFX3000-G QFabric System Deployment . . . . . . . . . . . . . . . . . . . . . 86
General Site Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Site Electrical Wiring Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Environmental Requirements and Specifications for a QFX3100 Director
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Environmental Requirements and Specifications for a QFX3008-I Interconnect
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Environmental Requirements and Specifications for a QFX3500 Device . . . . . . . 94
Environmental Requirements and Specifications for QFX3600 and QFX3600-I
Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
Chapter 7 Ports and Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Interface Support for the QFX3600 Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Interface Support for the QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
Interface Specifications for SFP, SFP+, and QSFP+ Transceivers for the QFX
Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Interface Specifications for SFP+ DAC Cables for the QFX Series . . . . . . . . . . . . 114
Interface Specifications for QSFP+ DAC Breakout Cables for the QFX Series . . . 120
Interface Specifications for QSFP+ DAC Cables for the QFX Series . . . . . . . . . . . 123
Cable Specifications for Copper-Based Control Plane Connections for the QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Chapter 8 Power . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
AC Power Specifications for a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . 129
AC Power Cord Specifications for a QFX3100 Director Device . . . . . . . . . . . . . . . 130
vCopyright © 2015, Juniper Networks, Inc.
Table of Contents
AC Power Specifications for a QFX3008-I Interconnect Device with Single-Phase
Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
AC Power Specifications for a QFX3008-I Interconnect Device with Three-Phase
Delta Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
AC Power Specifications for a QFX3008-I Interconnect Device with Three-Phase
Wye Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
AC Power Cord Specifications for a QFX3008-I Interconnect Device with
Single-Phase Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
AC Power Cord Specifications for a QFX3008-I Interconnect Device with
Three-Phase Delta Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
AC Power Cord Specifications for a QFX3008-I Interconnect Device with
Three-Phase Wye Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
AC Power Specifications for a QFX3600 or QFX3600-I Device . . . . . . . . . . . . . . 137
AC Power Specifications for a QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . 138
AC Power Cord Specifications for a QFX3500, QFX3600, or QFX3600-I
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
DC Power Specifications for a QFX3600 or QFX3600-I Device . . . . . . . . . . . . . 140
DC Power Specifications for a QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . 141
Chapter 9 Installing a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
Installing and Connecting a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . 143
Unpacking a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144
Mounting a QFX3100 Director Device on Two Posts in a Rack or Cabinet . . . . . . 146
Mounting a QFX3100 Director Device on Four Posts in a Rack or Cabinet . . . . . . 147
Connecting AC Power to a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . 149
Connecting a QFX Series Device to a Management Console . . . . . . . . . . . . . . . . . 151
Powering On a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Chapter 10 Installing a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . . . . . . . . . . . 155
Installing and Connecting a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . 155
Unpacking a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Parts Inventory (Packing List) for a QFX3008-I Interconnect Device . . . . . . . . . . 157
Installing QFX3008-I Interconnect Device Mounting Hardware on Four-Post
Racks or Cabinets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Installing Four-Post Mounting Shelf and Rear Support Bracket for QFX3008-I
Interconnect Device Four-Post Rack or Cabinet Mounting . . . . . . . . . . 160
Installing Cage Nuts for the Four-Post Mounting Shelf and Support
Bracket for QFX3008-I Interconnect Device Four-Post Rack or
Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162
Installing the Rear Support Bracket for QFX3008-I Interconnect Device
Four-Post Rack or Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . 162
Installing the Four-Post Mounting Shelf for QFX3008-I Interconnect
Device Four-Post Rack or Cabinet Mounting . . . . . . . . . . . . . . . . . . 162
Installing Spacer Bars and Shelves for QFX3008-I Interconnect Device
Four-Post Rack or Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
Installing Cage Nuts for QFX3008-I Interconnect Device Four-Post Rack
or Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
Installing the Small Mounting Shelf for QFX3008-I Interconnect Device
Four-Post Rack or Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . 165
Copyright © 2015, Juniper Networks, Inc.vi
QFX3000-G QFabric System Deployment Guide
Installing the Large Mounting Shelf and Spacer Bars for QFX3008-I
Interconnect Device Four-Post Rack or Cabinet Mounting . . . . . . . 166
Removing the Adjustable Center-Mounting Brackets for QFX3008-I
Interconnect Device Four-Post Rack or Cabinet Mounting . . . . . . . . . . 166
Installing QFX3008-I Interconnect Device Mounting Hardware on Two-Post
Racks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
Installing Cage Nuts for QFX3008-I Interconnect Device Two-Post Rack
Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
Installing the Small Mounting Shelf for QFX3008-I Interconnect Device
Two-Post Rack Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
Installing the Large Mounting Shelf for QFX3008-I Interconnect Device
Two-Post Rack Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
Mounting a QFX3008-I Interconnect Device on a Rack or Cabinet Using a
Mechanical Lift . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
Connecting Earth Ground to a QFX3008-I Interconnect Device . . . . . . . . . . . . . . 174
Connecting AC Power to a QFX3008-I Interconnect Device with Single-Phase
Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Preparing Delta and Wye Three-Phase Power Cords . . . . . . . . . . . . . . . . . . . . . . 178
Connecting AC Power to a QFX3008-I Interconnect Device with Three-Phase
Delta Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Connecting AC Power to a QFX3008-I Interconnect Device with Three-Phase
Wye Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
Connecting a QFX Series Device to a Management Console . . . . . . . . . . . . . . . . 190
Powering On a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . . . . . . . . . . . . 191
Chapter 11 Installing a QFX3600 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Installing and Connecting a QFX3600 or QFX3600-I Device . . . . . . . . . . . . . . . . 193
Unpacking a QFX3600 or QFX3600-I Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194
Mounting a QFX3600 or QFX3600-I Device on Two Posts in a Rack or
Cabinet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
Mounting a QFX3600 or QFX3600-I Device on Four Posts in a Rack or
Cabinet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198
Connecting Earth Ground to QFX3600 or QFX3600-I Devices . . . . . . . . . . . . . . 201
Connecting AC Power to a QFX3500, QFX3600, or QFX3600-I Device . . . . . . . 203
Connecting DC Power to a QFX3500, QFX3600, or QFX3600-I Device . . . . . . . 205
Connecting a QFX Series Device to a Management Console . . . . . . . . . . . . . . . . 209
Chapter 12 Installing a QFX3500 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Installing and Connecting a QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Unpacking a QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
Mounting a QFX3500 Device in a Rack or Cabinet . . . . . . . . . . . . . . . . . . . . . . . . 213
Connecting Earth Ground to a QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Connecting AC Power to a QFX3500, QFX3600, or QFX3600-I Device . . . . . . . 217
Connecting DC Power to a QFX3500, QFX3600, or QFX3600-I Device . . . . . . . 220
Connecting a QFX Series Device to a Management Console . . . . . . . . . . . . . . . . 223
viiCopyright © 2015, Juniper Networks, Inc.
Table of Contents
Chapter 13 Cabling a Copper-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Interconnecting Two Virtual Chassis for Copper-Based QFX3000-G QFabric
System Control Plane Redundancy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Connecting QFX3100 Director Devices in a Director Group . . . . . . . . . . . . . . . . . 228
Connecting QFX3100 Director Devices to a Copper-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
Connecting a QFX3100 Director Device to a Network for Out-of-Band
Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Connecting a QFX3008-I Interconnect Device to a Copper-Based QFX3000-G
QFabric System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
Connecting a QFX3600 Node Device to a Copper-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 238
Connecting a QFX3500 Node Device to a Copper-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
Chapter 14 Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
Interconnecting Two Virtual Chassis for Fiber-Based QFX3000-G QFabric System
Control Plane Redundancy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
Connecting QFX3100 Director Devices in a Director Group . . . . . . . . . . . . . . . . . 248
Connecting QFX3100 Director Devices to a Fiber-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
Connecting a QFX3100 Director Device to a Network for Out-of-Band
Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
Connecting a QFX3008-I Interconnect Device to a Fiber-Based QFX3000-G
QFabric System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
Connecting a QFX3600 Node Device to a Fiber-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
Connecting a QFX3500 Node Device to a Fiber-Based QFX3000-G QFabric
System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
Chapter 15 Cabling the Data Plane for the QFX3000-G QFabric System . . . . . . . . . . 269
Connecting a QFX3600 Node Device to a QFX3008-I Interconnect Device . . . 269
Connecting a QFX3500 Node Device to a QFX3008-I Interconnect Device . . . . 271
Copyright © 2015, Juniper Networks, Inc.viii
QFX3000-G QFabric System Deployment Guide
Part 3 Configuration
Chapter 16 Initial Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
QFabric System Initial and Default Configuration Information . . . . . . . . . . . . . . . 275
Converting the Device Mode for a QFabric System Component . . . . . . . . . . . . . 277
Example: Configuring the Virtual Chassis for the QFX3000-G QFabric System
Control Plane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283
Example: Configuring a Fiber-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
Importing a QFX3000-G QFabric System Control Plane Virtual Chassis
Configuration with a USB Flash Drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359
Generating the MAC Address Range for a QFabric System . . . . . . . . . . . . . . . . . 361
Performing the QFabric System Initial Setup on a QFX3100 Director Group . . . 362
Performing an Initial Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 363
Restoring a Backup Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 366
Chapter 17 QFabric System Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369
Understanding QFabric System Administration Tasks and Utilities . . . . . . . . . . 369
Gaining Access to the QFabric System Through the Default Partition . . . . . . . . . 373
Example: Configuring QFabric System Login Classes . . . . . . . . . . . . . . . . . . . . . . 374
Configuring Aliases for the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 382
Configuring the Port Type on QFX3600 Node Devices . . . . . . . . . . . . . . . . . . . . 392
Configuring Node Groups for the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . 395
Example: Configuring SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 399
Configuring Graceful Restart for QFabric Systems . . . . . . . . . . . . . . . . . . . . . . . . 401
Enabling Graceful Restart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
Configuring Graceful Restart Options for BGP . . . . . . . . . . . . . . . . . . . . . . . 403
Configuring Graceful Restart Options for OSPF and OSPFv3 . . . . . . . . . . . 404
Tracking Graceful Restart Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405
Optimizing the Number of Multicast Flows on QFabric Systems . . . . . . . . . . . . 405
Chapter 18 QFabric System Licensing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
Generating the License Keys for a QFabric System . . . . . . . . . . . . . . . . . . . . . . . 407
Adding New Licenses (CLI Procedure) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
Deleting a License (CLI Procedure) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
Saving License Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
Verifying Junos OS License Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 412
Displaying Installed Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 412
Displaying License Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 413
Chapter 19 Configuration Statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 415
aliases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416
archive (QFabric System) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
chassis (QFabric System) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 418
director-device (Aliases) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 420
fabric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421
file (QFabric System) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422
graceful-restart (Enabling Globally) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423
graceful-restart (Protocols BGP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 425
graceful-restart (Protocols OSPF) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 427
ixCopyright © 2015, Juniper Networks, Inc.
Table of Contents
interconnect-device (Chassis) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 429
interconnect-device (Aliases) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 430
multicast (QFabric Routing Options) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431
network-domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431
no-make-before-break . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 432
node-device (Aliases) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 433
node-device (Chassis) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 434
node-device (Resources) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435
node-group (Chassis) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436
node-group (Resources) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437
pic (Port) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438
remote-debug-permission . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 439
resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440
routing-options (QFabric System) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440
syslog (QFabric System) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 441
Part 4 Administration
Chapter 20 Software Upgrade and Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 445
Performing a Nonstop Software Upgrade on the QFabric System . . . . . . . . . . . 445
Backing Up the Current Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . . 446
Downloading Software Files Using a Browser . . . . . . . . . . . . . . . . . . . . . . . . 447
Retrieving Software Files for Download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 447
Performing a Nonstop Software Upgrade for Director Devices in a Director
Group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 448
Performing a Nonstop Software Upgrade for Interconnect Devices and Other
Fabric-Related Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 448
(Optional) Creating Upgrade Groups for Node Groups . . . . . . . . . . . . . . . . 448
Performing a Nonstop Software Upgrade on a Node Group . . . . . . . . . . . . 449
Verifying Nonstop Software Upgrade for QFabric Systems . . . . . . . . . . . . . . . . . 450
Verifying a Director Group Nonstop Software Upgrade . . . . . . . . . . . . . . . . . 451
Verifying a Fabric Nonstop Software Upgrade . . . . . . . . . . . . . . . . . . . . . . . 464
Verifying a Redundant Server Node Group Nonstop Software Upgrade . . . 465
Verifying a Network Node Group Nonstop Software Upgrade . . . . . . . . . . . 468
Upgrading Software on a QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 470
Backing Up the Current Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . . 471
Downloading Software Files Using a Browser . . . . . . . . . . . . . . . . . . . . . . . . 471
Retrieving Software Files for Download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 472
Installing the Software Package on the Entire QFabric System . . . . . . . . . . 472
Performing System Backup and Recovery for a QFabric System . . . . . . . . . . . . . 475
Chapter 21 Operational Mode Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
QFabric System Operational Mode Commands . . . . . . . . . . . . . . . . . . . . . . . . . . 478
Filtering Operational Mode Command Output in a QFabric System . . . . . . . . . 480
request chassis device-mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 481
request chassis fabric fpc . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 483
request component login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484
request fabric administration director-group change-master . . . . . . . . . . . . . . . 486
request fabric administration remove . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487
request fabric administration system mac-pool add . . . . . . . . . . . . . . . . . . . . . . 489
Copyright © 2015, Juniper Networks, Inc.x
QFX3000-G QFabric System Deployment Guide
request fabric administration system mac-pool delete . . . . . . . . . . . . . . . . . . . 490
request system halt . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 491
request system reboot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497
request system software format-qfabric-backup . . . . . . . . . . . . . . . . . . . . . . . . 500
request system software nonstop-upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 501
request system software system-backup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 507
set chassis display message . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 509
show chassis device-mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 515
show chassis ethernet-switch interconnect-device cb . . . . . . . . . . . . . . . . . . . . . 518
show chassis ethernet-switch interconnect-device fpc . . . . . . . . . . . . . . . . . . . . 535
show chassis fabric connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 560
show chassis fabric device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 567
show chassis lcd . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 569
show chassis nonstop-upgrade node-group . . . . . . . . . . . . . . . . . . . . . . . . . . . . 583
show fabric administration inventory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 584
show fabric administration inventory director-group status . . . . . . . . . . . . . . . . 589
show fabric administration inventory infrastructure . . . . . . . . . . . . . . . . . . . . . . 594
show fabric administration inventory interconnect-devices . . . . . . . . . . . . . . . . 597
show fabric administration inventory node-devices . . . . . . . . . . . . . . . . . . . . . . 599
show fabric administration inventory node-groups . . . . . . . . . . . . . . . . . . . . . . . 601
show fabric administration system mac-pool . . . . . . . . . . . . . . . . . . . . . . . . . . . 603
show fabric inventory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 604
show fabric session-host . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 607
show log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 608
show system software upgrade status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 611
Part 5 Troubleshooting
Chapter 22 QFabric System Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 615
Performing System Backup and Recovery for a QFabric System . . . . . . . . . . . . . 615
Performing a QFabric System Recovery Installation on the Director Group . . . . . 616
(Optional) Creating an Emergency Boot Device Using a Juniper Networks
External Blank USB Flash Drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 617
Performing a Recovery Installation Using a Juniper Networks External USB
Flash Drive with Preloaded Software . . . . . . . . . . . . . . . . . . . . . . . . . . . 618
Performing a Recovery Installation on a QFX3008-I, QFX3600-I, QFX3600, or
QFX3500 Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 623
Creating an Emergency Boot Device for a QFX Series Device . . . . . . . . . . . . . . . 625
xiCopyright © 2015, Juniper Networks, Inc.
Table of Contents
Copyright © 2015, Juniper Networks, Inc.xii
QFX3000-G QFabric System Deployment Guide
List of Figures
Part 1 Overview
Chapter 1 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Figure 1: Legacy Data Center Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Figure 2: QFX Series QFabric System Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Chapter 2 Hardware Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Figure 3: QFabric System Hardware Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Figure 4: External Routing Engine Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Figure 5: Clos Switching for QFX3008-I Interconnect Devices . . . . . . . . . . . . . . . . 22
Figure 6: QFX3008-I Data Plane and Control Plane Connections . . . . . . . . . . . . . 23
Figure 7: QFX3600-I Data Plane and Control Plane Connections . . . . . . . . . . . . . 24
Figure 8: QFX3500 Data Plane and Control Plane Connections . . . . . . . . . . . . . . 26
Figure 9: QFX3600 Data Plane and Control Plane Connections . . . . . . . . . . . . . . 27
Chapter 3 Software Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Figure 10: QFabric System Topology - Default Partition . . . . . . . . . . . . . . . . . . . . . 34
Figure 11: QFabric System Control Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . 36
Figure 12: QFabric System Data Plane Network . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Figure 13: QFX3008-I Interconnect Device Cross-Connect System . . . . . . . . . . . 40
Part 2 Installation
Chapter 7 Ports and Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Figure 14: QSFP+ Uplink Port Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
Chapter 8 Power . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Figure 15: AC Plug Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
Figure 16: AC Plug Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
Chapter 9 Installing a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
Figure 17: Unpacking a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . 145
Figure 18: Mounting the QFX3100 Director Device on Two Posts in a Rack . . . . . 147
Figure 19: Mounting a QFX3100 Director Device on Four Posts in a Rack or
Cabinet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Figure 20: Connecting an AC Power Cord to an AC Power Supply in a QFX3100
Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150
Figure 21: Connecting the QFX Series to a Management Console Through a
Console Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Figure 22: Connecting the QFX Series Directly to a Management Console . . . . . . 151
Chapter 10 Installing a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . . . . . . . . . . . 155
xiiiCopyright © 2015, Juniper Networks, Inc.
Figure 23: Installing Four-Post Mounting Shelf and Rear Support Bracket for
QFX3008-I Interconnect Device Four-Post Rack or Cabinet Mounting . . . . . 161
Figure 24: Installing Spacer Bar and Shelves for QFX3008-I Interconnect Device
Four-Post Rack or Cabinet Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Figure 25: Installing the Mounting Hardware for a Two-Post Rack . . . . . . . . . . . 168
Figure 26: Installing a QFX3008-I Interconnect Device in a Four-Post Rack . . . . 173
Figure 27: Attaching Rear Support Anchors to the QFX3008-I Chassis in a
Four-Post Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
Figure 28: Connecting a Grounding Cable to a QFX3008-I Interconnect
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Figure 29: Connecting an AC Power Cord to a Single-Phase Wiring Tray . . . . . . . 178
Figure 30: Assembling a Power Cord Using a 90° Connector . . . . . . . . . . . . . . . . 179
Figure 31: Assembling a Power Cord Using a Flat Connector . . . . . . . . . . . . . . . . 179
Figure 32: Wye Wiring Tray with a 90° Connector Installed . . . . . . . . . . . . . . . . . 180
Figure 33: Delta Wiring Tray with a Flat Connector Installed . . . . . . . . . . . . . . . . 180
Figure 34: Installing a Three-Phase Wiring Tray with a Power Cord Installed . . . . 181
Figure 35: Connecting Power to a Three-Phase Delta AC Power Supply . . . . . . . 186
Figure 36: Connecting Power to the Three-Phase Wye Wiring Tray . . . . . . . . . . . 189
Figure 37: Connecting the QFX Series to a Management Console Through a
Console Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
Figure 38: Connecting the QFX Series Directly to a Management Console . . . . . . 191
Chapter 11 Installing a QFX3600 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Figure 39: Attaching the Front or Rear Mounting Brackets to the Side Panel of
the Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
Figure 40: Mounting the Device on Two Posts in a Rack . . . . . . . . . . . . . . . . . . . . 197
Figure 41: Attaching the Installation Blades to the Rear of the Rack . . . . . . . . . . 200
Figure 42: Mounting the Device on Four-Posts . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Figure 43: Connecting a Grounding Cable to a QFX3600 or QFX3600-I
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
Figure 44: Connecting an AC Power Cord to an AC Power Supply in a QFX3500
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
Figure 45: Connecting an AC Power Cord to an AC Power Supply in a QFX3600
or QFX3600-I Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
Figure 46: DC Power Supply Faceplate for a QFX3500, QFX3600 or QFX3600-I
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
Figure 47: Securing Ring Lugs to the Terminals on the QFX3500, QFX3600 or
QFX3600-I DC Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
Figure 48: Connecting the QFX Series to a Management Console Through a
Console Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
Figure 49: Connecting the QFX Series Directly to a Management Console . . . . . 210
Chapter 12 Installing a QFX3500 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Figure 50: Installing an Installation Blade in a Rack . . . . . . . . . . . . . . . . . . . . . . . 214
Figure 51: Mounting the QFX3500 Device on Four Posts in a Rack . . . . . . . . . . . . 215
Figure 52: Connecting a Grounding Cable to a QFX3500 Device . . . . . . . . . . . . . 217
Figure 53: Connecting an AC Power Cord to an AC Power Supply in a QFX3500
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Figure 54: Connecting an AC Power Cord to an AC Power Supply in a QFX3600
or QFX3600-I Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Copyright © 2015, Juniper Networks, Inc.xiv
QFX3000-G QFabric System Deployment Guide
Figure 55: DC Power Supply Faceplate for a QFX3500, QFX3600 or QFX3600-I
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Figure 56: Securing Ring Lugs to the Terminals on the QFX3500, QFX3600 or
QFX3600-I DC Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
Figure 57: Connecting the QFX Series to a Management Console Through a
Console Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
Figure 58: Connecting the QFX Series Directly to a Management Console . . . . . 224
Chapter 13 Cabling a Copper-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Figure 59: QFX3000-G QFabric System Copper-Based Control
Plane—Inter-Virtual Chassis LAG Connections . . . . . . . . . . . . . . . . . . . . . . . 226
Figure 60: Connecting a Fiber-Optic Cable to an Optical Transceiver Installed
in an EX Series Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
Figure 61: QFX3100 Director Group Control Plane Connections for QFX3000-G
QFabric System Using Copper-Based Control Plane . . . . . . . . . . . . . . . . . . 228
Figure 62: QFX3100 Director Group Control Plane Connections for QFX3000-G
QFabric System Using Fiber-Based Control Plane . . . . . . . . . . . . . . . . . . . . 229
Figure 63: QFX3100 Director Group Control Plane Connections for QFX3000-M
QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
Figure 64: QFX3100 Director Group to Virtual Chassis Connections for
QFX3000-G QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
Figure 65: QFX3008-I Interconnect Device Control Plane Connections . . . . . . . 235
Figure 66: QFX3600 Node Device Control Plane Connections . . . . . . . . . . . . . . 239
Figure 67: QFX3500 Node Device Control Plane Connections . . . . . . . . . . . . . . . 241
Chapter 14 Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
Figure 68: QFX3000-G QFabric System Fiber-Based Control Plane—Inter-Virtual
Chassis LAG Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
Figure 69: Connecting a Fiber-Optic Cable to an Optical Transceiver Installed
in an EX Series Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
Figure 70: QFX3100 Director Group Control Plane Connections for QFX3000-G
QFabric System Using Copper-Based Control Plane . . . . . . . . . . . . . . . . . . 248
Figure 71: QFX3100 Director Group Control Plane Connections for QFX3000-G
QFabric System Using Fiber-Based Control Plane . . . . . . . . . . . . . . . . . . . . 249
Figure 72: QFX3100 Director Group Control Plane Connections for QFX3000-M
QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
Figure 73: QFX3100 Director Group to Virtual Chassis Connections for
QFX3000-G QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
Figure 74: QFX3000-G QFabric System Fiber-Based Control Plane—Interconnect
Device to Virtual Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
Figure 75: QFX3600 Node Device Fiber-Based Control Plane Connections for
QFX3000-M QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
Figure 76: QFX3500 Node Device Fiber-Based Control Plane Connections for
QFX3000-M QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
Part 3 Configuration
Chapter 16 Initial Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
xvCopyright © 2015, Juniper Networks, Inc.
List of Figures
Figure 77: QFX3000-G QFabric System Control Plane—Virtual Chassis Port
Ranges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
Figure 78: QFX3000-G QFabric System Control Plane—Director Group to Virtual
Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290
Figure 79: QFX3000-G QFabric System Control Plane—Interconnect Device to
Virtual Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292
Figure 80: QFX3000-G QFabric System Control Plane—Node Device to Virtual
Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293
Figure 81: QFX3000-G QFabric System Control Plane—Inter-Virtual Chassis
LAG Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
Figure 82: QFX3000-G QFabric System Fiber-Based Control Plane—Virtual
Chassis Port Ranges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329
Figure 83: QFX3000-G QFabric System Fiber-Based Control Plane—Director
Group to Virtual Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 333
Figure 84: QFX3000-G QFabric System Fiber-Based Control Plane—Interconnect
Device to Virtual Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335
Figure 85: QFX3000-G QFabric System Fiber-Based Control Plane—Node Device
to Virtual Chassis Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337
Figure 86: QFX3000-G QFabric System Fiber-Based Control Plane—Inter-Virtual
Chassis LAG Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
Copyright © 2015, Juniper Networks, Inc.xvi
QFX3000-G QFabric System Deployment Guide
List of Tables
About the Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Table 1: Notice Icons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Table 2: Text and Syntax Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Part 1 Overview
Chapter 1 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Table 3: QFabric System Terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Table 4: QFX3600 Node Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Chapter 2 Hardware Architecture Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Table 5: Supported QFabric System Hardware Configurations . . . . . . . . . . . . . . . . 17
Table 6: Oversubscription Ratio on Node Devices . . . . . . . . . . . . . . . . . . . . . . . . . 29
Chapter 4 Software Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Table 7: QFX3600 Node Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Table 8: Default Fabric Forwarding Class Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Table 9: Default Forwarding Class to Fabric Forwarding Class Set Mapping . . . . 65
Table 10: Class Group Scheduling Properties and Membership . . . . . . . . . . . . . . . 70
Table 11: Lossless Priority (Forwarding Class) Support for QFX3500 and
QFX3600 Node Devices When Fewer than Six Lossless Priorities Are
Supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Table 12: show class-of-service forwarding-class-set Command Output
Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Table 13: Summary of Differences Between Fabric fc-sets and Node Device
fc-sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Chapter 5 Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Table 14: Junos OS Feature Licenses and Model Numbers for QFX Series
Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
Table 15: Upgrade Licenses for Enhancing Port Capacity . . . . . . . . . . . . . . . . . . . 80
Part 2 Installation
Chapter 6 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Table 16: Number of 10-Gigabit Ethernet Access Ports Supported on Node
Devices Based on Oversubscription Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Table 17: Maximum Number of Node Devices Supported Based on
Oversubscription Ratio and Number of Interconnect Devices . . . . . . . . . . . . 87
Table 18: Number of Connections Required Between Node and Interconnect
Devices Based on Oversubscription Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Table 19: Site Electrical Wiring Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
xviiCopyright © 2015, Juniper Networks, Inc.
Table 20: QFX3100 Director Device Environmental Tolerances . . . . . . . . . . . . . . . 93
Table 21: QFX3008-I Interconnect Device Environmental Tolerances . . . . . . . . . . 94
Table 22: QFX3500 Device Environmental Tolerances . . . . . . . . . . . . . . . . . . . . . 95
Table 23: QFX3600 and QFX3600-I Device Environmental Tolerances . . . . . . . . 96
Chapter 7 Ports and Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Table 24: Supported Transceivers for the QFX3600 Device . . . . . . . . . . . . . . . . . 98
Table 25: Supported DAC and DAC Breakout Cables for the QFX3600
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
Table 26: Supported Transceivers for the QFX3500 Device . . . . . . . . . . . . . . . . . 101
Table 27: Supported DAC and DAC Breakout Cables for the QFX3500 Device . . 102
Table 28: Copper Interface Support and Optical Interface Support for
Gigabit Ethernet SFP Transceivers for the QFX Series . . . . . . . . . . . . . . . . . . 105
Table 29: Optical Interface Support for Fibre Channel SFP+ Transceivers for the
QFX Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
Table 30: Optical Interface Support for 10-Gigabit Ethernet SFP+ Transceivers
for the QFX Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
Table 31: Interface Support for 40-Gigabit Ethernet QSFP+ Transceivers for the
QFX Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Table 32: Third-Party SFP+ DAC Cable Support . . . . . . . . . . . . . . . . . . . . . . . . . . 115
Table 33: SFP+ Passive Direct Attach Copper Cable Specifications . . . . . . . . . . . 116
Table 34: SFP+ Active Direct Attach Copper Cable Specifications . . . . . . . . . . . . 118
Table 35: Third-Party QSFP+ DAC Breakout Cable Support . . . . . . . . . . . . . . . . . 121
Table 36: QSFP+ DAC Breakout Cable Specifications . . . . . . . . . . . . . . . . . . . . . . 122
Table 37: QSFP+ Active DAC Breakout Cable Specifications . . . . . . . . . . . . . . . . 123
Table 38: Third-Party QSFP+ DAC Cable Support . . . . . . . . . . . . . . . . . . . . . . . . 124
Table 39: Interface Specifications for QSFP+ DAC Cables . . . . . . . . . . . . . . . . . . 125
Table 40: Cable Specifications for Copper-Based Control Plane Connections
for the QFabric System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Chapter 8 Power . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Table 41: AC Power Specifications for a QFX3100 Director Device . . . . . . . . . . . . 129
Table 42: AC Power Cord Specifications for a QFX3100 Director Device . . . . . . . 130
Table 43: AC Power Specifications for a QFX3008-I Interconnect Device with
Single-Phase Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
Table 44: AC Power Specifications for a QFX3008-I Interconnect Device with
Three-Phase Delta Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
Table 45: AC Power Specifications for a QFX3008-I Interconnect Device with
Three-Phase Wye Wiring Trays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
Table 46: AC Power Cord Specifications for a Single-Phase Wiring Tray . . . . . . . 134
Table 47: Three-Phase Delta AC Power Cord Specifications . . . . . . . . . . . . . . . . 136
Table 48: Three-Phase Delta AC Power Cord Specifications . . . . . . . . . . . . . . . . 137
Table 49: AC Power Specifications for a QFX3600 or QFX3600-I Device . . . . . . 138
Table 50: AC Power Specifications for a QFX3500 Device . . . . . . . . . . . . . . . . . . 138
Table 51: AC Power Cord Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Table 52: DC Power Specifications for a QFX3600 or QFX3600-I Device . . . . . . 140
Table 53: DC Power Specifications for a QFX3500 Device . . . . . . . . . . . . . . . . . . 141
Chapter 9 Installing a QFX3100 Director Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
Copyright © 2015, Juniper Networks, Inc.xviii
QFX3000-G QFabric System Deployment Guide
Table 54: Inventory of Components Provided with a QFX3100 Director
Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
Chapter 10 Installing a QFX3008-I Interconnect Device . . . . . . . . . . . . . . . . . . . . . . . . . 155
Table 55: Parts List for QFX3008-I Interconnect Device Configurations . . . . . . . 158
Table 56: QFX3008-I Interconnect Device Accessory Kit Contents . . . . . . . . . . . 158
Table 57: QFX3008-I Interconnect Device Rack Install Accessory Kit
Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Table 58: QFX3008-I Interconnect Device Wiring Tray Accessory Kit Part
Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Table 59: Four-Post Mounting Shelf and Rear Support Bracket Hole
Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
Table 60: Four-Post Rack or Cabinet Mounting Hole Locations . . . . . . . . . . . . . . 164
Table 61: Two-Post Rack Mounting Hole Locations . . . . . . . . . . . . . . . . . . . . . . . 168
Chapter 11 Installing a QFX3600 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Table 62: Accessory Kit Part Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
Chapter 12 Installing a QFX3500 Node Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Table 63: Inventory of Components Supplied with a QFX3500 Device . . . . . . . . 212
Chapter 13 Cabling a Copper-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Table 64: Virtual Chassis-to-Virtual Chassis Copper-Based Control Plane Port
Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
Table 65: QFX3100 Director Device-to-Virtual Chassis Control Plane Port
Assignments for DG0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Table 66: Second QFX3100 Director Device-to-Virtual Chassis Control Plane
Port Assignments for DG1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Table 67: Interconnect Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
Table 68: QFX3600 Node Device-to-Virtual Chassis Control Plane Port
Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240
Table 69: QFX3500 Node Device-to-Virtual Chassis Copper-Based Control
Plane Port Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
Chapter 14 Cabling a Fiber-Based Control Plane for the QFX3000-G QFabric
System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
Table 70: Virtual Chassis-to-Virtual Chassis Fiber-Based Control Plane Port
Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
Table 71: QFX3100 Director Device-to-VIrtual Chassis Control Plane Port
Assignments for DG0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
Table 72: Second QFX3100 Director Device-to-Virtual Chassis Control Plane
Port Assignments for DG1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
Table 73: Interconnect Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257
Table 74: QFX3600 Node Device-to-Virtual Chassis Fiber-Based Control Plane
Port Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
Table 75: QFX3500 Node Device-to-Virtual Chassis Fiber-Based Control Plane
Port Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
Part 3 Configuration
Chapter 16 Initial Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
xixCopyright © 2015, Juniper Networks, Inc.
List of Tables
Table 76: Support for device mode options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
Table 77: QFX3000-G QFabric System Virtual Chassis Control Plane Port
Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
Table 78: Director Group Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290
Table 79: Hardware to Software Port Mappings for Director Device Network
Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291
Table 80: Interconnect Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . 292
Table 81: Interconnect Device Port Mappings for Two Additional Devices . . . . . 293
Table 82: Node Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
Table 83: Virtual Chassis LAG Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 295
Table 84: QFX3000-G QFabric System Virtual Chassis Fiber-Based Control
Plane Port Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 330
Table 85: Director Group Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
Table 86: Hardware to Software Port Mappings for Director Device Network
Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
Table 87: Interconnect Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335
Table 88: Interconnect Device Port Mappings for Two Additional Devices . . . . . 336
Table 89: Node Device Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337
Table 90: Virtual Chassis LAG Port Mappings . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
Part 4 Administration
Chapter 21 Operational Mode Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
Table 91: QFabric System Operational Mode Commands . . . . . . . . . . . . . . . . . . 478
Table 92: show chassis device-mode Output Fields . . . . . . . . . . . . . . . . . . . . . . . 516
Table 93: show chassis ethernet-switch interconnect-device fpc Output
Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 518
Table 94: show chassis ethernet-switch interconnect-device fpc Output
Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 535
Table 95: show chassis fabric connectivity Output Fields . . . . . . . . . . . . . . . . . . 560
Table 96: show chassis fabric device Output Fields . . . . . . . . . . . . . . . . . . . . . . . 567
Table 97: show chassis lcd Output Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571
Table 98: show chassis nonstop-upgrade node-group Output Fields . . . . . . . . 583
Table 99: show fabric administration inventory Output Fields . . . . . . . . . . . . . . 585
Table 100: show fabric administration inventory director-group status Output
Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 589
Table 101: show fabric administration inventory infrastructure Output Fields . . 594
Table 102: show fabric administration inventory interconnect-devices Output
Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 597
Table 103: show fabric administration inventory node-devices Output Fields . . 599
Table 104: show fabric administration inventory node-groups Output Fields . . . 601
Table 105: show fabric administration system mac-pool Output Fields . . . . . . . 603
Table 106: show fabric inventory Output Fields . . . . . . . . . . . . . . . . . . . . . . . . . . 605
Table 107: show fabric session-host Output Fields . . . . . . . . . . . . . . . . . . . . . . . 607
Table 108: show system software upgrade status Output Fields . . . . . . . . . . . . . 611
Copyright © 2015, Juniper Networks, Inc.xx
QFX3000-G QFabric System Deployment Guide
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56
  • Page 57 57
  • Page 58 58
  • Page 59 59
  • Page 60 60
  • Page 61 61
  • Page 62 62
  • Page 63 63
  • Page 64 64
  • Page 65 65
  • Page 66 66
  • Page 67 67
  • Page 68 68
  • Page 69 69
  • Page 70 70
  • Page 71 71
  • Page 72 72
  • Page 73 73
  • Page 74 74
  • Page 75 75
  • Page 76 76
  • Page 77 77
  • Page 78 78
  • Page 79 79
  • Page 80 80
  • Page 81 81
  • Page 82 82
  • Page 83 83
  • Page 84 84
  • Page 85 85
  • Page 86 86
  • Page 87 87
  • Page 88 88
  • Page 89 89
  • Page 90 90
  • Page 91 91
  • Page 92 92
  • Page 93 93
  • Page 94 94
  • Page 95 95
  • Page 96 96
  • Page 97 97
  • Page 98 98
  • Page 99 99
  • Page 100 100
  • Page 101 101
  • Page 102 102
  • Page 103 103
  • Page 104 104
  • Page 105 105
  • Page 106 106
  • Page 107 107
  • Page 108 108
  • Page 109 109
  • Page 110 110
  • Page 111 111
  • Page 112 112
  • Page 113 113
  • Page 114 114
  • Page 115 115
  • Page 116 116
  • Page 117 117
  • Page 118 118
  • Page 119 119
  • Page 120 120
  • Page 121 121
  • Page 122 122
  • Page 123 123
  • Page 124 124
  • Page 125 125
  • Page 126 126
  • Page 127 127
  • Page 128 128
  • Page 129 129
  • Page 130 130
  • Page 131 131
  • Page 132 132
  • Page 133 133
  • Page 134 134
  • Page 135 135
  • Page 136 136
  • Page 137 137
  • Page 138 138
  • Page 139 139
  • Page 140 140
  • Page 141 141
  • Page 142 142
  • Page 143 143
  • Page 144 144
  • Page 145 145
  • Page 146 146
  • Page 147 147
  • Page 148 148
  • Page 149 149
  • Page 150 150
  • Page 151 151
  • Page 152 152
  • Page 153 153
  • Page 154 154
  • Page 155 155
  • Page 156 156
  • Page 157 157
  • Page 158 158
  • Page 159 159
  • Page 160 160
  • Page 161 161
  • Page 162 162
  • Page 163 163
  • Page 164 164
  • Page 165 165
  • Page 166 166
  • Page 167 167
  • Page 168 168
  • Page 169 169
  • Page 170 170
  • Page 171 171
  • Page 172 172
  • Page 173 173
  • Page 174 174
  • Page 175 175
  • Page 176 176
  • Page 177 177
  • Page 178 178
  • Page 179 179
  • Page 180 180
  • Page 181 181
  • Page 182 182
  • Page 183 183
  • Page 184 184
  • Page 185 185
  • Page 186 186
  • Page 187 187
  • Page 188 188
  • Page 189 189
  • Page 190 190
  • Page 191 191
  • Page 192 192
  • Page 193 193
  • Page 194 194
  • Page 195 195
  • Page 196 196
  • Page 197 197
  • Page 198 198
  • Page 199 199
  • Page 200 200
  • Page 201 201
  • Page 202 202
  • Page 203 203
  • Page 204 204
  • Page 205 205
  • Page 206 206
  • Page 207 207
  • Page 208 208
  • Page 209 209
  • Page 210 210
  • Page 211 211
  • Page 212 212
  • Page 213 213
  • Page 214 214
  • Page 215 215
  • Page 216 216
  • Page 217 217
  • Page 218 218
  • Page 219 219
  • Page 220 220
  • Page 221 221
  • Page 222 222
  • Page 223 223
  • Page 224 224
  • Page 225 225
  • Page 226 226
  • Page 227 227
  • Page 228 228
  • Page 229 229
  • Page 230 230
  • Page 231 231
  • Page 232 232
  • Page 233 233
  • Page 234 234
  • Page 235 235
  • Page 236 236
  • Page 237 237
  • Page 238 238
  • Page 239 239
  • Page 240 240
  • Page 241 241
  • Page 242 242
  • Page 243 243
  • Page 244 244
  • Page 245 245
  • Page 246 246
  • Page 247 247
  • Page 248 248
  • Page 249 249
  • Page 250 250
  • Page 251 251
  • Page 252 252
  • Page 253 253
  • Page 254 254
  • Page 255 255
  • Page 256 256
  • Page 257 257
  • Page 258 258
  • Page 259 259
  • Page 260 260
  • Page 261 261
  • Page 262 262
  • Page 263 263
  • Page 264 264
  • Page 265 265
  • Page 266 266
  • Page 267 267
  • Page 268 268
  • Page 269 269
  • Page 270 270
  • Page 271 271
  • Page 272 272
  • Page 273 273
  • Page 274 274
  • Page 275 275
  • Page 276 276
  • Page 277 277
  • Page 278 278
  • Page 279 279
  • Page 280 280
  • Page 281 281
  • Page 282 282
  • Page 283 283
  • Page 284 284
  • Page 285 285
  • Page 286 286
  • Page 287 287
  • Page 288 288
  • Page 289 289
  • Page 290 290
  • Page 291 291
  • Page 292 292
  • Page 293 293
  • Page 294 294
  • Page 295 295
  • Page 296 296
  • Page 297 297
  • Page 298 298
  • Page 299 299
  • Page 300 300
  • Page 301 301
  • Page 302 302
  • Page 303 303
  • Page 304 304
  • Page 305 305
  • Page 306 306
  • Page 307 307
  • Page 308 308
  • Page 309 309
  • Page 310 310
  • Page 311 311
  • Page 312 312
  • Page 313 313
  • Page 314 314
  • Page 315 315
  • Page 316 316
  • Page 317 317
  • Page 318 318
  • Page 319 319
  • Page 320 320
  • Page 321 321
  • Page 322 322
  • Page 323 323
  • Page 324 324
  • Page 325 325
  • Page 326 326
  • Page 327 327
  • Page 328 328
  • Page 329 329
  • Page 330 330
  • Page 331 331
  • Page 332 332
  • Page 333 333
  • Page 334 334
  • Page 335 335
  • Page 336 336
  • Page 337 337
  • Page 338 338
  • Page 339 339
  • Page 340 340
  • Page 341 341
  • Page 342 342
  • Page 343 343
  • Page 344 344
  • Page 345 345
  • Page 346 346
  • Page 347 347
  • Page 348 348
  • Page 349 349
  • Page 350 350
  • Page 351 351
  • Page 352 352
  • Page 353 353
  • Page 354 354
  • Page 355 355
  • Page 356 356
  • Page 357 357
  • Page 358 358
  • Page 359 359
  • Page 360 360
  • Page 361 361
  • Page 362 362
  • Page 363 363
  • Page 364 364
  • Page 365 365
  • Page 366 366
  • Page 367 367
  • Page 368 368
  • Page 369 369
  • Page 370 370
  • Page 371 371
  • Page 372 372
  • Page 373 373
  • Page 374 374
  • Page 375 375
  • Page 376 376
  • Page 377 377
  • Page 378 378
  • Page 379 379
  • Page 380 380
  • Page 381 381
  • Page 382 382
  • Page 383 383
  • Page 384 384
  • Page 385 385
  • Page 386 386
  • Page 387 387
  • Page 388 388
  • Page 389 389
  • Page 390 390
  • Page 391 391
  • Page 392 392
  • Page 393 393
  • Page 394 394
  • Page 395 395
  • Page 396 396
  • Page 397 397
  • Page 398 398
  • Page 399 399
  • Page 400 400
  • Page 401 401
  • Page 402 402
  • Page 403 403
  • Page 404 404
  • Page 405 405
  • Page 406 406
  • Page 407 407
  • Page 408 408
  • Page 409 409
  • Page 410 410
  • Page 411 411
  • Page 412 412
  • Page 413 413
  • Page 414 414
  • Page 415 415
  • Page 416 416
  • Page 417 417
  • Page 418 418
  • Page 419 419
  • Page 420 420
  • Page 421 421
  • Page 422 422
  • Page 423 423
  • Page 424 424
  • Page 425 425
  • Page 426 426
  • Page 427 427
  • Page 428 428
  • Page 429 429
  • Page 430 430
  • Page 431 431
  • Page 432 432
  • Page 433 433
  • Page 434 434
  • Page 435 435
  • Page 436 436
  • Page 437 437
  • Page 438 438
  • Page 439 439
  • Page 440 440
  • Page 441 441
  • Page 442 442
  • Page 443 443
  • Page 444 444
  • Page 445 445
  • Page 446 446
  • Page 447 447
  • Page 448 448
  • Page 449 449
  • Page 450 450
  • Page 451 451
  • Page 452 452
  • Page 453 453
  • Page 454 454
  • Page 455 455
  • Page 456 456
  • Page 457 457
  • Page 458 458
  • Page 459 459
  • Page 460 460
  • Page 461 461
  • Page 462 462
  • Page 463 463
  • Page 464 464
  • Page 465 465
  • Page 466 466
  • Page 467 467
  • Page 468 468
  • Page 469 469
  • Page 470 470
  • Page 471 471
  • Page 472 472
  • Page 473 473
  • Page 474 474
  • Page 475 475
  • Page 476 476
  • Page 477 477
  • Page 478 478
  • Page 479 479
  • Page 480 480
  • Page 481 481
  • Page 482 482
  • Page 483 483
  • Page 484 484
  • Page 485 485
  • Page 486 486
  • Page 487 487
  • Page 488 488
  • Page 489 489
  • Page 490 490
  • Page 491 491
  • Page 492 492
  • Page 493 493
  • Page 494 494
  • Page 495 495
  • Page 496 496
  • Page 497 497
  • Page 498 498
  • Page 499 499
  • Page 500 500
  • Page 501 501
  • Page 502 502
  • Page 503 503
  • Page 504 504
  • Page 505 505
  • Page 506 506
  • Page 507 507
  • Page 508 508
  • Page 509 509
  • Page 510 510
  • Page 511 511
  • Page 512 512
  • Page 513 513
  • Page 514 514
  • Page 515 515
  • Page 516 516
  • Page 517 517
  • Page 518 518
  • Page 519 519
  • Page 520 520
  • Page 521 521
  • Page 522 522
  • Page 523 523
  • Page 524 524
  • Page 525 525
  • Page 526 526
  • Page 527 527
  • Page 528 528
  • Page 529 529
  • Page 530 530
  • Page 531 531
  • Page 532 532
  • Page 533 533
  • Page 534 534
  • Page 535 535
  • Page 536 536
  • Page 537 537
  • Page 538 538
  • Page 539 539
  • Page 540 540
  • Page 541 541
  • Page 542 542
  • Page 543 543
  • Page 544 544
  • Page 545 545
  • Page 546 546
  • Page 547 547
  • Page 548 548
  • Page 549 549
  • Page 550 550
  • Page 551 551
  • Page 552 552
  • Page 553 553
  • Page 554 554
  • Page 555 555
  • Page 556 556
  • Page 557 557
  • Page 558 558
  • Page 559 559
  • Page 560 560
  • Page 561 561
  • Page 562 562
  • Page 563 563
  • Page 564 564
  • Page 565 565
  • Page 566 566
  • Page 567 567
  • Page 568 568
  • Page 569 569
  • Page 570 570
  • Page 571 571
  • Page 572 572
  • Page 573 573
  • Page 574 574
  • Page 575 575
  • Page 576 576
  • Page 577 577
  • Page 578 578
  • Page 579 579
  • Page 580 580
  • Page 581 581
  • Page 582 582
  • Page 583 583
  • Page 584 584
  • Page 585 585
  • Page 586 586
  • Page 587 587
  • Page 588 588
  • Page 589 589
  • Page 590 590
  • Page 591 591
  • Page 592 592
  • Page 593 593
  • Page 594 594
  • Page 595 595
  • Page 596 596
  • Page 597 597
  • Page 598 598
  • Page 599 599
  • Page 600 600
  • Page 601 601
  • Page 602 602
  • Page 603 603
  • Page 604 604
  • Page 605 605
  • Page 606 606
  • Page 607 607
  • Page 608 608
  • Page 609 609
  • Page 610 610
  • Page 611 611
  • Page 612 612
  • Page 613 613
  • Page 614 614
  • Page 615 615
  • Page 616 616
  • Page 617 617
  • Page 618 618
  • Page 619 619
  • Page 620 620
  • Page 621 621
  • Page 622 622
  • Page 623 623
  • Page 624 624
  • Page 625 625
  • Page 626 626
  • Page 627 627
  • Page 628 628
  • Page 629 629
  • Page 630 630
  • Page 631 631
  • Page 632 632
  • Page 633 633
  • Page 634 634
  • Page 635 635
  • Page 636 636
  • Page 637 637
  • Page 638 638
  • Page 639 639
  • Page 640 640
  • Page 641 641
  • Page 642 642
  • Page 643 643
  • Page 644 644
  • Page 645 645
  • Page 646 646
  • Page 647 647
  • Page 648 648
  • Page 649 649
  • Page 650 650
  • Page 651 651
  • Page 652 652

Juniper QFX3000-G QFabric Deployment Manual

Category
Software
Type
Deployment Manual

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI