Brocade SANnav Management Portal and Global View User
Guide, 2.0x
Supporting SANnav Management Portal and Global View 2.0x
User Guide
6 March 2020
SANnav-200-UG102
6 March 2020
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Table of Contents
Copyright Statement.......................................................................................................................... 14
Introduction.........................................................................................................................................15
About This Document....................................................................................................................................................15
What Is New in This Document....................................................................................................................................15
Supported Hardware and Software.............................................................................................................................. 15
Contacting Technical Support for Your Brocade
®
Product....................................................................................... 17
Document Feedback...................................................................................................................................................... 17
Installation and Migration................................................................................................................. 18
Installation Overview......................................................................................................................................................18
Migration Overview........................................................................................................................................................ 18
SANnav Management Portal Deployment................................................................................................................... 19
System and Server Requirements for SANnav Management Portal....................................................................... 20
Installation Prerequisites for SANnav Management Portal.......................................................................................21
Installing the Application for Single-Node Deployment............................................................................................ 23
Installing the Application for Multi-Node Deployment...............................................................................................25
Firewall Requirements for SANnav Management Portal..........................................................................................26
SANnav Global View Deployment................................................................................................................................ 28
System and Server Requirements for SANnav Global View....................................................................................28
Installation Prerequisites for SANnav Global View...................................................................................................29
Installing the SANnav Global View Application........................................................................................................ 30
Firewall Requirements for SANnav Global View...................................................................................................... 32
Uninstalling the SANnav Application...........................................................................................................................33
Additional Scripts...........................................................................................................................................................34
Configuring a Firewall for SANnav.............................................................................................................................. 36
Example of Provisioning a VM for SANnav Installation............................................................................................ 36
Getting Started with SANnav Management Portal......................................................................... 45
SANnav Overview...........................................................................................................................................................45
Browser Requirements.................................................................................................................................................. 45
Launching SANnav Management Portal......................................................................................................................46
Overview of the User Interface.....................................................................................................................................47
Customizing Table Columns..................................................................................................................................... 50
Searching for Objects............................................................................................................................................... 50
Tags........................................................................................................................................................................... 52
Tagging Objects.........................................................................................................................................................52
Filters......................................................................................................................................................................... 55
Wildcards in Filters............................................................................................................................................ 56
SANnav-200-UG102
2
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Rules for AND and OR Filters...........................................................................................................................57
Creating Filters...................................................................................................................................................58
Managing Filters.................................................................................................................................................60
Deleting Filters................................................................................................................................................... 61
Creating a Network Scope........................................................................................................................................61
Setting the Date Range for Dashboards, Reports, and Events............................................................................... 63
Changing Your Password..............................................................................................................................................64
Initial Setup and Configuration.....................................................................................................................................65
Licensing............................................................................................................................................. 69
SANnav Licensing Overview.........................................................................................................................................69
SANnav Licensing Terminology................................................................................................................................ 69
SANnav License Types.............................................................................................................................................70
Managed Port Count.................................................................................................................................................70
How SANnav Licensing Works.....................................................................................................................................71
Obtaining the Server UID.............................................................................................................................................. 72
Generating a License.....................................................................................................................................................73
Adding a License to SANnav........................................................................................................................................75
Managing the Port Count.............................................................................................................................................. 77
Renewing a License.......................................................................................................................................................78
Rehosting a License on a Different Server: Planned Migration............................................................................... 79
Moving a License to a Different Server: Unplanned Migration.................................................................................81
Deleting a License..........................................................................................................................................................81
Security................................................................................................................................................82
User Management...........................................................................................................................................................82
Configuring Password, Lockout, and Session Policies............................................................................................ 84
Creating Custom Roles.............................................................................................................................................85
Creating Custom AORs............................................................................................................................................ 86
Creating a User Account.......................................................................................................................................... 87
Unlocking a User Account............................................................................................................................................ 89
SANnav Management Portal User Account Privileges.............................................................................................. 89
Configuring SANnav to Use an External Server for Authentication.........................................................................91
LDAP Server Configuration...........................................................................................................................................93
Adding LDAP Servers to the Docker Container....................................................................................................... 95
Creating Role and AOR Custom Attributes in the LDAP Active Directory............................................................... 95
Assigning Roles and AORs to Users on the LDAP Server......................................................................................96
Assigning Roles and AORs to LDAP Groups in SANnav........................................................................................ 97
RADIUS Server Configuration.......................................................................................................................................98
Configuring SANnav Credentials on the RADIUS Server........................................................................................ 99
Assigning Roles and AORs to Users on the RADIUS Server................................................................................101
SANnav-200-UG102
3
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Configuring Role and AOR Attributes on the RADIUS Server............................................................................... 101
TACACS+ Server Configuration..................................................................................................................................102
Assigning Roles and AORs to Users on the TACACS+ Server............................................................................. 103
Managing Signed Certificates..................................................................................................................................... 103
Monitoring......................................................................................................................................... 105
Discovery.......................................................................................................................................................................105
Discovering a Fabric............................................................................................................................................... 106
Stopping Switch Monitoring.................................................................................................................................... 109
Stopping Fabric Monitoring..................................................................................................................................... 110
Resuming Switch Monitoring.................................................................................................................................. 111
Resuming Fabric Monitoring................................................................................................................................... 112
Rediscovering a Switch...........................................................................................................................................113
Rediscovering a Fabric........................................................................................................................................... 114
Changing the Seed Switch..................................................................................................................................... 115
Deleting a Fabric.....................................................................................................................................................116
Configuring Fabric Tracking....................................................................................................................................117
Updating Fabric Members.......................................................................................................................................118
Dashboards................................................................................................................................................................... 119
Changing the Favorite Dashboard..........................................................................................................................120
Creating a Dashboard Quickly................................................................................................................................120
Creating a Dashboard with a Customized Layout..................................................................................................123
Viewing Dashboards.............................................................................................................................................. 125
Exporting Dashboard Templates.............................................................................................................................127
Importing Dashboard Templates............................................................................................................................. 128
Sharing Dashboards and Reports with Other Users.............................................................................................130
Health Summary Dashboard...................................................................................................................................131
Customizing the Health Score for Managed Entities...................................................................................... 132
Monitoring SAN Health and Status Daily........................................................................................................ 135
Factors Contributing to the Overall Health Score........................................................................................... 137
Network Port Traffic Conditions Dashboard........................................................................................................... 139
Troubleshooting Mode for Network Port Traffic Conditions Dashboard.......................................................... 140
Congestion Severity States............................................................................................................................. 143
Reports.......................................................................................................................................................................... 144
Creating a Report Template....................................................................................................................................145
Editing a Report Template...................................................................................................................................... 147
Scheduling a Report............................................................................................................................................... 149
Generating and Exporting Reports......................................................................................................................... 150
Exporting Report Templates....................................................................................................................................152
Importing Report Templates....................................................................................................................................152
Widgets for Dashboards and Reports....................................................................................................................... 154
SANnav-200-UG102
4
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Performance Widgets..............................................................................................................................................158
Status Widgets: Dashboard.................................................................................................................................... 161
Status Widgets: Reports......................................................................................................................................... 162
Performance Monitoring.............................................................................................................................................. 163
Launching Investigation Mode................................................................................................................................ 163
Collecting Items in the Sidebar for Investigation Mode..........................................................................................166
Using Investigation Mode........................................................................................................................................167
Scheduling High-Granularity Data Collection......................................................................................................... 177
Enabling and Disabling Historic Data Collection.................................................................................................... 179
Inventory Management................................................................................................................................................ 180
Adding Custom Fields to a Managed Object......................................................................................................... 181
Identifying Switches to Plan for an Upgrade.......................................................................................................... 184
Putting a Switch in Maintenance Mode.................................................................................................................. 186
Disabling and Enabling a Switch............................................................................................................................ 187
Disabling and Enabling a Switch Port.................................................................................................................... 188
Decommissioning E_Ports...................................................................................................................................... 189
Decommissioning F_Ports...................................................................................................................................... 191
Registering a CIMOM Server for F_Port Decommissioning...................................................................................193
Viewing Physical Switch Properties........................................................................................................................194
Renaming Switch Ports, Switches, and Fabrics.....................................................................................................195
Creating Host and Storage Enclosures.................................................................................................................. 196
Mapping Host and Storage Ports........................................................................................................................... 197
Converting Initiator and Target Device Types........................................................................................................ 199
Launching Web Tools..............................................................................................................................................201
Managing Trunk Inventory...................................................................................................................................... 201
Exporting Inventory Names and Mapping.............................................................................................................. 202
Importing Inventory Names and Mapping...............................................................................................................202
Topology Visualization.................................................................................................................................................204
Viewing the Fabric Topology...................................................................................................................................206
Showing All Devices in a Fabric.............................................................................................................................211
Viewing Connectivity between Hosts and Storage.................................................................................................213
Viewing Link Utilization........................................................................................................................................... 215
Viewing a Zone Topology........................................................................................................................................218
Flow Management....................................................................................................................................................... 219
Flow Management Setup........................................................................................................................................ 220
Configuring vTap for AMP Flow Monitoring............................................................................................................221
I/O Violation Summary............................................................................................................................................ 223
Inventory and IT Reservation..................................................................................................................................224
Determining Whether the Switch Is Sending Telemetry Data to the SANnav Server......................................224
Viewing the Number of Flows Monitored by the AMP Switch.........................................................................225
SANnav-200-UG102
5
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Reserving a Number of IT Flows to Be Monitored by AMP............................................................................226
Operating the Flows Window..................................................................................................................................227
Accessing and Exploring Flow Investigation Mode................................................................................................ 233
Operating in Flow Investigation Mode.................................................................................................................... 236
Investigating Flows from Switch Ports....................................................................................................................247
Creating a Flow Collection......................................................................................................................................252
Creating a Flow Filter...................................................................................................................................... 260
Importing and Exporting a Collection.............................................................................................................. 262
Creating a Custom Rule Set...................................................................................................................................264
Managing a Custom Rule Set......................................................................................................................... 264
Importing and Exporting a Custom Rule Set.................................................................................................. 267
Investigating an Aggregated Collection View......................................................................................................... 268
Report Widgets for AMP......................................................................................................................................... 273
Generating a Time Series Report of Collection Aggregation.......................................................................... 275
Generating a Time Series Report for Flow Violations.....................................................................................279
Generating a Top N Report for Collection Aggregation.................................................................................. 283
Generating a Top N Report for SCSI Errors................................................................................................... 289
Generating a Top N Report for Host Ports......................................................................................................292
Generating a Top N Report for Storage Ports................................................................................................ 297
Configuration.................................................................................................................................... 303
Policy-Based Configuration........................................................................................................................................ 303
Creating a Configuration Policy.............................................................................................................................. 303
Configuring a New Switch Before Adding It to the Fabric......................................................................................309
Configuring a New Switch After Adding It to the Fabric.........................................................................................311
Monitoring Configuration Drifts............................................................................................................................... 314
Resolving Configuration Drifts................................................................................................................................ 316
Configuration Blocks............................................................................................................................................... 318
Switch Configuration Backup and Restore...............................................................................................................325
Backing Up Switch and Logical Fabric Configurations...........................................................................................325
Restoring Switch or Logical Fabric Configurations.................................................................................................327
Managing Switch Configuration Backups............................................................................................................... 330
Call Home and ESRS................................................................................................................................................... 332
Supporting the SANnav License for Call Centers.................................................................................................. 332
Call Home Events................................................................................................................................................... 332
Configuring Call Home Notifications......................................................................................................................333
Configuring the Dell EMC Call Home Support Center........................................................................................... 336
Enabling and Disabling a Call Home Center..........................................................................................................338
Call Home Email Notifications................................................................................................................................ 338
Zoning............................................................................................................................................................................ 339
Zone Database Size............................................................................................................................................... 339
SANnav-200-UG102
6
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Naming Conventions............................................................................................................................................... 339
Creating Zone Aliases.............................................................................................................................................340
Creating a Single Zone Alias with Multiple Members..................................................................................... 340
Creating Multiple Zone Aliases........................................................................................................................341
Importing Zone Aliases.................................................................................................................................... 343
Exporting Zone Aliases....................................................................................................................................344
Configuring Zones in a Fabric...............................................................................................................................345
Creating Standard Zones............................................................................................................................... 346
Creating Peer Zones...................................................................................................................................... 347
Creating LSAN Zones.................................................................................................................................... 349
Creating LSAN Peer Zones............................................................................................................................351
Selecting and Adding Multiple Zone Aliases to a Zone.................................................................................. 353
Creating Zone Configurations................................................................................................................................. 356
Selecting and Adding Multiple Zones to a Zone Configuration.......................................................................359
Saving the Inactive Zone DB to the Offline Zone DB..................................................................................... 361
Identifying the Zones without Any Zone Configuration...........................................................................................362
Offline Zoning.......................................................................................................................................................... 363
Creating Offline Zone Configurations.............................................................................................................. 363
Importing an Offline Zone Configuration........................................................................................................ 365
Exporting an Offline Zone Configuration......................................................................................................... 366
Saving the Offline Zone Database to the Switch...........................................................................................366
Creating Offline Zones.....................................................................................................................................367
Creating Peer Zones with a Simplified Workflow................................................................................................... 369
Configuring the Zoning Policy.................................................................................................................................372
Modifying a Zone Configuration..............................................................................................................................373
Comparing Effective and Defined (Modified) Zone Configurations........................................................................ 375
Viewing Zone and Zone Configuration Details.......................................................................................................378
Viewing Online or Offline Zone Details........................................................................................................... 378
Viewing Online or Offline Zone Configuration Details..................................................................................... 380
Virtual Fabrics...............................................................................................................................................................383
Supported Platforms for Virtual Fabrics..................................................................................................................384
Creating a Logical Fabric........................................................................................................................................384
Adding Logical Switches to a Logical Fabric..........................................................................................................387
Activating a Logical Fabric......................................................................................................................................391
Editing Logical Fabrics and Switches.....................................................................................................................393
Editing a Logical Fabric................................................................................................................................... 393
Editing a Logical Switch.................................................................................................................................. 395
Deleting Logical Fabrics and Switches...................................................................................................................397
Deleting a Logical Fabric.................................................................................................................................397
Deleting a Logical Switch................................................................................................................................ 398
SANnav-200-UG102
7
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Fabric Properties for Logical Fabrics......................................................................................................................399
Logical Fabric Events..............................................................................................................................................400
Monitoring and Alerting Policy Suite....................................................................................................................... 401
MAPS Structural Elements..................................................................................................................................... 401
MAPS Actions......................................................................................................................................................... 402
MAPS Categories....................................................................................................................................................403
MAPS Groups......................................................................................................................................................... 404
MAPS Violations......................................................................................................................................................406
Viewing MAPS Violations.................................................................................................................................406
MAPS Rules............................................................................................................................................................ 407
MAPS Conditions.................................................................................................................................................... 407
MAPS Policies.........................................................................................................................................................408
MAPS Measures..................................................................................................................................................... 408
Port Health....................................................................................................................................................... 409
Switch Policy Status........................................................................................................................................ 410
Fabric State Changes...................................................................................................................................... 411
FRU Health...................................................................................................................................................... 412
Security Health.................................................................................................................................................413
Switch Resources............................................................................................................................................ 414
Extension Tunnel..............................................................................................................................................414
Traffic/Flows Performance............................................................................................................................... 415
FPI.................................................................................................................................................................... 415
GigE Port..........................................................................................................................................................416
Backend Port Monitoring................................................................................................................................. 416
MAPS Configuration................................................................................................................................................417
Configuring a MAPS Policy and Applying It to Multiple Switches................................................................... 417
Managing MAPS Configure Actions on a Switch............................................................................................420
Enabling or Disabling Policy Actions on a Switch...........................................................................................428
Configuring an Email Notification for MAPS................................................................................................... 429
Fibre Channel Routing.................................................................................................................................................430
License Requirements for Fibre Channel Routing................................................................................................. 430
Supported Platforms for Fibre Channel Routing.................................................................................................... 431
Limitations of Fibre Channel Routing....................................................................................................................431
Backbone Fabric ID Conditions.......................................................................................................................432
Configuring a Backbone Fabric.............................................................................................................................. 432
Editing a Backbone Fabric......................................................................................................................................436
Viewing the FCR Topology..................................................................................................................................... 438
vCenter Discovery.......................................................................................................................................................442
Adding the vCenter................................................................................................................................................442
Monitoring or Unmonitoring ESXi Hosts................................................................................................................. 442
SANnav-200-UG102
8
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Rediscovering ESXi Hosts.....................................................................................................................................442
Viewing ESXi Host Properties............................................................................................................................... 443
Investigating Virtual Machines................................................................................................................................ 444
Viewing Virtual Machine Properties........................................................................................................................ 445
Viewing ESXi Hosts in Topology........................................................................................................................... 447
Creating a VM Alarms Dashboard..........................................................................................................................449
FICON.............................................................................................................................................................................450
Viewing FICON Fabrics...........................................................................................................................................451
Configuring the FICON Display.............................................................................................................................. 453
FICON Planning...................................................................................................................................................... 454
Planning the Configuration.............................................................................................................................. 454
FICON Fabric Configuration................................................................................................................................... 455
Configuring a Cascaded FICON Fabric...........................................................................................................456
Adding FICON Logical Switches to a Cascaded FICON Fabric..................................................................... 459
Adding Ports to a FICON Logical Switch........................................................................................................ 461
Port Address Binding....................................................................................................................................... 463
Cascaded FICON Fabric Merge............................................................................................................................. 463
Merging Two Cascaded FICON Fabrics..........................................................................................................463
Resolving Merge Conflicts............................................................................................................................... 465
Resolving Domain ID Conflicts........................................................................................................................465
Activating a FICON Fabric...................................................................................................................................... 466
Deployment Behavior.......................................................................................................................................467
Post Deployment Behavior.............................................................................................................................. 469
Deleting FICON Fabrics and FICON Logical Switches.......................................................................................... 469
Deleting a FICON Fabric................................................................................................................................. 469
Deleting a FICON Logical Switch....................................................................................................................470
Connecting Cascaded FICON Fabrics over FCIP..................................................................................................470
Planning the Cascaded FICON Fabrics over FCIP Configuration.................................................................. 471
Configuring IP Links and Merging the Fabrics................................................................................................471
Configuring DWDM Links to Use R_RDYs..................................................................................................... 473
Extending RDR Applications over FCIP..........................................................................................................473
Event Management...........................................................................................................................476
Event Management Overview..................................................................................................................................... 476
Functions of Event Management............................................................................................................................476
Types of Registration.............................................................................................................................................. 476
Registering for SNMP Traps...................................................................................................................................476
Registering for Syslog.............................................................................................................................................478
Importing the Server Syslog Certificate Using a CLI Script........................................................................... 479
Enabling or Disabling SNMP Informs..................................................................................................................... 480
Enabling Event Notifications................................................................................................................................... 482
SANnav-200-UG102
9
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Setting the Frequency to Receive Email Event Notifications................................................................................. 484
Configuring an Email Setup....................................................................................................................................484
Defining the Trap Configuration..............................................................................................................................486
Forwarding...............................................................................................................................................................487
Filtering Traps and Messages......................................................................................................................... 487
Adding a Forwarding Destination.................................................................................................................... 490
Adding Trap Forwarding Credentials...............................................................................................................493
Managing Event Actions......................................................................................................................................... 494
Configuring Identification and Action............................................................................................................... 494
Creating Events and Policy............................................................................................................................. 496
Creating Sources............................................................................................................................................. 500
Creating an Event Action for Critical Events..................................................................................................502
Using Event Action to Suppress Selected Events......................................................................................... 507
Auto Acknowledging Events Based on Event Description............................................................................. 512
Filtering Events........................................................................................................................................................519
Searching Events.................................................................................................................................................... 523
Viewing Violations................................................................................................................................................... 524
Acknowledging or Unacknowledging Events.......................................................................................................... 526
Acknowledging or Unacknowledging a Single Event...................................................................................... 526
Setting Event Management Reports and Dashboard Widgets...............................................................................527
Exporting Event Management Reports............................................................................................................530
Extension Tunnels and Circuits..................................................................................................... 533
Overview of Extension Tunnels..................................................................................................................................533
Applying the Extension Dashboard........................................................................................................................... 533
Configuring IPsec Policies.......................................................................................................................................... 541
Creating an IPsec Policy........................................................................................................................................ 542
Editing an IPsec Policy........................................................................................................................................... 545
Deleting an IPsec Policy......................................................................................................................................... 548
Configuring an Extension Tunnel...............................................................................................................................548
Editing an Extension Tunnel.......................................................................................................................................558
Deleting a Tunnel......................................................................................................................................................... 561
Switch Maintenance and Support.................................................................................................. 562
Firmware Management.................................................................................................................................................562
Importing Firmware Files to the Repository........................................................................................................... 562
Managing the Repository........................................................................................................................................ 564
Updating a Selected Switch from an Internal or External Location........................................................................565
Updating the Firmware for One or More Switches from an Internal or External Location......................................568
Switch SupportSave................................................................................................................................................... 571
Requirements.......................................................................................................................................................... 571
SANnav-200-UG102
10
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Generating SupportSave for One or More Switches..............................................................................................571
Scheduling SupportSave for One or More Switches..............................................................................................574
Configuring Trace Dump........................................................................................................................................576
Managing the Switch SupportSave Files.............................................................................................................. 577
SANnav Management Portal Maintenance and Support..............................................................580
SANnav Backup and Restore.................................................................................................................................... 580
Configuring a Scheduled Backup.......................................................................................................................... 581
On-demand Backup............................................................................................................................................... 583
Restoring Backup Files..........................................................................................................................................583
Management Portal Server Support Data Collection............................................................................................... 584
Generating the Support Data Collection File..........................................................................................................584
Splitting and Merging SANnav Support Data Files................................................................................................ 586
Splitting SANnav Support Data Files.............................................................................................................. 586
Merging SANnav Support Data Files.............................................................................................................. 587
Downloading the Support Data Collection Files..................................................................................................... 587
Sending Support Data Collection Files to an FTP Server......................................................................................587
Deleting the Support Data Collection Files............................................................................................................ 588
Upgrading or Replacing Hardware on the SANnav Server..................................................................................... 588
Troubleshooting and Diagnostics.................................................................................................. 590
Master Node Failure.....................................................................................................................................................590
Worker Node Failure.................................................................................................................................................... 590
No Login Page.............................................................................................................................................................. 590
Dashboard Shows No Data for Switches.................................................................................................................. 591
High-Granularity Data Collection Schedule Option Is Unavailable.........................................................................592
Network Port Traffic Conditions Dashboard Is Blank..............................................................................................592
Repository Tab Not Available for Firmware Management or Switch SupportSave............................................... 593
Firmware Download or Switch SupportSave Fails................................................................................................... 593
Updating the OS with SANnav Installed....................................................................................................................593
Switch Busy Message..................................................................................................................................................594
D_Port Testing.............................................................................................................................................................. 594
Starting D_Port Testing........................................................................................................................................... 594
Scheduling D_Port Testing......................................................................................................................................596
Viewing D_Port Test Results.................................................................................................................................. 598
Deleting a Scheduled D_Port Test......................................................................................................................... 599
SANnav Global View........................................................................................................................600
Overview of SANnav Global View.............................................................................................................................600
Browser Requirements for SANnav Global View..................................................................................................... 600
SANnav Global View Compatibility Matrix................................................................................................................ 600
Logging In to SANnav Global View........................................................................................................................... 601
SANnav-200-UG102
11
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Quick Tour of SANnav Global View........................................................................................................................... 601
Global View Licensing................................................................................................................................................. 603
Creating a New User Account.................................................................................................................................... 604
Global View Authentication and Authorization........................................................................................................606
Adding a SANnav Management Portal Instance.......................................................................................................606
Global Dashboard Overview....................................................................................................................................... 607
Monitoring Fabric Health.........................................................................................................................................608
Monitoring Switch Health across Management Portal Instances........................................................................... 610
Displaying Port Usage Details................................................................................................................................ 612
Viewing Alerts..........................................................................................................................................................613
Creating a Global Report Template............................................................................................................................615
Global View Inventory Management.......................................................................................................................... 619
Viewing Inventory Using Filters.............................................................................................................................. 619
Viewing Performance Measures in the Switch Port Inventory............................................................................... 621
Investigating Switch Ports in SANnav Global View................................................................................................623
Exporting Inventory Views.......................................................................................................................................624
Viewing Global View Events....................................................................................................................................... 625
Global View Password and Lockout Policy.............................................................................................................. 627
Global View Support Data Collection........................................................................................................................ 628
Global View Backup..................................................................................................................................................... 629
Global View Email Setup............................................................................................................................................. 629
Exporting Select Configurations from Brocade Network Advisor to SANnav
Management Portal.......................................................................................................................... 631
Overview of Exporting Select Configurations......................................................................................................... 631
Exporting End Device Names..................................................................................................................................... 631
Importing End Device Names as Zone Aliases........................................................................................................ 632
Exporting Host or Storage Port Mapping..................................................................................................................632
Importing Host or Storage Port Mapping.................................................................................................................. 633
Exporting a MAPS Policy............................................................................................................................................ 633
Importing MAPS Policies.............................................................................................................................................633
SANnav REST API Overview.......................................................................................................... 634
Overall Strategy for the SANnav Management Portal REST API............................................................................634
Using the SANnav Management Portal REST API................................................................................................... 634
SANnav Management Portal Examples..................................................................................................................... 635
Logging In and Out................................................................................................................................................. 635
Discovery Module....................................................................................................................................................636
FCR Module............................................................................................................................................................ 638
Fault Module............................................................................................................................................................640
Inventory Search Module........................................................................................................................................ 645
SANnav-200-UG102
12
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Copyright Statement
Copyright
©
2019–2020 Broadcom. All Rights Reserved. Broadcom, the pulse logo, Brocade, and the stylized B logo are
among the trademarks of Broadcom in the United States, the EU, and/or other countries. The term “Broadcom” refers to
Broadcom Inc. and/or its subsidiaries.
Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability,
function, or design. Information furnished by Broadcom is believed to be accurate and reliable. However, Broadcom does
not assume any liability arising out of the application or use of this information, nor the application or use of any product or
circuit described herein, neither does it convey any license under its patent rights nor the rights of others.
The product described by this document may contain open source software covered by the GNU General Public License
or other open source license agreements. To find out which open source software is included in Brocade products, to view
the licensing terms applicable to the open source software, and to obtain a copy of the programming source code, please
download the open source disclosure documents in the Broadcom Customer Support Portal (CSP). If you do not have a
CSP account or are unable to log in, please contact your support provider for this information.
SANnav-200-UG102
14
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Introduction
About This Document
This guide describes how to monitor and manage your storage area network (SAN) using Brocade SANnav Management
Portal and Brocade SANnav Global View. This guide also includes installation procedures.
Within this document, information that pertains to both SANnav Management Portal and SANnav Global View products is
referred to simply as "SANnav"; whereas information that pertains to only one or the other refers to the specific product.
What Is New in This Document
Starting with this release, all new and updated content is listed in the "Revision History" section at the end of this
document.
Supported Hardware and Software
SANnav 2.0.0 supports the following Fabric OS software versions and hardware platforms.
Fabric OS Software Support
The following Fabric OS software versions are supported by this release of SANnav.
•
Fabric OS 8.x or later
•
Fabric OS 7.4 or later
Brocade Gen 6 (32Gb/s) Fixed-Port Switches
•
Brocade G610 Switch
•
Brocade G620 Switch
•
Brocade G630 Switch
•
Brocade 7810 Extension Switch
Brocade Gen 6 (32Gb/s) Directors
•
Brocade X6-4 Director
•
Brocade X6-8 Director
SANnav-200-UG102
15
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Brocade Gen 5 (16Gb/s) Fixed-Port Switches
•
Brocade 6505 Switch
•
Brocade 6510 Switch
•
Brocade 6520 Switch
•
Brocade M6505 Blade Server SAN I/O Module
•
Brocade 6542 Blade Server SAN I/O Module
•
Brocade 6543 Blade Server SAN I/O Module
•
Brocade 6545 Blade Server SAN I/O Module
•
Brocade 6546 Blade Server SAN I/O Module
•
Brocade 6547 Blade Server SAN I/O Module
•
Brocade 6548 Blade Server SAN I/O Module
•
Brocade 6558 Blade Server SAN I/O Module
•
Brocade 7840 Extension Switch
Brocade Gen 5 (16Gb/s) Directors
•
Brocade DCX 8510-4 Director
•
Brocade DCX 8510-8 Director
Brocade Gen 4 (8Gb/s) Fixed-Port Switches
•
Brocade 300 Switch
•
Brocade 5424 Blade Server SAN I/O Module
•
Brocade 5430 Blade Server SAN I/O Module
•
Brocade 5431 Blade Server SAN I/O Module
•
Brocade 5432 Blade Server SAN I/O Module
•
Brocade 5450 Blade Server SAN I/O Module
•
Brocade 5460 Blade Server SAN I/O Module
•
Brocade 5470 Blade Server SAN I/O Module
•
Brocade 5480 Blade Server SAN I/O Module
•
Brocade NC-5480 Blade Server SAN I/O Module
•
Brocade 7800 Extension Switch
Brocade Gen 4 (8Gb/s) Directors
•
Brocade DCX
•
Brocade DCX-4S
Analytics Monitoring Platform
The Analytics Monitoring Platform (AMP) is supported with the following AMP OS software versions:
•
AMP OS 3.0.0 or later (includes Flow Management support)
•
AMP OS 2.0.x (switch monitoring only)
SANnav-200-UG102
16
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Contacting Technical Support for Your Brocade
®
Product
For product support information and the latest information on contacting the Technical Assistance Center, go to https://
www.broadcom.com/support/fibre-channel-networking/. If you have purchased Brocade
®
product support directly from
Broadcom, use one of the following methods to contact the Technical Assistance Center 24x7.
Online Telephone
For nonurgent issues, the preferred method is to log in to
myBroadcom at https://www.broadcom.com/mybroadcom. (You
must initially register to gain access to the Customer Support
Portal.) Once there, select Customer Support Portal > Support
Portal. You will now be able to navigate to the following sites:
•
Knowledge Search: Clicking the top-right magnifying glass
brings up a search bar.
•
Case Management: The legacy MyBrocade case
management tool (MyCases) has been replaced with the Fibre
Channel Networking case management tool.
•
DocSafe: You can download software and documentation.
•
Other Resources: Licensing Portal (top), SAN Health (top and
bottom), Communities (top), Education (top).
Required for Severity 1 (critical) issues:
Please call Fibre Channel Networking Global Support at one of
the numbers listed at https://www.broadcom.com/support/fibre-
channel-networking/.
If you purchased Brocade product support from a Broadcom OEM/solution provider, contact your OEM/solution provider
for all your product support needs.
•
OEM/solution providers are trained and certified by Broadcom to support Brocade products.
•
Broadcom provides backline support for issues that cannot be resolved by the OEM/solution provider.
•
Brocade Supplemental Support augments your existing OEM support contract, providing direct access to Brocade
expertise. For more information on this option, contact Broadcom or your OEM.
•
For questions regarding service levels and response times, contact your OEM/solution provider.
Document Feedback
Quality is our first concern. We have made every effort to ensure the accuracy and completeness of this document.
However, if you find an error or an omission or if you think that a topic needs further development, we want to hear from
you. Send your feedback to [email protected]. Provide the publication title, publication number, topic
heading, page number, and as much detail as possible.
SANnav-200-UG102
17
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Installation and Migration
Installation Overview
The SANnav application uses a script-based installation. You must run the scripts that are provided in the
<install_home> directory to install the application. All the scripts for the SANnav application must be executed in the
bash shell.
The following installations are supported:
•
SANnav Management Portal
–
Single-node installation
–
Multi-node installation
•
SANnav Global View
–
Single-node installation
NOTE
SANnav Management Portal and SANnav Global View are two different software products. You cannot install
both software products on the same physical host or virtual machine.
NOTE
For switches that are running Fabric OS versions lower than 8.2.2, port 22 is required for SANnav Management
Portal to use the internal firmware repository and SCP and SFTP servers. See Installation Prerequisites for
SANnav Management Portal for additional details.
If there is a firewall between the client and server or between the server and the SAN, you must open a set of ports for
SANnav to function properly. The list of ports is provided in sections Firewall Requirements for SANnav Management
Portal and Firewall Requirements for SANnav Global View.
If the installation script detects that an earlier version of SANnav is running, you are prompted whether to migrate your
data to the new version.
Migration Overview
If you are upgrading SANnav Management Portal or SANnav Global View from a previous version, the installation script
provides the option of migrating your data. Migrating allows you to keep all user-configured data, customized data, and
historic data (such as port performance metrics and events) when you upgrade to the latest SANnav version.
When you migrate the data, the following occurs:
•
Installation settings (such as port customizations and the database password) from the previous installation are
preserved. The installation does not prompt you for these settings.
•
The license is carried forward to the new installation. After migration, you do not need to apply a new license. If the
license is a trial license, after migration the license is valid for the remaining days of the trial period.
•
The discovered fabrics are rediscovered. For SANnav Global View, the discovered portals are rediscovered.
•
User-configured data, customized data, and historic data (such as port performance metrics and events) are migrated.
Note that the following data is not migrated:
•
Support data collection files
•
SupportSave files
SANnav-200-UG102
18
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Migration Prerequisites
Before you migrate to the new SANnav version, back up the server. Use the backup script in the <install_home>/
bin/backuprestore folder.
Ensure that the seed switches for discovered fabrics have not reached end of support (EOS). If a seed switch has
reached end of support, after migration the fabric is unmonitored permanently with the discovery status "Unmonitored:
Seed switch is no longer supported." In this case, you must delete the fabric and rediscover it with a different seed switch.
To avoid this scenario, change the seed switch to a supported switch before migration.
OS Upgrade Options
SANnav 2.0.0 and higher do not support RHEL 7.4. If you are running RHEL 7.4 and want to migrate to SANnav 2.0.0,
you must first upgrade the OS to 7.5 or higher. You cannot migrate SANnav and the OS simultaneously. See Updating the
OS with SANnav Installed
Migration Paths
The following table lists the software versions and whether migration is supported.
Table 1: Supported Migration Paths
Current Version Migration Version Supported?
SANnav 1.1.0x SANnav 1.1.1x No
SANnav 1.1.0x SANnav 2.0.0 No
SANnav 1.1.1x SANnav 2.0.0 Yes
SANnav build x SANnav 2.0.0 build y No
The following table lists various system configurations and whether migration is supported.
Table 2: Supported System Configuration Paths
Current Deployment Migration Deployment Supported?
Single-node Single-node (same host) Yes
Multi-node Multi-node (master node, same host) Yes
Single-node Multi-node No
Multi-node Single-node No
SANnav Management Portal Deployment
SANnav Management Portal provides single-node and multi-node installation. During the installation, you are prompted
several times to accept default values or provide customized values for various settings.
For a multi-node installation, you can install SANnav on a cluster of three physical servers or on a cluster of three virtual
machines. You assign one node as a master node. The remaining two nodes are assigned as worker nodes.
The multi-node installation includes additional steps that must be performed on the master node and both of the worker
nodes.
SANnav-200-UG102
19
SANnav-200-UG102 User Guide
Brocade SANnav Management Portal and Global View User Guide, 2.0x
Installation Customizations
The following customizations are supported in the installation phase. Note that if you are migrating from an earlier version
of SANnav, you are not prompted for these customizations, and the settings from the previous installation remain in effect.
•
Docker installation directory — The default home directory for installing Docker is /var/lib/docker, but you can
change this to another directory.
•
Setting server-to-switch communication protocol preference. The following is the list of available protocol options:
–
0 for HTTP (Insecure communication)
–
1 for HTTPS (Secure communication. Requires that you have an IT-provided SSL certificate (or self-signed
certificate) and that your switches are configured for HTTPS.)
–
2 for HTTPS then HTTP (First HTTPS is tried, and if that fails, HTTP is used.)
•
Port customization — You can customize ports when installing SANnav Management Portal. To use a default port, that
port must be unused and available. The following is the list of default values:
–
SSH server port is 22
–
Client to Server HTTPS Port: Default HTTPS port is 443
–
SNMP Trap: Default SNMP trap port is 162
–
Syslog Port: Default syslog port is 514
–
Secure Syslog Port: Default Secure syslog port is 6514
–
Database Port: 5432
•
Database password — You can change the default SANnav Management Portal database password. You are given
an option to proceed installation with the default password or choose a new password for the SANnav database. The
default password is passw0rd (where 0 is a zero).
•
SCP/SFTP password — You can change the default SCP/SFTP password. You are given an option to proceed
installation with the default password or choose a new password for the internal SCP/SFTP server. The default
password is passw0rd (where 0 is a zero).
•
License auto-renewal — By default, SANnav is configured to automatically retrieve and activate a renewal license
when the license expires. You can deactivate automatic license renewal, in which case you must manually apply the
license yourself.
System and Server Requirements for SANnav Management Portal
It is mandatory to meet all the system and server requirements before you start SANnav Management Portal installation.
NOTE
For a multi-node installation, the maximum number of managed ports is the sum of the ports managed by the
master node and each worker node, and it cannot exceed 15,000.
The following table lists the system and server requirements for single-node and multi-node deployment for SANnav
Management Portal.
NOTE
The disk space requirement listed in the table is for SANnav only. Be sure to account for additional space
required by the operating system and for saving files.
The disk space can be from a direct-attached disk or through a network-mounted disk.
NOTE
The default home directory for installing Docker is /var/lib/docker, but you can choose another location
during installation. Docker must be installed on a local disk.
SANnav-200-UG102
20
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
Page is loading ...
/