Juniper Junos Space Network Management Platform User guide

Category
Software
Type
User guide
Junos Space Network Management Plaorm
Monitoring and Troubleshoong Guide
Published
2023-06-07
RELEASE
23.1
Juniper Networks, Inc.
1133 Innovaon Way
Sunnyvale, California 94089
USA
408-745-2000
www.juniper.net
Juniper Networks, the Juniper Networks logo, Juniper, and Junos are registered trademarks of Juniper Networks, Inc.
in the United States and other countries. All other trademarks, service marks, registered marks, or registered service
marks are the property of their respecve owners.
Juniper Networks assumes no responsibility for any inaccuracies in this document. Juniper Networks reserves the right
to change, modify, transfer, or otherwise revise this publicaon without noce.
Junos Space Network Management Plaorm Monitoring and Troubleshoong Guide
23.1
Copyright © 2023 Juniper Networks, Inc. All rights reserved.
The informaon in this document is current as of the date on the tle page.
YEAR 2000 NOTICE
Juniper Networks hardware and soware products are Year 2000 compliant. Junos OS has no known me-related
limitaons through the year 2038. However, the NTP applicaon is known to have some diculty in the year 2036.
END USER LICENSE AGREEMENT
The Juniper Networks product that is the subject of this technical documentaon consists of (or is intended for use
with) Juniper Networks soware. Use of such soware is subject to the terms and condions of the End User License
Agreement ("EULA") posted at hps://support.juniper.net/support/eula/. By downloading, installing or using such
soware, you agree to the terms and condions of that EULA.
ii
Table of Contents
About This Guide | v
1
Overview
Overview | 2
Monitoring Network Devices and Troubleshoong Soware Issues with Junos Space Network
Management Plaorm | 2
Overall System Condion and Fabric Load History Overview | 6
Junos Space Network Management Plaorm Widgets | 9
2
Log Files and Debug Ulies
Troubleshoong Junos Space Network Management Plaorm Issues by Using Log Files | 16
System Status Log File Overview | 16
Junos Space Network Management Plaorm Log Files Overview | 19
Troubleshoong Log File Overview | 23
Downloading the Troubleshoong Log File in Server Mode | 24
Downloading the Troubleshoong Log File in Maintenance Mode | 27
Downloading Troubleshoong System Log Files Through the Junos Space CLI | 28
Downloading a System Log File by Using a USB Device | 29
Downloading System Log File by Using SCP | 30
Customizing Node System Status Log Checking | 32
Customizing Node Log Files to Download | 33
Troubleshoong Network Devices by Using Junos Space Debug Ules | 35
Junos Space Debug Ulies Overview | 35
Execung Device-Connecon Debug Scripts | 39
Execung the Script to Collect Device-Connecon Informaon | 40
Execung the Script to Collect Device Debug Informaon | 42
Execung the Script to Unlock the Device Conguraon | 46
Execung the Script to Collect Node-Connecon Informaon | 46
iii
Execung Device Import Detail Script and Java Applicaon | 52
Execung the Script to Delete Data from Device Import Tables | 52
Execung the Java Applicaon to View Device XML | 54
Execung Job Management Scripts and Java Applicaons | 55
Execung the Java Applicaon to Collect Job Informaon | 55
Execung the Script to View the Stack Trace of a Job | 58
Execung the Script to View Job Informaon on Nodes | 59
Execung HornetQ Scripts | 65
Execung the HornetQ Script to View all JBoss Queues | 65
Execung the HornetQ Script to List of Messages in a JBoss Queue | 67
3
Troubleshoong Junos Space Plaorm Issues
Troubleshoong Login–Related Issues | 71
Troubleshoong the Not Able to Log In from the Junos Space Login Page Issue | 71
Troubleshoong Device Management–Related Issues | 73
Troubleshoong Device Discovery Failure | 73
Troubleshoong Device Data Collecon Issue | 75
Troubleshoong Devices Discovered Twice Using the Device Discovery Workow | 76
Troubleshoong Network Monitoring–Related Issues | 78
Troubleshoong the Network Monitoring Page Is Not Available Issue | 78
Troubleshoong DMI Schema–Related Issues | 80
Troubleshoong the Nondisplay of the DMI Schema Tree Issue | 80
iv
About This Guide
Use this guide to know about the various features, such as Systems of Record, System Snapshot, Audit
Logs, Looking Glass, and so on, that you can use to monitor and troubleshoot devices; and also, know
about procedures to troubleshoot issues, such as login-related issues, device management-related
issues, DMI schema-related issues, and so on, in Junos Space Plaorm.
v
1
PART
Overview
Overview | 2
CHAPTER 1
Overview
IN THIS CHAPTER
Monitoring Network Devices and Troubleshoong Soware Issues with Junos Space Network Management
Plaorm | 2
Overall System Condion and Fabric Load History Overview | 6
Junos Space Network Management Plaorm Widgets | 9
Monitoring Network Devices and Troubleshoong Soware Issues with
Junos Space Network Management Plaorm
IN THIS SECTION
Systems of Record | 3
System Snapshot | 3
Backup and Restore | 3
Maintenance Mode | 4
Audit Logs | 4
Jobs | 4
Secure Console | 5
Looking Glass | 5
Reports | 5
Junos Space Debug Ulies | 6
Use the following features of Junos Space Network Management Plaorm to monitor devices and
troubleshoot soware issues:
2
Systems of Record
A network managed by Junos Space Plaorm contains two repositories of informaon about the devices
in the network: the devices themselves (each device denes and reports its ocial state) and the
database (which contains informaon that is reported by the device during device discovery). This is
known as systems of record.
The systems of record operate in the following two modes depending on where the repository of
informaon is stored:
Network as a system of record (NSOR)—By default, the network is the system of record (NSOR). In
this mode, when a user commits a change in the conguraon of a network device, the commit
operaon automacally triggers a report through the system log to Junos Space Plaorm.
Junos Space as a system of record (SSOR)—In this mode, when you perform any out-of-band commit
operaon, Junos Space Plaorm receives a system log message from the device, but the values in the
Junos Space Plaorm database are not automacally changed or synchronized with the values on the
device. Instead, you can choose whether or not to overwrite the device's local changes by pushing
the accepted conguraon to the device from the Junos Space Plaorm database. For more
informaon about systems of record in Junos Space Plaorm, see
Systems of Record in Junos Space
Overview
.
System Snapshot
You can use the System Snapshot feature to create a snapshot of the current state of the Junos Space
system. The snapshot includes all persistent data on the hard disk including data in the database, system
and applicaon conguraon les, and applicaon and Linux executables. You can roll back the Junos
Space system to a predened state or an older release if the system reaches an unrecoverable error
state caused by undesirable behavior due to corrupon of system les, interrupon of crical processes,
and so on. The System Snapshot is a fabric-wide operaon that maintains consistency of data across all
nodes in the fabric.
You can create a snapshot before a signicant acon is performed—for example, adding or deleng a
Junos Space node, installing a Junos Space applicaon, and so on—because the acon can precipitate
the system into an undesirable state. You can delete the snapshot aer you have ascertained that the
acon was performed successfully. For more informaon about system snapshots, see
Creang a
System Snapshot
.
Backup and Restore
You use the Backup and Restore feature to back up (or schedule the backup of) and restore the data in
the Junos Space database. You can set up an hourly, daily, or weekly schedule. The database backup can
be stored on the local Junos Space system or transferred to a remote system automacally using the
Secure Copy mechanism.
3
You can restore the backup in any of the following circumstances:
Junos Space data is corrupted and you need to replace the corrupted data with uncorrupted data.
Junos Space soware is corrupted and unstable aer a reinstallaon or an upgrade and you need to
populate the Junos Space database with uncorrupted data.
For more informaon about backup and restore operaons, see
Backing Up and Restoring the Database
Overview
.
Maintenance Mode
Maintenance mode is a mode in which you can perform database restore and debugging tasks while all
nodes in the fabric are shut down and the Junos Space Network Management Plaorm Web proxy is
running. You need to be an authorized Junos Space administrator to put the system into maintenance
mode. You can put the system into maintenance mode only aer you iniate a restore task by using the
Backup and Restore feature.
The Junos Space system goes into maintenance mode in the following situaons:
Junos Space Network Management Plaorm soware goes down.
You iniate a restore operaon by using the Backup and Restore feature.
You upgrade the Junos Space Network Management Plaorm soware.
For more informaon about maintenance mode, see
Maintenance Mode Overview
.
Audit Logs
The Audit Logs workspace of Junos Space Plaorm displays the login history and tasks iniated by a
local or remote user. Through this workspace, you can track login history, view the list of device
management tasks, view the list of services that were provisioned on the device, and so on. However,
tasks that are not iniated by users, such as device-driven acvies (for example, resynchronizaon of
network elements), and changes made from the Junos Space CLI are not recorded in audit logs. Audit
logs can be used by administrators to review events—for example, to idenfy which user accounts are
associated with an event, to determine the chronological sequence of events (that is, what happened
before and during an event), and so on. For more informaon about audit logs, see
Junos Space Audit
Logs Overview
.
Jobs
You use the Jobs workspace of Junos Space Plaorm to monitor the status of jobs that are run in Junos
Space Plaorm and all Junos Space applicaons installed on Junos Space Plaorm. You can view the
status of the jobs on the Job Management page. A job is a user-iniated acon that is performed on any
4
object that is managed by Junos Space Plaorm, such as a device, service, or customer. Typical jobs in
Junos Space Network Management Plaorm include discovering devices, deploying services, prestaging
devices, and performing funconal and conguraon audits.
You can trigger jobs immediately or schedule jobs for a later date and me. Junos Space Plaorm
maintains a history of job statuses for all scheduled jobs. When a job is scheduled from a workspace,
Junos Space Plaorm assigns a job ID that serves to idenfy the job on the Job Management page. For
more informaon about jobs, see
Jobs Overview
.
Secure Console
The Secure Console feature on the Devices workspace provides a secure remote access connecon to
managed and unmanaged devices. Secure Console iniates an SSH session from the Junos Space user
interface by using the SSH protocol. Secure Console is a terminal window embedded in Junos Space
Plaorm that eliminates the need for a third-party SSH client to connect to devices. Secure Console
provides addional security while connecng to your devices by iniang an SSH session from the
Junos Space server rather than from your Web browser. You can access the Secure Console feature
either from the Device Management page or the Secure Console page. For more informaon about
Secure Console, see
Secure Console Overview
.
Looking Glass
You use the Looking Glass feature from the Devices workspace to view device conguraons by
execung basic CLI commands from the Junos Space user interface. You can execute these commands
on mulple devices and compare the conguraons and runme informaon of these devices. You can
execute the following types of commands by using Looking Glass: show, ping, test, and traceroute. The
commands that are supported and stored in the Junos Space Plaorm database are displayed on the
Looking Glass page. When you type the rst few leers of the command, the suggeson list displays the
commands that are supported, are stored, and begin with the leers that you typed. For more
informaon about Looking Glass, see
Looking Glass Overview
.
Reports
With the Reports workspace of Junos Space Plaorm, you can generate customized reports for
managing the resources in your network. You can use these reports to gather device inventory details,
job execuon details, user accounts, and audit trails. You rst create a report denion to specify what
informaon to retrieve from the Junos Space Plaorm inventory database. You then use this report
denion to generate, export, and print the reports. Junos Space Plaorm provides some predened
categories to create report denions. You can combine mulple categories to create a report denion.
By default, a predened set of aributes is included in a report denion. You can choose to add or
remove the aributes according to what informaon you want from the nal generated report. You can
5
group, sort, or lter data based on specic aributes available with the report denion. For more
informaon about reports, see
Reports Overview
.
Junos Space Debug Ulies
Junos Space debug ulies are a collecon of scripts and Java applicaons to fetch details that cannot
be viewed on the JBoss CLI or from the Junos Space user interface. These scripts and Java applicaons
are stored at /var/log/space-debug/debug-ulies and categorized under deviceConnecon,
jobManagement, deviceImport, and HornetQ directories. When you execute these scripts or Java
applicaons, you can view details such as device-connecon or node-connecon issues, device XMLs
fetched from the Junos Space Plaorm database, and jobs triggered and nodes that execute these jobs.
For more informaon about Junos Space debug ulies, see "Junos Space Debug Ulies Overview" on
page 35.
RELATED DOCUMENTATION
Overall System Condion and Fabric Load History Overview | 6
Junos Space Network Management Plaorm Widgets | 9
Overall System Condion and Fabric Load History Overview
IN THIS SECTION
Overall System Condion | 6
Fabric Load History | 8
Acve Users History | 9
You can view the overall Junos Space system condion and fabric load from the Junos Space Network
Management Plaorm Dashboard or the Administraon stascs page.
Overall System Condion
To calculate the overall Junos Space system condion, Junos Space Plaorm uses a formula based on
cluster health and node-funcon health:
6
Cluster health indicates the percentage of nodes in the fabric that are currently running.
For example, if only three nodes are reachable in a four-node fabric, cluster health is 75%.
Load-balancer health indicates the percentage of nodes (enabled for load balancing) that are running
the load-balancing process.
For example, if two nodes are enabled for load balancing and the load-balancing process is running
on only one node, the load-balancing health is 50%.
Database health indicates the percentage of nodes (enabled for database requests) that are running
the database process.
For example, if two nodes are enabled as the database server and the database process is running on
only one node, then database health is 50%.
Applicaon-logic health indicates the percentage of nodes (enabled for applicaon logic (DML and
business logic) that are running the applicaon-logic process.
For example, if three nodes are enabled for applicaon logic and the applicaon-logic process is
running on only two nodes, then applicaon-logic health is 67%.
Junos Space Plaorm retrieves data on the nodes and the node funcons that are running, and then
applies the following formula to determine the overall Junos Space system condion: Overall System
Condion = [(Number of Nodes Running) / (Number of Nodes in Fabric)] * [(Number of Nodes Running
Load_Balancing Process) / (Number of Nodes enabled for Load Balancing)] * [(Number of Nodes Running
Database-Server Process) / (Number of Nodes Enabled As Database Server)] * [(Number of Nodes
Running Applicaon-Logic Process) / (Number of Nodes Enabled for Applicaon Logic)]
The overall Junos Space system condion is expressed as a percentage. If we use the values in the
preceding examples in this formula, then the overall system condion would be calculated as: Overall
System Condion = 75% * 50%* 50% * 67% = 12.5%.
A value between 0 and 30% indicates that the system health is Poor, a value between 30% and 70%
indicates that the system health is average, and a value between 70% and 100% indicates that the
system health is good. The Overall System Condion chart displays the system health as shown in Figure
1 on page 8
7
Figure 1: Overall System Condion Gauge
The overall system health indicates 0% (Poor) when any one of the following condions is detected:
No nodes in the fabric are running.
No nodes enabled for load balancing are running the load-balancing process.
No nodes enabled for database requests are running the database process.
No nodes enabled for applicaon logic are running the applicaon-logic process.
Fabric Load History
The Fabric Load History chart, as shown in Figure 2 on page 8, displays the average CPU usage across
all nodes that are running in the fabric.
Figure 2: Fabric Load History Chart
8
Junos Space Plaorm uses the following formula to determine the fabric load: Fabric Load = (Total CPU
Usage for All Nodes Running) / (Number of Nodes Running)
For example, for a fabric with three nodes running and CPU usage of 80%, 30%, and 10%, respecvely,
the fabric load is 40%.
Acve Users History
The Acve Users History chart, as shown in Figure 3 on page 9, displays the number of acve users in
the past one minute.
Figure 3: Acve Users History Chart
RELATED DOCUMENTATION
Viewing the Junos Space Plaorm Dashboard
Viewing the Administraon Stascs
Junos Space Network Management Plaorm Widgets
IN THIS SECTION
Devices | 10
9
Device Templates | 10
CLI Conglets | 11
Images and Scripts | 11
Reports | 11
Network Monitoring | 12
Conguraon Files | 12
Jobs | 12
Role Based Access Control | 13
Audit Logs | 13
Administraon | 13
This topic presents a list of workspaces in Junos Space Network Management Plaorm and the widgets
that they display:
Devices
The Devices workspace displays the following widgets:
Device Count by Plaorm—Number of Juniper Networks devices added per device plaorm
Device Status—Percentage of devices with the UP, Down, or NA connecon status
Device Count by OS—Number of devices running a parcular Junos OS version
Device Count by Synchronizaon State—Device discovery targets that were discovered, failed, are
managed
For more informaon about these widgets, refer to the
Viewing Device Stascs
topic in the
Junos
Space Network Management Plaorm Workspaces Feature Guide
.
Device Templates
The Device Templates workspace displays the following widgets:
Template Status—Percentage of device templates with the Enabled and Need Review statuses
Template Denion Status—Percentage of device templates that are Published and Unpublished
statuses
10
Template Count by Device Family—Number of device templates created per device family
For more informaon about these widgets, refer to the
Viewing Device Template Stascs
and
Viewing
Template Denion Stascs
topics in the
Junos Space Network Management Plaorm Workspaces
Feature Guide
.
CLI Conglets
The CLI Conglets workspace displays the following widgets:
CLI Conglet Count by Device Family—Number of CLI conglets created per device family
Conguraon Viewer Count by Device Family—Number of conguraon views per device family
For more informaon about these widgets, refer to the
Viewing CLI Conglet Stascs
and
Viewing
Conguraon Views Stascs
topics in the
Junos Space Network Management Plaorm Workspaces
Feature Guide
.
Images and Scripts
The Images and Scripts workspace displays the following widgets:
Device Image Count by Plaorm Group—Number of device images per plaorm group
Device Images Count by Version—Number of device images created per Junos OS version
Number of Scripts by Type—Number of scripts created per script type. The script types are : Commit,
Op, and Event
Number of Jobs per Script Acon—Number of jobs triggered by dierent script-related acons
For more informaon about these widgets, refer to the
Viewing Stascs for Device Images and Scripts
topic in the
Junos Space Network Management Plaorm Workspaces Feature Guide
.
Reports
The Reports workspace displays the following widgets:
Report Denion Count by User—Number of report denions created per user
Report Count by User—Number of reports created per user
For more informaon about these widgets, refer to the
Viewing Report Stascs
and
Viewing Report
Denion Stascs
topics in the
Junos Space Network Management Plaorm Workspaces Feature
Guide
.
11
Network Monitoring
The Network Monitoring workspace displays the following widgets:
Nodes with Pending Problems—Nodes with outstanding alarms
Nodes with Outages—Nodes that reported outages
Availability Over the Past 24 hours—Number and percentage availability of the network interfaces of
the devices that reported outages
Nocaon—Check for nocaons sent to you, all Junos Space Plaorm users, and the on-call
schedule to x outages.
Resource Graphs—Search for resource graphs. Resource graphs display data collected from managed
nodes throughout your network such as crical SNMP performance, response me, and so forth.
KSC Reports—Search for key SNMP customized (KSC) reports. KSC reports enable you to create and
view SNMP performance data using prefabricated graph types.
Quick Search—Search for nodes by node ID, node label, IP address, or the type of service whether
ICMP or SNMP.
For more informaon about these widgets, refer to the
Network Monitoring Reports Overview
topic in
the
Junos Space Network Management Plaorm Workspaces Feature Guide
.
Conguraon Files
The Conguraon Files workspace displays the following widgets:
Conguraon File Count by Device Family—Number of conguraon les per device family
Devices with most Frequently Revised Conguraon Files—Devices whose conguraon les have
been revised most number of mes
For more informaon about these widgets, refer to the
Viewing Conguraon File Stascs
topic in the
Junos Space Network Management Plaorm Workspaces Feature Guide
.
Jobs
The Jobs workspace displays the following widgets:
Job Types—Percentage of all jobs of a parcular type that are run
State of Jobs Run—Percentages of jobs that succeeded, are canceled, are in progress, or failed
12
Average Execuon Time per Completed Job— Each bar in the Average Execuon Time per
Completed Job bar chart represents a job type and the average execuon me in seconds.
For more informaon about these widgets, refer to the
Viewing Stascs for Jobs
topic in the
Junos
Space Network Management Plaorm Workspaces Feature Guide
.
Role Based Access Control
The Role Based Access Control workspace displays the following widget:
Number of Users Assigned by Role—Percentage and the number of users that are assigned to a role
For more informaon about these widgets, refer to
Viewing User Stascs
.
Audit Logs
The Audit Logs workspace displays the following widgets:
Audit Log Stascal Graph—Tasks that are performed and logged in all Junos Space applicaons over
a specic period of me
Top 10 Acve Users in 24 hours—Top ten users who performed the most number of tasks over 24
hours
For more informaon about these widgets, refer to the
Viewing Audit Log Stascs
topic in the
Junos
Space Network Management Plaorm Workspaces Feature Guide
.
Administraon
The Administraon workspace displays the following widgets:
System Health—Junos Space system condion, load on the fabric, and acve users.
System Alert Messages in the last 30 days—SMTP server alert messages categorized by applicaon,
and when the error last occurred.
System Health Report—Health and performance of the Junos Space nodes in your Junos Space setup
and the processes on these nodes. Staring in Release 15.2R1, the Administraon workspace displays
the System Health Report widget.
For more informaon about these widgets, refer to the
Viewing the Administraon Stascs
topic in the
Junos Space Network Management Plaorm Workspaces Feature Guide
.
13
Release History Table
Release Descripon
15.1R2 Staring in Release 15.2R1, the Administraon workspace displays the System Health Report widget.
RELATED DOCUMENTATION
Overall System Condion and Fabric Load History Overview | 6
Junos Space Debug Ulies Overview | 35
14
2
PART
Log Files and Debug Ulies
Troubleshoong Junos Space Network Management Plaorm Issues by Using Log
Files | 16
Troubleshoong Network Devices by Using Junos Space Debug Ules | 35
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56
  • Page 57 57
  • Page 58 58
  • Page 59 59
  • Page 60 60
  • Page 61 61
  • Page 62 62
  • Page 63 63
  • Page 64 64
  • Page 65 65
  • Page 66 66
  • Page 67 67
  • Page 68 68
  • Page 69 69
  • Page 70 70
  • Page 71 71
  • Page 72 72
  • Page 73 73
  • Page 74 74
  • Page 75 75
  • Page 76 76
  • Page 77 77
  • Page 78 78
  • Page 79 79
  • Page 80 80
  • Page 81 81
  • Page 82 82
  • Page 83 83
  • Page 84 84
  • Page 85 85
  • Page 86 86

Juniper Junos Space Network Management Platform User guide

Category
Software
Type
User guide

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI