DGARM - Engagement Report - 20260508v1
Appearance
Auto-generated from the uploaded PDF DGARM_-_Engagement_Report_-_20260508v1.pdf. This is an extracted-text rendering for searchability; see the original PDF for exact formatting, diagrams, tables, and images.
2 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Table of Contents
Table of Contents 3
Document Properties 4
Version History 4
References 4
Executive Summary 5
Overview 5
Participants 5
Business Value 6
Outcomes 6
Next Steps 7
Cluster Review 8
Cluster Architecture & Topology 8
Elasticsearch Configuration Files and Bootstrap Checks 9
Version & Licence 11
Kibana Review 11
Findings 11
Recommendations 12
Security and Access Control Review 12
Findings 12
Recommendations 13
Snapshot, Backup, and Disaster Recovery Review 13
Current State 13
Snapshot Lifecycle Management (SLM) 13
Findings 14
Recommendations 14
Data Lifecycle, Storage, and Retention Review 15
Findings 15
Recommendations 16
Monitoring and Alerting Review 16
Current State 16
Findings 16
Recommendations 17
Data Source Inventory & Integration Status 18
Out-of-Scope Dashboard Assistance 24
Action Plan - Next Steps 28
3 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Document Properties
Version History
Version Date Author Description
1.0 2026 May 8th Salm Alaeddine Initial Release
References
Ref. No Document Name Location Description
DGARM Design Document -
1 Email Design Document
20250829 v1.2
4 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Executive Summary
Overview
Elastic conducted an advisory review of DGARM’s Elastic environment to assess the current cluster
deployment, validate the implementation against the available design documentation, and identify any
gaps, risks, or improvement opportunities.
The review focused on the deployed Elasticsearch and Kibana clusters, including cluster
configuration, monitoring, alerting, snapshot and restore readiness, security controls, data lifecycle
management, and operational alignment with Elastic best practices.
The engagement was structured around the following areas:
● Current state discovery.
● Cluster configuration review against the documented design.
● High-level health and operational review.
● Alignment to Elastic best practices.
● Monitoring, alerting, backup, and disaster recovery readiness.
● Identification of risks, findings, recommendations, and next steps.
Elastic guidance referenced during the review includes production readiness, dedicated monitoring,
index lifecycle management, shard sizing, snapshot and restore, and dedicated master node design.
Elastic recommends using ILM to automate rollover and retention, using snapshots as the supported
backup method, and using a separate monitoring cluster for production monitoring where applicable.
Participants
Org Name Role/Position mail
Biswajit Banerjee Project Manager biswajit@tetrain.com
Mukul Mahajan mukul@tetrain.com
Muralidharan
Tetra / Lead Architect muralidharan_S12@infosys.com
Subramanian
Infosys
Bhasha Sisodia Operations Manager bhasha.sisodia@infosys.com
Karan Neelkanth Platform Lead karan.neelkanth@infosys.com
5 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Divya Dhyani divya_dhyani@infosys.com
Bimlesh Kumar bimlesh.kumar@infosys.com
Juhu Sajwar juhu.sajwar@infosys.com
Prashant Kashyap prashant.kashyap@tetrain.com
Manish Singh Manish@tetrain.com
Salim Alaeddeine Consulting Architect salim.alaeddine@elastic.co
Elastic
Sri Suba Selvachamy Delivery Manager sri.selvachamy@elastic.co
Business Value
The cluster review provides DGARM with a clear understanding of the current Elastic platform state
and highlights the actions required to improve platform stability, resilience, governance, and
operational maturity.
The key business value includes:
● Improved confidence in Elastic platform health and recoverability.
● Early identification of risks that may impact service availability.
● Better alignment between the deployed environment and the approved design.
● Improved operational visibility through monitoring, alerting, and audit logging.
● Reduced risk of data loss through validated snapshot and restore processes.
● Clearer prioritisation of remediation and optimisation activities.
Outcomes
The engagement produced the following key outcomes:
● Reviewed the current Elastic deployment at a high level.
● Compared the current environment against the available design documentation.
● Identified critical areas requiring immediate attention, including:
○ Production license status.
○ Snapshot repository functionality.
○ Backup and disaster recovery readiness.
○ Monitoring architecture.
6 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
○ Alert notification actions.
● Reviewed the current monitoring and alerting setup.
● Identified that Stack Monitoring alert issues related to API keys were resolved after updating
the API key.
● Reviewed the current audit logging approach.
● Identified that Elasticsearch audit logs are currently consumed by Imperva but not ingested
into Elastic.
● Captured recommended actions to improve alignment with Elastic best practices.
Next Steps
The recommended next steps are:
● Apply the correct production license for the Search Cluster before 8 May 2026.
● Review and remediate the snapshot repository issue.
● Validate Snapshot Lifecycle Management policies and snapshot success history.
● Perform a controlled restore test to confirm recoverability.
● Move monitoring to a dedicated monitoring cluster where aligned with the design and
governance requirements.
● Configure alert actions for critical Stack Monitoring alerts.
● Enable logs collection for Elasticsearch, Kibana, and relevant ingestion components.
● Review audit logging requirements and consider enabling Kibana audit logging.
● Back up non-Elasticsearch configuration artefacts.
7 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Cluster Review
Cluster Architecture & Topology
The following clusters were reviewed or identified as part of the engagement. At the time of the
review, no dedicated monitoring cluster was deployed.
Search Cluster
Node Role Hostname IP CPU RAM (GB) Disk (GB)
Master + Data dcplelkschmdh01 10.150.25.70 16 64 1024
Node
Master + Data dcplelkschmdh02 10.150.25.71 16 64 1024
Node
Master + Data dcplelkschmdh03 10.150.25.72 16 64 1024
Node
Machine dcplelkschml01 10.150.25.73 8 64 200
Learning Node
Kibana Node dcplelkschkib01 10.150.25.74 8 16 200
Kibana Node dcplelkschkib02 10.150.25.75 8 16 200
Logstash Node dcplelkschlgst01 10.150.25.76 8 16 300
Logstash Node dcplelkschlgst02 10.150.25.77 8 16 300
Observability Cluster
Node Role Hostname IP CPU RAM (GB) Disk (GB)
Master Node dcplelkobsmas01 10.150.25.78 8 16 200
Master Node dcplelkobsmas02 10.150.25.79 8 16 200
Master Node dcplelkobsmas03 10.150.25.80 8 16 200
Hot Node dcplelkobshtdt01 10.150.25.81 16 64 1024
Hot Node dcplelkobshtdt02 10.150.25.82 16 64 1024
Warm Node dcplelkobswmdt01 10.150.25.83 16 64 3072
Warm Node dcplelkobswmdt02 10.150.25.84 16 64 3072
Warm Node dcplelkobswmdt03 10.150.25.85 16 64 3072
8 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Warm Node dcplelkobswmdt04 10.150.25.86 16 64 3072
Machine dcplelkobsml01 10.150.25.87 16 32 200
Learning Node
Machine dcplelkobsml02 10.150.25.88 16 32 200
Learning Node
Kibana Node dcplelkobskib01 10.150.25.89 8 16 200
Kibana Node dcplelkobskib02 10.150.25.90 8 16 200
Fleet Server dcplelkobsflt01 10.150.25.91 8 16 200
Node
Fleet Server dcplelkobsflt02 10.150.25.92 8 16 200
Node
APM Node dcplelkobsapm01 10.150.25.93 8 16 200
APM Node dcplelkobsapm02 10.150.25.94 8 16 200
Logstash Node dcplelkobslgst01 10.150.25.95 8 16 300
Logstash Node dcplelkobslgst02 10.150.25.96 8 16 300
Elasticsearch Configuration Files and Bootstrap Checks
As part of the cluster review, the Elasticsearch configuration files were reviewed against Elastic
production guidance and bootstrap requirements. The review identified several configuration items
that should be cleaned up or hardened to improve operational clarity, production stability, and
resilience.
Elasticsearch.yml
Finding Recommendation Elastic Reference
cluster.initial_master_nodes entry was Remove the entry from the Bootstrapping a
found in the Elasticsearch configuration file to avoid cluster
configuration file. This setting is only confusion during future
required during the initial cluster maintenance, restarts, or
bootstrap and should not remain in the node replacement activities.
configuration after the cluster has
formed.
9 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
bootstrap.memory_lock: true is • Disable swap at the Disable swapping /
currently commented out. This means operating system level, set Bootstrap checks
Elasticsearch memory may be vm.swappiness = 1 where
swapped to disk, which can cause applicable, OR
long garbage collection pauses and •Enable
node instability. bootstrap.memory_lock: true,
and validate that memory
locking is active.
No shard allocation awareness Configure shard allocation Shard allocation
configuration was found. awareness based on the awareness
node.attr.rack, node.attr.zone, or physical topology, such as
similar awareness attributes are not rack, zone, or data centre, to
configured. help distribute primary and
replica shards across failure
domains.
Kibana.yml
Finding Recommendation Elastic reference
Plaintext password in kibana.yml - Remove from file. Add to Secure Settings
elasticsearch.password: "" Kibana keystore:
bin/kibana-keystore add
elasticsearch.password
All three encryption keys exposed in Move all three keys to Security
plaintext - xpack.*.encryptionKey Kibana keystore. Configuration
Audit logging not enabled - Enable Audit Logging
xpack.security.audit.enabled not xpack.security.audit.enable
configured d: true
Elastic Documentation reference:
● Elastic Production Guidance — Running Elastic Stack in production requires planning for
resilience, performance, and scalability.
● Elasticsearch Important Settings — Production configuration items include cluster name, node
name, network host, discovery, heap, logging, and backups.
● Elasticsearch Bootstrap Checks — In production mode, failed bootstrap checks prevent
Elasticsearch from starting.
10 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Version & Licence
The Elasticsearch clusters are currently deployed on version 9.3.1.
The Observability cluster has the correct production licence applied, and no immediate action is
required.
The Search cluster is currently running on a trial licence, which is due to expire on 8 May 2026. The
trial licence should be replaced with the appropriate licence before the expiry date to avoid any loss
of licensed features or potential service impact. The severity of this issue has been communicated to
the relevant team, and it should be addressed promptly to avoid loss of licensed features or potential
service impact.
The DR cluster currently has a full production licence applied. This should be reviewed, as the DR
cluster was scoped to remain under the appropriate non-production licence unless it is actively being
used during a disaster recovery scenario.
During normal operations, the production licence should remain assigned to the production cluster. In
the event of a DR activation, the production licence can be moved to the DR cluster and then reverted
back once the production environment has been restored.
Kibana Review
The Kibana review covered:
● Kibana availability and sizing.
● Spaces and saved object organisation.
● User access and role-based access control.
● External authentication integration.
● Role mappings.
● Alerting and connector configuration.
● Kibana audit logging.
Findings
Finding Severity Observation
Kibana audit logging is Medium Kibana audit logging is not currently enabled.
not enabled
11 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Alert actions are not High Critical monitoring alerts may not notify operational
configured teams.
Role mappings require Medium Access model should be reviewed against the
validation documented security design.
Recommendations
● Validate spaces and saved object organisation.
● Review RBAC design and role mappings.
● Enable Kibana audit logging if required by governance or compliance requirements.
● Configure alert actions for critical operational alerts.
Security and Access Control Review
The security review covered:
● Authentication model.
● External authentication or SSO integration.
● Role-based access control.
● Role mappings.
● TLS and certificate configuration.
● Audit logging.
Findings
Finding Severity Observation
Elasticsearch audit logs are not Medium Audit logs are consumed by Imperva but not
ingested into Elastic available in Elastic for investigation or correlation.
Kibana audit logging is not Medium Kibana user activity visibility is limited.
enabled
RBAC requires validation Medium Roles and mappings should be reviewed against the
security design.
12 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Certificate lifecycle Medium TLS and certificate management should be
management requires reviewed.
validation
Recommendations
● Review security design against the live implementation.
● Validate SSO or external authentication if available.
● Review role mappings against least privilege principles.
● Enable Kibana audit logging where required.
● Confirm whether Elasticsearch audit logs should be ingested into Elastic.
● Validate TLS configuration and certificate expiry management.
Snapshot, Backup, and Disaster Recovery Review
Current State
Snapshot configuration is not confirmed as functional. The snapshot repository appears to have
issues that require further investigation. Backup and disaster recovery readiness therefore remain a
critical risk area.
Elastic snapshots are the supported way to back up Elasticsearch data. Elastic explicitly states that
filesystem-level copies of node data directories are not a supported backup and restore method.
Snapshot Lifecycle Management (SLM)
Cluster snapshots can be managed using Snapshot Lifecycle Management (SLM). Note this is
different from the searchable snapshots which are managed as part of ILM actions.
When configuring long term snapshot retention, it is important to consider the frequency of the
snapshots as well as the retention of a snapshot. Each snapshot has some overhead on the master
nodes, so having an appropriate snapshot lifecycle management strategy is important for cluster
stability.
13 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
The recommended strategy is to apply multiple SLM policies with varying intervals and retention to
provide flexibility in both snapshot granularity as well as retention length. The following three policies
could be used in conjunction:
Snapshot Policy Frequency Retention Approximate Snapshot Count
Short-term snapshots Every 15 minutes 24 hours 96
Daily snapshots Daily 1 month 31
Monthly snapshots Monthly 1 year 12
Combining the above three policies will ensure that snapshots are taken every 15 minutes, minimising
the potential data loss and/or reingestion required if recent data needs to be restored. In addition, it
reduces the overall number of snapshots required by taking snapshots at longer intervals. This
process is described in detail in the following documentation.
Findings
Finding Severity Observation
Snapshot repository issue Critical Repository health requires investigation.
Snapshot success history not Critical Snapshot reliability is not yet validated.
confirmed
Restore test not confirmed Critical Recoverability is not proven.
Non-Elasticsearch artefacts require Medium Elastic snapshots do not cover all deployment
separate backup and configuration files.
Recommendations
● Review and fix the snapshot repository issue.
● Validate Snapshot Lifecycle Management policies.
● Confirm snapshot success and failure history.
● Perform a controlled restore test.
● Monitor snapshot failures and configure alert actions.
14 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
● Back up non-Elasticsearch configuration artefacts separately. Configuration artefacts to back
up outside Elasticsearch snapshots include:
● elasticsearch.yml
● kibana.yml
● Logstash pipeline files.
● Operating system configuration.
● Certificates and private keys.
● Other deployment artefacts.
Data Lifecycle, Storage, and Retention Review
The review covered:
● ILM policy design.
● Rollover conditions.
● Retention periods.
● Data tier allocation.
● Shard sizing and shard count.
Elastic ILM is designed to automate the lifecycle of time-based indices, including rollover, retention,
and deletion, helping optimise performance, reliability, and storage cost.
Elastic also provides shard sizing guidance to avoid excessive shard and index counts, including
guidance around the number of indices per GB of heap on master nodes.
Therefore enforcing a strict shard strategy is required. The following guidelines should be followed for
shard sizing:
1. Primary Shards should be between 10GB and 50GB in size.
2. In cases where logsdb data stream type is used, 10-30GB is an ideal size.
3. Shards should contain no more than 200 million documents.
4. No more than 3000 indices per 1 GB of master heap.
Findings
Finding Severity Observation
15 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
ILM alignment requires High ILM policies need to be compared with business
validation retention requirements.
Shard sizing requires High Shard count and shard sizing should be reviewed as per
review design
Storage tier alignment Medium Data placement should align with data value, search
requires review frequency, and retention requirements.
Recommendations
● Review all ILM policies against business retention requirements.
● Confirm rollover conditions are appropriate for data volume.
● Validate delete phases to avoid uncontrolled data growth.
● Review data tiers and ensure data is stored on the correct tier.
Monitoring and Alerting Review
Current State
The current monitoring state appears to be self-monitoring for each cluster, with metrics collection
only. Logs are not fully collected into Elastic for monitoring and troubleshooting.
Stack Monitoring alerting had an API key related issue, which was resolved by updating the API key.
However, alert actions are not currently configured.
Elastic recommends using a separate monitoring cluster for production environments. This helps
ensure monitoring data remains available if the production cluster is unavailable, and it also prevents
monitoring activity from impacting production performance.
Findings
Finding Severity Observation
Self-monitoring is High Monitoring data may be unavailable if the
currently used production cluster is impacted.
16 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Logs are not fully High Troubleshooting visibility is limited.
collected
Alert actions are not High Critical alerts may not notify administrators.
configured
API key issue was Closed / Updating the API key fixed the Stack Monitoring
resolved Informational alert issue.
Recommendations
● Move monitoring to a dedicated monitoring cluster in line with the design documentation.
● If a dedicated monitoring cluster is not feasible, assess AutoOps suitability based on
governance and compliance requirements.
● Collect both metrics and logs for Elasticsearch, Kibana, Logstash, Elastic Agent, and Beats
where applicable.
● Configure notification actions for critical alerts.
● Recommended alert notifications actions could include:
○ Email.
○ Ticketing platform.
○ Microsoft Teams.
○ Incident management tooling.
Recommended alert coverage:
● Cluster health.
● Node availability.
● Disk usage and storage thresholds.
● JVM memory pressure.
● CPU utilisation.
● Shard allocation issues.
● Snapshot failures.
● Ingestion failures.
● Kibana Task Manager issues.
17 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Elastic Stack Monitoring includes preconfigured alerting rules based on Elastic recommendations,
which can be tailored to the environment.
Data Source Inventory & Integration Status
The ingestion review covered the current and planned data sources across servers, databases,
platforms, applications, storage, network, and security devices.
Elastic out-of-the-box integrations are being used where available, including System, PostgreSQL,
IBM MQ, GitHub, Tenable, Palo Alto, Fortinet, Juniper SRX, Aruba CX, F5 BIG-IP, Forcepoint, and
Kubernetes/OpenShift where applicable. Elastic integrations provide pre-packaged assets to collect,
store, and visualise data from supported sources.
For data sources where no suitable out-of-the-box integration is available, custom ingestion is
required using supported ingestion patterns such as syslog, Logstash, API polling, HTTP Endpoint,, or
custom Elastic Agent integrations.
A quick overview on the data onboarding progress:
Data Source Type OOTB Current Status / Notes
Integration
RHEL Servers Server System Logs & Onboarded using Elastic System integration
Metrics for logs and metrics.
~210 host onboarded at this stage
Physical Server System Logs &
Servers Metrics
Kubernetes / Platform Kubernetes / Onboarded, but some metrics are not being
OpenShift OpenShift collected due to OpenShift SCC/context
integration permissions. Requires follow-up.
eMudhra Application N/A eMudhra Host is being monitored at this
SecurePass / stage. Application logs are not onboarded
iDAM yet.
PostgreSQL Database PostgreSQL Onboarded using OOTB integration.
IBM MQ Application IBM MQ OOTB integration used. Running through
some challenges, support case follow up
Neo4J Application N/A Not yet onboarded
18 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
NGINX + API Application N/A Onboarded. Need to verify sub_status
Gateway parsing/visibility.
JBoss Web Server / N/A Not yet onboarded
Server Application
GitHub Application GitHub Not yet onboarded
ManageEngine Application N/A Not yet onboarded
ITSM
ManageEngine Application N/A Not yet onboarded
Patch
Tenable Application Tenable Not yet onboarded
Imperva Application Imperva Not yet onboarded
/ Security
Cisco SAN Storage Cisco Nexus, Logs : Cisco Nexus integration deployed.
Switch / subject to Might need to validate if devices are Nexus
Storage validation OS or IOS and use the appropriate
integration (Cisco IOS, Cisco Nexus)
Metrics: Can use SNMP polling t o get
devices health, and metrics.
NetApp Storage N/A SNMP polling is currently used to collect
Storage device metrics. This may need to be
fine-tuned to ensure all required metrics are
covered. Alternative options include using
NetApp REST APIs for metrics collection or
reviewing NetApp Harvest as a potential
metrics collection approach.
Veritas Backup Backup N/A Not yet onboarded
Palo Alto Security Palo Alto Onboarded Logs. Metrics are not yet
Firewall — Next-Gen configured.
Internal Firewall
Fortinet Security Fortinet Logs are working. Metrics are not yet
Firewall — FortiGate configured.
External Firewall Logs
Fortinet Security Fortinet Not yet onboarded
Sandbox FortiGate
Firewall Logs,
subject to
validation
Juniper Router Network Juniper SRX OOTB integration is deployed. Review the
incoming log patterns to confirm alignment
with the default integration parsing
19 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
patterns. If the logs do not match the
default patterns, create a custom pattern
and add it to the ingest pipeline.
Aruba Network HPE Aruba CX Metrics onboarded using SNMP poling
Switches
WAF Security F5 BIG-IP Not yet onboarded
DDoS Security F5 BIG-IP Not yet onboarded
Proxy Security Forcepoint Web Not working. Requires follow-up.
Security
DLP Security Forcepoint Web Not working. Requires follow-up.
Security,
subject to
validation
F5 Load Security / F5 BIG-IP Data is not coming in. Current issue
Balancer Network appears to be that data is being sent as
syslog rather than to the expected HTTP
endpoint.
Based on the current setup, Elastic is receiving syslog/log data from the devices through the available
integrations, but metrics collection is not yet enabled or available for some device types through the
same integrations. This is common, as many network, security, and storage integrations are primarily
log-focused, while infrastructure and performance metrics may require additional collection methods.
Elastic can provide recommendations around possible ingestion patterns, Elastic-supported
integrations, data modelling, dashboarding, alerting, and best-practice alignment. However, the
implementation, support, and maintenance of any custom integrations, vendor-specific scripts,
third-party tools, exporters, SNMP configurations, API collectors, or non-Elastic-supported
components would remain the responsibility of the client or the relevant third-party vendor.
At a high level, the recommended approach would be a hybrid model:
● Continue using Elastic integrations and syslog for logs and security events.
● Use SNMP polling for standard device health and infrastructure metrics where suitable.
● Use vendor APIs where richer platform-specific metrics are required.
● Use Logstash or Elastic Agent/custom integrations where transformation, enrichment, or
custom collection is required.
20 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
For the listed devices, the possible direction would be:
Storage Devices
For Cisco SAN switches/storage, SNMP polling may be considered for visibility into interface status,
throughput, errors, discards, power supply, fan status, temperature, and general hardware health.
For NetApp Storage, metrics can be collected using SNMP polling, NetApp REST APIs, or by exploring
NetApp Harvest. SNMP polling may be used for device-level metrics, but it may need to be fine-tuned
to ensure all required metrics are covered. NetApp REST API-based collection may provide richer
visibility into areas such as volume capacity, aggregate usage, IOPS, latency, controller health,
disk/shelf health, and replication status.
For Veritas Backup, API-based collection or scheduled export through Logstash may be considered to
monitor backup job status, failed jobs, success rate, backup duration, storage pool usage, and SLA
compliance, depending on the available Veritas interfaces.
Security Devices
For Palo Alto Firewalls, the available Elastic Palo Alto integration capabilities should be reviewed to
confirm whether metrics collection can be enabled for the PAN-OS environment. Elastic provides a
Palo Alto Networks metrics integration that periodically fetches metrics from Palo Alto Networks
firewalls and management systems.
For Fortinet Firewalls, SNMP polling may typically be used for metrics such as CPU, memory,
interface status, bandwidth, session count, HA status, and hardware health, while syslog continues to
provide security and traffic events.
For Sandbox, WAF, DDoS, Proxy, DLP, and F5 Load Balancer platforms, the preferred collection
method depends on the vendor, model, supported interfaces, and required metrics. In many cases,
SNMP can provide baseline infrastructure health, while vendor APIs may provide richer operational
metrics such as policy events, blocked requests, queue depth, backend health, pool member status,
throughput, latency, and service availability.
Network Devices
For Aruba Switches and Juniper Routers, SNMP polling is commonly used for metrics collection. This
may cover device availability, CPU, memory, interface utilisation, interface errors/discards, port
21 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
status, temperature, fan/power status, and routing or protocol health where exposed by the device
MIBs.
The initial baseline metrics to consider may include:
● Device availability
● CPU utilisation
● Memory utilisation
● Interface status and utilisation
● Interface errors and discards
● Hardware health
● Storage capacity
● Backup success/failure status
● HA/failover status
● Last successful metric collection timestamp
From an Elastic perspective, the metrics should ideally be normalised into dedicated metrics data
streams such as network, security, storage, and backup metrics.
For Logstash-based onboarding, it is recommended to use Elastic data streams rather than
standalone indices where possible.
Data streams are better suited for time-series data such as logs, metrics, and observability events.
They also integrate well with index lifecycle management, rollover, and long-term retention strategies.
Recommended approach:
● Use data streams for metrics and logs.
● Apply consistent dataset and namespace naming.
● Align the data stream naming convention with the design documentation.
● Apply ILM policies based on data type, value, and retention requirements.
Example pattern:
metrics-network.snmp-prod
metrics-storage.netapp-prod
logs-network.device-prod
22 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
For SNMP and custom metrics, it is recommended to map important fields to Elastic Common Schema
(ECS) where practical.
For example:
Current / Recommended ECS-Aligned Field Notes
Custom Field
tag.device host.hostname or host.name Use keyword mapping for
filtering and grouping.
Device IP field host.ip Use IP mapping where
possible.
Device type host.type or custom device.type Helps classify routers,
switches, storage, etc.
Interface observer.ingress.interface.name, Use consistent naming for
name observer.egress.interface.name, or network interface
custom interface field dashboards.
Interface event.status or custom mapped keyword Enables consistent filtering
status field and visualisation.
SNMP source data_stream.dataset Helps organise and route
data.
The exact mapping should be reviewed based on the source data structure and the dashboards
required.
To support dashboard filtering and aggregations, key fields should be mapped correctly.
Recommended examples:
● Hostnames and device names: keyword
● IP addresses: ip
● Interface names: keyword
● Status fields: keyword
● CPU, memory, disk, and bandwidth metrics: numeric fields, for example long, double.
● Timestamps: date
23 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
For reference, the following documentation pages may be useful:
● Elastic Agent and Fleet overview:
https://www.elastic.co/docs/reference/fleet
● Manage Elastic Agent integrations:
https://www.elastic.co/docs/reference/fleet/manage-integrations
● Elastic integrations catalogue:
https://www.elastic.co/integrations
● Logstash SNMP integration plugin, including SNMP polling and SNMP trap support:
https://www.elastic.co/docs/reference/logstash/plugins/plugins-integrations-snmp
● Logstash SNMP input plugin:
https://www.elastic.co/docs/reference/logstash/plugins/plugins-inputs-snmp
● Palo Alto Networks logs integration for Elastic:
https://www.elastic.co/docs/reference/integrations/panw
● Palo Alto Networks metrics integration for Elastic:
https://www.elastic.co/docs/reference/integrations/panw_metrics
Out-of-Scope Dashboard Assistance
Although dashboard creation was outside the original review and validation scope, the team raised an
urgent request for assistance with creating an overall monitoring dashboard. In response, we
supported the team remotely via screen sharing and helped structure the dashboard across server,
network, and storage monitoring sections.
The server monitoring section was completed where data is available, including CPU, memory, disk
utilisation, and top utilisation views. The network monitoring section was structured, but current data
availability is limited to Aruba device interface status. Network CPU and memory metrics, other
network device types, and additional models are not yet onboarded into Elastic. The storage section
was also structured and populated using the available NetApp SNMP data, currently limited to device
status and global health.
The overall monitoring dashboard structure was created to cover the main requested areas:
● Server monitoring.
● Network monitoring.
24 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
● Storage monitoring.
The dashboard structure now provides a foundation for the required monitoring use cases, with
visualisations populated where the relevant data is currently available.
Where data is not available, the required sections were structured so that they can be completed once the
missing data sources and metrics are onboarded into Elastic.
Screenshots of the created dashboard:
25 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
26 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
27 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.
Action Plan - Next Steps
Priority Action Owner Target
Critical Apply correct production license before 8 May DGARM Immediate
2026.
Critical Review and fix snapshot repository issue. DGARM Immediate
Critical Validate snapshot policies and snapshot success DGARM Immediate
history.
Critical Perform controlled restore test. DGARM Immediate
High Review monitoring architecture against design. DGARM Short term
High Configure alert notification actions. DGARM Short term
High Enable log collection for monitoring. DGARM Short term
High Review ILM, shard sizing, and retention. DGARM Short term
Medium Review and enable Kibana audit logging if required. DGARM Medium
term
Medium Confirm whether Elasticsearch audit logs should be DGARM Medium
ingested into Elastic. term
Medium Back up configuration artefacts outside DGARM Medium
Elasticsearch snapshots. term
28 | elastic.co | © 2026 Elasticsearch B.V. All Rights Reserved.