ServiceWatch metric
The Search Engine sends metrics to ServiceWatch. The metrics provided by default monitoring are data collected at 1‑minute intervals.
Basic Metrics
The following are the basic metrics for the Search Engine namespace.
The indicators whose names are displayed in bold below are the indicators selected as key metrics among the basic metrics provided by Search Engine. The key metrics are used to build service dashboards that are automatically created for each service in ServiceWatch.
Each metric provides guidance in the user guide on which statistical values are meaningful when viewing that metric, and among the meaningful statistics, the values shown in bold are the primary statistics. In the service dashboard, you can view key metrics through primary statistical values.
OS Basic Metrics
Category | Performance items | unit | Detailed description | meaningful statistics |
|---|---|---|---|---|
| CPU | CPU Usage | Percent | CPU usage |
|
| Disk | Disk Usage | Percent | Disk usage |
|
| Disk | Disk Write Bytes | Bytes/Second | Write throughput on block device (bytes/second) |
|
| Disk | Disk Read Bytes | Bytes/Second | Read throughput from block device (bytes/second) |
|
| Disk | Disk Write Requests | Count/Second | Number of write requests on block device (requests per second) |
|
| Disk | Disk Read Requests | Count/Second | Number of read requests on block device (requests per second) |
|
| Disk | Average Disk I/O Queue Size | None | Average queue length of requests issued to the block device |
|
| Disk | Disk I/O Utilization | Percent | The proportion of time the block device actually spent handling I/O operations |
|
| Memory | Memory Usage | Percent | Memory usage |
|
| Memory | Swap Out Bytes | Bytes/Second | Data transferred from memory to swap area (bytes/second) |
|
| Memory | Swap Used Bytes | Bytes | Current swap space size |
|
| Memory | Swap Cached Usage | Percent | Cached swap usage rate |
|
| Memory | Swap Total Bytes | Bytes | Total swap space size configured on the system |
|
| Memory | Swap In Bytes | Bytes/Second | Amount read from swap area to memory (bytes/second) |
|
| Memory | Swap Usage | Percent | Current usage ratio relative to total swap space |
|
| Memory | Swap Cached Bytes | Bytes | Size of pages that have been restored to memory but still have a copy in the swap area |
|
| Memory | Swap Free Bytes | Bytes | Size of unused remaining swap space |
|
| Network | Network In Bytes | Bytes/Second | Received capacity (bytes/second) on the network interface |
|
| Network | Network Out Bytes | Bytes/Second | Transmitted capacity (bytes/second) on the network interface |
|
| Network | TCP Connections | Count/Second | Total number of TCP connections currently properly established |
|
| Network | Network In Packets | Count | Number of packets received on the network interface |
|
| Network | Network Out Packets | Count | Number of packets transmitted on the network interface |
|
| Network | Network In Dropped | Count | Number of packet drops received on the network interface |
|
| Network | Network Out Dropped | Count | Number of packet drops transmitted from the network interface |
|
| Network | Network In Errors | Count | Number of packet errors received on the network interface |
|
| Network | Network Out Errors | Count | Number of packet errors transmitted from the network interface |
|
| OS | OS Uptime | Seconds | The time elapsed (seconds) since the system was last booted. |
|
Search Engine basic metrics
Category | Performance items | unit | Detailed description | meaningful statistics |
|---|---|---|---|---|
| cache | Field data evictions | Count/Second | Number of items forcibly removed (evicted) from the field data cache due to memory pressure |
|
| cache | Field data memory size | Bytes |
|
|
| cache | Query cache evictions | Count/Second | Number of cache entries automatically deleted (evicted) from the query cache due to memory shortage, etc. |
|
| cache | Query cache size | Bytes | Display the amount of memory the node occupies in the query cache in bytes |
|
| Cluster Status | Cluster health | None | Indicates whether all primary and replica shards are allocated
|
|
| cpu | SearchEngine CPU usage | Percent | Display the current CPU usage of the Search Engine process as a percentage (%) |
|
| document | SearchableDocuments | Count | Total number of searchable documents held by the node (primary + replica) |
|
| document | DeletedDocuments | Count | Total number of documents marked for deletion (soft delete) on the node (primary + replica) |
|
| filesystem | Data Filesystem Available | Bytes | Current available capacity (Byte) in the file system storing Search Engine data |
|
| filesystem | Data Filesystem Size | Bytes | Total capacity (Byte) of the file system that stores Search Engine data |
|
| Indexing | Documents deleted rate | Count/Second | Number of documents deleted by the node |
|
| Indexing | Indexing Time | None | Time (seconds) the node spent on indexing |
|
| Indexing | Documents indexed rate | Count/Second | Number of documents indexed (added/updated) by the node |
|
| jvm | Count in GC | Count/Second | Number of times JVM garbage collection was executed |
|
| jvm | Time spent in GC | None | Time spent on JVM garbage collection (GC time in seconds per minute) |
|
| jvm | JVM Memory Max | Bytes | JVM max memory setting value |
|
| jvm | JVM Memory Used | Bytes | Amount of memory used by the JVM |
|
| Merges | Documents merged rate | Count/Second | Number of documents processed during the merge process |
|
| Merges | Documents merged bytes | Bytes/Second | Total bytes processed in the merge process |
|
| Merges | Merging time | None | Node’s time spent on merge operation (seconds) merging (elapsed seconds/Second) |
|
| network | Node-to-Node Network In Bytes | Bytes/Second | Number of bytes received in communication between Search Engine nodes |
|
| network | Node-to-Node Network Out Bytes | Bytes/Second | Number of bytes transmitted in communication between Search Engine nodes |
|
| nodes | Nodes | Count | Total number of nodes |
|
| Search | Query time | None | Node time spent executing the search query (seconds) query (elapsed seconds/Second) |
|
| SearchEngineDashboards | SearchEngineDashboards Connections | Count | SearchEngineDashboards concurrent connection count |
|
| SearchEngineDashboards | SearchEngineDashboards Memory Total | Bytes | Memory amount secured by SearchEngineDashboards from the OS |
|
| SearchEngineDashboards | SearchEngineDashboards Memory Used | Bytes | Memory usage of SearchEngineDashboards |
|
| SearchEngineDashboards | SearchEngineDashboards Uptime | Milliseconds | SearchEngineDashboards concurrent connection count |
|
| SearchEngineDashboards | SearchEngineDashboards Disconnects | Count | SearchEngineDashboards uptime |
|
| SearchEngineDashboards | SearchEngineDashboards Requests | Count | Total request count for SearchEngineDashboards |
|
| SearchEngineDashboards | SearchEngineDashboards Reponse Time Avg | Milliseconds | SearchEngineDashboards Average response time over the last 5 seconds (milliseconds) |
|
| SearchEngineDashboards | SearchEngineDashboards Reponse Time MAX | Milliseconds | SearchEngineDashboards Maximum response time in the last 5 seconds (milliseconds) |
|
| SearchEngineDashboards | SearchEngineDashboards UP | None | SearchEngineDashboards /api/status status value indicating whether the API responded correctly (Up metric)
|
|
| segment | Count of index segments | Count | Number of segments held by the node |
|
| segment | Memory size of segments | Bytes | Node’s segment memory usage (bytes) |
|
| shards | Active primary shards | Count | Active primary shard count, the number of primary shards that are operating normally in the current cluster |
|
| shards | Active shards | Count | Total number of active primary and replica shards, i.e., the total shard count obtained by adding the primary and replica shards that are currently operating normally in the cluster. |
|
| shards | Delayed shards | Count | Number of shards with delayed allocation, the number of shards whose placement on a node is temporarily delayed due to the configured timeout |
|
| shards | Initializing shards | Count | Number of shards being initialized |
|
| shards | Relocating shards | Count | Number of shards being relocated, the total number of shards moved (relocated) to other nodes in the current cluster |
|
| shards | Unassigned shards | Count | Number of unassigned shards, meaning the total number of shards that are not allocated to any node in the cluster. |
|
| tasks | Pending tasks | Count | A task that must be applied to the entire cluster (e.g., configuration changes, shard reallocation, index template updates, etc.) is still pending and waiting in the queue. |
|
| translog | Total translog operations | Count/Second | Number of operations accumulated in the translog after the last flush |
|
| translog | Total translog size | Bytes/Second | translog size (byte) |
|
| up | SearchEngine UP | None | The status value (Up metric) indicating whether the cluster’s Cluster Info API responded correctly
|
|