ServiceWatch metric
Simple AI Inference sends metrics to ServiceWatch. The metrics provided by default monitoring are data collected at 5‑minute intervals.
Basic Metrics
The following are the basic metrics for the Simple AI Inference namespace. The indicators whose names are displayed in bold below are the key indicators selected among the default indicators provided by Simple AI Inference. The key metrics are used to build service dashboards that are automatically created for each service in ServiceWatch. Each metric provides guidance in the user guide on which statistical values are meaningful when querying that metric, and among the meaningful statistics, the values shown in bold are the primary statistics.
In the service dashboard or monitoring tab, you can view key metrics through primary statistical values. Or you can also view the key metrics on the monitoring tab of the Simple AI Inference detail page. You can also view the usage rate per GPU device in the ServiceWatch metrics menu.
| Performance item (metric name) | Detailed description | unit | meaningful statistics |
|---|---|---|---|
| Model Total Tokens | Model token usage (total) | Count |
|
| Model Request Server Error | Number of model request failures (server error) | Count |
|
| Model Input Tokens | Model token usage (input) | Count |
|
| Model Request Throttled | Model request limit count (request quota exceeded) | Count |
|
| Model Request Client Error | Model request failure count (client error) | Count |
|
| Model Output Tokens | Model token usage (output) | Count |
|
| Model Cached Tokens | Model token usage (cache) | Count |
|
| Model Request Prompt Rejected | Number of model request rejections (prompt review) | Count |
|
| Model Request Success | Number of successful model requests | Count |
|