Feature/metrics inspector - #444

Draft

klement wants to merge 11 commits into

theroyallab:mainfrom

klement:feature/metrics-inspector

Commits on Jul 31, 2026

API: Add opt-in Prometheus-compatible /metrics endpoint

Klement Sekera
and
claude
committed
9d61e78
API: Add KV cache metrics to /metrics endpoint

Klement Sekera
and
claude
committed
25e0314
API: Add prefix-cache counters, latency histograms and spec decode stats to /metrics

Klement Sekera
and
claude
committed
db7054e
API: Stop publishing prompt_tokens_seconds in /metrics

Klement Sekera
and
claude
committed
e17db62
API: Add tokens_predicted_max to /metrics

Klement Sekera
and
claude
committed
8c75400

Commits on Aug 1, 2026

API: Add KV offload cache gauges to /metrics

Klement Sekera
and
claude
committed
8b05929
API: Add recurrent checkpoint metrics to /metrics

Klement Sekera
and
claude
committed
e972669
API: Build token histogram buckets from the model's context length

Klement Sekera
and
claude
committed
ef44f6f
API: Publish process_start_time_seconds in /metrics

Klement Sekera
and
claude
committed
5b73894
Tools: Add inspect_metrics.py for reading /metrics

Klement Sekera
and
claude
committed
35e65f2
Tools: Show where the engine's time goes in inspect_metrics.py

Klement Sekera
and
claude
committed
11d1f8c