Skip to content

feat(metrics): expose opt-in Lance object-store diagnostics - #421

Merged
beinan merged 2 commits into
lance-format:mainfrom
beinan:codex/lance-io-metrics-r5
Oct 21, 2026
Merged

beinan merged 2 commits into
lance-format:mainfrom
beinan:codex/lance-io-metrics-r5

Conversation

@beinan

@beinan beinan commented Oct 20, 2026 •

Copy link
Copy Markdown
Collaborator

Application phase timings currently combine Lance file encoding and storage I/O. Add an opt-in lance-io-metrics feature to core and server so Lance 13's storage counters, request durations and retryable-response metrics use the existing recorder and /metrics endpoint. Defaults remain unchanged; the server registers metric descriptions after installing its recorder.

The documentation explains label cardinality and the limits of overlapping request durations. A real Lance write, merge, close and reopen test verifies retained data and emitted read/write metrics; CI runs the optional feature explicitly. Histogram regression checks enforce separate finite label domains for application and Lance metrics, including under the all-features coverage configuration.

Core builds without default features again: the backlog-refusal counter now uses the existing optional metrics shim, and disabled flush metrics avoid computing unused labels. CI checks this configuration as well.

Validation: actual Lance I/O integration test, all-features histogram regression, optional-feature Clippy, core without default features, full repository CI helper, and workspace package checks.

Refs #378

@beinan
beinan merged commit 5902300 into lance-format:main Oct 21, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant