Skip to content

feat: add shared WAL proposal admission budget - #377

Merged
beinan merged 1 commit into
lance-format:mainfrom
beinan:codex/wal-node-admission
Oct 19, 2026
Merged

beinan merged 1 commit into
lance-format:mainfrom
beinan:codex/wal-node-admission

Conversation

@beinan

@beinan beinan commented Oct 19, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Multiple WAL groups on one node need a shared proposal budget so concurrent producers cannot each consume the full disk allowance. Add an opt-in admission module with atomic reservations, drop-based release, encoded-write accounting, and a reserved control window. Refresh uses real file lengths and allocated blocks; successful admission does not scan the directory.

This module is not connected to production ingestion. It does not reserve filesystem extents or cap previously accepted replication traffic; replica-pressure coordination and snapshot collection remain necessary.

Testing

  • Release admission/placement tests: five passed, including racing reservations and reclamation while proposals remain pending.
  • Release Clippy with lab,placement,admission, formatting, spelling and diff checks passed.
  • Full local CI script passed: workspace Rust Clippy/tests, Python pytest, Ruff format/lint and Pyright.
  • CI explicitly tests and lints the optional module.

Refs #378.

@beinan
beinan merged commit 5f15545 into lance-format:main Oct 19, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant