Skip to content

Apply configured store retry budget - #15

Closed
dumontg wants to merge 2 commits into
imports/08-cas-412from
imports/09-store-retries
Closed

dumontg wants to merge 2 commits into
imports/08-cas-412from
imports/09-store-retries

Conversation

@dumontg

@dumontg dumontg commented Oct 7, 2026 •

Copy link
Copy Markdown
Owner

Stacked on #14.

Imports tobi/walgit#90 by @behinddwalls. store.max_retries applies only to idempotent reads; S3 and GCS mutation clients make one attempt.

Conflict resolution: tobi#60 (in this stack) and tobi#90 both rewrote the S3 client setup. The credentials provider from tobi#60 (static pair or default chain) is resolved once and shared by the single-attempt mutation client and the retrying read client from tobi#90.

One follow-up commit makes Azure reads follow store.max_retries too, so the setting means the same on every backend; Azure conditional writes stay single-attempt.

Verified on the top of this stack: cargo clippy --workspace --all-targets -- -D warnings, cargo fmt --check, the crate test suites, and the Azure harness (just test-azure: store contract plus git push, clone, pull and cold restart on Azurite) pass. Known unrelated failures: the runtime stall timing tests in e2e (also intermittent on main) and the web UI asset tests that need pnpm run build.

behinddwalls and others added 2 commits October 7, 2026 08:40
Backend SDK retries covered conditional mutations as well as reads. If a manifest CAS landed but its response was lost, an SDK retry could receive 412 from the already-committed write and make the publisher treat success as a lost race.

Apply `store.max_retries` only to idempotent GCS and S3 reads and interrupted bulk reads. Configure GCS mutation clients and the S3 mutation client for one attempt, while S3 metadata reads use a separate retry-enabled client and presigned GETs retain explicit bounded retries.

Healthy calls remain one request. Failure paths add at most `store.max_retries` read attempts; conditional writes, uploads, copies, multipart operations, and deletes remain single-attempt.

✅ `cargo check -p walgit-store --all-features`

✅ `cargo test -p walgit-store --all-features`

✅ `cargo test -p walgit-server --test sim healthy_request_round_trip_budgets -- --exact`

✅ `cargo clippy -p walgit-store --all-targets --all-features -- -D warnings`

✅ `cargo fmt --all -- --check`

✅ `git diff --check`

Closes tobi#82

(cherry picked from commit 34f240d)
The retry budget now means the same on every backend: extra attempts for transient failures on reads, zero disables them. Conditional writes stay single-attempt.
@dumontg

dumontg commented Oct 7, 2026

Copy link
Copy Markdown
Owner Author

Landed on main in 8347913 (merge of the stack top 59b206f), so this PR's changes are on main.

@dumontg dumontg closed this Oct 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants