Skip to content

[P1] Scale shard processing and bound hot-path concurrency - #2

Closed
apple050620312 wants to merge 1 commit into
codex/p0-security-privacyfrom
codex/p1-scaling-hot-path
Closed

apple050620312 wants to merge 1 commit into
codex/p0-security-privacyfrom
codex/p1-scaling-hot-path

Conversation

@apple050620312

Copy link
Copy Markdown
Owner

Summary

  • Add validated SHARD_COUNT and SHARD_IDS configuration for distributed shard workers.
  • Move synchronous database operations off the event loop with bounded execution time.
  • Add bounded TTL/LRU caches for guild settings, filters, and webhooks.
  • Bound link-fix and EmbedEZ concurrency and rate-limit overload warnings.
  • Replace analytics row loading with database-side counts and buffered asynchronous event writes.
  • Document multi-process shard assignment and capacity-tuning controls.

Priority

P1 — removes event-loop and upstream-service bottlenecks that become critical at roughly 50,000 guilds.

Dependency

Stacked on #1. Review and merge #1 first; after it merges, retarget this PR to main.

Validation

  • Shard parsing and cache behavior tests pass.
  • Runtime import and source-tree parsing checks pass.

@apple050620312

Copy link
Copy Markdown
Owner Author

Superseded by upstream PR Kyrela#112.

@github-actions github-actions Bot locked and limited conversation to collaborators Sep 10, 2026
@apple050620312
apple050620312 deleted the codex/p1-scaling-hot-path branch September 10, 2026 06:40
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant