Skip to content

fix(database): restack Mongo live updates onto current Event Relays - #1606

Merged
kkopanidis merged 6 commits into
feat/database-realtime-mongofrom
cursor/mongo-1601-restack-396e
Sep 13, 2026
Merged

kkopanidis merged 6 commits into
feat/database-realtime-mongofrom
cursor/mongo-1601-restack-396e

Conversation

@kkopanidis

Copy link
Copy Markdown
Contributor

Restacks #1601 onto current #1600 (9e6356ef) and lands leftover Mongo interventions. Head is strictly ahead of #1600. Do not merge #1600 or #1601. Do not retarget to main.

Restack

Leftovers

  • Lock-generation fencing. Leader renew failure bumps a generation so a draining watch cannot emit. Do not open a watch unless the lock extends after acquire.
  • Redis TTL. Recoverable disconnect still skip-wipes; realtime:socket:* / exclusive realtime:doc:* keys expire after 120s if recovery never happens. Restore persists keys.
  • dropDatabase reopen test alongside drop/rename/invalidate.
  • CMS-read gate at emit. Deny skips client delivery (no extra ReBAC round-trip) and keeps membership. Authorization UNAVAILABLE keeps membership without emitting. Admin still receives events.
  • Performance. $match/$project; skip path is token-only; serialized handleChange; batched ReBAC+cache. Token persists after successful emit. No fullDocument in the payload.

Locked

  • Persist resume token after successful emit (at-least-once duplicates OK).
  • Emit/bus throw → stopStream + scheduleRetry.
  • No router.eventRelays.enabled, no tenants.

Out of scope

Open in Web Open in Cursor 

kkopanidis and others added 6 commits September 13, 2026 02:36
…ger) (#1604)

* fix(router): harden event relays for HA and auth lifetime

EventBus uses a single Redis message dispatcher with subscriberId maps,
SIGTERM/SIGINT shutdown, and subscribe-after-ACK. Hermes installs engine
middleware once, skips empty-room namespace broadcasts, demotes hot-path
logs, and re-authenticates recovered /events/ subscriptions. EventRelayManager
gains coalesced periodic reconcile, compiled templates, inbound caps,
TTL-cached emit-time ReBAC, room eviction, backpressure, preview API, and
metrics/docs aligned with the interventions plan.

* fix(router): address #1604 re-review P1 and P2 follow-ups

Recovery re-auth keeps per-user subscription state across disconnect;
emit-time ReBAC distinguishes unavailable vs deny; EventBus drops process
signal handlers and adds subscribeAck; manager subscribes only after Redis
ACK and broadcasts evictRelayIds on refresh; Hermes backpressure uses local
sockets without emit acks; cache is bounded; preview caps sample JSON;
handshake matcher rejects ticket/sid/non-namespace paths; socket middleware
rebind avoids duplicate registration on first sockets enable.

* fix(hermes): restore production tsc for engine middleware chain

Type the Socket.IO engine middleware runner as Express NextFunction so
recursive callbacks match registerGlobalMiddleware. Use Logger.info for
socket trace lines (IConduitLogger has no debug).

* fix(router): import Express Response for socket global middleware

_rebindSocketGlobalMiddlewares passes handlers typed with fetch Response
because Response was not imported from express, failing tsc against Hermes
registerSocketGlobalMiddleware.

* fix(router): quit EventBus on module shutdown signals

Stop event relays and call grpcSdk.bus.quit() from Router.shutdown(),
registered on SIGTERM/SIGINT with process exit so Redis teardown is not
left to SDK signal handlers. Tighten registerGlobalMiddleware typing and
trim handshake helper comment (deslop).

* fix(router): pass-3 recovery, scoped emit, and subscription hygiene

Recovery re-auth keeps membership on Authorization UNAVAILABLE and only
leaves on deny; re-check subscriptions for restored er: rooms via room map.
Prune user subscriptions on disconnect when no other socket holds them.
Scope relay emits to receivers in the target room; use Engine.IO
writeBuffer/writable for backpressure. Drop hot-path Hermes socket info logs.

* fix(router): pass-4 recovery map, backpressure, emit tests

Store relay subs on socket.data; resolve recovered rooms from context and
TTL room map without last-writer userId. Prune room map when unused on
disconnect. Backpressure uses writeBuffer depth only. Add Hermes/router
tests for room-scoped emit and queue metric.

* fix(router): clear eventRelaySubs from socket.data on recovery deny

* fix(router): clear socket.data subs on recovery fail-closed leave
Split validateEventRelayInput into per-field parsers to reduce complexity.
Silence unused-parameter lint in EventBus test FakeRedis stub.
Replay the Mongo delta onto feat/router-event-relays (9e6356e). Keep
#1604 Hermes (engine.use, er: recovery, writeBuffer) and graft only the
port-keyed adapter plus register-before-initSockets. Do not take old
#1601 Socket.ts wholesale.

Co-authored-by: Konstantinos Kopanidis <kkopanidis@users.noreply.github.com>
Record #1601 (bc32384) as a parent without changing the restacked tree
so GitHub can merge this branch into feat/database-realtime-mongo.

Co-authored-by: Konstantinos Kopanidis <kkopanidis@users.noreply.github.com>
…is keys

Lock renew failure bumps a generation so a draining watch cannot emit.
Do not open a watch unless the leader lock extends after acquire.
Arm TTL on realtime socket/doc keys when a recoverable disconnect
never recovers; persist on restore. CMS-read deny fails closed at
emit without extra ReBAC round-trips and keeps membership; UNAVAILABLE
keeps membership. Cover dropDatabase reopen.

Co-authored-by: Konstantinos Kopanidis <kkopanidis@users.noreply.github.com>
… watches

Two overlapping ensureLeader calls both bumped the lock generation while
the first openStream was still reading the resume token, so the watch
never attached. Hold an acquiring flag so only one opener runs.
@kkopanidis
kkopanidis marked this pull request as ready for review September 13, 2026 18:54
@kkopanidis
kkopanidis merged commit 47eccc2 into feat/database-realtime-mongo Sep 13, 2026
12 checks passed
@kkopanidis
kkopanidis deleted the cursor/mongo-1601-restack-396e branch September 13, 2026 18:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants