Repository navigation

Change data capture for EloqDoc: log scan, schema-op timestamps, cluster gate, multi-node fixes - #577

Merged

liangjchen merged 27 commits into

mainfrom

cdc/change-stream

Oct 29, 2026

Merged

Change data capture for EloqDoc: log scan, schema-op timestamps, cluster gate, multi-node fixes#577
liangjchen merged 27 commits into
mainfrom
cdc/change-stream

Commits on Oct 19, 2026
- Add the CDC scan, cluster gate and schema-ops-in-flight messages to log.proto
  
  liangjchen
  and
  claude
  committed
  adac497
- Serve the CDC log scan and keep a CDC retention window in the log state
  
  liangjchen
  and
  claude
  committed
  1e1e10d
- Pin the checkpoint below write locks and make add index recoverable from its prepare log
  
  liangjchen
  and
  claude
  committed
  ede2d32
- Retry a failed range-split UpsertRanges with the same ranges
  
  liangjchen
  and
  claude
  committed
  9e9841f
- Let a change-stream cursor scan the log groups through TxLog
  
  liangjchen
  and
  claude
  committed
  11d4d10
- Reject a negative checkpointer_interval and raise one below 5 s to 5 s
  
  liangjchen
  and
  claude
  committed
  043ee7d
- Commit table DDL above drained DML and make schema-op recovery exact
  
  liangjchen
  and
  claude
  committed
  5ca1cbb
- Keep the CDC DDL history, long-poll idle CdcScans, replay data under a recovered DDL
  
  liangjchen
  and
  claude
  committed
  e97f70f
- Add a fault point that holds a table op before its commit-stage write locks
  
  liangjchen
  and
  claude
  committed
  468f7a8
- Carry the cluster gate, refuse schema ops it pauses, keep its log slot
  
  liangjchen
  and
  claude
  committed
  7bbf188
- Pause and resume the cluster gate, and recover it by install alone
  
  liangjchen
  and
  claude
  committed
  10b34b0
- Export the cluster gate and change data capture gauges
  
  liangjchen
  and
  claude
  committed
  174d407
- Docs: schema ops' commit timestamps, the gate's log and replay
  
  liangjchen
  and
  claude
  committed
  2fb6c05
- Fix recovery, routing and data store waits found by multi-node tests
  
  liangjchen
  and
  claude
  committed
  ff6f8e5
- Docs: change data capture in the consolidated architecture docs
  
  liangjchen
  and
  claude
  committed
  66b8105
Commits on Oct 21, 2026
- EloqStore: host every data shard on one store
  
  liangjchen
  and
  claude
  committed
  b0cf531
- EloqStore: pin the reworked data store shard support
  
  liangjchen
  and
  claude
  committed
  bcda5ff
- EloqStore: pin the review follow-ups of the data store shard support
  
  liangjchen
  and
  claude
  committed
  a7f8db7
- Fault injection: aim the kv-table-create failure at one table
  
  liangjchen
  and
  claude
  committed
  a1fb6bf
- Fault injection: the upsert-table crash faults take a table too
  
  liangjchen
  and
  claude
  committed
  8fdc7f1
Commits on Oct 28, 2026
- Tests: build the FetchRecordCc and log snapshot tests again
  
  liangjchen
  and
  claude
  committed
  3d8d8fc
- Shard eviction: one cleaner per shard, paced releases, deferred retries
  
  liangjchen
  and
  claude
  committed
  58d32a3
- CircularQueue: include <cstdint>
  
  liangjchen
  and
  claude
  committed
  90ca5f9
- EloqStore: pin the data store shard support as merged
  
  liangjchen
  and
  claude
  committed
  75bdf52
- Format the CDC changes with clang-format-18
  
  liangjchen
  and
  claude
  committed
  7db59c0
- Log snapshots: check the CDC history and gate files like the others
  
  liangjchen
  and
  claude
  committed
  b406d60
- Start the bthread workers before the storage handler
  
  liangjchen
  and
  claude
  committed
  81a43c9

Commits

Commits on Oct 19, 2026

Commits on Oct 21, 2026

Commits on Oct 28, 2026