Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
7017d69
test(agent): add conversation replay fixture for agent panel e2e
claude Sep 2, 2026
bdfe766
fix(agent): drop unused export flagged by knip
Sep 2, 2026
7554341
fix(agent): mint the agent tab from blankGraph, not the default template
christian-byrne Sep 2, 2026
38f5581
test(agent): add recorded conversation exporter
christian-byrne Sep 2, 2026
1f447de
docs(browser-tests): add replay-coverage convention for agent bug fixes
CodeJuggernaut Sep 2, 2026
9b23481
test(agent): replay regression for #16611 subgraph-scope minting
CodeJuggernaut Sep 2, 2026
ed90dff
fix(agent-crdt): treat awareness state:null as absent, not a rejected…
christian-byrne Sep 2, 2026
2c34fd2
test(agent): replay regression for #16285 catch-up baseline
CodeJuggernaut Sep 2, 2026
23e15ea
docs(browser-tests): route replay capture through the conversation ex…
CodeJuggernaut Sep 2, 2026
7189625
test(agent): fix 16611 exemplar interaction idioms
CodeJuggernaut Sep 2, 2026
04f12be
test: correct the 16285 red recipe to the verified two-line patch
CodeJuggernaut Sep 2, 2026
e820fb7
test: drive the 16611 exemplar at the layout store level
CodeJuggernaut Sep 2, 2026
f138a9f
test(agent): add eight recorded conversation replays
CodeJuggernaut Sep 3, 2026
3c898f1
test(agent): name the replay regressions after the behavior
CodeJuggernaut Sep 3, 2026
3d41e1c
test(agent): wait for the applied thread id before replaying
CodeJuggernaut Sep 3, 2026
7b838a4
test(agent): record the two eval-suite cases on the local agent
CodeJuggernaut Sep 3, 2026
9e39c6d
test(agent): credit the snapshot sort, not the renderer, for pin order
CodeJuggernaut Sep 3, 2026
0815526
test(agent): replace the synthesized eval fixtures with recordings
CodeJuggernaut Sep 3, 2026
a8158b8
test(agent): derive replay expectations from the fixture and replay r…
CodeJuggernaut Sep 3, 2026
4da760e
test(agent): move the recorded conversations to a stacked PR
CodeJuggernaut Sep 3, 2026
f99f679
test(agent): add ten recorded agent conversations
CodeJuggernaut Sep 3, 2026
0f01c91
Merge remote-tracking branch 'origin/main' into dg-a4-exemplars
CodeJuggernaut Sep 3, 2026
5c14737
test(agent): read the expected graph from the applier, not a re-imple…
CodeJuggernaut Sep 3, 2026
1024774
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
b84c222
test(agent): pass the host graph to the timing replay
CodeJuggernaut Sep 3, 2026
520ca7c
test(agent): cut the remaining multi-line comments to one line
CodeJuggernaut Sep 3, 2026
f909105
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
793963b
test(agent): one-line the last carried comments
CodeJuggernaut Sep 3, 2026
43dc9ca
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
f5c2531
fix(agent): squash the blank-tab comment to one line
CodeJuggernaut Sep 3, 2026
0f891ff
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
198e910
[automated] Apply ESLint and Oxfmt fixes
actions-user Sep 3, 2026
5530d7e
[automated] Apply ESLint and Oxfmt fixes
actions-user Sep 3, 2026
80f31b5
test(agent): drop the two replay regressions already covered by unit …
CodeJuggernaut Sep 3, 2026
d9da30f
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
379ed0a
Merge remote-tracking branch 'origin/nathaniel/be-11470-recorded-repl…
CodeJuggernaut Sep 3, 2026
aa4d47f
Merge remote-tracking branch 'origin/nathaniel/be-11470-recorded-conv…
CodeJuggernaut Sep 3, 2026
1429807
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
0a71484
test(agent): derive replay expectations on the harness itself
CodeJuggernaut Sep 3, 2026
64cb617
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
cd75933
test(agent): keep the harness's helper types private
CodeJuggernaut Sep 3, 2026
1cb9ddf
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
b16baaf
test(agent): replay spec reads its expectations from the harness
CodeJuggernaut Sep 3, 2026
2e93a0f
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
e4931f8
test(agent): timing replay reads the expected graph from the harness
CodeJuggernaut Sep 3, 2026
d17304d
test(agent): address review on the replay harness and exporter
CodeJuggernaut Sep 3, 2026
2dffdd4
test(agent): let a replay interleave human edits
CodeJuggernaut Sep 3, 2026
3f30cda
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
9328b9b
test(agent): replay a recorded turn with a concurrent human edit
CodeJuggernaut Sep 3, 2026
ada8676
test(agent): keep the row label helper private to the harness
CodeJuggernaut Sep 3, 2026
51f097d
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
a5c8462
test(agent): keep this PR to the recordings
CodeJuggernaut Sep 3, 2026
33e4e04
test(agent): timing and concurrent-edit replays live with the code, d…
CodeJuggernaut Sep 3, 2026
46ca478
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
cdf46cb
test(agent): read replay ops through their own types and pin the coal…
CodeJuggernaut Sep 3, 2026
bfe0bcd
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
8afc472
test(agent): drop two recordings whose ops the zimage case already co…
CodeJuggernaut Sep 3, 2026
dd27afb
test(agent): record a conversation fixture with one command
CodeJuggernaut Sep 3, 2026
f1ebb7b
refactor(agent): split the recorder's gates behind zod boundaries
CodeJuggernaut Sep 3, 2026
76f3092
docs(browser-tests): recordings need the agent's non-standalone mode
CodeJuggernaut Sep 3, 2026
dff2e22
Merge branch 'dg-a4-exemplars' into nathaniel/be-11470-recorded-conve…
CodeJuggernaut Sep 3, 2026
dcddbb8
Merge branch 'nathaniel/be-11470-recorded-conversations' into nathani…
CodeJuggernaut Sep 3, 2026
3a42b75
docs(agent): name the agent mode a recording needs and why
CodeJuggernaut Sep 3, 2026
a1ac2ca
test(agent): agent-conversation.v2 replays every turn of a thread
CodeJuggernaut Sep 3, 2026
928221c
test(agent): record every turn of a thread in one command
CodeJuggernaut Sep 3, 2026
4828f06
test(agent): type the exporter test capture against the capture input
CodeJuggernaut Sep 3, 2026
86d55e7
docs(agent): point the recording recipe at the launcher's record mode
CodeJuggernaut Sep 3, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions browser_tests/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -612,6 +612,33 @@ test.afterEach(async ({ comfyPage }) => {
`debugShowCanvasOverlay()`, `debugGetCanvasDataURL()` are for local debugging
only. Never commit them.

## Replay coverage for agent bug fixes

When a fix changes how the agent's turns affect the app (graph edits,
CRDT frames, panel state), add a conversation replay case alongside the
fix so the bug stays fixed:

1. **Record the conversation.** Reproduce the bug's turn with
`scripts/agentConversationRecord.ts` against the non-standalone local
stack (Postgres + doc host), which is the only place the doc host
writes the audit rows a replay asserts. That one command records the
turn and writes the conversation JSON under
`browser_tests/fixtures/data/agent/conversations/` through the
exporter, marked `response_side: 'recorded'`; see
`fixtures/data/agent/README.md` for the stack recipe, the command and
the capture format. Never write `graph_ops` by hand and never relabel
a synthesized response as recorded.
2. **Add the replay case.** Drive the fixture through the conversation
replay fixture (`agentConversationFixture`), asserting the
canvas-observable outcome the bug corrupted (graph end-state or
panel state - not mock call counts, not model text).
3. **Prove it bites.** Before merging, run the case once against the
fix's parent commit (red) and once at the fix (green); paste both
run lines in the PR description. A replay case that never went red
against the bug does not count as regression coverage.

Name the case after the behavior it protects (`agent-<behavior-slug>.json`, with the fix PR cited in the spec header and the fixture's `source.note`). The exporter writes the provenance the replay keeps: `source.capture` (thread and message ids) and `source.note` (row ids and the raw capture hash), which is enough to re-export the recording.

## Test Data & Typed API Mocks

Mock data in `fixtures/data/` exports **typed** objects that conform to
Expand Down
Loading
Loading