From 2e8ddc17f0f61283f7bf71711620788793a60857 Mon Sep 17 00:00:00 2001 From: Yash Mohan Date: Tue, 14 Jul 2026 19:14:01 +0530 Subject: [PATCH] docs(simulation): Replay concept Co-Authored-By: Claude Opus 4.8 (1M context) --- src/pages/docs/simulation/concepts/replay.mdx | 50 +++++++++++++++++++ 1 file changed, 50 insertions(+) create mode 100644 src/pages/docs/simulation/concepts/replay.mdx diff --git a/src/pages/docs/simulation/concepts/replay.mdx b/src/pages/docs/simulation/concepts/replay.mdx new file mode 100644 index 00000000..28713881 --- /dev/null +++ b/src/pages/docs/simulation/concepts/replay.mdx @@ -0,0 +1,50 @@ +--- +title: "Replay" +description: "Reproduce a real production bug as a test, instead of guessing at a synthetic one" +--- + +## What replay is + +**Replay** takes a real production conversation from [Observe](/docs/observe) and turns it into a scenario you can rerun against a dev agent. Say a caller got quoted the wrong refund window last week: you pick that exact conversation, generate a scenario from its transcript, and run it against your fixed agent to confirm it now gets it right. Instead of guessing at a synthetic case, you reproduce the real one. + +## Session replay and trace replay + +You choose how much of the production data becomes one conversation. + +### Session + +A whole session, every trace under one `session_id` in order, replays as a single multi-turn conversation. Reach for it when you want to rerun full production conversations end to end. + +### Trace + +Each selected trace replays as its own one-turn conversation, an input and an output. Reach for it when you want to replay individual calls or single-turn interactions. + +## Chat and voice + +Replay works in both channels. **Chat replay** rebuilds the conversation from the production transcripts. **Voice replay** goes further: it pulls the original voice setup (system prompt, assistant settings, and provider config) from the production call, so the replayed call runs on the same configuration as the original. Voice replay supports **Vapi** as the primary provider, with **Retell** supported for transcript comparison. + +in Observe"] --> RS["Replay session"] + RS --> SC["Generated scenario"] + SC --> RUN["Simulation run"] + RUN --> CMP["Compare with the original"] +`} /> + +Once the run finishes, you compare the replayed conversation with the original side by side, transcripts, metrics, and for voice the audio, so you can see exactly what your change moved. + +## Replay closes the loop + +A production failure that only happened once can slip away. Save its replayed scenario into your regular runs and it becomes a permanent regression test: the exact conversation that broke is now something every future version has to pass. + +## Keep exploring + + + + The scenario replay generates from a call + + + The agent definition replay recreates + +