Skip to content

docs(evaluation): Test an eval#753

Merged
khushalsonawat merged 3 commits into
docs/evaluation-revampfrom
docs/eval-explore-playground-test
Jul 16, 2026
Merged

docs(evaluation): Test an eval#753
khushalsonawat merged 3 commits into
docs/evaluation-revampfrom
docs/eval-explore-playground-test

Conversation

@YashMohan23

Copy link
Copy Markdown

Walkthrough of the Test Evaluation panel on an eval's page.

  • The four ways to feed the eval data: Custom, Dataset, Tracing, and Simulation
  • How the eval's variables map to your fields: auto-mapped for Custom (its variables are the JSON keys), mapped per field for a real data source like a trace
  • Reading the result: a pass or fail with an explanation of the verdict

Two annotated screenshots (Custom mode, and a trace-based test result).

Stacked on #751 (Explore playground overview).

Walkthrough of the Test Evaluation panel on an eval's page: the four ways to
feed it data (Custom, Dataset, Tracing, Simulation), how the eval's variables
map to your fields (auto-mapped for Custom, mapped per field for real data),
and reading the pass/fail result with its explanation. Includes two annotated
screenshots.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@khushalsonawat khushalsonawat left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check comments

Comment thread src/pages/docs/evaluation/guides/explore-playground/test-an-eval.mdx Outdated
Comment thread src/pages/docs/evaluation/guides/explore-playground/test-an-eval.mdx Outdated
Comment thread src/pages/docs/evaluation/guides/explore-playground/test-an-eval.mdx Outdated
Comment thread src/pages/docs/evaluation/guides/explore-playground/test-an-eval.mdx Outdated
Yash Mohan and others added 2 commits July 15, 2026 22:51
- Reorder the four data sources to match the UI tab order (Dataset, Tracing,
  Simulation, Custom)
- Add a colon after each bold term and tighten the Custom bullet to one clause
- Link the first mention of Dataset, Tracing, and Simulation
- Trim the Custom caption so it no longer repeats the mapping paragraph

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Replace the two Test Evaluation screenshots with uniform captures (both now the
same dimensions), keeping the horizontal callouts on the mode tabs and the Pass
result.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Base automatically changed from docs/eval-explore-playground-overview to docs/evaluation-revamp July 16, 2026 12:38

@khushalsonawat khushalsonawat left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Content is accurate and grounded in the UI; the screenshot dimensions are a capture-environment constraint, not a content issue.

@khushalsonawat
khushalsonawat merged commit dae7083 into docs/evaluation-revamp Jul 16, 2026
@khushalsonawat
khushalsonawat deleted the docs/eval-explore-playground-test branch July 16, 2026 12:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants