Issues

• Turn reviewed agent incidents into durable regression scenarios

  developer-experienceepic:evaluationpriority:p1type:feature
  microsoft/waza#664 · Filter by author spboyer opened on Oct 9, 2026
  1

• Add controlled comparisons and opt-in trustworthy release policies

  epic:cicdepic:evaluationpriority:p1type:feature
  microsoft/waza#665 · Filter by author spboyer opened on Oct 9, 2026
  5

• Capture portable eval evidence and explain requirement failures

  dashboardepic:evaluationobservabilitypriority:p1type:feature
  microsoft/waza#663 · Filter by author spboyer opened on Oct 9, 2026
  2

• Validate graders with known-good, bad, and alternative-valid cases

  epic:evaluationgraderspriority:p1type:feature
  microsoft/waza#661 · Filter by author spboyer opened on Oct 9, 2026

• Add deterministic MCP and CLI fault-recovery scenarios

  epic:evaluationmcppriority:p1type:feature
  microsoft/waza#662 · Filter by author spboyer opened on Oct 9, 2026

• Add agent-free eval preflight and observable requirement contracts

  developer-experienceepic:evaluationpriority:p0type:feature
  microsoft/waza#660 · Filter by author spboyer opened on Oct 9, 2026
  2

• Add scenario-first eval authoring without requiring a skill

  developer-experienceepic:evaluationpriority:p0type:feature
  microsoft/waza#659 · Filter by author spboyer opened on Oct 9, 2026
  2

• Protect existing eval workflows with a compatibility corpus

  epic:evaluationpriority:p0type:feature
  microsoft/waza#658 · Filter by author spboyer opened on Oct 9, 2026
  2

• Epic: trustworthy regression testing for agent workflows

  epic:evaluationpriority:p0type:epic
  microsoft/waza#657 · Filter by author spboyer opened on Oct 9, 2026
  1

• inject_skill_body drops the skill directory, so relative links in SKILL.md cannot resolve

  microsoft/waza#656 · Filter by author akunzai opened on Oct 9, 2026
  1

• Add opt-in Copilot-native sandboxing for evaluations

  enhancementepic:evaluationsecuritytype:enhancement
  microsoft/waza#544 · Filter by author cwkendall opened on Aug 19, 2026
  2

• Bring Your Own Model — Ollama, OpenAI, Anthropic, OpenCode engines

  enhancementepic:go-cligo:needs-researchneeds-author-feedbackparkedquestionrelease:backlogtype:epic
  microsoft/waza#11 · Filter by author spboyer opened on Feb 28, 2026
  21