Skip to content

Add run-scoped validation report consumer - #899

Merged
Brandon Miller (brandom-msft) merged 4 commits into
mainfrom
brandom-msft-p4-reporting-pilot
Aug 10, 2026
Merged

Add run-scoped validation report consumer#899
Brandon Miller (brandom-msft) merged 4 commits into
mainfrom
brandom-msft-p4-reporting-pilot

Conversation

@brandom-msft

@brandom-msft Brandon Miller (brandom-msft) commented Aug 10, 2026

Copy link
Copy Markdown
Member

Summary

  • add a presentation-only consumer for versioned normalized per-sample result artifacts
  • publish a current-run GitHub Actions job summary with outcome, stage, duration, freshness, and evidence links
  • render partial incomplete rows before failing malformed or missing handoffs
  • add a reusable reporting workflow and fixture tests without changing the producer or canonical schema

Scope

This is the consumer/reporting pilot for ADO 5505679 (https://msdata.visualstudio.com/Vienna/_workitems/edit/5505679). The artifact fields are an explicit temporary adapter boundary and must be aligned with the validation session's canonical producer schema before integration.

Validation

  • python .github/scripts/test/test-render-validation-report.py passes
  • existing workflow structure harness was attempted but cannot run locally because jq is not installed

Do not use this as a persistent dashboard or pinned issue report.

Consume versioned normalized sample artifacts in a separate reporting job and publish an incomplete summary before failing malformed handoffs.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Consume the frozen nested sample and run contract, require diagnostics, and preserve partial-summary failure behavior.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Require exact v1 result fields and completeness validation before rendering the run-scoped summary.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
…ting-pilot

# Conflicts:
#	.github/workflows/scripts-selftest.yml
@brandom-msft
Brandon Miller (brandom-msft) merged commit 5c57acc into main Aug 10, 2026
16 checks passed
@brandom-msft
Brandon Miller (brandom-msft) deleted the brandom-msft-p4-reporting-pilot branch August 10, 2026 21:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant