Skip to content

Add public validation health dashboard pilot - #893

Open
Brandon Miller (brandom-msft) wants to merge 4 commits into
mainfrom
brandom-msft-p4-health-dashboard-pilot
Open

Add public validation health dashboard pilot#893
Brandon Miller (brandom-msft) wants to merge 4 commits into
mainfrom
brandom-msft-p4-health-dashboard-pilot

Conversation

@brandom-msft

@brandom-msft Brandon Miller (brandom-msft) commented Aug 7, 2026

Copy link
Copy Markdown
Member

Summary

  • add a two-sample dashboard pilot for the C# and Python quickstart/chat-with-agent samples
  • render linked L3/L4 status and last-run columns from normalized public validation results
  • keep missing results explicit as Never run
  • add credential-free renderer coverage to scripts-selftest

Dashboard contract

The renderer accepts normalized result JSON and maps each completed level to:

  • pass → ✅
  • sample failure → ❌
  • infrastructure/error → ⚠️
  • no result → ⚪ Never run

The pilot is intentionally limited to two samples. Both currently have L3 commands and no L4 declarations, so the seeded dashboard shows Never run for all cells until a separate validation producer publishes results.

Scope boundary

This PR owns only the public dashboard presentation and its two-sample pilot configuration. It does not add a validation workflow, schedule, issue publisher, strike counter, or quarantine behavior, and it does not change .github/workflows/validate.yml or the required trusted job.

Validation execution, normalized artifact production, and delivery to the dashboard are being planned and implemented separately under P4.1 so they can consume the P5-owned transition manifest and preserve the frozen cold-L4 and failure/error contracts.

Tracking

ADO 5505679: https://msdata.visualstudio.com/Vienna/_workitems/edit/5505679

Public dashboard: #892

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 320063cb-69d2-49f6-8105-adc392a67da6
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 320063cb-69d2-49f6-8105-adc392a67da6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant