Skip to content

feat: retain integrated review shadow reports - #449

Draft
huang47 wants to merge 2 commits into
codex/readiness-review-inventoryfrom
codex/readiness-shadow-report
Draft

huang47 wants to merge 2 commits into
codex/readiness-review-inventoryfrom
codex/readiness-shadow-report

Conversation

@huang47

@huang47 huang47 commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

ELI5

A reviewer needs one place to see the risk grade and the available review evidence. This workflow collects both and saves a report, while clearly marking the evidence it has not checked.

shadow-flow

Summary

  • Run the existing grader in report-only mode and collect GitHub review evidence for the same supplied snapshot.
  • Retain one advisory JSON artifact for 30 days. No label, review, comment, optional check run, or repository policy is written. Actions run and job checks still exist.
  • Add a CI caller that exercises the reusable workflow and downloads its artifact with a synthetic policy.

Verification

  • 46 Python tests passed, including the real risk grader, review evaluator, stale snapshots, and publication switches.
  • A read-only local run against a draft PR with a synthetic policy returned a current risk grade and WAITING for missing evidence.
  • Actionlint and repository checks passed. The current-head Actions run ran the reusable workflow and downloaded its artifact: WAITING with a synthetic policy. The workflow-pins suite passed after registering the new input contract.

Limits

The caller must provide an authorized policy and verify the tested SHA. Reviews and thread reads are not atomic; reviewer permissions and other finding sources remain unverified. This report cannot produce READY and is not a merge gate. No pilot or policy activation is included.

Stack

Stack order: 5/9, follows #448 — feat: collect scoped GitHub review evidence; followed by #450 — feat: report current Actions check failures.

Provenance

Implemented and verified with an interactive coding agent and human direction. Recovery: remove the caller or revert the provider pin; retained artifacts expire normally.

@coderabbitai

coderabbitai Bot commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant