Skip to content

chore: mark S2 complete in NEXT_100_PR_MAP #969

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
cschanhniem merged 1 commit into from
Jul 10, 2026
Merged

chore: mark S2 complete in NEXT_100_PR_MAP #969

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/research/NEXT_100_PR_MAP.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -231,7 +231,7 @@ Make it possible for an external reviewer to understand, in one artifact, why sp
| PR | Task | Why it matters | Review class |
|---:|---|---|---|
| S1 | Add score vs cheap-enemy gap report schema (SEG-) (complete). — src/openamp_foundry/evidence/score_enemy_gap_report.py: SEG- 16-field schema + CheapEnemyResult helper; VALID_GAP_VERDICTS (4: gap_meaningful/gap_marginal/gap_absent/comparison_not_run), VALID_CHEAP_ENEMY_TYPES (8), VALID_GAP_ASSESSMENT_METHODS (5); MINIMUM_MEANINGFUL_GAP=0.05; build() auto-computes verdict+best_enemy+gap; dry_lab_only=True enforced; 53 tests. BASELINE: 9215→9278. PR #966. | Flags when pipeline score margin over best cheap baseline is below a meaningful threshold; prevents advancing candidates that cheap baselines explain equally well. | C |
| S2 | Add selection transparency ledger schema (STL-). | Per-candidate-family ledger of every evidence artifact that influenced selection; makes selection_basis auditable and traceable. | C |
| S2 | Add selection transparency ledger schema (STL-) (complete). — src/openamp_foundry/evidence/selection_transparency_ledger.py: STL- 16-field schema + ArtifactReference helper; VALID_SELECTION_BASES (8), VALID_SELECTION_OUTCOME_TYPES (7), VALID_LEDGER_COMPLETENESS_GRADES (4); REQUIRED (BSP/SEG/SRG); not_specified blocked; complete grade requires all required; build() auto-computes completeness; dry_lab_only=True; 48 tests. BASELINE: 9278→9341. PR #968. | Per-candidate-family ledger of every evidence artifact that influenced selection; makes selection_basis auditable and traceable. | C |
| S3 | Add evidence completeness checker schema (ECC-). | Lists all expected artifact types (BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB) and which are present/absent for a candidate family; completeness_grade (A–D); closes "what's still needed for review?" question. | C |
| S4 | Add pipeline run stability report schema (RSR-). | Compares outputs across N pipeline runs; flags candidate families whose ranking is unstable across runs; prevents overconfident selection of borderline candidates. | C |
| S5 | Add prediction quality trend report schema (PQT-). | Tracks cumulative prediction quality across all confirmed WHR results; rolling precision/accuracy trend; degradation alerts; closes Phase S. | C |
Loading