Skip to content

docs: update METHODS.md version tag and annotate 7-seed expansion - #79

Merged
cschanhniem merged 2 commits into
mainfrom
feat/methods-7seed-note
Jun 28, 2026
Merged

cschanhniem merged 2 commits into
mainfrom
feat/methods-7seed-note

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Summary

docs/METHODS.md was last updated for PRs #47–54. The synthesis pool subsequently expanded from 5 to 7 scaffold families (SEED-006 through SEED-009 in expansion PRs; SEED-001 magainin-1 re-entered in PR #72 via the face_segregation_bonus). Readers comparing the methods document to the current synthesis readiness report would see "5 seeds / 383 variants" vs "7 families / 100 candidates" with no explanation.

Changes

  • Version line: PRs #47–54 → PRs #47–78
  • Generation section: added annotated blockquote distinguishing
    • Initial benchmark run: 5 seeds, 383 variants, 87-candidate eval set (43 + 44), AUROC 0.8420
    • Current synthesis pool: 7 scaffold families, 100 candidates — same pipeline config, wider seed set

No scoring formulas, benchmark numbers, or pipeline logic changed.

Test plan

  • make test → 1245 passed
  • Documentation only — no code changes
  • Verified version numbers are consistent with PR history

🤖 Generated with Claude Code

…l expansion

The methods document was last updated for PRs #47-54. Since then the synthesis
pool was expanded from 5 to 7 scaffold families (SEED-006 through SEED-009 in
expansion PRs; SEED-001 re-entered in PR #72 via face_segregation_bonus).

Changes:
- Version line: "PRs #47-54" → "PRs #47-78"
- Generation section: added blockquote note distinguishing the initial 5-seed
  benchmark run (383 variants, 87-candidate eval set, AUROC 0.8420) from the
  current 7-seed synthesis pool (100 candidates)
- No scoring formulas or benchmark numbers changed
AUROC 0.8420 was achieved in PR #72 (face_segregation_bonus), not in the
initial 5-seed benchmark generation run. Clarify that the generation section
describes the initial corpus and the AUROC figure reflects scoring improvements
through PR #72. Also note that the 87-sequence eval set was finalized in PR #66.
@cschanhniem
cschanhniem merged commit 820bc5c into main Jun 28, 2026
1 check passed
@cschanhniem
cschanhniem deleted the feat/methods-7seed-note branch June 28, 2026 15:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant