fig(1): integrate Tier-A re-validated Aider-S cells into the heatmap - #9
Merged
Conversation
The committed Figure 1 rendered the 3 re-validated Aider-Sonnet floor cells as n/a (stale -x aggregate entries) and predated the mis-stamped-cell corrections. Update aggregate_lite_aider_anthropic.json with the 2026-06-08 Tier-A full-suite results (chardet 250/376=66.5%, marshmallow 1073/1229=87.3%, voluptuous 133/149=89.3%; jinja stays n/a — exceeds the model context window) and regenerate. Regen also picks up the 4 mis-stamped cells now correctly n/a (marshmallow Aider-G/Sm-S, portalocker Sm-G, jinja Aider-G), syncing the figure to current data. Caption updated. Provenance guard: 17 pending (unchanged), PASS. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Per review: the 17in-wide canvas downscaled to ~0.3x at textwidth (tiny footnote) with a 0.30 inter-panel wspace (over-wide middle margin). Narrow to 14x9, wspace 0.30->0.08 (tight middle), enlarge the footnote 8.5->13pt + wrap to 4 lines, and reserve explicit bottom space (subplots_adjust bottom=0.22) so the footnote no longer overlaps the x-axis labels. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…row labels Per review: (1) 'Aider-S/Aider-G' were wider than the 2-char KD/B3/Sm/OH codes and overlapped at the bottom -> 'Ai-S/Ai-G' (footnote notes Ai-S = Aider-Sonnet). (2) Panel B's row labels (identical to Panel A's) collided with the value-add colorbar under the tightened wspace -> omit them; B shares A's row labels. Middle stays tight, no overlaps. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Regenerates Figure 1 so the 3 re-validated Aider-Sonnet floor cells render real values instead of
n/a(they were stale-xaggregate entries):Source: 2026-06-08 Tier-A full-suite re-validation via
score_branch(thestream=Truefix, PR #8). Updatesaggregate_lite_aider_anthropic.json+ regeneratesfigure1.pdf+ caption.Regen also syncs the figure to current data — the 4 mis-stamped cells (marshmallow Aider-G/Sm-S, portalocker Sm-G, jinja Aider-G) now correctly show
n/aper CORRECTIONS.md. Provenance guard: 17 pending (unchanged), PASS.Figure now matches the corrected paper (benchmarks-private PR forthcoming for the embedded copy).
🤖 Generated with Claude Code