Repository navigation

Make the metrics suite complete and usable from one object - #79

Open

mkeeler43 wants to merge 18 commits into

mainfrom

feat/metrics-suite

Commits on Sep 25, 2026

Make a metric one decorator and a board one object

mkeeler43
and
claude
committed
efb8d42
Add a notebook that walks the metrics suite on a toy problem

mkeeler43
and
claude
committed
2c21d7b
Port the metric suite onto the one-decorator contract

mkeeler43
and
claude
committed
5a5a317
Let a board choose its space, and load published checkpoints by name

mkeeler43
and
claude
committed
5224615
Describe the current metric suite where contributors read about it

mkeeler43
and
claude
committed
1babd6a
Format the notebook's code cells the way CI does

mkeeler43
and
claude
committed
3c6e6f5
Put the notebook's imports where the linter expects them

mkeeler43
and
claude
committed
32afcc7

Commits on Sep 28, 2026

Say what each metric measures and how to read its scale

mkeeler43
and
claude
committed
3cc4150
Run the metrics notebook on beams2d with published checkpoints

mkeeler43
and
claude
committed
62812ca
Measure memorization as a distance, without a tolerance

mkeeler43
and
claude
committed
1126e7d
Stop passing the spec to push_to_hub, which no longer reads it

mkeeler43
and
claude
committed
0af3a34
Drop the evaluator argument _publish stopped using

mkeeler43
and
claude
committed
ab2ef94

Commits on Sep 29, 2026

Measure settling against the optimum, and size the kernel from the training data

mkeeler43
and
claude
committed
68b32b9
Explain the evaluation context before asking the reader to write a metric

mkeeler43
and
claude
committed
59c198d
Address the first review: one default spec, conditions for saved designs, and a board that keeps its registry

mkeeler43
and
claude
committed
cc5f16e
Re-run the notebook with the renamed explain column

mkeeler43
and
claude
committed
6a1ad77

Commits on Sep 30, 2026

Address the second review: one CLI default, a volume budget the board knows, one bandwidth per board

mkeeler43
and
claude
committed
481fd39

Commits on Oct 1, 2026

Let the board take the test rows themselves, and the evaluator a chosen slice

mkeeler43
and
claude
committed
876e094