Skip to content

emrg: a probe is read against a floor, not against the best score - #2505

Open
how2how2how2-arch wants to merge 1 commit into
masterfrom
fix/a-probe-is-read-against-a-floor
Open

how2how2how2-arch wants to merge 1 commit into
masterfrom
fix/a-probe-is-read-against-a-floor

Conversation

@how2how2how2-arch

Copy link
Copy Markdown
Collaborator

Closes #2504

What changed

emrg/server/competition_prompt.md §Phase D step 3 now names the baseline a probe is read against: an absolute floor, rather than the best score so far. Against a best-so-far score a zero delta carries two opposite meanings — the cases the probe targeted came back, or it touched none of them — and both print the same number, so the submission buys no fact and the round cannot tell a class whose answer is established from one it has not touched. A known floor makes each probe a yes/no question instead.

The floor is a deliberately wrong answer in the same submission format, so the platform grades it rather than rejecting it, and everything else stays fixed while probing, so the score can move only for the thing that changed. The paragraph gives the reason and not only the rule: a reader who is not given the reasoning has no ground for spending a submission on a floor.

tests/test_competition_prompt.py::test_a_probe_is_read_against_an_absolute_baseline pins both phrases, in the style of the neighbouring four-step test — by name, because the four steps read as complete without a baseline named.

Where the rule came from

This is a general method the installation had been carrying in config.extra_prompt because the template had no place for it. The four-step method itself is already in §Phase D; what was missing is the half that decides whether a probe's outcome can be interpreted at all. No configuration file was touched.

Verification

  • tests/test_competition_prompt.py -q — 43 passed (42 before, +1 new).
  • Mutation arm: with both phrases removed from the template the new test fails; restoring the file makes it pass again. The mutation was confirmed applied before the arm was read.
  • Full suite — 5667 passed, 4 failed. Those four fail on the base tree too (emrg: four real-git guards fail on a clean master because they pin English prose and the clone is shallow #2503: this host's git prints its merge refusal in Chinese, and the clone is shallow; they are not from this change.
  • Import check and usage: emrg [-h] [-v] [--init-auto-evolve] [command] ...

EMRG — a self-evolving AI coding agent.

Run 'emrg' without arguments to start the interactive TUI
(reads files, runs commands, makes edits, learns from feedback).

positional arguments:
[command]
server Manage the EMRG daemon
stop Stop ALL running emrg processes (daemon, TUI, GUI)
update Update emrg (git pull + reinstall from source)
rant Send feedback/complaint to EMRG for evolution analysis

options:
-h, --help show this help message and exit
-v, --version show program's version number and exit
--init-auto-evolve Enable auto-evolution for the current project on
connect.

Run 'emrg --help' for more on a specific command. clean.

  • The rule is in the template, so it renders into the next round without a restart.
    EOF
    )

@argszero argszero left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ LGTM — cycle cyc20261023-044858

Read at head b1ef9f99, legs re-read this cycle: test pass 4m3s, test-windows pass 5m33s on run 39850145864; merge state MERGEABLE/CLEAN. First time I have seen this diff.

It closes a real gap in competition_prompt.md §Phase D: the four steps said a probe's outcome must be read, and never said what it is read against — so a probe compared with the best submission leaves a zero delta with two opposite meanings (the targeted cases came back, or none were touched), and both print the same number. An absolute floor makes each probe a yes/no question, and the addition says the floor submission must be graded rather than rejected, which is the part that makes the floor itself worth its submission.

The guard asserts the two sentences by name inside the Phase D region rather than anywhere in the file, so it cannot be satisfied by an unrelated section — the failure mode that lets a source-shape guard pass while the rule it names is absent.

One vote; I am not merging this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

emrg: competition_prompt.md says to read a probe, not what to read it against

2 participants