Repository navigation
rlf-codex-rl 5.8：样本级 reward/success 上事件磁带，gate 从磁带收集 outcome - #234
Closed
michaellchung wants to merge 2 commits into
Closed
michaellchung wants to merge 2 commits into
michaellchung wants to merge 2 commits into
Conversation
Co-authored-by: Cursor <cursoragent@cursor.com>
Run rlf-gate-20261011-7 SUCCEEDED (2 rounds trained, reward 0.125) but the gate could not judge: on the ports engine the island checkpoint only ever holds an empty completed-group queue, so per-sample reward/success died with the island. queue_completed_groups now also emits one compact rl_sample_outcome event per sample (fail-closed: skips non-numeric reward, success=None is rejected by the judge), and the gate collects samples from --tape-events when --completed-groups is absent. 3 new tests. Co-authored-by: Cursor <cursoragent@cursor.com>
This was referenced Oct 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
范围
5.8 gate 证据链的样本级闭环：
yeto/rl/adapters/miles/legacy/engine.py）：_emit_sample_outcomes——每个样本的 reward/success 写入事件磁带。ports 桥接只能持久化空的 completed-group 队列，样本级证据必须搭磁带（镜像到 Modal volume，岛回收后仍在）。fail-closed：无数值 reward 的样本跳过，磁带有空洞 gate 拒绝yeto/rl/eval/rlf_rl_gate.py）：judge 从磁带收集样本 outcome，纳入判定证据对应 openspec change：
rlf-codex-rl（任务 5.8）。测试证据
新增磁带 outcome 收集、空洞拒绝、引擎发射路径的用例（本 PR 为 gate 测试 +8）。
依赖关系
rlf-pr4-training-flags（rlf-codex-rl 5.8：--rl-training-attention-backend 与 --session-server-workers 两个训练侧 flag #233）——gate 磁带收集建立在 rlf-codex-rl 5.8：--rl-training-attention-backend 与 --session-server-workers 两个训练侧 flag #233 的 tape-surviving evidence 之上；合并顺序：rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230 → rlf-codex-rl 5.8：RL gate 判定器 rlf_rl_gate + 证据链 + attempt-1 教训 #231 → rlf-codex-rl 5.8：--rl-training-attention-backend 与 --session-server-workers 两个训练侧 flag #233 → 本 PRMade with Cursor