Repository navigation
rlf-codex-rl 5.8：--rl-training-attention-backend 与 --session-server-workers 两个训练侧 flag - #233
Merged
Merged
Conversation
…e-surviving gate evidence
- --rl-training-attention-backend {auto,flash,fused,unfused}: recipe default
overridable (flash-only recipes refuse); gate run uses unfused after the
L40S flash-attn cute JIT crd2idx compile failure (failure class
trainer_kernel_compile, attention fwd, LoRA-independent)
- rlf_rl_gate: policy-update proof from the island event tape rl_publication
payload hashes (代拍板 v2) — survives island teardown via --modal-tape-volume;
adapter-file path kept; policy_update_source recorded in evidence
- CPU tests: 4 new backend-override + 5 new tape-collection tests
Co-authored-by: Cursor <cursoragent@cursor.com>
gate attempt 2 (rlf-gate-20261011-4) passed the attention-backend override (AttnBackend.unfused on the island) but died on a session-server import storm: Miles defaults --session-server-workers to 32, and 32 parallel sglang imports on the 4-core L40S island missed the 300 s ready window (same failure class as compaction G3 run c). Yeti had no flag for the worker count; plumb it cli -> launcher -> island -> AgentConfig -> Miles argv, launch-side >=1 validation, translation allowlist. The gate run drops to 8 workers (rollout is 4 groups x 4 samples). Silver lining: --modal-tape-volume + completed-groups in ~/yeto-output worked — the island tape was pulled despite the failed run. Co-authored-by: Cursor <cursoragent@cursor.com>
This was referenced Oct 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
范围
5.8 gate attempt-2/attempt-3 的两个训练侧修复：
--rl-training-attention-backend：允许覆盖 trainer 的 attention backend——attempt-1 失败于 trainer cutlass 编译，覆盖后端可绕开；同时让 gate 证据在事件磁带上留存（tape-surviving evidence），岛回收后仍可判定--session-server-workers：会话服务器 worker 数可配——attempt-2 中默认单 worker 成为 rollout 瓶颈涉及
yeto/cli.py、yeto/launcher.py、yeto/rl/engine/run_config.py、yeto/rl/adapters/miles/{config,island_entry}.py，及rlf_rl_gate.py的磁带证据收集增强。对应 openspec change：
rlf-codex-rl（任务 5.8）。测试证据
新增
test_rl_training_attention_backend.py（flag 透传、run_config 落盘、island_entry 生效），gate 测试同步扩充。依赖关系
rlf-pr2-gate-runner（rlf-codex-rl 5.8：RL gate 判定器 rlf_rl_gate + 证据链 + attempt-1 教训 #231）——本 PR 直接修改 rlf-codex-rl 5.8：RL gate 判定器 rlf_rl_gate + 证据链 + attempt-1 教训 #231 引入的rlf_rl_gate.py与其测试；合并顺序：rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230 → rlf-codex-rl 5.8：RL gate 判定器 rlf_rl_gate + 证据链 + attempt-1 教训 #231 → 本 PRMade with Cursor