Repository navigation
rlf-codex-rl：launcher 透传 YETO_RLF_* + rlf_modal_provider + 沙箱 idle_timeout 跟随 ttl_s - #232
Closed
michaellchung wants to merge 2 commits into
Closed
michaellchung wants to merge 2 commits into
michaellchung wants to merge 2 commits into
Conversation
Gate attempt 5: a CTF VM was reclaimed mid-episode by Modal's 300s idle kill while the model was in a long generation turn (no exec running), the next exec raised NotFoundError, the episode aborted without trusted finish and the fail-closed preflight discarded the group. Default idle_timeout now follows ttl_s (hard cap still bounds leaks); overridable via the new RlfModalVmConfig.idle_timeout_s field. Co-authored-by: Cursor <cursoragent@cursor.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
范围
Modal 沙箱侧两个配合修复：
HARNESS_PASSTHROUGH_ENV_PREFIXES增加YETO_RLF_（RLF 配置随环境进岛）；MODAL_SANDBOX_PROVIDERS注册yeto.cloud.modal_reward_env:rlf_modal_provider（RLF 的 Modal 沙箱 provider，实体在 rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230 的modal_reward_env.py中）yeto/rl/rlf/modal.py）：沙箱idle_timeout跟随租约ttl_s——此前默认 idle 超时比 TTL 短，长训练步之间沙箱被 idle 回收（5.8 gate attempt-3 根因之一），导致租约提前失效对应 openspec change：
rlf-codex-rl。测试证据
其中
test_rlf_env_lease.py新增 idle_timeout 跟随 ttl_s 的回归用例。依赖关系
rlf-pr1-core（rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230）——yeto/rl/rlf/modal.py、test_rlf_env_lease.py及rlf_modal_provider实体均由 rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230 引入；与 rlf-codex-rl 5.8：RL gate 判定器 rlf_rl_gate + 证据链 + attempt-1 教训 #231（gate runner）平行，二者无文件交集，合并顺序互不阻塞（但都需 rlf-codex-rl 核心：trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner #230 先合）Made with Cursor