Skip to content

rlf-codex-rl 核心:trusted flag、Qwen3-30B-A3B profile、RLF 入口接线与 baseline runner - #230

Merged
michaellchung merged 4 commits into
mainfrom
rlf-pr1-core
Oct 11, 2026
Merged

michaellchung merged 4 commits into
mainfrom
rlf-pr1-core

Conversation

@michaellchung

Copy link
Copy Markdown
Contributor

范围

rlf-codex-rl(RLF CTF 任务接入 Codex RL 训练链路)的核心切片,从 s19-fix-import-boundary 未推送提交中切出:

  • trusted flag 修复、Qwen3-30B-A3B 模型 profile(yeto/rl/rlf/ 合约/目录/Modal/preflight/trajectory)
  • RLF 入口接线(codex_backend、compaction_bridge、codex_openenv_generate、harness agent)
  • baseline runner(yeto/rl/eval/rlf_baseline.py、yeto/cloud/modal_rlf_baseline.py、modal_reward_env)
  • CTF lease 打包与 gate 判定标准、README 模型别名、turn cap 8192(用户已批准)、prompts 内目标 endpoint、baseline 分段会话接线
  • 5.6/5.7 GPU 证据与决策日志(evidence/rlf/),openspec change 文档(proposal/design/tasks/spec)
  • 5.6/5.7 标记完成并附证据指针

对应 openspec change:rlf-codex-rl(本 PR 含 change 文档本体)。

测试证据

CPU 测试(yeto-test-venv,基于 agentenv/main c9f07425):

tests/test_rlf_baseline.py tests/test_rlf_env_lease.py tests/test_rlf_bridge.py
tests/test_rlf_gate_evidence.py tests/test_rlf_rollout_entry.py tests/test_qwen3_cyber_profile.py
tests/test_rlf_compaction_profile.py tests/test_harness_codex_openenv.py
103 passed in 10.28s

GPU 侧 5.6/5.7 证据见 evidence/rlf/acceptance-status.json 与 decision-log.md(已在 GPU 上跑出,随本 PR 入库)。

依赖关系

  • base:main,本 PR 是栈底
  • 后续 PR 依赖本 PR:gate runner(5.8 判定器)、Modal 沙箱修复两片将栈在本 PR 之上,合并时请按顺序处理

冲突解决说明

cherry-pick 时仅 codex_openenv_generate.py import 区与 main 新提交冲突(main 加 import os,本分支加 import uuid),已两者保留。

🤖 本 PR 由切分流程从 s19 工作分支摘出,不含任何密钥材料(已全量扫描)。

Made with Cursor

…ng, gate criteria, CTF lease packaging, baseline runner

- trusted reference flag: recv-loop transport fix (was single-recv), verified on
  real Modal nested Docker (evidence/rlf/modal-ctf-trusted-recvfix2.log)
- codex_backend profile qwen3_30b_a3b (thinking, 32K/1024/48/8192) + whitelist
- RLF identity producer + catalog prompt_rows entry + provider signature fix
- compaction profile registration entry (qwen3_cyber 24576/4096/3)
- rl_gate five hard criteria incl. success_count>0; group_advantages +
  policy_update_evidence APIs; cpu_e2e now computes real values
- CTF orchestration packaged (dockerd/build/target/health/teardown) +
  RlfCtfLease full EnvironmentLease + finish_trusted RLF grade path
- rlf baseline runner (A100-80GB bf16 SGLang) + Modal driver + CPU tests
- codex harness: bounded diagnostic body on non-200 (503 no-read kept), repinned
- evidence: VM lease E2E pass, HF weights volume manifest, baseline run1 (0%
  success, turn-1 truncation at 1024-token cap)
… in prompts, baseline segment-session wiring, 5.6/5.7 GPU evidence
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants