Repository navigation

feat(rl): add Miles SAO streaming DiLoCo and Terminal-Bench validation - #46

Merged

WaldenLee2005 merged 108 commits into

mainfrom

feat/sao-tbench21-e2e-validation

Aug 27, 2026

Merged

feat(rl): add Miles SAO streaming DiLoCo and Terminal-Bench validation#46
WaldenLee2005 merged 108 commits into
mainfrom
feat/sao-tbench21-e2e-validation

Commits on Jul 30, 2026
- feat(rl): add pinned Miles LoRA federation
  AlexEisie
  committed
  0f0f2c7
- docs(rl): clarify Miles RL implementation
  AlexEisie
  committed
  3caa18a
- feat(rl): adopt maintained Miles sync hooks
  AlexEisie
  committed
  9ebd420
- feat(rl): add reproducible Miles LM benchmark
  AlexEisie
  committed
  4f2b963
Commits on Jul 31, 2026
- docs(rl): record current Miles validation
  AlexEisie
  committed
  8e1eef9
- docs(benchmarks): publish Miles RL results
  AlexEisie
  committed
  bb3ecda
Commits on Aug 4, 2026
- merge: sync Miles RL branch with origin/main
  AlexEisie
  committed
  0e6ec5a
- feat(sft): add causal LoRA adapter lifecycle
  AlexEisie
  committed
  e36f5d8
- fix(sft): normalize adapter resume recipe defaults
  AlexEisie
  committed
  4c3b935
- feat(rl): add local PPO and CyberGym integration
  AlexEisie
  committed
  06ba71d
- feat(rl): add existing-host SSH acceptance harness
  AlexEisie
  committed
  0a0d843
- feat(benchmarks): extend Miles RL run controls
  AlexEisie
  committed
  33214ae
- chore(sft): trim adapter lifecycle integration
  AlexEisie
  committed
  35fb4c3
- fix(benchmark): pass audit directory to RL workers
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  00460ec
Commits on Aug 5, 2026
- docs(rl): document Miles RL synchronization
  AlexEisie
  committed
  ab168ca
- feat(rl): add decoupled Miles synchronization
  AlexEisie
  committed
  0016409
- test(rl): cover decoupled Miles lifecycle
  AlexEisie
  committed
  0f9cdcb
- feat(benchmarks): compare decoupled Miles RL
  AlexEisie
  committed
  9d4abd1
- docs(rl): add decoupled DiLoCo design
  AlexEisie
  committed
  18a396c
- fix(rl): zero-token tolerance and ssh harness dashboard default value
  AlexEisie
  committed
  9fedf78
- fix(syncer): replay pulls only after reconnect
  AlexEisie
  committed
  9f32ddf
- fix(cybergym): serialize identical reward submissions
  AlexEisie
  committed
  f9aff3c
- feat(rl): start decoupled phases from exported adapters
  AlexEisie
  committed
  41bb8ac
- fix(rl): add curriculum and variance-aware CyberGym sampling
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  22922e8
- fix(rl): bound variance sampling and offload weight sync
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  f4282df
- fix(rl): wake offloaded actor before initial export
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  beb519f
Commits on Aug 6, 2026
- fix(rl): use actor group onload for offloaded export
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  e8d2e37
- Verify decoupled RL SSH artifacts
  AlexEisie
  committed
  37c9f90
- Fix Miles RL runtime attestation and offload lifecycle
  AlexEisie
  committed
  94f423c
- fix(rl): delegate initial offload lifecycle to Miles
  AlexEisie
  committed
  2806dca
- fix(rl): finalize offload-safe Miles publication
  AlexEisie
  committed
  b31e3fa
- Add CyberGym text Level 1 prompts
  AlexEisie
  committed
  8b8e2b4
- Support shaped CyberGym reward scoring
  AlexEisie
  committed
  d9d1f07
- Handle large Level 1 source archives
  AlexEisie
  committed
  d4a6e25
- Fix AFL++ CyberGym coverage runner
  AlexEisie
  committed
  3bc5854
Commits on Aug 7, 2026
- Relocate CyberGym coverage setup
  AlexEisie
  committed
  cf40eaf
- Keep decoupled RL design notes local
  AlexEisie
  committed
  470e2da
- fix: pin RL SGLang source to the patched revision
  AlexEisie
  committed
  3296df9
- fix: forward RL chat template kwargs through SSH harness
  AlexEisie
  committed
  afd2988
- fix: exclude benchmark reports from SSH RL deploys
  AlexEisie
  committed
  158bee4
- fix: pin Miles SGLang host compatibility update
  AlexEisie
  committed
  388e36c
- fix: pin compatible Miles runtime
  AlexEisie
  committed
  c876901
- fix: pin repaired Miles RL image
  AlexEisie
  committed
  a0480ae
- fix: pin lazy p2p Miles import
  AlexEisie
  committed
  96eb95d
- fix: pin compatible SGLang LoRA transport
  AlexEisie
  committed
  6a12ee8
Commits on Aug 10, 2026
- feat(rl): add DeepSeek V4 secrlenv training path
  WaldenLee2005
  committed
  5708b5b
- feat(rl): support large canonical expert policies
  AlexEisie
  committed
  2786e20
- feat(rl): add safety expert full tuning
  AlexEisie
  committed
  90911da
- fix(rl): pin memory-safe Miles state export
  AlexEisie
  committed
  a5ca6aa
Commits on Aug 11, 2026
- merge: sync secrlenv work with origin/main
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  1edb368
- docs: design Miles yeto-v30 pin update
  AlexEisie
  committed
  e961817
- docs: plan Miles yeto-v30 pin update
  AlexEisie
  committed
  d66b3f1
- fix(rl): pin latest Miles disk restore
  AlexEisie
  committed
  7c34200
- feat(rl): support pipeline parallel policy sync
  AlexEisie
  committed
  4f7f97f
- fix(rl): fetch pinned Miles directly
  AlexEisie
  committed
  cc6d982
- docs: design DeepSeek V4 pipeline parallel support
  AlexEisie
  committed
  872f989
- feat(rl): support DeepSeek V4 pipeline parallelism
  AlexEisie
  committed
  1496ed3
- fix(rl): keep clone-only policy sparse
  AlexEisie
  committed
  a405913
- docs: design balanced DeepSeek V4 expert mapping
  AlexEisie
  committed
  cf060c9
- feat(rl): balance DeepSeek V4 expert mapping
  AlexEisie
  committed
  04112d6
- fix(rl): preserve balanced expert collectives
  AlexEisie
  committed
  891ea68
- chore: ignore superpowers docs
  AlexEisie
  committed
  d841f0f
Commits on Aug 12, 2026
- feat(rl): complete PP2 SecrlEnv runtime bring-up
  AlexEisie
  committed
  6393624
- chore(rl): fetch pinned SGLang from source
  AlexEisie
  committed
  9f70fa5
- fix(protocol): avoid duplicate fragment buffers
  AlexEisie
  committed
  2b17168
- fix(rl): reset frozen expert guard after restore
  AlexEisie
  committed
  6819101
- fix(rl): preserve PP2 hybrid train metrics
  AlexEisie
  committed
  b7ee40e
Commits on Aug 13, 2026
- fix(secrlenv): serialize episode finalization ownership
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  5d4f3ec
- fix(rl): disable blocking addr2line symbolization
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  ccf57a3
- chore(rl): pin Miles IPC staging fix
  AlexEisie
  committed
  6da3111
- feat(rl): support dedicated SSH syncer hosts
  AlexEisie
  committed
  9e588e4
Commits on Aug 14, 2026
- fix(rl): harden lifecycle and stream strict policy sync
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  e83a1f7
- fix(rl): stream clone-only policy exports
  AlexEisie
  committed
  fa2a4cf
- fix(rl): use portable systemd kill option
  AlexEisie
  committed
  da3cb0e
- fix(rl): normalize clone export owner rank
  AlexEisie
  committed
  d09a7d0
- fix(rl): stream strict initial policy
  AlexEisie
  committed
  881aca7
- fix(rl): compact streamed policy chunks for Ray
  AlexEisie
  committed
  a438f88
- fix(rl): extend final ack timeout and trace policy apply
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  0ff9f06
Commits on Aug 17, 2026
- feat(rl): add signed Codex xhigh harness and eval
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  4b870c6
- fix(rl): scope SecRLEnv daemons to island heads
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  e00a939
- fix(rl): canonicalize live Codex schema attestation
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  76af2c1
- Fix expert-full DP2 optimizer masters
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  a928e08
Commits on Aug 18, 2026
- fix(rl): bound streamed Miles harness replies
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  111ef2f
- Add opt-in W&B telemetry for fleets
  claude
  committed
  3df3701
- Stream syncer metrics in local controller mode too
  claude
  committed
  6953f7d
- fix(rl): bound SecRLEnv create retries
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  b7cfdbb
- Fix two gaps the H200 two-island run exposed
  claude
  committed
  f0714a0
- Merge W&B telemetry and extend it to RL islands
  claude
  committed
  88eba75
- Wire telemetry through the SSH harness too
  claude
  committed
  224bc8a
- Fix an RL x-axis that no real event carries
  claude
  committed
  54e6250
- Merge remote-tracking branch 'origin/feat/secrlenv-infra-abort-v28' into feat/secrlenv-infra-abort-v28
  AlexEisie
  committed
  252de98
- rl: add scalar-only W&B loss telemetry
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  cab105d
Commits on Aug 19, 2026
- fix(rl): bound SecRLEnv trajectory replacement
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  18c1627
- fix(rl): authenticate pre-create infrastructure exhaustion
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  dea4a85
- fix(rl): rebase TMS preload artifact for agentenv
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  b110e3e
Commits on Aug 20, 2026
- feat(rl): add attested Qwen3.8 Codex profile
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  10c530f
- feat(rl): derive attested SecRLEnv task-pack subsets
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  557b773
Commits on Aug 21, 2026
- Pin per-agent flagless DinD debug contract
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  fc00664
- Tell Codex agents about flagless DinD copy
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  f5bcef3
Commits on Aug 22, 2026
- docs: hand off Qwen3.8 SecRLEnv full run
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  40f7517
Commits on Aug 24, 2026
- docs: redesign SecRLEnv RL around Decoupled DiLoCo
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  7715119
- docs: stage GRPO DiLoCo and PULSE architecture
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  657ba71
Commits on Aug 25, 2026
- feat(rl): add full-parameter synchronization foundation
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  1c1098d
Commits on Aug 26, 2026
- feat(rl): add SAO streaming DiLoCo coordinator
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  60b61b3
Commits on Aug 27, 2026
- feat(sao): validate Terminal-Bench streaming DiLoCo e2e
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  5bfc011
- Merge remote-tracking branch 'origin/main' into feat/sao-tbench21-e2e-validation
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  1dc9c46
- chore(sao): clean validation diff whitespace
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  4d00437
- docs(sao): correct matched evaluation and add architecture exports
  
  WaldenLee2005
  authored and
  WaldenLee2005
  committed
  7c768d3

Commits

Commits on Jul 30, 2026

Commits on Jul 31, 2026

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Commits on Aug 6, 2026

Commits on Aug 7, 2026

Commits on Aug 10, 2026

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

Commits on Aug 14, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 19, 2026

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Commits on Aug 22, 2026

Commits on Aug 24, 2026

Commits on Aug 25, 2026

Commits on Aug 26, 2026

Commits on Aug 27, 2026