Train harnesses through Harbor: drop the standalone opencode example - #7457
Open
sergiopaniego wants to merge 1 commit into
Open
sergiopaniego wants to merge 1 commit into
sergiopaniego wants to merge 1 commit into
Conversation
5 of 12 tasks
Member
|
Thanks, just waiting on #6947 to merge to review this in details |
Harbor (served through OpenEnv) now covers every coding-agent harness, opencode included, so the standalone async_grpo_opencode example is removed. The "Training on harnesses" section of the OpenEnv guide is rewritten around Harbor and the validated TrainingTrace from #6947, and the examples overview loses the opencode row.
sergiopaniego
force-pushed
the
docs-harness-harbor
branch
from
October 1, 2026 11:11
65eea8e to
eb25cd7
Compare
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
This was referenced Oct 1, 2026
Member
Author
qgallouedec
approved these changes
Oct 2, 2026
qgallouedec
left a comment
Member
There was a problem hiding this comment.
Thanks, lgtm! One nit: the token-eligibility paragraph still says "verify() remains independent of token eligibility", the rest of the section now says "the task's verifier".
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
The loop-owning (black-box) harness path now goes through Harbor on OpenEnv: every agent Harbor installs (
mini-swe-agent,opencode,claude-code, ...) is trained with the sameHarnessRolloutWorker, picked with--harness. Since #6947, TRL has two ways to train opencode (async_grpo_opencodeandasync_grpo_harbor --harness opencode). Harbor is the path we want to recommend, so this drops the standalone one and moves the docs over.Changes:
examples/async_grpo_opencode/(async_grpo_opencode.py,opencode_hf_sandbox.py).docs/source/openenv.md: rewrite "Training on harnesses" around Harbor (how the capture works, wiring withpartial(HarborSessionFactory, ...), server and vLLM requirements). It follows the API AsyncGRPO: train OpenEnv harnesses from validated token captures #6947 shipped: the validatedTrainingTracefrom OpenEnv, with token eligibility in its masks. The examples list at the top no longer linksasync_grpo_opencode.docs/source/example_overview.md: drop theasync_grpo_opencoderow, and point theasync_grpo_harborrow's Harbor link to the OpenEnv docs, since the TRLharbor.mdpage it links is removed in Remove the experimental Harbor integration (superseded by OpenEnv) #6948.Follow-ups outside this repo: the
muse-glimmerblog post linksexamples/async_grpo_opencode/async_grpo_opencode.py, and the community blog on harness training runs on the old path. Both will be updated to point to Harbor.Before submitting
AI writing disclosure
We welcome the use of AI tools to help with contributions. For transparency and to help us improve our review process, please indicate the level of AI involvement in this PR.
Who can review?
@adithya-s-k @qgallouedec
🤖 Generated with Claude Code
Note
Low Risk
Documentation and example removal only; no library API or training runtime changes.
Overview
Removes the standalone
async_grpo_opencodeexample (local subprocess and HF sandbox scripts) so loop-owning harness training is documented and demonstrated only throughasync_grpo_harbor, where agents like opencode are selected via--harnesson the OpenEnv Harbor server.Docs: The examples index drops the opencode row and points Harbor links at OpenEnv docs.
openenv.mdrewrites “Training on harnesses” around Harbor (HarborSessionFactory,openenv harbor serve, capture proxy flow,MAX_CONCURRENT_ENVS, updated wiring snippet) and drops opencode-specific setup from the ready-to-use list.Reviewed by Cursor Bugbot for commit eb25cd7. Bugbot is set up for automated code reviews on this repo. Configure here.