feat: add vime rollout logp probe - #142
Conversation
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
Signed-off-by: inaniloquentee <3051000145@qq.com>
530e826 to
84cd08d
Compare
|
This pull request has been inactive for 30 days. To keep things moving, please update it or let us know if it's still in progress. Otherwise it will be automatically closed in 30 days. |
Summary
--custom-generate-function-pathshim that preserves Vime native generation and invokes RL-Kernellogpas a minimal rollout-side probe.Sample.metadata["rl_kernel"]["vime_logp_probe"].Scope
This is a minimal PoC for #120.
It does not replace vLLM sampling/logprob computation, does not change Vime/slime/vLLM source, does not add a production integration, and does not claim train-inference numerical consistency or speedup.
Depends on #117, #118, and #119
Closes #120
Part of #83