Repository navigation
docs: fix KTO data-shape row to use completion column - #938
Conversation
The choosing-a-trainer table documented KTO rows as
{prompt, response, label: bool}, but the KTO loader requires
completion and label columns. Updated in English and Turkish.
Fixes HodeTech#885
Reviewer's guide (collapsed on small PRs)Reviewer's GuideThe documentation now directs KTO users to provide File-Level Changes
Assessment against linked issues
Possibly linked issues
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
|
Warning Review limit reachedThis review ran on the open-source allowance, not this organization's plan, because the pull request author doesn't have an assigned seat. Waiting won't change this — ask an organization admin to assign them a seat, or add seats in Billing if every seat is already assigned, then retry. Next included review available in 47 minutes. View limit details
Comment |
|
Hi @vortsghost2025, thanks for picking up #885! 🙏 The fix itself is correct, and I checked it against the loader rather than by reading alone:
There are two small things I'd like added to the PR description so the issue closes cleanly. No code change is needed. 1. Please say explicitly that the SFT row is out of scope.
2. Please name the finding ID. FYI, no action needed in this PR: while checking I noticed The project CI shows Thanks again, a clean and focused change! |
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Adds the [Unreleased] > Fixed entry for the "Choosing a Trainer" KTO row. The SFT row of the same table is a separate defect tracked in HodeTech#403 and is left unchanged. Resolves: F-W1-DOCS-TRAIN-02 Refs HodeTech#885 Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
|
Hi @vortsghost2025, thank you for taking on #885, and for keeping the English and Turkish pages in step. 🙏 To get this ready to merge, I pushed two small commits to your branch (a regular push, no force-push):
I also added the finding ID and the "out of scope" line about the SFT row to the PR description myself, since the squash commit takes its text from there, so you don't need to do anything further. The guards and the full CI matrix are green, and I'll merge it now. Thanks again for the clean, focused fix! |
Fixes #885
Resolves: F-W1-DOCS-TRAIN-02
Out of scope: the
{prompt, completion}→ SFT row is a separate defect tracked in #403 and is intentionally left unchanged here.The "What to look at in your data" table in choosing-trainer.md documented KTO rows as
{prompt, response, label: bool}, but_validate_trainer_columnsinforgelm/data.pyrequirescompletionandlabelcolumns — data shaped the way the page recommended fails with a KeyError.Changed the KTO row to
{prompt, completion, label: bool}in both the English page and the Turkish mirror.Summary by Sourcery
Correct the documented KTO data shape so users provide columns accepted by the trainer.
Enhancements:
completioncolumn in the English and Turkish trainer-selection guides.Documentation: