Skip to content

docs/usermanuals/en/concepts/data-formats.md: false claim — forgelm audit flags rows where chosen == rejected ('⚠ 12 chosen-rejected identical rows') (DOC-D3B05-007) #233

Open

Description

@cemililik

Wave 1 · theme D1-10: Documentation-only fixes · highest severity High · 1 finding(s) · effort docs fix

Summary

Users rely on a guard against a common preference-data bug that does not exist.

Primary finding

DOC-D3B05-007 — docs/usermanuals/en/concepts/data-formats.md: false claim — forgelm audit flags rows where chosen == rejected ('⚠ 12 chosen-rejected identical rows')

severity High

Where. docs/usermanuals/en/concepts/data-formats.md:69,164 (Turkish mirror: docs/usermanuals/tr/concepts/data-formats.md:69,162) · type: false claim

The document says. forgelm audit flags rows where chosen == rejected ('⚠ 12 chosen-rejected identical rows')

What the code does. No such check exists: forgelm/data_audit has no reference to chosen/rejected. Auditing a file with two identical chosen/rejected rows produced no flag, and the per-row text that was scanned was only prompt.

Code references. forgelm/data_audit/_types.py:78, forgelm/data_audit/_streaming.py:116-165

User impact. Users rely on a guard against a common preference-data bug that does not exist.

Proposed correction. Remove the claim (or implement the check). Suggest a one-liner such as jq 'select(.chosen==.rejected)' instead.

Turkish mirror. the Turkish page has the same error; fix both in the same PR

Acceptance criteria

  • Each statement is re-checked against the code at fix time.
  • Documentation listed above is corrected in English and in its Turkish mirror in the same PR.
  • Every finding in this issue is resolved or explicitly closed with a reason.

Found by the October 2026 ForgeLM code and documentation review against commit cab2947. Code links point at that commit; line numbers may have moved since. Finding IDs (CR-…, DOC-…, TECH-…) are stable references for this backlog.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationseverity: highWrong behaviour or a false claim users rely onsource: review-2026-10Found by the October 2026 code and documentation reviewwave: 1Roadmap wave 1: high severity, small effort

    Type

    No type

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions