Skip to content

TR mirror drift in docs/usermanuals/en/data/leakage.md: Exact match in val/test (any field that matters: prompt, chosen, response, etc.). (DOC-TR12-004) #350

Open

Description

@cemililik

Wave 1 · theme D1-10: Documentation-only fixes · highest severity High · 1 finding(s) · effort docs fix

Summary

Neither: one simhash over the extracted payload; DPO 'chosen' not included; exact duplicates are simply Hamming 0.

Primary finding

DOC-TR12-004 — TR mirror drift in docs/usermanuals/en/data/leakage.md: Exact match in val/test (any field that matters: prompt, chosen, response, etc.).

severity High

Where. EN docs/usermanuals/en/data/leakage.md:41-42 · TR docs/usermanuals/tr/data/leakage.md:41-42

English text. Exact match in val/test (any field that matters: prompt, chosen, response, etc.).

Turkish text. Val/test'te kesin eşleşme (önemli her alan: prompt, chosen, response vb.).

Which is correct. Neither: one simhash over the extracted payload; DPO 'chosen' not included; exact duplicates are simply Hamming 0.

Proposed correction (Turkish text for the -tr page). Her satırın çıkarılan metin yükünün (bkz. Veri Seti Denetimi) 64-bit simhash'i, Hamming eşiği (varsayılan 3) içinde val/test satırlarıyla karşılaştırılır; tam eşleşme Hamming 0'dır. chosen/rejected gibi alanlar karşılaştırmaya girmez.

Acceptance criteria

  • Each statement is re-checked against the code at fix time.
  • Documentation listed above is corrected in English and in its Turkish mirror in the same PR.
  • Every finding in this issue is resolved or explicitly closed with a reason.

Found by the October 2026 ForgeLM code and documentation review against commit cab2947. Code links point at that commit; line numbers may have moved since. Finding IDs (CR-…, DOC-…, TECH-…) are stable references for this backlog.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationi18nEnglish/Turkish documentation mirrorseverity: highWrong behaviour or a false claim users rely onsource: review-2026-10Found by the October 2026 code and documentation reviewwave: 1Roadmap wave 1: high severity, small effort

    Type

    No type

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions