Skip to content

[Wave 3] Medium — TR mirror: docs/usermanuals/en/data/ingestion.md #629

Open

Description

@cemililik

Wave 3 · 5 finding(s) in 5 fix package(s). English/Turkish mirror drift for this document pair; fix the side the finding names.

Findings

  • DOC-TR12-022 (TR mirror, Medium) — TR mirror drift in docs/usermanuals/en/data/ingestion.md: PDF: table extraction (best-effort); DOCX: preserves headings; EPUB: Strips navigation/index; preserves chapter structure
    severity Medium
    Where. EN docs/usermanuals/en/data/ingestion.md:46-48 · TR docs/usermanuals/tr/data/ingestion.md:46-48
    English text. PDF: table extraction (best-effort); DOCX: preserves headings; EPUB: Strips navigation/index; preserves chapter structure
    Turkish text. tablo çıkarma (best-effort); başlık hiyerarşisini korur; Navigasyon/içindekileri çıkarır; bölüm yapısını korur
    Which is correct. Neither.
    Proposed correction (Turkish text for the -tr page). PDF: metin çıkarımı (pypdf), tablo çıkarımı yok; tekrarlayan header/footer satırları ayıklanır. DOCX: paragraf metni + tablolar Markdown tablo olarak; başlık stilleri Markdown başlığına çevrilmez. EPUB: nav/cover/copyright/colophon/titlepage/frontmatter öğeleri atlanır; bölümler boş satırla birleştirilir.

  • DOC-TR12-023 (TR mirror, Medium) — TR mirror drift in docs/usermanuals/en/data/ingestion.md: sliding falls back to character mode when no tokenizer is available; --chunk-size OR --chunk-tokens, not both
    severity Medium
    Where. EN docs/usermanuals/en/data/ingestion.md:62,89 · TR docs/usermanuals/tr/data/ingestion.md:62,88
    English text. sliding falls back to character mode when no tokenizer is available; --chunk-size OR --chunk-tokens, not both
    Turkish text. tokenizer yoksa karakter moduna düşer; Ya bunu YA DA --chunk-tokens, ikisini birden değil
    Which is correct. Neither: --chunk-tokens without --tokenizer is a ValueError; character mode is used only when --chunk-tokens is not given; passing both just ignores --chunk-size with a warning.
    Proposed correction (Turkish text for the -tr page). --chunk-tokens her zaman --tokenizer gerektirir (yoksa hata verir). --chunk-tokens verilmezse karakter modu kullanılır. İkisi birlikte verilirse --chunk-size yok sayılır ve uyarı loglanır.

  • DOC-TR12-024 (TR mirror, Medium) — TR mirror drift in docs/usermanuals/en/data/ingestion.md: paragraph | One chunk per paragraph
    severity Medium
    Where. EN docs/usermanuals/en/data/ingestion.md:64 · TR docs/usermanuals/tr/data/ingestion.md:64
    English text. paragraph | One chunk per paragraph
    Turkish text. Paragraf başına bir chunk
    Which is correct. Greedy packer: consecutive paragraphs are packed up to chunk_size; an oversized paragraph is emitted alone.
    Proposed correction (Turkish text for the -tr page). Paragrafları chunk_size (veya --chunk-tokens) sınırına kadar art arda paketler; sınırı aşan tek paragraf kendi chunk'ı olur; paragraflar bölünmez.

  • DOC-TR12-025 (TR mirror, Medium) — TR mirror drift in docs/usermanuals/en/data/ingestion.md: no --format flag in v0.7.0; JSONL example with "metadata": {"source","chunk"}
    severity Medium
    Where. EN docs/usermanuals/en/data/ingestion.md:72-75 · TR docs/usermanuals/tr/data/ingestion.md:72-75
    English text. no --format flag in v0.7.0; JSONL example with "metadata": {"source","chunk"}
    Turkish text. v0.7.0'da --format flag'i yoktur; metadata örneği
    Which is correct. Neither: chunks are {"text": ...} only; summary has no 'dropped-row reasons'.
    Proposed correction (Turkish text for the -tr page). {"text": "Bölüm 4.2: ..."} örneğini kullanın, 'metadata' alanını ve 'v0.7.0' ifadesini kaldırın; özet raporu chunk sayısı, dosya/biçim dağılımı ve notları içerir.

  • DOC-TR12-026 (TR mirror, Medium) — TR mirror drift in docs/usermanuals/en/data/ingestion.md: alpha < 0.45 + underscore > 0.10 + >= 5 page-number matches
    severity Medium
    Where. EN docs/usermanuals/en/data/ingestion.md:111 · TR docs/usermanuals/tr/data/ingestion.md:110
    English text. alpha < 0.45 + underscore > 0.10 + >= 5 page-number matches
    Turkish text. alpha < 0.45 + underscore > 0.10 + ≥ 5 sayfa numarası
    Which is correct. Code: alpha < 0.30, leader (dot/underscore runs >=3) ratio > 0.10, >=5 page numbers; also stale in _parser.py --keep-frontmatter help.
    Proposed correction (Turkish text for the -tr page). (alfa oranı < 0.30 + nokta/alt çizgi 'leader' oranı > 0.10 + ≥ 5 satır-içi sayfa numarası → ilk ve son 12 sayfaya kadar düşür)

Done when

  • Every finding above is fixed or closed with a reason (tick it here).
  • Code fixes carry a test; doc fixes update the Turkish mirror in the same PR.

Found by the October 2026 ForgeLM code and documentation review against commit cab2947. Code links point at that commit; line numbers may have moved since. Finding IDs (CR-…, DOC-…, TECH-…) are stable references for this backlog.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationi18nEnglish/Turkish documentation mirrorseverity: mediumReal defect with limited reach or a workaroundsource: review-2026-10Found by the October 2026 code and documentation reviewwave: 3Roadmap wave 3: medium severity, module sweeps

    Type

    No type

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions