Skip to content

Numerical-claims guard does not check the stated test-module count outside README #958

Open

Description

@cemililik

Found while verifying #954, which added a test module and updated the stated count by hand in five places.

What happens

The numerical-claims guard's test-module rule (tools/check_doc_numerical_claims.py, scope toplevel) reads only README.md, by design: docs/roadmap/ records per-wave figures that must not be rewritten to the current total. The surfaces that state the current count are not checked at all:

  • CLAUDE.md and AGENTS.md (tests/ # 130 test modules)
  • CONTRIBUTING.md (130 test files)
  • docs/reference/architecture.md and architecture-tr.md (130 test modules, 130 test modülü)

On #954's head, setting all five to 999 still prints OK: every numerical doc claim matches canonical scrapes.

Acceptance criteria

  • The test-module rule also covers the current-inventory surfaces (the module_inventory scope plus CONTRIBUTING.md), including the test files and Turkish test modülü phrasings, while docs/roadmap/ stays exempt.
  • A test sets each of those counts wrong and expects a finding.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: dev-toolingCode area: dev-toolingbugSomething isn't workingseverity: lowMinor defect, inaccuracy or rough edge

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions