Skip to content

docs(testing): describe the test strategy without publishing it - #65

Merged
hhimanshu merged 1 commit into
mainfrom
feat/64-generic-test-strategy
Aug 5, 2026
Merged

docs(testing): describe the test strategy without publishing it#65
hhimanshu merged 1 commit into
mainfrom
feat/64-generic-test-strategy

Conversation

@hhimanshu

@hhimanshu hhimanshu commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Closes #64.

The page documented the conformance harness in enough detail to be a build guide — the capture mechanism and the tool behind it, exact fixture paths, the internal test-macro name, a pipeline diagram, and the file naming for known differences.

None of that helps a reader decide whether to trust the engine, and all of it is reusable by anyone wanting to build the same thing. The corpus is the hard part and the durable advantage; the page should carry the confidence without handing over the recipe.

Kept — these are the actual reasons to trust it, and they're arguments, not instructions:

  • Reference values come from Google Sheets itself, not from a specification and not from our own output
  • Why that matters: an engine checked against itself can only ever agree with itself
  • Enforced vs tracked categories, and how to read them
  • Known differences stay in the total rather than being removed — a conformance number that excludes its own failures isn't evidence
  • Reference integrity: values are never hand-edited, and reference data never travels with an engine change

Removed — the capture tooling and pipeline wiring, exact fixture paths, internal test-macro names, the diagram, and the internal naming for the known-differences set.

Net effect: shorter, and it now reads as why this is trustworthy rather than how to rebuild it.

The same edit has been applied to the corresponding section of the marketing site (truecalc/website#2), so the two stay consistent.

🤖 Generated with Claude Code


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

The page documented the conformance harness in enough detail to be a
build guide: the capture mechanism and the tool behind it, exact fixture
paths, the internal test-macro name, a pipeline diagram, and the file
naming for known differences.

None of that helps a reader decide whether to trust the engine, and all
of it is reusable by anyone wanting to build the same thing. The corpus
is the hard part and the durable advantage; the page should carry the
confidence without handing over the recipe.

Kept, because they are the reasons to trust it: reference values come
from Google Sheets itself rather than from a specification or from our
own output; an engine checked against itself only ever agrees with
itself; enforced vs tracked categories; known differences stay in the
total rather than being removed; values are never hand-edited and
reference data never travels with an engine change.

Closes #64

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@hhimanshu hhimanshu self-assigned this Aug 5, 2026
@hhimanshu
hhimanshu merged commit afd26cd into main Aug 5, 2026
2 checks passed
@hhimanshu
hhimanshu deleted the feat/64-generic-test-strategy branch August 5, 2026 19:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make the test-strategy page generic

1 participant