Skip to content

Publish reproducible chart-to-CSV fixtures before restoring accuracy claims #20

Description

@kiku-jw

Goal

Create a reproducible proof path for Chart2CSV extraction quality before publishing accuracy, speed, or comparison claims.

Required artifact

For each supported chart category (line, bar, scatter):

  • source image with provenance;
  • expected ground-truth CSV;
  • actual extracted CSV;
  • model/path name and exact version;
  • run date and command or request;
  • comparison method and mismatch report;
  • clear distinction between browser Mistral extraction and local CV/Tesseract extraction.

Acceptance

  • fixtures and expected outputs are checked into the repository;
  • one repeatable command or test produces the actual outputs;
  • results are dated and do not generalize beyond the tested fixture set;
  • public README/site links to the artifact instead of claiming an unsupported universal accuracy percentage;
  • any performance measurement records hardware, network/model latency boundary, and sample count.

The current site baseline intentionally labels the project Alpha and removes unsupported 90%+, fastest, competitor, and pricing claims until this evidence exists.

Tracked from kiku-jw/kikuai-project-map#13.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions