Skip to content

good-dog demo: corpus expansion (54→62) + reproducible pipeline + LadybugDB graph-sins - #54

Merged
M0nkeyFl0wer merged 5 commits into
mainfrom
good-dog-group-c-e
Jun 21, 2026
Merged

M0nkeyFl0wer merged 5 commits into
mainfrom
good-dog-group-c-e

Conversation

@M0nkeyFl0wer

@M0nkeyFl0wer M0nkeyFl0wer commented Jun 19, 2026 •

Copy link
Copy Markdown
Owner

Shareable good-dog graph-demo package.

1. Corpus expansion — Group C + E (54 → 62 notes)

Completes the expansion manifest (A/B/D already in v0.3).

  • Group C (Cat 7): AVMA breed-bite review, AAFCO nutrient profiles, Ostrander/Parker genomics (23 clades), WSAVA nutritional assessment.
  • Group E: FDA xylitol aliases (Cat 4), UK Dangerous Dogs Act + XL Bully (Cat 6), Danish-Swedish Farmdog 202nd AKC breed (Cat 6/5, closes the FSS pipeline), WTTW Chicago shelter (Cat 2c/1).
  • +16 ground-truth questions (50→66; Cat 7 2→6). validate.py OK; 619 passing.
  • 7/8 substring-verified live (PDFs via pdftotext fallback); E4/WTTW Cloudflare-blocked → manifest-facts, flagged for re-verify.

2. Reproducible graph pipeline (tools/good-dog-graph-pipeline/)

The subagent-swarm build harness, committed out of /tmp: 8 stage scripts + 5 Workflow scripts (extract → resolve → recover → recall → author-sources) + ontology adapter + the self-contained 62-note viz + a README. Extraction is a Claude subagent swarm (not a local model); embeddings stay local; writes use LadybugDB reconstruct-and-swap.

3. Public LadybugDB graph-sins (docs/ladybug-graph-sins.md)

Operational corruption/crash findings + safe primitives, stripped of machine/project specifics. Headlines the 0.17.1 incremental-REL-write corruption repro for the LadybugDB maintainers.

Result

62 notes → 579 entities / 533 edges, 86% edge-recall (405/469) vs ground truth, 0 fabricated edges, largest connected component 289 nodes.

web-flow added 2 commits June 19, 2026 10:12
…entary)

Group C (Cat 7 token/cost stress, dense docs): AVMA breed-bite literature review,
AAFCO nutrient-profile revisions, Ostrander/Parker dog-breed genomics clades, WSAVA
nutritional assessment guidelines. Group E (supplementary): FDA xylitol aliases (Cat 4),
UK Dangerous Dogs Act + XL Bully (Cat 6), Danish-Swedish Farmdog 202nd AKC breed
(Cat 6/5, closes the FSS pipeline), WTTW Chicago shelter overcrowding (Cat 2c/1).

Corpus 54 -> 62 notes; +16 ground-truth questions (50 -> 66). validate.py OK,
619 passing. 7/8 substring-verified live (PDFs via pdftotext fallback); E4 (WTTW)
authored from manifest-verified facts only — live source is Cloudflare-blocked,
flagged for re-verification.
…sins

Commits the subagent-swarm graph-build pipeline out of /tmp into the repo so the
good-dog demo graph is reproducible and preserved:
- tools/good-dog-graph-pipeline/: 8 stage scripts + 5 Workflow scripts (extract /
  resolve / recover / recall / author-sources) + ontology adapter + the
  self-contained 62-note viz + a README documenting the flow, deps (LadybugDB
  0.17.1, Ollama, Claude Workflow) and the two-layer ground-truth design.
- docs/ladybug-graph-sins.md: public-facing LadybugDB operational findings,
  stripped of machine/project specifics; headlines the 0.17.1 incremental-REL
  -write corruption repro for the maintainers.
- pyproject: exclude the reference build scripts from ruff (terse one-offs, not
  maintained library code).

Pipeline result: 62 notes -> 579 entities / 533 edges, ~87% edge-recall vs
ground truth, 0 fabricated edges, largest connected component 289 nodes.
@M0nkeyFl0wer M0nkeyFl0wer changed the title good-dog: Group C+E expansion — 8 sources (54→62 notes, Cat 7 + supplementary) good-dog demo: corpus expansion (54→62) + reproducible pipeline + LadybugDB graph-sins Jun 19, 2026
web-flow added 3 commits June 19, 2026 15:18
- all_rights_reserved (davemech Mech-1970 note) -> fair_use_excerpt: the note
  short-excerpts a copyrighted source for the contradiction pair (its license_note
  already states fair-use rationale); matches the convention of the other 28
  fair-use-excerpt notes.
- cc_by_4_0 -> cc_by_4.0 (formatting dup); fair_use / fair_use_research ->
  fair_use_excerpt (unify the fair-use family); strip stray quotes/whitespace.
- Left distinct licenses intact: public_domain, cc_by_sa, cc_by_nc_4.0,
  open_government_license_*, and 'other' (proprietary web pages, honest catch-all).
The WTTW Chicago shelter article was confirmed live in a human browser
2026-06-19 (page title matches source_title), establishing the URL resolves to
the correct article. The page stays behind Cloudflare for automated fetchers
(403, no archive.org snapshot), so exact on-page strings aren't machine-matched;
the 265% / 2,455 figures trace to the fact-checked source manifest. Updated the
note's provenance paragraph accordingly.
…tion

Opens with the title + one-line tagline + Contents so the substance ('What this
is') comes first; the Fifth Element image and the Multipass/MemPalace origin
blockquote move to the bottom.
@M0nkeyFl0wer
M0nkeyFl0wer merged commit f9fd791 into main Jun 21, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants