Skip to content

content-quality P0+P1: strip LLM enrichment tail + integrity leaks (61/61 pass) - #1

Draft
zepedara wants to merge 1 commit into
mainfrom
audit/content-quality-p0-p1
Draft

content-quality P0+P1: strip LLM enrichment tail + integrity leaks (61/61 pass)#1
zepedara wants to merge 1 commit into
mainfrom
audit/content-quality-p0-p1

Conversation

@zepedara

Copy link
Copy Markdown
Collaborator

What this is

Executes P0 + P1 of the content-quality audit (docs/CONTENT_QUALITY_AUDIT.md, added in this PR). The audit read all 61 modules and found the core teaching is solid but the machine-generated "enrichment" tail (40% of all content) is the source of nearly every defect — fabricated CLI flags, mislabeled ATT&CK IDs, duplicated blocks, and leaked generator scaffolding.

Changes

P0 — integrity

  • Removed 9 leaked LLM planning-scratchpad blocks shipped into public READMEs
  • Removed the ANTHROPIC_MAGIC_STRING_TRIGGER_REFUSAL_ canary rule (module 42)
  • Stripped <!-- cyberlab-enriched --> markers + trailing bare-URL dumps from all 61
  • Rewrote module 23's guided walkthrough (was 100% scratchpad) and regrounded its answer key to the shipped bodyfile
  • Fixed leaked meta-text (07) and malformed Sources links (09, 31)

P1 — de-bloat

  • Deleted the generated enrichment tail under ## MITRE ATT&CK & DFIR phase across all 61 modules (~11,000 lines, ~40% of the lab)
  • Preserved the 5 hand-authored Detection-validation blocks (21,34,47,50,58) and 54's accurate scdbg flag table

Validation

  • Contract validator: 61/61 pass, mean 1.0000, INDEX in sync
  • All code fences balanced; all 12 required sections intact in every module

Not in this PR (deferred, see report)

  • P2 — replace the shared byte-identical stand-in artifacts with real per-module files and regenerate every answer key from actual bytes
  • P3 — the 14 in-core enrichment subsections still in 6 modules (04,09,35,51,54,61), and module consolidation (.NET 14+29, shellcode 17+31, capstones 47/48/49)

Draft for review — nothing merged to main.

🤖 Generated with Claude Code

…1/61 pass)

Acts on the findings in docs/CONTENT_QUALITY_AUDIT.md. Removes the machine-
generated "enrichment" the audit found to be the source of nearly every content
defect, while preserving all hand-written module cores and the 5 verified
Detection-validation blocks.

P0 (integrity, public repo):
- remove 9 leaked LLM planning-scratchpad blocks from shipped READMEs
  (02,07,08,10,23,40,45,53,55)
- remove the ANTHROPIC refusal-test canary YARA rule (42)
- strip every module's <!-- cyberlab-enriched --> markers + trailing bare-URL dumps
- rewrite 23-plaso guided walkthrough (was 100% leaked scratchpad) and reground its
  answer key to the shipped bodyfile (earliest crtime Tue Nov 14 2023 22:13:20 /etc/passwd)
- fix leaked meta-reasoning (07) and malformed Sources links (09, 31)

P1 (de-bloat):
- delete the generated enrichment tail (Essential Commands & Features / Threat
  Hunting / Detection Signatures / Adversary Emulation / Common Pitfalls /
  Real-World Case Study) under '## MITRE ATT&CK & DFIR phase' across all 61 modules
- ~11,000 lines removed (~40% of the lab); the fabricated CLI flags, mislabeled
  ATT&CK IDs, and duplicated blocks are removed with it
- PRESERVE the 5 hand-authored, artifact-grounded Detection-validation blocks
  (21,34,47,50,58) and 54's accurate scdbg flag table

Contract validator: 61/61 pass, mean 1.0000, INDEX in sync.

Deferred (tracked in the report): P2 real per-module artifacts + answer-key
regrounding; P3 the 14 in-core enrichment subsections in 6 modules
(04,09,35,51,54,61) and module consolidation.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01RnkkeCESM5VSNobfg2MdkJ
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant