Repository navigation
test: use a secret-shaped fake credential in built-in app tests - #22750
Conversation
Built-in app tests that use an AWS access key ID as their stand-in for "a credential" now use a GitLab-shaped fake token the redactor treats as a secret. No product code changes; every test passes on main before and after.
UX Review (Opus 5.5) — ⏭️ skippedRevision |
First Principles Review (Opus 5.5) — ⏭️ skippedRevision |
Design Review (Opus 5.5) — ✅ PASSDesign-level review of Design-Verdict: PASS Test-only change that swaps in a different fake input. No design-level concerns. Notes
[DESIGN-REVIEWED] 081d02d Description read[DESCRIPTION-READ] 1a5d96983946f5cda9babe5f3ecba08066592c8d45e870e033dc9e6f0cb1211f That sha256 names everything this verdict read: the PR description, plus the 1 evidence file(s) the workflow collected from it and handed this review. It covers that evidence because the media strip replaces every attachment URL with the same placeholder, so an edit swapping one attachment for another would leave the description's captured text identical while what this review judged changed. Recompute it with |
Opus 5.5 Review — ✅ no blocking findingsReviewed Verdict parsed from the review's SHA-scoped output markers for commit False positive or not applicable? A repository writer can comment: |
GPT 6.1 Review — ✅ no blocking findingsGPT 6.1 completed its review of This comment is updated in place on each push. Review detailsNo findings. False positive or not applicable? A repository writer can comment: |
KiroCrewCaptain
left a comment
There was a problem hiding this comment.
Tier 1 auto-approve: test (19 files). Criteria: no conflict, no requested changes, security path denylist clean, design-doc gate clean, security checklist all-NO, no reviewer-lane findings, readiness signal fresh for this head SHA, declared category matches the diff. Category: test files only: redaction tests swap their fake credential value for another credential-shaped string; no production code changes.
Problem / Motivation
Goal: Built-in app tests that only need "some credential" use a fake value the redactor treats as a secret, not an AWS access key ID.
About 20 built-in app test files (under
src/kiro_crew/apps/builtins/*/tests) use the AWS documentation key ID as their stand-in for a credential. The redaction design in #22552 moves key IDs to the Identifier tier, which is never redacted. Once that lands, every one of those tests would stop exercising redaction at all.Why it matters
Without this swap, the key-ID change would have to rewrite these tests in the same PR as the security change, which buries the real behaviour change under thousands of mechanical lines. Done first, the swap is reviewable on its own, and the follow-up PR carries only the tests whose expected result really changes.
Not a goal
test/andwebsite/tests, which test: use a secret-shaped fake credential in redaction tests (1/2) #22736 and test: use a secret-shaped fake credential in redaction tests (2/2) #22737 cover.What changed (motivation → approach → change)
These app tests used a key ID to mean "a credential", so a tier change for key IDs would silently empty them. Each now uses a GitLab-shaped
glpat-fake with the same 16-character body, which every redactor these apps call treats as a secret. This includes theaws_controlpackaging scan tests, whose fake now matches the scan's vendor-token rule.This completes the set started by #22736 and #22737; the three touch disjoint files and each passes on main alone.
Backwards compatibility
Compatible: only tests change; nothing a user runs is touched.
Removes nothing: every test keeps its assertion; only the fake input changes.
Tests
Every changed test passes on
origin/mainwith the swap (815 tests).No test is added, so no determinism proof applies.
Manual verification
N/A - test-only change; the suite is the verification.
Related Issues
Part of #22552
Checklist
feat|fix|docs|style|refactor|perf|test|chore|ci|build|revert: ...)