Skip to content

Make required readiness checks fail when unverified - #79

Open
starmorph wants to merge 1 commit into
render-examples:mainfrom
starmorph:codex/honest-readiness
Open

starmorph wants to merge 1 commit into
render-examples:mainfrom
starmorph:codex/honest-readiness

Conversation

@starmorph

Copy link
Copy Markdown
Contributor

Doctor could exit successfully with zero registered tasks, an unavailable task API, or missing effective installation grants. A successful JSON null task response also crashed the check. Separately, GitHub setup treated an old failed delivery attempt as proof that the webhook was delivering, even while inactive.

Required task checks now fail when registration is missing, incomplete, unavailable, or invalid. Zod validates external task responses and webhook delivery metadata without printing raw payloads. Missing installation permissions/events also fail readiness. The gateway's intentional no-App-credentials skip remains supported.

Webhook setup now states that configuration succeeded while activation/delivery remains unverified. Doctor checks the documented delivery-detail URL against the configured gateway and requires a successful response, with instructions to activate/save and redeliver a ping when needed. It reports the observed delivery rather than claiming the App is currently active, and imposes no arbitrary age cutoff. Runbook and operational guidance match that behavior.

Users and automation can now treat failed or unavailable required checks as blockers, rather than mistaking a zero exit for verified readiness.

Validation: npm run check passed — 26 files, 191 tests. Added fake-backed coverage for null/malformed/non-array task payloads, unavailable/rejected APIs, zero/partial/complete tasks, missing grants, expected gateway skips, and missing/failed/mismatched webhook delivery metadata. No deployed resources or live credentials were changed.

Fixes #75.

Validate Render task responses, fail incomplete registration and installation grants, and distinguish webhook configuration from proven delivery. Require delivery metadata for the configured target without claiming current activation.

Fixes render-examples#75

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

[P1] Make doctor and webhook setup report verified readiness accurately

1 participant