Skip to content

feat(gate): triage verified hosted fetchers - #12

Merged
madars merged 4 commits into
mainfrom
codex/hosted-fetchers
Aug 31, 2026
Merged

madars merged 4 commits into
mainfrom
codex/hosted-fetchers

Conversation

@madars

@madars madars commented Aug 28, 2026 •

Copy link
Copy Markdown
Member

Classifies source-verified vendor-hosted fetchers separately from command-line agents: Claude-User/, ChatGPT-User/, and Google-Agent; are matched with their advertised case-sensitive spelling and the same product-token boundaries as crawler identities, then authenticated against embedded vendor ranges. Claude Code is explicitly excluded even if a future UA also contains Claude-User/.

Release policy, confirmed by the project owner: allow_hosted_fetchers defaults true, so verified hosted fetchers pass through even on paid routes because they can complete neither PoW nor x402. Setting it false produces a strict 403 rather than an unusable payment offer. Unverified claims always fail closed. Like crawler claims, an unresolvable client address warns once and follows the ordinary ladder. This authenticates vendor infrastructure, not a user.

The machine-readable feeds are refreshed by the updater. Anthropic’s stable outbound /21 has no feed and is explicitly documented as manually reviewed against its source page.

Stacked on #11. Verification: make check; official Go 1.22 suite; Go stable formatter.

@madars
madars force-pushed the codex/machine-identity-stage branch from fb82281 to 292a477 Compare August 29, 2026 00:32
@madars
madars force-pushed the codex/hosted-fetchers branch from ecc3755 to 4dcf319 Compare August 29, 2026 00:32
@madars
madars force-pushed the codex/machine-identity-stage branch from 292a477 to 8795da4 Compare August 29, 2026 00:45
@madars
madars force-pushed the codex/hosted-fetchers branch from 4dcf319 to 0cd603c Compare August 29, 2026 00:46
@madars
madars force-pushed the codex/machine-identity-stage branch from 8795da4 to be92359 Compare August 29, 2026 00:52
@madars
madars force-pushed the codex/hosted-fetchers branch from 0cd603c to 70c7f3f Compare August 29, 2026 00:52

@anders94 anders94 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm guessing reversing the IP and then reversing that doesn't wprk for claude bot? (and maybe others?)

Base automatically changed from codex/machine-identity-stage to codex/verified-crawlers August 30, 2026 00:55
kylecrawshaw
kylecrawshaw previously approved these changes Aug 31, 2026
Base automatically changed from codex/verified-crawlers to main August 31, 2026 18:34
@kylecrawshaw
kylecrawshaw dismissed their stale review August 31, 2026 18:34

The base branch was changed.

madars and others added 4 commits August 31, 2026 14:49
…d source ranges

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…ody_agents 200

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…402 (allow_hosted_fetchers, default on)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… hosted vendor feeds

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@madars
madars force-pushed the codex/hosted-fetchers branch from c93164b to fc1954c Compare August 31, 2026 18:50
@madars
madars merged commit 93e847b into main Aug 31, 2026
5 checks passed
@madars
madars deleted the codex/hosted-fetchers branch August 31, 2026 18:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants