Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/conformance-probes.yml
Original file line number Diff line number Diff line change
Expand Up @@ -194,10 +194,10 @@ jobs:
matrix:
include:
- os: ubuntu-22.04
claude-version: "2.1.280"
claude-version: "2.1.296"
probe-tmpdir: /dev/shm/pytest-probes
- os: macos-14
claude-version: "2.1.280"
claude-version: "2.1.296"
probe-tmpdir: /tmp/pytest-probes
env:
CLAUDE_CODE_SMOKE_TEST: "1"
Expand Down
1 change: 1 addition & 0 deletions docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,4 +37,5 @@ multi-level orchestrator. The bundled recipes implement issue → plan → workt
- [audit/surface-freeze-checklist.md](audit/surface-freeze-checklist.md) — commands.py public import surface freeze checklist
- [verification/review-pr-immunity.md](verification/review-pr-immunity.md) — deterministic review-pr projection matrix and live provider-attempt record
- [verification/child-terminal-reasons-4623.md](verification/child-terminal-reasons-4623.md) — child-terminal-reason taxonomy implementation and test-coverage verification record
- [verification/model-pins-5276.md](verification/model-pins-5276.md) — Claude 5.5 model pins and the Claude Code 2.1.296 floor: launch, effort, canary and resume record
- [phoropter/](phoropter/README.md) — phoropter lens framework: execution contracts, recipe blocks, synthesis strategies, and authoring guide
38 changes: 28 additions & 10 deletions docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ test_check:
command: ["task", "test-check"]

model:
default: "claude-sonnet-5"
default: "claude-sonnet-5-5"

worktree_setup:
command: ["task", "install-worktree"]
Expand Down Expand Up @@ -70,7 +70,7 @@ AutoSkillit uses [dynaconf](https://www.dynaconf.com/) for configuration. Enviro

```bash
AUTOSKILLIT_TEST_CHECK__TIMEOUT=300 # sets test_check.timeout to 300
AUTOSKILLIT_MODEL__DEFAULT=claude-sonnet-5 # sets model.default
AUTOSKILLIT_MODEL__DEFAULT=claude-sonnet-5-5 # sets model.default
AUTOSKILLIT_QUOTA_GUARD__ENABLED=false # disables quota guard
```

Expand Down Expand Up @@ -102,13 +102,31 @@ model:

Recipe steps can also specify a `model` field per-step in their YAML definition.

The logical `opus` class resolves to the canonical `claude-opus-5-5` model ID by
default. Projects that route Claude through a provider whose deployment does
not accept that raw ID (Amazon Bedrock, Microsoft Foundry, or a custom
gateway) should supply the provider's own accepted deployment/model
identifier via a `providers.profiles` entry and a matching `step_overrides` /
`recipe_overrides` / `model_overrides` binding — those overrides are resolved
before this alias and always take precedence.
AutoSkillit pins the model classes to canonical Anthropic IDs: `sonnet` resolves to
`claude-sonnet-5-5`, `opus` to `claude-opus-5-5`, and `haiku` to `claude-haiku-5-5`.
Claude Code's own aliases can select older versions on Claude Platform on AWS,
Amazon Bedrock, Google Cloud's Agent Platform (Vertex AI), and Microsoft Foundry.
The supported minimum is Claude Code 2.1.296: interactive launches below it fail,
and `autoskillit doctor` warns.

[Claude Code's model configuration](https://code.claude.com/docs/en/model-config)
describes provider mapping. On Amazon Bedrock and Google Cloud's Agent Platform,
Claude Code maps an Anthropic ID passed with `--model` to the provider's ID when
that provider serves the version. For a different deployment name, its
`modelOverrides` setting maps each Anthropic ID to a Microsoft Foundry deployment,
Bedrock inference profile ARN, or custom gateway model name. This applies to every
`--model` AutoSkillit passes, including triage.

AutoSkillit can select a step's model through `model.step_overrides`,
`model.recipe_overrides`, or `providers.model_overrides`. Values can be literal IDs
or names in `providers.profiles`; profiles resolve only with the experimental
`providers` feature enabled. See [Model precedence](#model-precedence):
`model.override` outranks these sources, and each ladder ignores the other's sources.

Contract-staleness triage always uses the `haiku` class ID and ignores AutoSkillit's
model overrides. The pre-launch version check does not cover triage. If the provider
rejects the ID without a matching `modelOverrides` entry, or `claude` on `PATH` is
older than 2.1.296, triage treats every changed skill as meaningful.

### Operator escape hatches

Expand Down Expand Up @@ -548,7 +566,7 @@ test_check:
command: ["pytest", "-v", "--tb=short"]

model:
default: "claude-sonnet-5"
default: "claude-sonnet-5-5"

worktree_setup:
command: ["task", "install-worktree"]
Expand Down
2 changes: 1 addition & 1 deletion docs/design/acp-session-contract.md
Original file line number Diff line number Diff line change
Expand Up @@ -374,7 +374,7 @@ future use and have no current production consumer outside the exemption set.
| `required_session_files` | Session directory contract enforcement (Codex: `frozenset({"config.toml"})`; Claude: `frozenset()`) |
| `session_dir_symlinks` | Session directory layout (Codex: `frozenset({"sessions", "archived_sessions"})`; Claude: `frozenset()`) |
| `patch_format` | Write-guard path extraction (Claude: `"unified_diff"`; Codex: `"codex_star_update"`) |
| `min_version` | Version validation in doctor (Codex: `"0.156.1"`; Claude: `"2.1.280"`) |
| `min_version` | Version validation in doctor (Codex: `"0.156.1"`; Claude: `"2.1.296"`) |
| `mcp_env_forward_vars` | MCP env forwarding (Codex: `CODEX_MCP_ENV_FORWARD_VARS = AUTOSKILLIT_PRIVATE_ENV_VARS - CODEX_MCP_ENV_SERVER_EXCLUDED_VARS`; Claude Code inherits the full environment and declares `frozenset()`). MCP registration forwards each listed variable present in the agent process; the Codex MCP server env and builder coverage architecture tests enforce the contract. |
| `github_api_callable` | Future network-capability gate for outbound GitHub API writes |

Expand Down
30 changes: 15 additions & 15 deletions docs/design/forward-obligations/triage-portability-impact.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,52 +14,52 @@ an LLM subprocess.

## Current State

- `ClaudeCodeBackend`: `triage_capable=True` (set in `CLAUDE_CODE_CAPABILITIES`,
`_type_backend.py:229`). Uses a `claude -p` subprocess with Haiku model.
- `CodexBackend`: `triage_capable=False` (`codex.py:559`). Triage is skipped entirely.
- `ClaudeCodeBackend`: `triage_capable=True` (set in `CLAUDE_CODE_CAPABILITIES`). Uses
a `claude -p` subprocess with the `haiku` model class resolved through
`backend.translate_model("haiku")` (`claude-haiku-5-5`).
- `CodexBackend`: `triage_capable=False` (set in `CodexBackend.capabilities`). Triage is skipped entirely.

## Contract Gaps

`_triage_batch()` (`_llm_triage.py:80`) constructs the triage command at lines 123–131:
`_triage_batch()` constructs the triage command directly:

```python
triage_cmd: list[str] = [
backend.binary_name(),
ClaudeFlags.PRINT,
prompt,
ClaudeFlags.MODEL,
"claude-haiku-4-5-20251001",
backend.translate_model("haiku"),
ClaudeFlags.OUTPUT_FORMAT,
fmt.value,
]
```

The command uses `backend.binary_name()` (not a hardcoded `"claude"` literal) but depends on
`ClaudeFlags` constants (`PRINT`, `MODEL`, `OUTPUT_FORMAT`) which are Claude-CLI-specific.
The model `"claude-haiku-4-5-20251001"` is hardcoded. Portability to a non-Claude backend
requires either:
The backend owns the model ID. Portability to a non-Claude backend still requires either:

- A backend-agnostic `triage_cmd()` protocol method on `CodingAgentBackend`, or
- A dedicated lightweight triage backend decoupled from the coding-agent backend.

## Required Steps for Portable Triage

1. Add an optional `triage_cmd(prompt: str, model: str) -> list[str]` method to
`CodingAgentBackend` (or add a `BackendCapabilities.triage_model` field).
`CodingAgentBackend`.
2. Update `_triage_batch` to call `backend.triage_cmd()` instead of constructing the
command inline with `ClaudeFlags`.
3. Gate on `triage_capable` (already done at `_llm_triage.py:107`).
3. Gate on `triage_capable` (already done in `_triage_batch`).

## Blast Radius

`_llm_triage.py` is a standalone module at the package root. Changes are isolated and do not
touch `BackendCapabilities` layout or the sub-protocol set. The `triage_capable` field on
`BackendCapabilities` (`_type_backend.py:86`) already has production consumers (the guard at
`_llm_triage.py:107`), so no `_FORWARD_DECLARED` exemption is needed.
`BackendCapabilities` already has a production consumer in `_triage_batch`, so no
`_FORWARD_DECLARED` exemption is needed.

## Key References

- `_llm_triage.py:33` — `triage_staleness()` entry point
- `_llm_triage.py:80` — `_triage_batch()` with command construction
- `_llm_triage.py:107` — `triage_capable` guard
- `core/types/execution/_type_backend.py:86` — `triage_capable` field definition
- `triage_staleness()` — entry point in `_llm_triage.py`
- `_triage_batch()` — command construction in `_llm_triage.py`
- `_triage_batch()`'s `triage_capable` guard — backend admission in `_llm_triage.py`
- `BackendCapabilities.triage_capable` — field definition in `core/types/execution/_type_backend.py`
6 changes: 3 additions & 3 deletions docs/execution/claude-startup-readiness.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ Claude interactive launches seal these values after caller environment overlays:
|---|---:|---|
| `MCP_CONNECTION_NONBLOCKING` | `0` | Ask Claude to wait for the connection batch |
| `MCP_CONNECT_TIMEOUT_MS` | `30000` | Bound the connection batch and tool-list snapshot |
| minimum Claude Code version | `2.1.280` | [Anthropic's 2.1.280 release](https://github.com/anthropics/claude-code/releases/tag/v2.1.280) adds Claude Opus 5.5, the pinned `opus` target |
| minimum Claude Code version | `2.1.296` | The lowest release that serves every pinned model: 2.1.280 adds Opus 5.5, 2.1.284 Sonnet 5.5 and 2.1.293 Haiku 5.5 ([model configuration](https://code.claude.com/docs/en/model-config)), and [2.1.296](https://github.com/anthropics/claude-code/releases/tag/v2.1.296) fixes Haiku 5.5 token counts behind gateways |
| fresh prompt attempts | `3` | Defense-in-depth dispatch cap after a pre-dispatch failure |

`MCP_CONNECT_TIMEOUT_MS` is the connection batch/list-snapshot deadline. It is
Expand Down Expand Up @@ -73,8 +73,8 @@ The weekly `conformance-probes.yml` workflow runs these pinned rows:

| Platform | Claude Code |
|---|---|
| Ubuntu 22.04 | 2.1.280 |
| macOS 14 | 2.1.280 |
| Ubuntu 22.04 | 2.1.296 |
| macOS 14 | 2.1.296 |

Each row installs the named version, exports its canonical path as
`CLAUDE_CODE_EXECPATH`, and runs the exact restricted interactive surface with
Expand Down
3 changes: 2 additions & 1 deletion docs/skills/overrides.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,8 @@ When an override is rejected, every AutoSkillit-mediated surface — `run_skill`
`/autoskillit:<name>`, and the session add-dir — falls back to serving the bundled twin.
Claude Code, however, still discovers the project's `.claude/skills/<name>` directory
natively as `/<name>`, independent of AutoSkillit's own admission decision. Claude Code
2.1.280 was observed to prefer that native copy over a same-named add-dir copy. This is
2.1.280, an earlier AutoSkillit support floor, was observed to prefer that native copy over a
same-named add-dir copy; the observation has not been repeated on later releases. This is
observed behavior, not a documented contract, and it was verified for Claude Code only.

An admitted override is also published into the add-dir, so both the native
Expand Down
Loading
Loading