Skip to content

fix(inspect): scope middle-out transform to OpenRouter - #415

Open
Danconnolly wants to merge 2 commits into
JackHopkins:mainfrom
Danconnolly:fix/inspect-middle-out-transform
Open

Danconnolly wants to merge 2 commits into
JackHopkins:mainfrom
Danconnolly:fix/inspect-middle-out-transform

Conversation

@Danconnolly

Copy link
Copy Markdown

Summary

  • Remove the unconditional middle-out transform from the controlled sandbox solver.
  • Resolve the configured model once per generation.
  • Apply transforms=["middle-out"] only when the model is routed through OpenRouter, matching the existing unbounded-solver behavior (see lines 591-602).

Why

middle-out is an OpenRouter-specific input-context transform. Sending it to direct or OpenAI-compatible non-OpenRouter model providers can cause unsupported-parameter failures.

Testing

  • uv run python -m compileall -q fle/eval/inspect/sandbox/sandbox_solver.py
  • git diff --check

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant