Skip to content

Commit 9b3869f

Browse files
tfensterCopilot
andauthored
add note about repackaging (#24366)
<!--Delete sections as needed --> ## Description Added a note about repackaging to increase context as discussed with @brandonh6k in #24243 ## Related issues or tickets #24243 ## Reviews <!-- Notes for reviewers here --> <!-- List applicable reviews (optionally @tag reviewers) --> - [ ] Technical review - [ ] Editorial review - [ ] Product review --------- Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
1 parent 3c79e7c commit 9b3869f

1 file changed

Lines changed: 12 additions & 0 deletions

File tree

content/manuals/ai/model-runner/ide-integrations.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,18 @@ Before configuring any tool:
2525
$ docker model pull ai/qwen2.5-coder
2626
```
2727

28+
> [!TIP]
29+
>
30+
> The default context size for many models (such as `gpt-oss`) is 4,096 tokens, which is limiting for coding tasks.
31+
> You can repackage it with a larger context window:
32+
>
33+
> ```console
34+
> $ docker model pull gpt-oss
35+
> $ docker model package --from ai/gpt-oss --context-size 32000 gpt-oss:32k
36+
> ```
37+
> Alternatively, models like ai/glm-4.7-flash, ai/qwen2.5-coder, and ai/devstral-small-2
38+
> come with 128K context by default and work without repackaging.
39+
2840
## Cline (VS Code)
2941
3042
[Cline](https://github.com/cline/cline) is an AI coding assistant for VS Code.

0 commit comments

Comments
 (0)