Skip to content

Reduce MCP prompt weight and make LLM config engine-agnostic - #14

Merged
vitorcastro78 merged 2 commits into
mainfrom
mcp-context-budget
Sep 20, 2026
Merged

vitorcastro78 merged 2 commits into
mainfrom
mcp-context-budget

Conversation

@vitorcastro78

Copy link
Copy Markdown
Collaborator

Summary

  • Cap MCP tools per turn and prefer lazy tool discovery so any tenant (not just light demos) stays within context budgets.
  • Add host LlmEndpoint (with OllamaEndpoint fallback) and rewrite README/self-host Quickstart as BYO OpenAI-compatible engines for HN.
  • Document Show HN blurb and stop implying the gateway is Ollama-only.

Test plan

  • dotnet test on Api.Tests
  • Admin Settings health shows defaultLlmEndpoint
  • Agentic chat with a high-MCP app stays under num_ctx / does not dump the full catalog
  • Docker network stack rebuild + /health 200

Clamp maxMcpToolsPerTurn at 12, keep MCP out of the first-hop catalog until tool_search/tool_describe pin, and cap wiki inject to ~75% of num_ctx.
@vitorcastro78
vitorcastro78 merged commit a1baf68 into main Sep 20, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants