refactor(router): clarify routing prompt within token budget - #232
refactor(router): clarify routing prompt within token budget#232Light-code11 wants to merge 2 commits into
Conversation
|
Updated the router prerequisite to address the prompt-semantics concern directly.
Validation: 15 focused router/catalog tests passed, the 493-test CI-equivalent suite passed, and 242 deterministic cases produced 0 misroutes with no baseline regression. Public and Victor catalogs are approximately 5,081.5 and 5,731.5 tokens. A live OpenAI-backed eval could not be run locally because no real API key is available. |
PR reviewI reviewed the router prompt-format changes, generated tool schemas, catalog lint/budget gates, and routing evaluation behavior at commit FindingsNo blocking correctness, security, or routing-contract issues found.
Validation
The deterministic evaluation only exercises exact-match routing and therefore cannot measure how the live model interprets the changed descriptions. The live OpenAI-backed evaluation was not run because no authorized real API key was available. This is a documented residual prompt-quality risk, but I consider it non-blocking because the semantic mappings remain explicit, the schemas are unchanged, and the structural/budget gates pass. Conclusion: Safe and ready to merge. |
Summary
Do NOTguidance for exclusionsActions:andOther tools:headingsWhy
The Victor routing surface was already approximately 5,998/6,000 tokens before adding another skill. This prerequisite creates room for the Meeting Room skill without bundling a global router change into #225.
The compact prompt still tells the model what each value means:
Use:contains the skill's positive routing conditionDo NOT:contains the skill's exclusion conditionActions:maps examples to actions within the current skillOther tools:maps counterexamples to a different toolValidation
git diff --checkpassedThe live OpenAI-backed routing evaluation was not run locally because no real
OPENAI_API_KEYis available. The deterministic gate and all local suites above were run; the live command remainspython scripts/run_routing_eval.py --mode v2 --checkwhen a key is available.Companion feature: #225