Enable end-to-end LeanCI PR review pipeline - #1
Merged
Conversation
added 13 commits
July 30, 2026 18:12
Extend the TDD §14.1 taxonomy so later review stages can fail with typed, user-visible errors.
Start the local proxy, export OPENAI_BASE_URL, run LeanCI, and always stop the proxy. Upload metrics artifacts from the composite Action.
Support compressed (Paritok proxy) and uncompressed (provider) chat completions with retries for transient failures.
Run tool-calling turns against ToolHost, repair invalid JSON once, and package prompt markdown for installable builds.
Validate raw JSON into typed Finding objects and enforce severity floor plus max_findings.
Provide model rate lookups and assumption labels used by honest review receipts.
Compute token reduction and estimated USD with honesty labels for missing baselines and weak compression.
Create or update the marked review comment with findings, receipt table, and failure-comment rendering.
Serialize the §17.1 metrics contract to leanci-metrics.json for Actions upload.
Sequence diff through publish and metrics, post failure comments on errors, and run the pipeline from python -m leanci.
Run both LLM bindings sequentially on the same manifest and compute planted-bug parity flags.
Record required PARITOK and OpenAI secrets plus the minimal PR verification steps for M3.6.
Bare paritok lacks uvicorn; install paritok[proxy] as required by the Paritok CLI.
LeanCI could not completeError class: LLMError
|
added 16 commits
July 30, 2026 18:29
Allow --openai-url so the Action can use OpenRouter (or other providers) with the existing OPENAI_API_KEY secret.
Avoid 402 Payment Required while validating the review pipeline end-to-end.
openrouter/free queued past 120s; give Paritok+upstream more room and pin gpt-oss-20b:free for CI e2e.
Use Gemini's OpenAI-compatible chat endpoint so e2e can run without OpenRouter credits.
gemini-2.0-flash has free-tier quota limit 0 on this key; flash-latest still serves.
Surface provider/Paritok 400 details in CI comments instead of only the reason phrase.
Echo extra_content.google.thought_signature so multi-turn function calls do not 400.
Honor Retry-After with a longer 429 floor and shrink CI tool/file caps so reviews fit under RPM.
Four attempts with 60–90s floors so a single review can clear the RPM window.
flash-latest (3.6) is stuck at free-tier RPM; lite has a working quota on this key.
Use llama-3.3-70b-versatile with roomier tool-turn caps so reviews can finish.
Front Paritok→Groq with a UA-bearing local hop, and finalize JSON on the last agent turn.
Switch to 8b-instant and tighter file/diff caps so the first chat request stays under 12k tokens.
Drop to 2 files and a shorter diff cap so free-tier chat requests fit.
8b fits TPM but fails tool-calling; 70b should stay under 12k tokens with 2 files.
The e2e agent finished; pricing KeyError was the only remaining hard fail.
CodewithJha
force-pushed
the
feat/e2e-review-pipeline
branch
from
July 31, 2026 07:21
c54f66d to
73eba26
Compare
CodewithJha
added a commit
that referenced
this pull request
Jul 31, 2026
Enable end-to-end LeanCI PR review pipeline
CodewithJha
added a commit
that referenced
this pull request
Aug 1, 2026
Enable end-to-end LeanCI PR review pipeline
CodewithJha
added a commit
that referenced
this pull request
Aug 1, 2026
Enable end-to-end LeanCI PR review pipeline
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
mode=dual_run).Test plan
leanci-metricsartifact uploadspytest(254 tests) green