Add progress indicator to oaeval audit command#197
Merged
himanshu231204 merged 6 commits intoJul 21, 2026
Conversation
…/model download requirements
… mock BERTScore in unit tests
…h progress callback parameter
|
🎉 Congratulations @PrinceThummar011! Your pull request has been successfully merged into main. 🚀 Thank you for contributing to OpenAgentHQ and helping improve the project. We truly appreciate your contribution and hope to see you back with more amazing PRs! Happy Open Sourcing! ❤️ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a progress indicator to the
oaeval auditcommand usingrich.progress, consistent with the existing pattern inrun.py. Users now see which corpus check is currently executing instead of an unresponsive terminal during long-running audits.Changes
openagent_eval/corpus/auditor.py— Introduced an optionalprogress_callbackparameter onCorpusAuditor.audit(). The callback is invoked at three points: before document scanning begins, when each configured analyzer starts, and upon audit completion.openagent_eval/cli/commands/audit.py— Integrated arich.progress.Progresscontext in the CLI command and connected it to the new callback to update the task description and progress bar in real time.tests/unit/test_cli/test_cli_improvements.py— AddedTestAuditCommand, covering help text, invalid-path error handling, and verification that the progress callback fires correctly via mocking.Design Notes
CorpusAuditor, keeping the auditor UI-agnostic and reusable outside the CLI context.run.pyfor consistency across commands.Testing
tests/unit/test_metrics/test_generation.py::TestSemanticSimilarityfailed during a full run; confirmed unrelated to this change and pre-existing onmain.Closes #123