Add Radius skills plugin and Claude Code eval CI - #42
Conversation
|
b9ebff7 to
1e5d6b0
Compare
| }, | ||
| "metadata": { | ||
| "version": "0.0.3", | ||
| "description": "Claude Code plugins from Radius Technology Systems for AI-assisted blockchain development on the Radius Network" |
There was a problem hiding this comment.
Note: I did not rework any existing language. May be a follow up the next gen gets built out.
| env: | ||
| CLAUDE_EVAL_PROVIDER: ${{ vars.CLAUDE_EVAL_PROVIDER }} | ||
| CLAUDE_EVAL_MODEL: ${{ vars.CLAUDE_EVAL_MODEL }} | ||
| CLAUDE_EVAL_JUDGE_MODEL: ${{ vars.CLAUDE_EVAL_JUDGE_MODEL }} |
There was a problem hiding this comment.
@kylecrawshaw heads up I will be setting variables and secrets into this repo for auto plugin evals whenever plugins get modified.
|
Is the goal to move all skills to this repo and sunset the existing radius skills repo? |
Yes, that's idea. I discussed it with Adam and Tyler and they are in agreement. What do you think? |
1e5d6b0 to
5ea598a
Compare
|
|
||
| ```text | ||
| /plugin marketplace add https://github.com/radiustechsystems/radius-cli.git | ||
| /plugin install radius-dev@radius-cli |
There was a problem hiding this comment.
I think we can work on the naming here.
|
Eval report |
kylecrawshaw
left a comment
kylecrawshaw
left a comment
There was a problem hiding this comment.
This looks great. I'm sure we'll want to make changes, but I'm comfortable merging this change as is for now
2 participants
Summary
evaluateskill, into the radius-cli monorepo outside npm packages.Validation
python3 scripts/validate_plugin.py— 4 skills, 17 scenario fixtures, 3 Claude eval cases passed.claude plugin validate plugins/radius— passed.git diff --check origin/main...HEAD— passed.CI configuration
Set
ANTHROPIC_API_KEY, or setOPENROUTER_API_KEYplusCLAUDE_EVAL_PROVIDER=openrouter. For OpenRouter also setCLAUDE_EVAL_MODELandCLAUDE_EVAL_JUDGE_MODELto provider-supported IDs. The workflow uses a 10 USD list-price ceiling and does not grant Bash or payment tools to eval cases.No changeset is needed because
packages/*is unchanged.