Skip to content

commit for plugin#3

Merged
CodeArtsAgent merged 2 commits into
mainfrom
feat-skill-installer
Jul 18, 2026
Merged

commit for plugin#3
CodeArtsAgent merged 2 commits into
mainfrom
feat-skill-installer

Conversation

@CodeArtsAgent

@CodeArtsAgent CodeArtsAgent commented Jul 9, 2026

Copy link
Copy Markdown
Owner

Summary by CodeRabbit

  • New Features
    • Added a local evaluation toolchain bootstrapper (macOS) plus a dependency readiness preflight check.
    • Added automated backend/frontend port detection and improved Playwright-based visual capture after admin login.
    • Introduced standardized round templates and shared HTTP/UI testing utilities.
    • Added new JavaScript SAST checks for common security issues.
  • Documentation
    • Updated skill naming conventions across installer/layout examples, and corrected installation commands for the hyphenated code-arena entries.
    • Added/expanded CodeArena evaluation standards, scoring overviews, and round report/templates in both English and Chinese, plus a refreshed tool setup guide.

@coderabbitai

coderabbitai Bot commented Jul 9, 2026

Copy link
Copy Markdown

Review Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: fd92e972-cb89-49a1-a2cd-60d97e8928ed

📥 Commits

Reviewing files that changed from the base of the PR and between c68cc2d and b6bf90c.

⛔ Files ignored due to path filters (2)
  • .DS_Store is excluded by !**/.DS_Store
  • skills/.DS_Store is excluded by !**/.DS_Store
📒 Files selected for processing (38)
  • AGENTS.md
  • README.md
  • skills/code-arena-cn/SKILL.md
  • skills/code-arena-cn/references/EVAL_STANDARDS.md
  • skills/code-arena-cn/references/basic_eval_cases.md
  • skills/code-arena-cn/references/example_round_eval_cases.md
  • skills/code-arena-cn/references/report_template.md
  • skills/code-arena-cn/references/scoring_overview.md
  • skills/code-arena-cn/scripts/cap.mjs
  • skills/code-arena-cn/scripts/check-tools.sh
  • skills/code-arena-cn/scripts/detect-ports.mjs
  • skills/code-arena-cn/scripts/lib/detect-ports.mjs
  • skills/code-arena-cn/scripts/lib/http.mjs
  • skills/code-arena-cn/scripts/lib/ui.mjs
  • skills/code-arena-cn/scripts/sast-rules.yaml
  • skills/code-arena-cn/scripts/setup-tools.sh
  • skills/code-arena-cn/scripts/templates/api_test.template.mjs
  • skills/code-arena-cn/scripts/templates/ui_test.template.mjs
  • skills/code-arena-cn/scripts/templates/visual_test.template.mjs
  • skills/code-arena-cn/scripts/tools-README.md
  • skills/code-arena-en/SKILL.md
  • skills/code-arena-en/references/EVAL_STANDARDS.md
  • skills/code-arena-en/references/basic_eval_cases.md
  • skills/code-arena-en/references/example_round_eval_cases.md
  • skills/code-arena-en/references/report_template.md
  • skills/code-arena-en/references/scoring_overview.md
  • skills/code-arena-en/scripts/cap.mjs
  • skills/code-arena-en/scripts/check-tools.sh
  • skills/code-arena-en/scripts/detect-ports.mjs
  • skills/code-arena-en/scripts/lib/detect-ports.mjs
  • skills/code-arena-en/scripts/lib/http.mjs
  • skills/code-arena-en/scripts/lib/ui.mjs
  • skills/code-arena-en/scripts/sast-rules.yaml
  • skills/code-arena-en/scripts/setup-tools.sh
  • skills/code-arena-en/scripts/templates/api_test.template.mjs
  • skills/code-arena-en/scripts/templates/ui_test.template.mjs
  • skills/code-arena-en/scripts/templates/visual_test.template.mjs
  • skills/code-arena-en/scripts/tools-README.md

📝 Walkthrough

Walkthrough

The PR standardizes CodeArena skill names from codearena-* to code-arena-* and adds synchronized Chinese and English evaluation standards, rubrics, report templates, harness scripts, reusable testing utilities, SAST rules, and local toolchain setup documentation.

Changes

CodeArena skill naming and evaluation framework

Layer / File(s) Summary
Skill naming and repository guidance
AGENTS.md, README.md, skills/*/SKILL.md, skills/skill-installer/SKILL.md
Renames CodeArena identifiers, updates installation commands and metadata, revises repository guidance, and adjusts the skill-installer code fence.
Chinese evaluation standards and rubrics
skills/code-arena-cn/references/*
Adds Chinese workflow standards, baseline and round scoring rubrics, scoring overview, and bilingual report templates.
Chinese evaluation harness tooling
skills/code-arena-cn/scripts/*
Adds port detection, HTTP and Playwright helpers, evidence recorders, tool setup/check scripts, SAST rules, harness templates, screenshot capture, and toolchain documentation.
English evaluation standards and rubrics
skills/code-arena-en/references/*
Adds English workflow standards, baseline and round scoring rubrics, scoring overview, and standardized report templates.
English evaluation harness tooling
skills/code-arena-en/scripts/*
Adds matching English port detection, HTTP and Playwright helpers, evidence recorders, tool setup/check scripts, SAST rules, harness templates, screenshot capture, and toolchain documentation.

Estimated code review effort: 3 (Moderate) | ~30 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name Status Explanation Resolution
Title check ❓ Inconclusive The title is generic and does not clearly describe the actual change to the skill-installer Markdown layout. Rename the PR to describe the specific change, such as the formatting adjustment in skills/skill-installer/SKILL.md.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat-skill-installer

Comment @coderabbitai help to get the list of available commands.

@CodeArtsAgent
CodeArtsAgent merged commit 671f3dc into main Jul 18, 2026
1 check was pending
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant