Skip to content

Add race condition flakiness detection agentic workflow - #306

Open
mbianchidev with Copilot wants to merge 2 commits into
mainfrom
copilot/feat-add-race-condition-flakiness-detection
Open

Add race condition flakiness detection agentic workflow#306
mbianchidev with Copilot wants to merge 2 commits into
mainfrom
copilot/feat-add-race-condition-flakiness-detection

Conversation

Copilot AI commented Jun 5, 2026

Copy link
Copy Markdown
Contributor

Adds a dedicated gh-aw agentic workflow to surface tests that fail intermittently due to concurrency bugs, distinct from the existing general flaky-test detection.

New workflow: race-condition-detection

  • Source + lock: .github/workflows/race-condition-detection.md compiled to race-condition-detection.lock.yml.
  • Trigger: weekday-only schedule cron: "0 7 * * 1-5" plus workflow_dispatch.
  • Classification: flags a test as a race-condition suspect on either signal:
    • Same-commit non-determinism — the same test passes and fails across runs sharing one headSha.
    • Concurrency signature — failure type/message matches a per-language indicator (Go DATA RACE, Java ConcurrentModificationException, ThreadSanitizer, deadlocks, PoisonError, asyncio/await timing, etc.). Deterministic failures are explicitly out of scope.
  • Inputs: reuses the proven artifact-download + per-language analyzer steps: from corn-flakes-detection, so the agent only reads pre-generated ./reports/*.md (the sandbox blocks python3). runs.json carries headSha to enable same-commit grouping.
  • Outputs: one issue per suspect via safe-outputs (create-issue prefix [race condition] , labels race-condition,flaky-test,automated; update-issue; noop), including a PR-title remediation instruction for the Copilot coding agent.

Security posture

  • Least-privilege read-only permissions, network: {}, GitHub MCP toolset for reads (no raw curl).
  • All actions SHA-pinned; github/gh-aw/actions/setup pinned to f990bbb7…, matching sibling workflows and the repo's full-SHA pin rule.

Notes for reviewers

  • The GH_TOKEN env warning at compile time is shared with corn-flakes-detection (read-only gh access for the agent) and is the reason strict: false is retained.
  • Azure MCP (per issue guidance) is intentionally not wired in — this workflow operates solely on GitHub Actions test artifacts with no Azure infrastructure, so adding it would introduce secrets/attack surface for no functional gain.

Copilot AI changed the title [WIP] Add race condition flakiness detection using MCP Add race condition flakiness detection agentic workflow Jun 5, 2026
Copilot AI requested a review from mbianchidev June 5, 2026 19:43
@mbianchidev
mbianchidev marked this pull request as ready for review June 5, 2026 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: add race condition flakiness detection

2 participants