[devin-ai-integration]

Related Issue(s)	nasa#6378 (first entry this benefits)
Has Unit Tests (y/n)	n (offline stubbed-API scenarios run locally, see below)
Documentation Included (y/n)	y (.github/actions/ext-ci/README.md)
Generative AI was used in this contribution (y/n)	AI

---

Change Description

orchestrator.py only; the workflows are unchanged.

• The revision under test dictates manifest.json. head_manifest() reads it from the PR head, merge-queue commit or manual fprime_ref through this repository's contents API (data only; the workflow and the script still come from the default branch, whose copy now only serves the upstream_repository preflight). A PR that adds or edits an entry therefore exercises it on its own checks. Entries the default branch does not have are marked new when the PR edits the manifest, and select_repos() ignores on_pr: false for them: the PR that introduces an entry is the one run it must get. Duplicate ids or a missing file fail early with a clear message.
• Real conclusions for failure_policy: notify. check_conclusion() and finalize() no longer map failures to neutral: GitHub folds neutral checks into the collapsed app group and out of the merge box, which read as "the check disappeared when it failed" on ci: add STM32H753XI-EVAL2 to supported platforms and external CI work… nasa/fprime#6378. notify now only keeps the orchestrator job green; the check summary says the failure is informational.
• Remote run held in a protected environment (waiting): the check is retitled "Waiting for approval in " and both timeout clocks restart when it is released (hil.yml runs its hosted job before the gated one, so the old run_started_at clock would have eaten the running allowance).
• dispatch failed on 403/404 hints at the External CI App installation (403 is what the stm32 repo returned before it was added).

Rationale

Requested: a PR adding a manifest entry should run that entry and report it on its own checks, with the PR head's manifest used as is (reviewed like any ci.yml), without checking out PR code in the privileged workflow_run job.

Testing/Review Recommendations

• Offline, with a fake GitHub API (16 scenarios): fork PR adding stm32-baremetal (on_pr: false, notify) dispatches both entries with fprime_repository=<fork>, waits through waiting, ends as a failure check and a green job; unchanged manifest keeps default behaviour (devel on_pr: false entry filtered); edited existing entry used as is; merge group and manual fprime_ref/pr_number runs read the manifest of that revision; stale branch carrying an entry removed on devel does not get new; duplicate ids / missing manifest raise before any Check Run; dispatch 403 → hint + failed check + exit 1; block failure/cancelled/timed_out mappings; paths_ignore-only PR → skipped checks; finalize after cancellation → cancelled, after a crash → failure; fork of F´ no-op; attempt 2 re-dispatches only non-green checks.
• Live: gh api repos/nasa/fprime/contents/.github/actions/ext-ci/manifest.json?ref=<fork PR head sha> returns the fork PR's file for an open fork PR whose SHA is on no nasa/fprime branch, which is what head_manifest() relies on.
• End to end once on devel: rebase ci: add STM32H753XI-EVAL2 to supported platforms and external CI work… nasa/fprime#6378; its External CI / stm32-baremetal check should appear (cross-compile only: hil.yml skips the board for fprime_repository != nasa/fprime).

Future Work

Merge-queue runs dispatch every entry (on_pr only applies to PR heads), so a hardware entry in a merge group would wait for the external repo's environment approval; nasa/fprime does not use the merge queue today.

Contributor Checklist

• I have the rights to contribute this change set under the Apache-2.0 license.
• I agree to be bound by the contributor guidelines.

AI Usage (see policy)

Code, documentation and the offline test scenarios were written by an AI agent under maintainer direction.

• This contribution follows the F´ AI development skills (entered through AGENTS.md).

IAMAI

---

🟢 Devin Review found nothing to fix · View findings · Follow Devin's work

[devin-ai-integration]

I'll fix CI failures and address comments from users with write access that start with 'Devin'.

• Disable automatic comment, CI, and merge conflict monitoring

---

Prompt hidden (unlisted session)

[devin-ai-integration]

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.