Repository navigation
GitLab Status: recognize and retry builder runner failures - #13
Merged
Merged
Conversation
The testing-2026-10-11 request reached the builder 1 s after the run (pipeline 37669), but its first job died with runner_system_failure (Kubernetes 502 Bad Gateway) before any build job existed. The tracker only looked for build jobs, so it waited 10 min and reported that no job started. - track-build.sh: a failed request pipeline for the package right after the request, or a build job that failed for a runner reason, ends with exit status 3 and the GitLab job link. - gitlab-status.yml: on status 3, re-run the "build" job of that Build Package run (at most twice, only from the tracker of attempt 1) and follow the new request. The organization webhook fires for re-runs too (pipeline 37694, 2 s after the manual re-run).
GitLab Status: recognize and retry builder runner failures
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The testing-2026-10-11 request reached the builder (pipeline 37669), but the builder's runner failed with runner_system_failure (Kubernetes 502) before building. GitLab Status now recognizes that within seconds, re-runs the build job of the Build Package run (at most twice) and follows the new request. Tested in ruscher#6.