[Svilen-Stefanov]

Demo change for CodeBoarding. This pull request was written to show CodeBoarding's architecture review on k8up. It is not an upstream pull request and is not proposed to k8up-io/k8up.

Summary

Gate backups on the health of their repository. Before the Backup controller starts a backup Job, it reads the last finished Check of the repository and the repository's Snapshot resources, records the result on the Backup, and exports it as a metric. When the last check failed, a backup can opt in to being skipped instead of writing more data into a repository that restic reported as damaged.

Changes

Read repository health on the restic side

• Add ReadRepositoryHealth in restic/kubernetes, next to the snapshot sync that already owns the Snapshot resources.
• It lists the namespace's Check and Snapshot resources, keeps the ones for the backup's repository, and returns the last finished check, the snapshot count, and when the newest snapshot was taken.
• Checks without a backend are matched against the operator's global repository, the same way they run.

API: condition, reasons, and an opt-in field

• New RepositoryHealthy condition on Backup with reasons LastCheckSucceeded, LastCheckFailed, and NoCheckFound. The message names the check, when it finished, and the snapshot summary.
• New skipOnFailedCheck field on BackupSpec, also available in Schedule backups. A skipped backup completes with reason RepositoryUnhealthy and starts no Job.
• Add CheckList.LatestFinished, Check.FinishedAt, Check.RepositoryOrDefault, and SnapshotList.Latest.
• Regenerate the Backup and Schedule CRDs.

Gate in the Backup controller

• Evaluate the gate in Provision before taking the repository lock, so a skipped backup never waits for a lock or creates PreBackupPods.
• Update the status only when the conditions change, so requeues do not cause status writes.
• New operator flag --global-skip-backup-on-failed-check (BACKUP_GLOBAL_SKIP_BACKUP_ON_FAILED_CHECK) that enables skipping for all backups.

Metrics

• k8up_backup_repository_healthy{namespace}: 1 if the last finished check succeeded, 0 if it failed.
• k8up_backups_skipped_unhealthy_repository_total{namespace}: backups skipped because of a failed check.

Docs

• The status reference, metrics reference, and operator usage list the new condition, metrics, and flag.

Testing

• api/v1: latest finished check, finish time of running and failed checks, repository fallback to the global repository, latest snapshot.
• restic/kubernetes: health with no resources, a failed check after a successful one, checks and snapshots of other repositories ignored, and backend-less checks against the global repository; message formatting.
• operator/backupcontroller: no check, succeeded check, failed check without opt-in, and skips through skipOnFailedCheck and through the global flag, checked on the stored status.

Local validation:

• go build ./... and go vet ./... passed.
• go vet -tags integration on the touched packages passed.
• go test ./api/... ./restic/... ./operator/... ./cmd/... passed.

🤖 Generated with Claude Code

[github-actions]

CodeBoarding review

Status: 7 changed components

See the full change in CodeBoarding.

graph LR
    n_Operator_Controllers["Operator Controllers"]
    n_Restic_Execution_Client["Restic Execution Client"]
    n_Kubernetes_API_Schemas["Kubernetes API Schemas"]
    n_Command_Line_Entrypoints["Command-Line Entrypoints"]
    n_Restore_Utilities_and_Helpers["Restore Utilities and Helpers"]
    n_Operator_Controllers -- "checks repository health and lists pods via" --> n_Restic_Execution_Client
    n_Operator_Controllers -- "reconciles and updates status of" --> n_Kubernetes_API_Schemas
    n_Restic_Execution_Client -- "utilizes string generator from" --> n_Operator_Controllers
    n_Restic_Execution_Client -- "streams archives through" --> n_Restore_Utilities_and_Helpers
    n_Restic_Execution_Client -- "reads check and snapshot schemas from" --> n_Kubernetes_API_Schemas
    n_Command_Line_Entrypoints -- "registers controllers in" --> n_Operator_Controllers
    n_Command_Line_Entrypoints -- "invokes restic commands on" --> n_Restic_Execution_Client
    n_Command_Line_Entrypoints -- "invokes restore helpers from" --> n_Restore_Utilities_and_Helpers
    classDef added fill:#1f883d,stroke:#0b5d23,color:#ffffff;
    classDef modified fill:#bf8700,stroke:#7d4e00,color:#ffffff;
    classDef deleted fill:#cf222e,stroke:#82071e,color:#ffffff,stroke-dasharray:5 3;
    class n_Operator_Controllers,n_Restic_Execution_Client,n_Kubernetes_API_Schemas,n_Command_Line_Entrypoints modified;
    linkStyle 4 stroke:#0b5d23,stroke-width:2px;
    linkStyle 0,1 stroke:#7d4e00,stroke-width:2px;

Loading

_{download artifacts · run 40249987560}