Repository navigation
Add daily OSM postbox import workflow - #214
Merged
Merged
Conversation
New osm-import.yml runs osm_import.sh at 03:17 UTC every day (and on manual dispatch with dry_run / prune / full_reimport inputs), keeping the Firestore postbox collection in step with OpenStreetMap without a manual run. - Auth is keyless Workload Identity Federation via google-github-actions/auth, which feeds the importer's Application Default Credentials. It reads two repo variables; the one-time gcloud setup is in the workflow header. The provider condition admits only this repo on master, so branch or PR workflows can't write production data. - Scheduled runs pass --prune; the importer's 5% guard fails the run rather than hide boxes on a truncated export. - The incremental manifest persists in the Actions cache (new key per run, restored by prefix), so daily runs only write changed nodes. - The refreshed postboxes.json is discarded, not committed back. - Adds a job summary of the import counts, and uploads a rejected Overpass response as an artifact on failure. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_018ZVwVFLy92tTB2jsW8JeSW
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a GitHub Actions workflow that automatically syncs postbox data from OpenStreetMap (via Overpass API) to Firestore on a daily schedule. The workflow uses keyless Workload Identity Federation for secure credential-free authentication and includes comprehensive setup documentation.
Key changes
.github/workflows/osm-import.yml):--dry-run,--prune,--no-manifestImplementation details
google-github-actions/auth@v3with Workload Identity Federation; the workflow includes complete one-time GCP setup instructions (service account, workload identity pool, OIDC provider, IAM bindings).last_import_manifest.jsonis cached with a unique key per run, restored by prefix (newest wins); losing the cache triggers a full re-import (still correct)--dry-runflag skips Firestore writes and manifest updates for testing--prunesoft-marks postbox docs whose OSM node has been deleted; scheduled runs prune by default; the importer fails if truncation would affect >5% of postboxes (safety check)Firestore remains the source of truth; the downloaded postboxes.json is discarded after import.
https://claude.ai/code/session_018ZVwVFLy92tTB2jsW8JeSW