Skip to content

docs(firestore-bigquery-export): document failure handling and recovery - #3131

Open
cabljac wants to merge 1 commit into
feat/kits-fbe-cloud-tasks-write-bufferfrom
docs/kits-fbe-failure-handling
Open

docs(firestore-bigquery-export): document failure handling and recovery#3131
cabljac wants to merge 1 commit into
feat/kits-fbe-cloud-tasks-write-bufferfrom
docs/kits-fbe-failure-handling

Conversation

@cabljac

@cabljac cabljac commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Last layer of the Cloud Tasks write buffer stack. README only.

Adds a "Failure handling" section describing the sync queue, how to recover rows parked in BACKUP_COLLECTION back into BigQuery, and the known limits that have not been verified live. Adds the two new params to the settings table, syncBigQuery to the list of functions to re-export, roles/cloudtasks.enqueuer to the roles list, and updates the differences section so failed writes are described as the same buffer the extension has rather than a trigger retry.

Part of #3031.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the documentation in README.md to reflect the introduction of the syncBigQuery Cloud Tasks queue for buffering and retrying failed BigQuery writes. It details the new configuration parameters, IAM roles, failure handling behavior, and API surface changes. The feedback suggests a minor wording improvement in the failure handling section to clarify that a row is dropped along with the task if no backup collection is configured.

Comment thread kits/firestore-bigquery-export/README.md Outdated
@cabljac
cabljac force-pushed the docs/kits-fbe-failure-handling branch from 4062cf2 to 3912c71 Compare September 7, 2026 16:45
@cabljac
cabljac marked this pull request as ready for review September 7, 2026 16:50
@cabljac
cabljac force-pushed the docs/kits-fbe-failure-handling branch from 3912c71 to fa2b405 Compare September 7, 2026 16:52
@cabljac cabljac mentioned this pull request Sep 7, 2026
62 tasks
@cabljac
cabljac force-pushed the docs/kits-fbe-failure-handling branch from fa2b405 to 78d2e27 Compare September 7, 2026 17:26
Adds the failure handling section: the sync queue, recovering parked rows
from BACKUP_COLLECTION, known limits, and the new params.
@cabljac
cabljac force-pushed the docs/kits-fbe-failure-handling branch from 78d2e27 to b435f88 Compare September 8, 2026 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant