sincecutoff.com
← all changes

gcloud datastream objects start-backfill filters partial backfills

Introduced 2026-06-02 · score 0.94

HOW TO USE IT

When you need to backfill only matching rows from a supported SQL source, run `gcloud datastream objects start-backfill` for the object with `--sql-where-clause` set to the filter, without the `WHERE` keyword.

gcloud datastream objects start-backfill <object> --stream=<stream> --location=<location> --sql-where-clause="t.key1 = 'value1'"

WHY THIS HELPS

When backfilling only matching records from a Datastream object, start a partial backfill with a SQL where clause.

REQUIREMENTS AND LIMITATIONS

  • OBJECT (required): ID or fully qualified identifier of the stream object.
  • --stream (required): Stream name; can be supplied in the fully qualified object identifier instead.
  • --location (required): Resource location; can be supplied in the fully qualified object identifier instead.
  • --sql-where-clause: SQL WHERE clause selecting included data, without the `WHERE` keyword. Supported only for SQL sources.
  • Prerequisite: Partial backfill is supported only for SQL sources. Oracle, PostgreSQL, and MySQL support is being made available gradually; a request fails if the stream does not yet support the feature.
  • Prerequisite: The object must not have `Pending` or `Active` status when initiating backfill.
  • The partial backfill is on the specified object.

FIRST-PARTY EVIDENCE

Check the installed version and the source before using it. Entry JSON

Report a problem with this card