sincecutoff.com
← all changes

wrangler Pipelines sink creation supports gzip compression for JSON

Introduced 2026-09-03 · score 0.94

HOW TO USE IT

For a Wrangler 4.129.0 Pipelines sink with JSON output, select `gzip` or `uncompressed` in the CLI or interactive setup flow. The current CLI reference does not document a JSON compression flag; the API documents JSON compression in the sink `format` object.

curl https://api.cloudflare.com/client/v4/accounts/<ACCOUNT_ID>/pipelines/v1/sinks -H 'Content-Type: application/json' -H "Authorization: Bearer <CLOUDFLARE_API_TOKEN>" -d '{"name":"<SINK_NAME>","type":"r2","format":{"type":"json","compression":"gzip"}}'

WHY THIS HELPS

Create a JSON sink for a Pipelines workflow with gzip compression.

REQUIREMENTS AND LIMITATIONS

  • Version: 4.129.0
  • Availability: Pipelines is in open beta.
  • format.type (required): Use `json` for JSON output; the documented format is a JSON or Parquet object.
  • format.compression: JSON accepts `uncompressed` or `gzip`.
  • [SINK] (required): Name of the sink to create.
  • --type (required): Type of sink to create.
  • --bucket (required): R2 bucket name.
  • Prerequisite: The Create Sink API requires a token with Pipelines Write permission.
  • JSON sinks accept `uncompressed` or `gzip`.
  • Parquet retains its existing compression options and `zstd` default.
  • Docs conflict: Current Wrangler command docs describe --compression as Parquet-only and default it to zstd; this differs from release-note behavior for JSON in Wrangler 4.129.0, so that flag behavior is not used here.

FIRST-PARTY EVIDENCE

Check the installed version and the source before using it. Entry JSON

Report a problem with this card