Skip to main content
Version: Tenzir v4.3

batch

The batch operator controls the batch size of events.

Expert Operator

The batch operator is a lower-level building block that lets users explicitly control batching, which otherwise is controlled automatically by Tenzir's underlying pipeline execution engine. Use with caution!

Synopsis

batch [<limit>]

Description

The batch operator takes its input and rewrites it into batches of up to the desired size.

<limit>

An unsigned integer denoting how many events to put into one batch at most.

Defaults to 65536.

Examples

Write exactly one NDJSON object at a time to a Kafka topic.

batch 1 | to kafka -t topic write json -c