Skip to content

Parses binary data into events with a single data field, in a streaming fasion.

read_chunks

The read_chunks operator turns each incoming byte chunk into a single event with a field called data of type blob. Unlike read_all, which buffers the entire input and produces one event, read_chunks emits events as data arrives.

This is useful for piping binary data out from_ operators, that can only emit events.

from_file "data.bin" {
read_chunks
}
{data: b"<chunk contents>"}
from_file "input.bin" {
read_chunks
}
to_file "output.bin" {
write_chunks
}

Last updated: