Skip to content

save_s3

Saves bytes to an Amazon S3 object.

save_s3 uri:str, [anonymous=bool]

The save_s3 operator writes bytes to an S3 object in an S3 bucket.

The connector tries to retrieve the appropriate credentials using AWS’s default credentials provider chain.

If a config file <prefix>/etc/tenzir/plugin/s3.yaml or ~/.config/tenzir/plugin/s3.yaml exists, it is always preferred over the default AWS credentials. The configuration file must have the following format:

access-key: your-access-key
secret-key: your-secret-key
session-token: your-session-token (optional)

The path to the S3 object.

The syntax is s3://[<access-key>:<secret-key>@]<bucket-name>/<full-path-to-object>(?<options>).

Options can be appended to the path as query parameters, as per Arrow:

For S3, the options that can be included in the URI as query parameters are region, scheme, endpoint_override, allow_bucket_creation, and allow_bucket_deletion.

Whether to ignore any predefined credentials and try to save with anonymous credentials.

Read CSV from an object obj.csv in the bucket examplebucket and save it as YAML to another bucket examplebucket2:

load_s3 "s3://examplebucket/obj.csv"
read_csv
write_yaml
save_s3 "s3://examplebucket2/obj.yaml"

load_s3, to_asl

Last updated: