Snowflake
Snowflake is a multi-cloud data warehouse. Tenzir can send events from a pipeline to Snowflake databases.
Use the to_snowflake
output operator
at the end of a pipeline to send events to a specific table.
ADBC
Tenzir uses Apache Arrow under the hood to encode batches of events into a columnar representation. The Arrow Database Connectivity (ADBC) API makes makes it possible to efficiently transfer large datasets between Tenzir and a database. Think of ADBC as the columnar equivalent of JDBC/ODBC. ADBC has a Snowflake driver that Tenzir uses to send events to Snowflake with the bulk ingestion API. For further details on ADBC, read the introductory blog post from the Arrow project.
Examples
Send data to a Snowflake database
from {foo: 42, bar: true}
to_snowflake \
account_identifier="asldyuf-xgb47555",
user_name="tenzir_user",
password="password1234",
database="MY_DB",
schema="MY_SCHEMA",
table="TENZIR"