load_google_cloud_pubsub
Subscribes to a Google Cloud Pub/Sub subscription and obtains bytes.
Authentication
The connector tries to retrieve the appropriate credentials using Google's Application Default Credentials.
Description
The google_cloud_pubsub
loader acquires raw bytes from a Google Cloud Pub/Sub subscription.
project_id = str
The project to connect to. Note that this is the project id, not the display name.
subscription_id = str
The subscription to subscribe to.
timeout = duration (optional)
How long to wait for messages before ending the connection. A duration of zero means the operator will run forever.
The default value is 0s
.
Examples
Subscribe to my-subscription
in the project amazing-project-123456
and parse the messages as JSON: