RealtimeTrigger
Consume a message in real-time from a Pub/Sub topic and create one execution per message.
If you would like to consume multiple messages processed within a given time frame and process them in batch, you can use the io.kestra.plugin.gcp.pubsub.Trigger instead.
type: "io.kestra.plugin.gcp.pubsub.RealtimeTrigger"Consume a message from a Pub/Sub topic in real-time.
id: realtime-pubsub
namespace: company.team
tasks:
- id: log
type: io.kestra.plugin.core.log.Log
message: "Received: {{ trigger.data }}"
triggers:
- id: trigger
type: io.kestra.plugin.gcp.pubsub.RealtimeTrigger
projectId: test-project-id
topic: test-topic
subscription: test-subscription
YESThe Pub/Sub topic
The Pub/Sub topic. It must be created before executing the task.
YEStrueYESThe GCP service account to impersonate.
YESPT1MdurationYESdurationMax duration in the Duration ISO format, after that the task will end.
YESYESThe GCP project ID.
YES["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used.
YESSTRINGSTRINGJSONThe serializer/deserializer to use.
YESThe GCP service account.
NOCREATEDRUNNINGPAUSEDRESTARTEDKILLINGSUCCESSWARNINGFAILEDKILLEDCANCELLEDQUEUEDRETRYINGRETRIEDSKIPPEDList of execution states after which a trigger should be stopped (a.k.a. disabled).
YESThe Pub/Sub subscription
The Pub/Sub subscription. It will be created automatically if it didn't exist and 'autoCreateSubscription' is enabled.
The message attributes map
The message data, must be a string if serde type is 'STRING', otherwise a JSON object
If it's a string, it can be a dynamic property otherwise not.
The message identifier
The message ordering key