Consume events from Azure Event Hubs.
type: "io.kestra.plugin.azure.eventhubs.Consume"
Consume data events from Azure EventHubs.
id: azure_eventhubs_consume_data_events
namespace: company.team
tasks:
- id: consume_from_eventhub
type: io.kestra.plugin.azure.eventhubs.Consume
eventHubName: my_eventhub
namespace: my_eventhub_namespace
connectionString: "{{ secret('EVENTHUBS_CONNECTION') }}"
bodyDeserializer: JSON
consumerGroup: "$Default"
checkpointStoreProperties:
containerName: kestra
connectionString: "{{ secret('BLOB_CONNECTION') }}"
The event hub to read from.
Namespace name of the event hub to connect to.
The Deserializer to be used for serializing the event value.
The config properties to be passed to the Deserializer.
Configs in key/value pairs.
The config properties to be used for configuring the BlobCheckpointStore.
Azure Event Hubs Checkpoint Store can be used for storing checkpoints while processing events from Azure Event Hubs.
The maximum number of retry attempts before considering a client operation to have failed.
The maximum permissible delay between retry attempts in milliseconds.
Connection string of the Storage Account.
The consumer group.
Custom endpoint address when connecting to the Event Hubs service.
The ISO Datetime to be used when PartitionStartingPosition
is configured to INSTANT
.
Configs in key/value pairs.
The maximum number of events to consume per event hub partition per poll.
The max time duration to wait to receive events from all partitions.
The max time duration to wait to receive a batch of events up to the maxBatchSizePerPartition
.
The starting position.
The SAS token to use for authenticating requests.
This string should only be the query parameters (with or without a leading '?') and not a full URL.
Number of events consumed from Azure Event Hubs.
URI of a kestra internal storage file containing the messages.