Consume

Consume events from Azure Event Hubs.

yaml
type: "io.kestra.plugin.azure.eventhubs.Consume"

Consume data events from Azure EventHubs.

yaml
id: azure_eventhubs_consume_data_events
namespace: company.team

tasks:
  - id: consume_from_eventhub
    type: io.kestra.plugin.azure.eventhubs.Consume
    eventHubName: my_eventhub
    namespace: my_eventhub_namespace
    connectionString: "{{ secret('EVENTHUBS_CONNECTION') }}"
    bodyDeserializer: JSON
    consumerGroup: "$Default"
    checkpointStoreProperties:
      containerName: kestra
      connectionString: "{{ secret('BLOB_CONNECTION') }}"

Dynamic YES

The event hub to read from.

Dynamic YES

Namespace name of the event hub to connect to.

Dynamic YES

Default STRING

Possible Values

STRINGBINARYIONJSON

The Deserializer to be used for serializing the event value.

Dynamic YES

Default {}

The config properties to be passed to the Deserializer.

Configs in key/value pairs.

SubType string

Dynamic YES

Default {}

The config properties to be used for configuring the BlobCheckpointStore.

Azure Event Hubs Checkpoint Store can be used for storing checkpoints while processing events from Azure Event Hubs.

Dynamic YES

Default 5

Dynamic YES

Default 500

Dynamic YES

Connection string of the Storage Account.

Dynamic YES

Default $Default

The consumer group.

Dynamic YES

Custom endpoint address when connecting to the Event Hubs service.

Dynamic YES

The ISO Datetime to be used when PartitionStartingPosition is configured to INSTANT.

Configs in key/value pairs.

Dynamic YES

Default 50

Dynamic YES

Default PT10S

Format duration

The max time duration to wait to receive events from all partitions.

Dynamic YES

Default PT5S

Format duration

The max time duration to wait to receive a batch of events up to the maxBatchSizePerPartition.

Dynamic YES

Default EARLIEST

Possible Values

EARLIESTLATESTINSTANT

The starting position.

Dynamic YES

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Dynamic YES

Shared Key access key for authenticating requests.

Dynamic YES

Shared Key account name for authenticating requests.

Number of events consumed from Azure Event Hubs.

Format uri

URI of a kestra internal storage file containing the messages.

​Consume

Consume