Azure Bulk

Azure Bulk

Certified

Batch upsert Azure Table entities

Buffers entities in groups of 100 and submits transactional table batches. Each batch action must share a partition key; rows without a type use defaultType.

yaml
type: io.kestra.plugin.azure.storage.table.Bulk
yaml
id: azure_storage_table_bulk
namespace: company.team

tasks:
  - id: bulk
    type: io.kestra.plugin.azure.storage.table.Bulk
    endpoint: "https://yourstorageaccount.table.core.windows.net"
    connectionString: "DefaultEndpointsProtocol=...=="
    table: "table_name"
    from:
      - partitionKey: "color"
        rowKey: "green"
        type: "UPSERT_MERGE"
        properties:
          "code": "00FF00"
Properties

Service endpoint URL

Base HTTPS endpoint of the target service.

Structured data items, either as a map, a list of map, a URI, or a JSON string.

Structured data items can be defined in the following ways:

  • A single item as a map (a document).
  • A list of items as a list of maps (a list of documents).
  • A URI, supported schemes are kestra for internal storage files, file for host local files, and nsfile for namespace files.
  • A JSON String that will then be serialized either as a single item or a list of items.

Target Azure table name

Existing Azure Table Storage table to operate on; case-insensitive.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Connection string of the Storage Account.

DefaultUPSERT_REPLACE
Possible Values
CREATEUPSERT_MERGEUPSERT_REPLACEUPDATE_MERGEUPDATE_REPLACEDELETE

Set default action type

Applied when a row omits type; defaults to UPSERT_REPLACE.

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Shared Key access key for authenticating requests.

Shared Key account name for authenticating requests.

Number of entities processed

The total number of entities processed in the bulk operation.