Azure Upload

Azure Upload

Certified

Upload file(s) to Azure Blob Storage

Uploads one or more files from Kestra internal storage to Azure Blob Storage.

yaml
type: io.kestra.plugin.azure.storage.blob.Upload

Upload an input file to Azure Blob Storage

yaml
id: azure_storage_blob_upload
namespace: company.team

inputs:
  - id: myfile
    type: FILE

tasks:
  - id: upload
    type: io.kestra.plugin.azure.storage.blob.Upload
    endpoint: https://kestra.blob.core.windows.net
    connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
    container: kestra
    from: "{{ inputs.myfile }}"
    name: "myblob"

Extract data via an HTTP API call and upload it as a file to Azure Blob Storage

yaml
    id: azure_blob_upload
    namespace: company.team

    tasks:
      - id: extract
        type: io.kestra.plugin.core.http.Download
        uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/salaries.csv

      - id: load
        type: io.kestra.plugin.azure.storage.blob.Upload
        endpoint: https://kestra.blob.core.windows.net
        connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
        container: kestra
        from: "{{ outputs.extract.uri }}"
        name: data.csv

Upload multiple files to Azure Blob Storage

yaml
    id: azure_blob_upload_multiple
    namespace: company.team

    tasks:
      - id: upload
        type: io.kestra.plugin.azure.storage.blob.Upload
        endpoint: https://kestra.blob.core.windows.net
        connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
        container: kestra
        from: "{{ outputs.previous_task.outputFiles }}"
        name: "uploads/"
Properties

The blob container.

Service endpoint URL

Base HTTPS endpoint of the target service.

Structured data items, either as a map, a list of map, a URI, or a JSON string.

Structured data items can be defined in the following ways:

  • A single item as a map (a document).
  • A list of items as a list of maps (a list of documents).
  • A URI, supported schemes are kestra for internal storage files, file for host local files, and nsfile for namespace files.
  • A JSON String that will then be serialized either as a single item or a list of items.

The full blob path on the container.

Possible Values
P4P6P10P15P20P30P40P50P60P70P80HOTCOOLARCHIVE

Access tier

Hot/Cool/Archive for block blobs or premium tiers for page blobs; does not change etag

Connection string of the Storage Account.

Immutability policy to apply to the uploaded blob

Definitions
expiryTimestring
Formatdate-time

The time when the immutability policy expires.

policyModestring
Possible Values
MUTABLEUNLOCKEDLOCKED

The immutability policy mode.

Legal hold

Sets legal hold; requires container immutable storage with versioning enabled

Blob metadata

Key/value metadata to set on the blob

Reference (ref) of the pluginDefaults to apply to this task.

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Shared Key access key for authenticating requests.

Shared Key account name for authenticating requests.

Blob tags

User-defined tags to apply

Validate checksum

Compute MD5 client-side and pass it to Azure for server-side integrity verification; on mismatch the upload fails with Md5Mismatch

Uploaded blob (single file only)

Present only when a single file is uploaded; null for multiple files

Definitions
containerstring
eTagstring
lastModifiedstring
Formatdate-time
namestring
sizeinteger
uristring
Formaturi

All uploaded blobs

List of all uploaded blobs

Definitions
containerstring
eTagstring
lastModifiedstring
Formatdate-time
namestring
sizeinteger
uristring
Formaturi

The size of the uploaded blob, in bytes.

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

PostgreSQL
PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

6 tasks

25 blueprints