Azure Upload

Azure Upload
Certified
Upload a file to Azure Data Lake Storage

Uploads a Kestra internal file to ADLS; optionally acquires a short lease via Blob API to avoid concurrent writes. Lease duration defaults to 15s and is clamped to Azure's 15–60s limits.

yaml
type: io.kestra.plugin.azure.storage.adls.Upload

Examples

Download a json file and upload it to Azure Data Lake Storage.

yaml
id: azure_data_lake_storage_upload
namespace: company.team

tasks:
  - id: download_request
    type: io.kestra.plugin.core.http.Download
    uri: adls/product_data/product.json

  - id: upload_file
    type: io.kestra.plugin.azure.storage.adls.Upload
    filePath: "path/to/file/product.json"
    from: "{{ outputs.download_request.uri }}"
    connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
    fileSystem: "tasks"
    endpoint: "https://yourblob.blob.core.windows.net"

Properties

endpoint *string

Service endpoint URL

Base HTTPS endpoint of the target service.

filePath *string

File path

Full path of the file in its file system

fileSystem *string

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name

from *string

Source file

kestra:// URI from internal storage to upload

Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.

assets

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions

io.kestra.core.models.assets.AssetsDeclaration

assetFailureBehaviorstring

Possible Values

IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

io.kestra.core.models.assets.AssetIdentifier

id*string

Min length1

typestring

outputs

The assets produced as outputs.

io.kestra.plugin.ee.assets.Dataset

id*string

Min length1

Max length150

type*object

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

io.kestra.plugin.ee.assets.File

id*string

Min length1

Max length150

type*object

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

io.kestra.plugin.ee.assets.Table

id*string

Min length1

Max length150

type*object

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

io.kestra.plugin.ee.assets.VM

id*string

Min length1

Max length150

type*object

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

io.kestra.core.models.assets.External

id*string

Min length1

Max length150

type*object

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

io.kestra.core.models.assets.Custom

id*string

Min length1

Max length150

type*string

Min length1

Custom asset type

descriptionstring

displayNamestring

metadataobject

Default{}

namespacestring

Min length1

Max length150

connectionString string

Connection string of the Storage Account.

leaseDurationSeconds integerstring

Lease duration (s)

Lease duration between 15 and 60 seconds; values are clamped

sasToken string

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

sharedKeyAccountAccessKey string

Shared Key access key for authenticating requests.

sharedKeyAccountName string

Shared Key account name for authenticating requests.

useLease booleanstring

Use lease

Acquire blob lease before upload to prevent concurrent writers

validateChecksum booleanstring

Validate checksum

Compute MD5 client-side and pass it to Azure for server-side integrity verification; on mismatch the upload fails with Md5Mismatch

Outputs

file

Uploaded file

Definitions

io.kestra.plugin.azure.storage.adls.models.AdlsFile

accessControlListarray

SubTypestring

archiveStatus

com.azure.storage.file.datalake.models.ArchiveStatus

archiveTier

com.azure.storage.file.datalake.models.AccessTier

contentEncodingstring

contentLanguagestring

contentMd5string

contentTypestring

creationTimestring

Formatdate-time

eTagstring

fileNamestring

fileSystemstring

groupstring

isDirectoryboolean

lastModifedstring

Formatdate-time

leaseDurationstring

Possible Values

INFINITEFIXED

leaseStatestring

Possible Values

AVAILABLELEASEDEXPIREDBREAKINGBROKEN

leaseStatusstring

Possible Values

LOCKEDUNLOCKED

namestring

ownerstring

permissionsstring

sizeinteger

uristring

Formaturi

Metrics

file.size counter

The size of the uploaded file, in bytes.

Scrapy CLI

Tasks that run Scrapy spiders and CLI commands to scrape data from websites.

Data

Supabase

Tasks that call Supabase APIs for data and storage operations.

Data

Azure UploadCertifiedUpload a file to Azure Data Lake Storage

More Plugins in this Category

Scrapy CLI

Supabase

Azure Upload
Certified
Upload a file to Azure Data Lake Storage