Azure Downloads
CertifiedDownload multiple blobs to Kestra storage
Azure Downloads
Download multiple blobs to Kestra storage
Lists blobs with optional prefix/regex, downloads them to internal storage, and optionally archives or moves according to action.
type: io.kestra.plugin.azure.storage.blob.DownloadsExamples
id: azure_storage_blob_downloads
namespace: company.team
tasks:
- id: downloads
type: io.kestra.plugin.azure.storage.blob.Downloads
endpoint: "https://yourblob.blob.core.windows.net"
connectionString: "DefaultEndpointsProtocol=...=="
container: "mydata"
prefix: "sub-dir"
delimiter: "/"
action: NONE
Properties
action *string
MOVEDELETENONEPost-action
Action to apply after download (NONE, DELETE, MOVE)
container *string
Container
Target container to list and download from
endpoint *string
Service endpoint URL
Base HTTPS endpoint of the target service.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150connectionString string
Connection string of the Storage Account.
delimiter string
Delimiter
Virtual folder delimiter for listing
failOnMissingChecksum booleanstring
Fail when the server has no Content-MD5
Only applies when validateChecksum is true. If true, the task fails when the Azure object has no stored Content-MD5. If false (default), validation is skipped with a warning.
filter string
FILESFILESDIRECTORYBOTHList filter
FILES or DIRECTORIES filter for listing; defaults to FILES
maxFiles integerstring
25The maximum number of files to download
Limits the number of blobs downloaded. If not specified, all matching blobs will be downloaded.
moveTo
Move destination
Target path when action=MOVE
io.kestra.plugin.azure.storage.blob.Copy-CopyObject
Source/destination container
Blob path
Full blob name (virtual path) inside the container
prefix string
Prefix
Limits listing to blobs starting with this path
regexp string
Regex filter
Java regex applied to blob names after prefix
sasToken string
The SAS token to use for authenticating requests.
This string should only be the query parameters (with or without a leading '?') and not a full URL.
validateChecksum booleanstring
Validate checksum against server's Content-MD5
If true, compute the MD5 of the downloaded file and compare it to the Content-MD5 stored on the Azure object. Many block blobs uploaded as streams have no Content-MD5; see failOnMissingChecksum to control that case.
Outputs
blobs array
Downloaded blobs
outputFiles object
Downloaded files map
Map of blob name to kestra:// URI of the downloaded file
