Azure Downloads

Azure Downloads
Certified
Download multiple blobs to Kestra storage

Lists blobs with optional prefix/regex, downloads them to internal storage, and optionally archives or moves according to action.

yaml
type: io.kestra.plugin.azure.storage.blob.Downloads

Examples

yaml
id: azure_storage_blob_downloads
namespace: company.team

tasks:
  - id: downloads
    type: io.kestra.plugin.azure.storage.blob.Downloads
    endpoint: "https://yourblob.blob.core.windows.net"
    connectionString: "DefaultEndpointsProtocol=...=="
    container: "mydata"
    prefix: "sub-dir"
    delimiter: "/"

Properties

action *string

Possible Values

MOVEDELETENONE

Post-action

Action to apply after download (NONE, DELETE, MOVE)

container *string

Container

Target container to list and download from

endpoint *string

Service endpoint URL

Base HTTPS endpoint of the target service.

connectionString string

Connection string of the Storage Account.

delimiter string

Delimiter

Virtual folder delimiter for listing

failOnMissingChecksum booleanstring

Fail when the server has no Content-MD5

Only applies when validateChecksum is true. If true, the task fails when the Azure object has no stored Content-MD5. If false (default), validation is skipped with a warning.

filter string

DefaultFILES

Possible Values

FILESDIRECTORYBOTH

List filter

FILES or DIRECTORIES filter for listing; defaults to FILES

maxFiles integerstring

Default25

The maximum number of files to download

Limits the number of blobs downloaded. If not specified, all matching blobs will be downloaded.

moveTo

Move destination

Target path when action=MOVE

Definitions

io.kestra.plugin.azure.storage.blob.Copy-CopyObject

container*string

Source/destination container

name*string

Blob path

Full blob name (virtual path) inside the container

pluginDefaultsRef string

Reference (ref) of the pluginDefaults to apply to this task.

prefix string

Prefix

Limits listing to blobs starting with this path

regexp string

Regex filter

Java regex applied to blob names after prefix

sasToken string

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

sharedKeyAccountAccessKey string

Shared Key access key for authenticating requests.

sharedKeyAccountName string

Shared Key account name for authenticating requests.

validateChecksum booleanstring

Validate checksum against server's Content-MD5

If true, compute the MD5 of the downloaded file and compare it to the Content-MD5 stored on the Azure object. Many block blobs uploaded as streams have no Content-MD5; see failOnMissingChecksum to control that case.

Outputs

blobs array

Downloaded blobs

Definitions

io.kestra.plugin.azure.shared.storage.blob.models.Blob

containerstring

eTagstring

lastModifiedstring

Formatdate-time

namestring

sizeinteger

uristring

Formaturi

outputFiles object

SubTypestring

Downloaded files map

Map of blob name to kestra:// URI of the downloaded file

NetBox

Enterprise

Enterprise NetBox tasks to create, update, and query devices, IP addresses, and sites over the NetBox API.

Infrastructure

Clickhouse

Tasks that connect to ClickHouse via JDBC to run queries and loads.

Data

Azure DownloadsCertifiedDownload multiple blobs to Kestra storage

Azure Downloads

More Plugins in this Category

NetBox

Clickhouse

Azure Downloads
Certified
Download multiple blobs to Kestra storage