ESC
Ask Kestra AI
ESC
Kestra AI

Hi! I'm your Kestra AI assistant.
Ask me anything about workflows.

EXAMPLE QUESTIONS

How to run a Ansible playbook?
How to run Python script?
How to add secrets?

Azure Reads

Azure Reads

Certified

Read all files from an Azure Data Lake Storage directory

Read all files from an Azure Data Lake Storage directory using the Azure SDK.

yaml
type: io.kestra.plugin.azure.storage.adls.Reads
yaml
id: azure_storage_datalake_readq
namespace: company.team

tasks:
  - id: read_file
    type: io.kestra.plugin.azure.storage.adls.Reads
    connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
    fileSystem: "tasks"
    endpoint: "https://yourblob.blob.core.windows.net"
    directoryPath: "path/to/my/directory/"
Properties

Directory Name

Service endpoint URL

Base HTTPS endpoint of the target service.

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Connection string of the Storage Account.

Fail when the server has no Content-MD5

Only applies when validateChecksum is true. If true, the task fails when the Azure object has no stored Content-MD5. If false (default), validation is skipped with a warning.

Default25

The maximum number of files to read

Limits the number of files read. If not specified, all matching files will be read.

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Shared Key access key for authenticating requests.

Shared Key account name for authenticating requests.

Validate checksum against server's Content-MD5

If true, compute the MD5 of the downloaded file and compare it to the Content-MD5 stored on the Azure object. Many block blobs uploaded as streams have no Content-MD5; see failOnMissingChecksum to control that case.

The list of files

Definitions
accessControlListarray
SubTypestring
archiveStatus
archiveTier
contentEncodingstring
contentLanguagestring
contentMd5string
contentTypestring
creationTimestring
Formatdate-time
eTagstring
fileNamestring
fileSystemstring
groupstring
isDirectoryboolean
lastModifedstring
Formatdate-time
leaseDurationstring
Possible Values
INFINITEFIXED
leaseStatestring
Possible Values
AVAILABLELEASEDEXPIREDBREAKINGBROKEN
leaseStatusstring
Possible Values
LOCKEDUNLOCKED
namestring
ownerstring
permissionsstring
sizeinteger
uristring
Formaturi
SubTypestring

The downloaded files as a map of from/to URIs

More Plugins in this Category

Scrapy CLI
Scrapy CLI

Tasks that run Scrapy spiders and CLI commands to scrape data from websites.

Data

1 tasks

Supabase
Supabase

Tasks that call Supabase APIs for data and storage operations.

Data

5 tasks