Azure Read
CertifiedRead a file from Azure Data Lake Storage
Azure Read
Read a file from Azure Data Lake Storage
Read a file from Azure Data Lake Storage using the Azure SDK.
type: io.kestra.plugin.azure.storage.adls.ReadExamples
id: azure_storage_datalake_read
namespace: company.team
tasks:
- id: read_file
type: io.kestra.plugin.azure.storage.adls.Read
connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
fileSystem: "tasks"
endpoint: "https://yourblob.blob.core.windows.net"
filePath: "full/path/to/file.txt"
- id: log_size
type: io.kestra.plugin.core.debug.Echo
level: INFO
format: " {{ outputs.read_file.file.size }}"
Properties
endpoint *string
Service endpoint URL
Base HTTPS endpoint of the target service.
filePath *string
File path
Full path of the file in its file system
fileSystem *string
The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150checksumAlgorithm string
MD5SHA_256Checksum algorithm
Algorithm used to compute and compare the checksum. Defaults to MD5. Note: validateChecksum (server-side) only supports MD5, since that is what Azure stores. SHA-256 requires expectedChecksum.
connectionString string
Connection string of the Storage Account.
expectedChecksum string
Expected checksum
User-supplied expected checksum for the downloaded file. Accepts a lowercase or uppercase hex digest, or the equivalent base64 encoding (Azure's native Content-MD5 format). Takes precedence over validateChecksum.
failOnMissingChecksum booleanstring
Fail when the server has no Content-MD5
Only applies when validateChecksum is true. If true, the task fails when the Azure object has no stored Content-MD5. If false (default), validation is skipped with a warning.
sasToken string
The SAS token to use for authenticating requests.
This string should only be the query parameters (with or without a leading '?') and not a full URL.
validateChecksum booleanstring
Validate checksum against server's Content-MD5
If true, compute the MD5 of the downloaded file and compare it to the Content-MD5 stored on the Azure object. Many block blobs uploaded as streams have no Content-MD5; see failOnMissingChecksum to control that case.
Outputs
file
The downloaded file
io.kestra.plugin.azure.storage.adls.models.AdlsFile
com.azure.storage.file.datalake.models.ArchiveStatus
com.azure.storage.file.datalake.models.AccessTier
date-timedate-timeINFINITEFIXEDAVAILABLELEASEDEXPIREDBREAKINGBROKENLOCKEDUNLOCKEDuri
