Azure SharedAccess

Azure SharedAccess

Certified

Create a Shared Access link for Azure Data Lake Storage

Create a Shared Access link for Azure Data Lake Storage using the Azure SDK.

yaml
type: io.kestra.plugin.azure.storage.adls.SharedAccess

Upload a file to Azure Data Lake Storage, then create a link to access this file which expires in one day from now.

yaml
id: azure_storage_adls_shared_access
namespace: company.team

tasks:
    - id: download_request
      type: io.kestra.plugin.core.http.Download
      uri: https://dummyjson.com/products

    - id: to_ion
      type: io.kestra.plugin.serdes.json.JsonToIon
      from: "{{ outputs.download_request.uri }}"

    - id: upload_file
      type: io.kestra.plugin.azure.storage.adls.Upload
      filePath: "adls/product_data/product.json"
      from: "{{ outputs.to_ion.uri }}"
      connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
      fileSystem: "tasks"
      endpoint: "https://yourblob.blob.core.windows.net"

    - id: shared_access
      type: io.kestra.plugin.azure.storage.adls.SharedAccess
      filePath: "adls/product_data/product.json"
      expirationDate: "{{ now() | dateAdd(1, 'DAYS') }}"
      permissions:
        - READ
      connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
      fileSystem: "tasks"
      endpoint: "https://yourblob.blob.core.windows.net"

    - id: download_file_with_token
      type: io.kestra.plugin.core.http.Download
      uri: "{{ outputs.shared_access.uri }}"
Properties

Service endpoint URL

Base HTTPS endpoint of the target service.

The time after which the SAS will no longer work

File path

Full path of the file in its file system

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name

SubTypestring
Possible Values
READADDCREATEWRITEDELETELISTMOVEEXECUTEMANAGE_OWNERSHIPMANAGE_ACCESS_CONTROL

The permissions to be set for the Shared Access

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Connection string of the Storage Account.

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Shared Key access key for authenticating requests.

Shared Key account name for authenticating requests.

Formaturi

The SAS URI