pluginsplugin-azuretasksstorage.adls

Delete a list of objects from Azure Data Lake Storage.

yaml
type: "io.kestra.plugin.azure.storage.adls.deletefiles"

Download files from a remote server, upload them to Azure Data Lake Storage, finally delete them all at one

yaml
id: azure_storage_blob_delete_list
namespace: company.team

pluginDefaults:
  - type: io.kestra.plugin.azure.storage.adls
    values:
      connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
      fileSystem: "tasks"
      endpoint: "https://yourblob.blob.core.windows.net"

tasks:
  - id: for_each
    type: io.kestra.plugin.core.flow.EachSequential
    value: ["pikachu", "charmander"]
    tasks:
      - id: download_request
        type: io.kestra.plugin.core.http.Download
        uri: https://pokeapi.co/api/v2/pokemon/{{ taskrun.value }}

      - id: to_ion
        type: io.kestra.plugin.serdes.json.JsonToIon
        from: "{{ currentEachOutput(outputs.download_request).uri }}"

      - id: upload_file
        type: io.kestra.plugin.azure.storage.adls.Upload
        fileName: "adls/pokemon/{{ taskrun.value }}.json"
        from: "{{ currentEachOutput(outputs.to_ion).uri }}"

  - id: delete_file
    type: io.kestra.plugin.azure.storage.adls.DeleteFiles
    concurrent: 2
    directoryPath: "adls/pokemon/"
Properties

Directory Name

The blob service endpoint.

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name.

Minimum >= 2

Number of concurrent parallel deletions.

Connection string of the Storage Account.

Default false

Whether to raise an error if the file is not found.

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

Shared Key access key for authenticating requests.

Shared Key account name for authenticating requests.

Default 0

The count of deleted files.

Default 0

The size of all the deleted files.