Download Download

yaml
type: "io.kestra.plugin.databricks.dbfs.Download"

Download a file

The file can be of any size. The task will download the file in chunks of 1MB.

Examples

Download a file from the Databricks File System

yaml
id: "download"
type: "io.kestra.plugin.databricks.dbfs.Download"
id: downloadFile
type: io.kestra.plugin.databricks.dbfs.Download
authentication:
  token: <your-token>
host: <your-host>
from: /Share/myFile.txt

Properties

from

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The file to download

accountId

  • Type: string
  • Dynamic: ✔️
  • Required:

Databricks account identifier

authentication

Databricks authentication configuration

This property allows to configure the authentication to Databricks, different properties should be set depending on the type of authentication and the cloud provider. All configuration options can also be set using the standard Databricks environment variables. Check the Databricks authentication guide for more information.

configFile

  • Type: string
  • Dynamic: ✔️
  • Required:

Databricks configuration file, use this if you don't want to configure each Databricks account properties one by one

host

  • Type: string
  • Dynamic: ✔️
  • Required:

Databricks host

Outputs

uri

  • Type: string

The URL of the file downloaded to Kestra's internal storage

Definitions

AuthenticationConfig

authType

  • Type: string
  • Dynamic:
  • Required:

azureClientId

  • Type: string
  • Dynamic: ✔️
  • Required:

azureClientSecret

  • Type: string
  • Dynamic: ✔️
  • Required:

azureTenantId

  • Type: string
  • Dynamic: ✔️
  • Required:

clientId

  • Type: string
  • Dynamic: ✔️
  • Required:

clientSecret

  • Type: string
  • Dynamic: ✔️
  • Required:

googleCredentials

  • Type: string
  • Dynamic: ✔️
  • Required:

googleServiceAccount

  • Type: string
  • Dynamic: ✔️
  • Required:

password

  • Type: string
  • Dynamic: ✔️
  • Required:

token

  • Type: string
  • Dynamic: ✔️
  • Required:

username

  • Type: string
  • Dynamic: ✔️
  • Required:

Metrics

file.size

  • Type: counter

The file size