Download
type: "io.kestra.plugin.databricks.dbfs.Download"
Download a file
The file can be of any size. The task will download the file in chunks of 1MB.
Examples
Download a file from the Databricks File System
id: "download"
type: "io.kestra.plugin.databricks.dbfs.Download"
id: downloadFile
type: io.kestra.plugin.databricks.dbfs.Download
authentication:
token: <your-token>
host: <your-host>
from: /Share/myFile.txt
Properties
from
- Type: string
- Dynamic: ✔️
- Required: ✔️
The file to download
accountId
- Type: string
- Dynamic: ✔️
- Required: ❌
Databricks account identifier
authentication
- Type: AuthenticationConfig
- Dynamic: ❌
- Required: ❌
Databricks authentication configuration
This property allows to configure the authentication to Databricks, different properties should be set depending on the type of authentication and the cloud provider. All configuration options can also be set using the standard Databricks environment variables. Check the Databricks authentication guide for more information.
configFile
- Type: string
- Dynamic: ✔️
- Required: ❌
Databricks configuration file, use this if you don't want to configure each Databricks account properties one by one
host
- Type: string
- Dynamic: ✔️
- Required: ❌
Databricks host
Outputs
uri
- Type: string
The URL of the file downloaded to Kestra's internal storage
Definitions
AuthenticationConfig
authType
- Type: string
- Dynamic: ❌
- Required: ❌
azureClientId
- Type: string
- Dynamic: ✔️
- Required: ❌
azureClientSecret
- Type: string
- Dynamic: ✔️
- Required: ❌
azureTenantId
- Type: string
- Dynamic: ✔️
- Required: ❌
clientId
- Type: string
- Dynamic: ✔️
- Required: ❌
clientSecret
- Type: string
- Dynamic: ✔️
- Required: ❌
googleCredentials
- Type: string
- Dynamic: ✔️
- Required: ❌
googleServiceAccount
- Type: string
- Dynamic: ✔️
- Required: ❌
password
- Type: string
- Dynamic: ✔️
- Required: ❌
token
- Type: string
- Dynamic: ✔️
- Required: ❌
username
- Type: string
- Dynamic: ✔️
- Required: ❌
Metrics
file.size
- Type: counter
The file size