Databricks Download

Databricks Download

Certified

Download a file from DBFS

Streams a DBFS file to a temp file in Kestra internal storage using 1 MB chunks; returns the storage URI.

yaml
type: io.kestra.plugin.databricks.dbfs.Download

Download a file from the Databricks File System.

yaml
id: databricks_dbfs_download
namespace: company.team

tasks:
  - id: download_file
    type: io.kestra.plugin.databricks.dbfs.Download
    authentication:
      token: "{{ secret('DATABRICKS_TOKEN') }}"
    host: <your-host>
    from: /Share/myFile.txt
Properties

Source DBFS path

Absolute path to the DBFS file to download

Databricks account identifier

Databricks authentication configuration

This property allows to configure the authentication to Databricks, different properties should be set depending on the type of authentication and the cloud provider. All configuration options can also be set using the standard Databricks environment variables. Check the Databricks authentication guide for more information.

Definitions
authTypestring

Authentication type

azureClientIdstring

Azure client ID

azureClientSecretstring

Azure client secret

azureTenantIdstring

Azure tenant ID

clientIdstring

Client ID

clientSecretstring

Client secret

googleCredentialsstring

Google credentials JSON

googleServiceAccountstring

Google service account email

passwordstring

Password

tokenstring

Databricks personal access token

usernamestring

Username

Databricks configuration file, use this if you don't want to configure each Databricks account properties one by one

Databricks host

Reference (ref) of the pluginDefaults to apply to this task.

Formaturi

Downloaded file URI

Internal storage URI for the downloaded file

The file size

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

PostgreSQL
PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

6 tasks

25 blueprints