PLUGINSPLUGIN-DATABRICKSTASKSDBFSIO.KESTRA.PLUGIN.DATABRICKS.DBFS.UPLOAD

Upload

Table of Contents

Contribute

Upload

yaml

type: "io.kestra.plugin.databricks.dbfs.Upload"

Upload a file

The file can be of any size. The task will upload the file in chunks of 1MB.

Examples

Upload a file to the Databricks File System

yaml

id: "upload"
type: "io.kestra.plugin.databricks.dbfs.Upload"
id: uploadFile
type: io.kestra.plugin.databricks.dbfs.Upload
authentication:
  token: <your-token>
host: <your-host>
from: "{{inputs.someFile}}"
to: /Share/myFile.txt

Properties

`from`

Type: string
Dynamic: ✔️
Required: ✔️

The file to upload

Must be a file from Kestra internal storage.

`to`

Type: string
Dynamic: ✔️
Required: ✔️

The destination path

`accountId`

Type: string
Dynamic: ✔️
Required: ❌

Databricks account identifier

`authentication`

Type: AuthenticationConfig
Dynamic: ❌
Required: ❌

Databricks authentication configuration

This property allows to configure the authentication to Databricks, different properties should be set depending on the type of authentication and the cloud provider. All configuration options can also be set using the standard Databricks environment variables. Check the Databricks authentication guide for more information.